README
¶
NOTE -->
After a long hiatus of this project having been forked and developed internally @brucearctor wants to revive/rewrite in the open.
Astounding
How to use
See docs/using.md for instructions on how to use.
What this is
This is the start of a project to create the cloud infrastructure around protocol buffers.
Specifically, Terraform is generated via .proto files and extending protoc.
The first iteration will focus on GCP and specifically data pipelines within.
The services initially targeted will be:
For BigQuery, we will also rely on protoc-gen-bq-schema.
After initial bits of the easier stuff, extensions will folllow to support loadbalancers and perhaps everything to support the entire end-to-end pipelines.
More difficult, but ideally longer-term, we'll get to a place where we can annotate the proto with the sort of desired grouping/stateful transformations, and some additional cool things that can be done with real-time data.
This project extends protoc via options.
To avoid any future conflicts, we have a reserved an id (# 1090) for the protobuf extension. We'll use a map to keep things flexible for the many desired options, rather than allocating more and more individual extenion id options.
Note on terraform versions generated:
For now, we will generate Terraform v0.13. TBD intent on whether/when to update what gets generated [seems more ideal] and/or if will facilitate multiple versions based on additional options.
Note on project naming:
The name is a reference to Astounding Stories. Specifically, Collision Orbit, written by Jack Williamson -- Collision Orbit didn't seem a great name given the negative connotations with collisions :-) That work is relevant since it is the first claimed use of Terraforming (which is what much of this code creates!).
Documentation
¶
There is no documentation for this package.
Source Files
Directories