sky-high

README

Sky High

Overview

The following Go program have been made in the purpose of consumming a Redis queue of coordinates, to download their related satellite image from the Google Static Map API and store them in a defined S3 Bucket.

Getting Started

Run with Docker

Requirements

To run this script you'll need the following:

• docker
• docker compose
• a Redis queue already running filled with locations
• an access key id and secret for a S3 Bucket
• an API key for the Google static Map API.

Then check up the S3 Bucket all the images should have been pushed to to the defined folder.

How can I access the S3 bucket data ?

To access the data of the S3 bucket you will need the appropriate access key id and access key secret, those should have been kept by the creator of the S3 bucket (and that's likely to be me => @guilhem-sante).

You should then access the S3 bucket content through a CLI (like aws), or from a dedicated GUI like expandrive (I personnaly recommand the usage of a GUI).

Configuration

You can configure the script with the following environment variables:

NAME	DESCRIPTION	REQUIRED	DEFAULT VALUE
nb_worker	The number of goroutine that will run simultanely	no	1
log_level	The minimum log level	no	"INFO"
google_api.key	The required API key for any requests to the Google Static Map API	yes
google_api.picture.zoom	The zoom scope (from 1 to 20) of the satellite picture	no	18
google_api.picture.width	The image width in pixel	no	400
google_api.picture.height	The image height in pixel	no	400
google_api.picture.map_type	The map type to download image from	no	"satellite"
google_api.picture.format	The image type format to download	no	"jpg"
redis.addr	The address of the Redis server	no	"localhost:6379"
redis.password	The password for the redis server if any	no
redis.db	The database to get elements from	no	0
redis.queue_name	The queue name to get elements from	no	"locations"
s3.endpoint	The endpoint of the S3 bucket	no	"s3.amazonaws.com"
s3.region	The region of the S3 bucket if any	no
s3.bucket_name	The S3 bucket name	yes
s3.image_folder	The folder in which satellite images should be pushed	no	satellite-images
s3.access_key_id	The access key id to access the S3 Bucket	yes
s3.access_key_secret	The access key secret to access the S3 Bucket	yes