cdn-origin

README

Whats-This CDN Origin

Simple but quick Golang webserver that serves requests to get files and redirects from a PostgreSQL and SeaweedFS backend.

Requirements

• PostgreSQL server with objects table
• SeaweedFS cluster with files in the objects table

Usage

$ go get -u github.com/whats-this/cdn-origin

# With configuration file
$ cp $GOPATH/src/github.com/whats-this/cdn-origin/cdn-origin.sample.toml /etc/cdn-origin/cdn-origin.toml
$ vim /etc/cdn-origin/cdn-origin.toml
$ cdn-origin

# With environment variables
$ set DATABASE_CONNECTION_URL="postgres://postgres@localhost/data?sslmode=disable"
$ set SEAWEED_MASTER_URL="http://localhost:9333"
$ ...
$ cdn-origin

# With flags
$ cdn-origin \
    --database-connection-url="postgres://postgres@localhost/data?sslmode=disable" \
    --seaweed-master-url="http://localhost:9333" \
    ...

# Flags take precedence over environment variables, which take precedence over config files

Information about configuration variables and their purpose can be found in cdn-origin.sample.toml. Configuration is handled by Viper.

Metrics

If cdnUtil.serveMetrics is enabled, /.cdn-util/prometheus/metrics?authKey={{cdnUtil.authKey}} will return Prometheus-compatible information about requests (and Go runtime information).

Here is a sample scrape configuration for accessing data from cdn-origin:

scrape_configs:
  - job_name: 'cdn_origin'
    scrape_interval: 5s
    metrics_path: '/.cdn-util/prometheus/metrics'
    params:
        authKey: ['secret']
    static_configs:
      - targets: ['localhost:8080']

Sample Grafana dashboards can be found in dashboards.json.

Custom metrics:

• HTTPRequestsTotal: cdn_origin_http_requests_total{host="request Host header"}

TODO

• Process chunked files stored in SeaweedFS, similar to how SeaweedFS cli handles it
• Add TTL to volume cache
• Write tests
• Add thumbnail functionality (SeaweedFS supports this)

License

cdn-origin is licensed under the MIT license. A copy of the MIT license can be found in LICENSE.