Back to godoc.org
github.com/grailbio/bigslice

module github.com/grailbio/bigslice

v0.0.0 (8e22b3d)
Latest Go to latest
Published: May 28, 2020 | License: Apache-2.0

Source Code

README

Bigslice

Bigslice is a serverless cluster data processing system for Go. Bigslice exposes composable API that lets the user express data processing tasks in terms of a series of data transformations that invoke user code. The Bigslice runtime then transparently parallelizes and distributes the work, using the Bigmachine library to create an ad hoc cluster on a cloud provider.

Developing Bigslice

Bigslice uses Go modules to capture its dependencies; no tooling other than the base Go install is required.

$ git clone https://github.com/grailbio/bigslice
$ cd bigslice
$ GO111MODULE=on go test
Source: github.com/grailbio/bigslice@v0.0.0-20200528011339-8e22b3d8113e/README.md