fli

module
v0.0.0-...-c5655c4 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jan 4, 2017 License: Apache-2.0

README

FLI

Fli, the CLI to FlockerHub, is like Git for data. Just like you can use Git to copy, branch, push and pull code, you can use Fli to copy, branch, push and pull your data volumes.

Fli lets you take incremental snapshots of any database or data volume that runs on Linux, and push those snapshots to a hosted volume repository called FlockerHub where they can be accessed by any person or machine to whom you’ve granted access.
Fli can also be used without FlockerHub to manage data volumes locally.

Fli logo

Fli uses ZFS for taking and managing snapshots. Because the snapshots are incremental, each additional push or pull to the FlockerHub sends only part of the data, speeding up transfer times and reducing bandwidth consumption.

Additionally, just like you can use Git to organize your code into repos and branches, Fli gives you the ability to organize your data into volumesets and branches. You can use Fli to manage these snapshots locally without using FlockerHub at all, or push them to FlockerHub to share with others.

Installation

It's easy to get started using Fli because Fli is distributed on the DockerHub as a container image called clusterhq/fli so you just need to run docker pull clusterhq/fli. You can also download the Go binary directly by running curl -L "https://download.clusterhq.com/releases/fli/<version>" > /usr/local/bin/fli chmod +x /usr/local/bin/fli<

Using Fli requires a few dependencies so make sure you have these on your system before getting started.

View the complete documentation for Fli or read on for some more background on the project.

Build Fli from source

Fli can also be built from source. Instructions to build from source can be found here.

Why use Fli?

With increased popularity of microservices and container-based architectures, greater and greater emphasis is being placed on automated testing to ensure that separately created and updated microservices all work together when deployed to production. Manual QA is no longer sufficient, there are simply too many variables to test. As a result, a new set of requirements are emerging to address data management needs across the entire DevOps lifecycle. Even before getting to production, container data management (CDM) needs to span a number of use cases including:

  • Making realistic test data available to the entire development team to help improve developer productivity
  • Providing realistic production data to staging and QA environments for accurate pre-prod testing
  • Integrating test data into Continuous Integration / Delivery (CI/CD) environments to accelerate application development

Solving these problems is why we created Fli.

Fli, a Git-like CLI, lets Developers and Ops capture the state of a data volume running on a Linux server (usually this means a database, but Fli also works for snapshotting files, plugins, binaries and other test fixtures), and move it to a cloud based repository similar to GitHub where it can then be shared and then pulled by any other authorized user or machine.

At the present, Fli works best for testing, but these generic capabilities to snapshot and move data will one day enable:

  • Disaster Recovery (DR) and backup resiliency for production stateful services to ensure required uptime availability
  • Enabling movement of workloads across a multi-cloud environment for cost, performance and security reasons

Demo

Using Fli to push and pull volumes to FlockerHub

Get involved

  • Submit a issue or PR on GitHub. We'd love your help.
  • Join our Slack community at http://slack.clusterhq.com/
  • You can also join us on the #clusterhq channel on the irc.freenode.net
  • Ask a question on the flockerhub-fli-users Google group
  • Send us an email at support@clusterhq.com
  • Tweet us at @ClusterHQ

Directories

Path Synopsis
client
fli
dl
filediffer/attrcmp
Package attrcmp provides a file attr diff method.
Package attrcmp provides a file attr diff method.
filediffer/variableblk
Package variableblk provides a file diff method based on the following algorithm: Scan the files and compare byte by byte.
Package variableblk provides a file diff method based on the following algorithm: Scan the files and compare byte by byte.
fs
record
Package record defines interfaces for syscall records, executor and encoder/decoder.
Package record defines interfaces for syscall records, executor and encoder/decoder.
zfs
dp
sync
Package sync provides utilities necessary to synchronize metadata across dataplanes.
Package sync provides utilities necessary to synchronize metadata across dataplanes.
mdsimpls
restfulstorage
Package restfulstorage is a package for remote access to metadata via a RESTful HTTP interface.
Package restfulstorage is a package for remote access to metadata via a RESTful HTTP interface.
meta
miscutils
Package rest provides the building blocks for implementing the V1 HTTP REST API handlers
Package rest provides the building blocks for implementing the V1 HTTP REST API handlers
Package securefilepath offers operations on filesystem paths and files in a way which offers additional security properties beyond simple string manipulation.
Package securefilepath offers operations on filesystem paths and files in a way which offers additional security properties beyond simple string manipulation.
vh

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL