fromkafka

Documentation

Index

• Variables
• func NewFrom(parent charm.Command, fs *flag.FlagSet) (charm.Command, error)
• type From
  • func (f *From) Run(args []string) error

Variables

var FromSpec = &charm.Spec{
	Name:  "from-kafka",
	Usage: "from-kafka [options] [config.yaml ...]",
	Short: "sync Kafka topics to Zed lake pools",
	Long: `
The "from-kafka" command syncs data from Kafka topics to Zed lake pools.
Topics and their target pools are read from the inputs section of the
config.yaml files.  (One topic/pool pair may also be specified via -topic
and -pool.)  The Kafka records are transcoded into Zed and synced to the
main branch of the target pools.

The key for each pool must be "kafka.offset" in ascending order.

See https://github.com/brimdata/zync/README.md for a description
of how this works.
`,
	New: NewFrom,
}

Functions

func NewFrom

func NewFrom(parent charm.Command, fs *flag.FlagSet) (charm.Command, error)

Types

type From

type From struct {
	*root.Command
	// contains filtered or unexported fields
}

func (*From) Run

func (f *From) Run(args []string) error