cmd/

sk-cat takes one or more links to (compressed) files and will stream their content to stdout.

todo: adjust code

CLI to convert various metadata formats, mostly to fatcat entities.

sk-crossref-snapshot creates a snapshot from a set of crossref records, as harvested.

sk-feed retrieves various upstream data sources.

TODO: string normalization cli tool

sk-oai-dctojsonl converts a stream of XML records, where each record is separated by a record separator "1E".

sk-oai-records was used as a first step to go from concatenated metha OAI XML file (invalid, hard to parse) to properly separated XML documents (using ASCII record separator).

sk-snapshot turns feeds into snapshots, for simplicity often with external tools.