bcommon

package module
v0.10.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Oct 6, 2026 License: Apache-2.0 Imports: 0 Imported by: 0

README

bcommon

CI CodeQL Release Go Reference License

bcommon is a Go library of building blocks for BSV overlay applications that publish and verify committed records: the codec a record is written in, the roots and store references it commits to, the derivation and PushDrop outputs that lock it, the carrier and mined transactions that put it on chain, the BEEF a host admits them in, the clients a producer and a reader talk to, and the SPV check a reader runs. An application supplies its own schema, derivation, tags and wallet profile as parameters; nothing here names one.

Status: pre-1.0. Every application pins an exact tag, and the API may change between v0 minor versions. One tag versions both languages. See docs/versioning.md.

Packages

Package What it provides
cbor Deterministic CBOR, an RFC 8949 subset; the decoder refuses anything non-canonical
record The bounded, ordered reading of an application record: a canonical CBOR map with integer keys, a magic and preserved unknown keys, refused for the first rule it breaks
commit RFC 6962 Merkle roots, inclusion paths and their verification, over 32-byte commitments or leaves of any length: a streaming root, the root of content cut into fixed segments, per-block subtree roots, and the compact path whose sides follow from the index and the leaf count
chirp CHIRP (BRC-167) version 1 and its profile 1: root and branch node codecs, the canonical construction from content (in memory or streamed), closure verification object by object, and the UHRP object identifier and CHIRP URL of a hash
store Store reference entries, manifests, and the rule that computes a store's root from its entry and its members' commitments
pushdrop BRC-42/43 derivation under counterparty Anyone, tagged PushDrop locks, unlockers and decoding, and a lock read leniently and rebuilt canonically from raw script bytes
carrier An unmineable carrier transaction that commits a payload, and the funding lock, decode and sweep it spends from
chaintoken The BEEF a host admits a mined chain token, an unmined carrier and a mined sweep in, read exactly as declared on the wire and held to exactly what the object needs, and a token output held to its key
keyed The content key of BRC-369 keyed content, its symmetric key and commitment, the check on an unwrapped key, BRC-2's symmetric form, one BRC-369 segment, and a content key's wrap under a group epoch with the application's domain string
mint Builders for a state transition, a funding tree of at most 1023 funding outputs and a payment, with a fee loop that signs to measure the size and rebuilds at the rate until the fee covers it
funding Funding-tree state kept between runs, and the BEEF kept for transactions spent before they mine
guard A structural walk of a BRC-74 BUMP, a BEEF or a raw transaction before the SDK allocates for it, and a public key taken only in its canonical encoding
nodeapi A Teranode JSON-RPC and asset API client with bounded responses and a txid-in-proof check
bwallet An embedded BRC-100 wallet backend and coin pool, a Signer, and BRC-29 derivations, keyed by an application profile
wirewallet A BRC-100 wallet over the wallet wire, loopback only, and a handler that serves one
publish The settlement leg (EF to an ingress, hex to a node RPC, arcade) and the BEEF object leg to an overlay host, which never share a socket, plus a transition journal
producer A producer's orchestration: fee inputs and change from a coin pool, settlement, the funding-tree lifecycle, the one kept copy of each unproven transaction, and proof collection that republishes what has mined
chainview Whether a transaction can still mine: a settlement leg's error read as a definitive refusal or as transient, and the input another transaction spent
purse The client and payee legs of a BRC-105 payment for a priced question, over the embedded wallet: pay one output on a 402, and take a BRC-29 payment into the pool
payee The payee's side of those payments: the payee key, a host's versioned ledger of accepted payments read and written byte for byte, the host's replay and conflict rule, and an idempotent settle run into the pool with its counts
acceptance The value discriminator for an incoming payment: fast on SPV, the receiver's own broadcast and the network's verdict at or below a threshold, held for a proof above it, bounded per payer and in total, and a monitor that flags a payer whose fast payment is lost
headers A chain tracker over WhatsOnChain, chaintracks or an overlay-bridge, checking proof of work
hostset Host sources and quorum fan-out across the addresses behind one overlay host
lookup A BRC-24 lookup client for output-list answers
resolve BRC-169 handle resolution and BRC-180 overlay discovery, under a strict HTTPS client policy
knownkeys The grammar and store of a pinned-key file: pin, rotate, retire, forget
verify The refusal vocabulary, SPV verdicts on one transaction, and the carrier check a reader runs
termsafe Text someone else wrote, filtered before it reaches a terminal, and the same rules checked before a producer publishes text
sanitize The renderer filter: four ordered character rules over a pinned Unicode 15.1 emoji table, which a terminal and a web renderer apply alike before they show text someone else wrote
goldentest Test helpers: a fixed key, hex and transaction parsing that fail the test, and a stub chain tracker
testchain A local stand-in chain for tests: it mines what it is sent and serves a node's RPC and asset API, a broadcaster, an ingress and a header source

The TypeScript package under ts/, @lightwebinc/bcommon, holds the twins an overlay topic manager or lookup service needs, tested against the same vectors as the Go packages. It has two entry points:

Entry point What it provides
@lightwebinc/bcommon Deterministic CBOR, the record reader, store refs entries, the reader's BRC-42 derivation, PushDrop reading and field signatures, the funding decode, the carrier check, the BEEF a mined token is admitted in, byte-leaf RFC 6962 roots and compact paths, the CHIRP codec and closure check, the renderer filter, and the overlay engine interfaces a module satisfies. It imports nothing but its peer @bsv/sdk and nothing from node:, so a browser can load it as well as a host
@lightwebinc/bcommon/testing Test helpers for Node: a counting host, restore rows and storage, BEEF built as the engine builds it, a minter over a test key, and a simulator that calls a lookup service in the engine's order

Install

Go, pinned to an exact tag, the latest in docs/versioning.md:

go get github.com/lightwebinc/bcommon@v0.4.0

TypeScript: the package is packed from the same tag and vendored, so the application's lockfile pins its bytes, and the application supplies the @bsv/sdk peer at the exact version the package names:

git clone --depth 1 --branch v0.4.0 https://github.com/lightwebinc/bcommon
cd bcommon/ts && npm ci && npm pack    # writes lightwebinc-bcommon-0.4.0.tgz
# in the application, with the tarball copied to vendor/
npm install ./vendor/lightwebinc-bcommon-0.4.0.tgz @bsv/sdk@2.7.1

Usage

A record body in canonical CBOR, its RFC 6962 commitment, and the key a reader expects the record's output to be locked to, from the producer's identity key alone:

import (
	"crypto/sha256"

	"github.com/bsv-blockchain/go-sdk/wallet"

	"github.com/lightwebinc/bcommon/cbor"
	"github.com/lightwebinc/bcommon/commit"
	"github.com/lightwebinc/bcommon/pushdrop"
)

// A placeholder: an application registers its own in docs/registry.md.
var record = pushdrop.Derivation{
	Protocol: wallet.Protocol{SecurityLevel: wallet.SecurityLevelEveryApp, Protocol: "example app"},
	KeyID:    "record",
}

body, err := cbor.Encode(cbor.Map{{Key: "name", Val: "example"}})
root := commit.Root([][32]byte{sha256.Sum256(body)})
key, err := record.ExpectedLockingKey(identity) // identity is an *ec.PublicKey

The same derivation on the TypeScript side, in a topic manager:

import { readerLockingKey } from '@lightwebinc/bcommon'

const key = readerLockingKey([1, 'example app'], 'record', identityHex)

docs/examples.md walks through deriving and decoding a PushDrop lock, building a funding tree and a carrier on an in-process test chain, verifying a carrier from a BEEF, guarding a proof, RFC 6962 proofs, stores and CBOR, reading an application record, admitting a mined token from its BEEF, committing to a key and wrapping it, paying fees and minting the next funding tree as a producer, and filtering text for a terminal. Every Go example there is an Example test that go test compiles and checks.

Documentation

  • Architecture: the package layers and import graph, what each package owns, the parse-and-guard rule, application-supplied constants, and the Go and TypeScript twins
  • Configuration: every caller-supplied parameter and option struct, the defaults, and the values frozen once used on chain
  • Examples: offline how-to, backed by compiled example tests
  • Registry: the derivation protocols, tags, record magic, topics and baskets that applications built on bcommon have chosen, so that no two collide
  • Vectors: the tests compare the library's output byte for byte with vectors from an independent generator
  • Dependencies: the one direct dependency and why its version is exact
  • Versioning: exact tags, one tag for both languages, and what a v0 minor may change

Requirements

Go 1.26.2 or later, and github.com/bsv-blockchain/go-sdk pinned at exactly v1.5.2, the library's only direct dependency. See docs/dependencies.md. The TypeScript package needs Node 24 and @bsv/sdk 2.7.1 exactly, as a peer; make ts-test builds and tests it, and nothing in the Go build needs Node.

Build and test

make verify     # formatting, vet, the dependency rule, licences, vectors, build, tests
make ts-test    # the TypeScript package: type-check, build, tests (Node 24)

Every Go target runs with GOWORK=off, so what is checked is what a tag ships.

Licence

Apache-2.0 (LICENSE). Third-party notices are in NOTICE and LICENSE-THIRD-PARTY.

Documentation

Overview

Package bcommon is the root of a library of building blocks for BSV overlay applications that publish and verify committed records: a deterministic CBOR codec, RFC 6962 roots, store references and manifests, BRC-42/43 derivation and tagged PushDrop outputs, a non-final carrier that commits a payload to the chain, transaction builders with a fee loop, funding-tree state, node, arcade and wallet clients, the producer's orchestration of fees, funding trees and proofs around them, a header source, host sets with quorum fan-out, BRC-24 lookup, BRC-169 and BRC-180 resolution, a pinned-key file, SPV verdicts, a payee's ledger and settle run, and a filter for text that reaches a terminal. Each subdirectory that holds Go code is one package; this root package holds no code of its own.

An application supplies what makes these packages its own: the payload schema, the derivation protocol and key ids, the output tags, the wallet profile, the RPC id and the pin file's header all arrive as parameters rather than defaults. A default derivation or wallet profile would quietly re-key an application that forgot to pass one.

testdata is not a package. Its fixtures directory holds response bodies vendored from the services the network packages talk to, and its vectors directory the vectors an independent generator (tools/vectors) writes, which the packages' tests compare their own output against byte for byte. Both are kept at the root so every package reads them by the same relative path.

Imports

Every package here, in production code and in tests, imports only the standard library, github.com/bsv-blockchain/go-sdk and other packages of this module. One outside dependency is what an application pinning this library takes on, so a second one would be a cost to every application at once. TestBoundary and TestBoundaryFiles enforce the rule. The vector generator in tools/vectors is a separate module that nothing here imports, held to a rule of its own: it may add an independent CBOR encoder, and it may never import this module.

Nor does any package take on what belongs to an application's command: flags, logging, the environment, the user's configuration directories, the standard streams, other processes or the process's exit. Settings and output arrive as parameters. TestNoProcessConcerns enforces it.

Versioning

The library is pre-1.0. An application pins an exact tag and moves to a newer one deliberately, because a v0 minor version may change the API.

Directories

Path Synopsis
Package acceptance decides how much evidence a payment needs before the receiver acts on it, and gathers that evidence.
Package acceptance decides how much evidence a payment needs before the receiver acts on it, and gathers that evidence.
Package bwallet is an embedded BRC-100 wallet backend for an application that publishes on chain, and the Signer through which such an application signs with it or with any other wallet.Interface.
Package bwallet is an embedded BRC-100 wallet backend for an application that publishes on chain, and the Signer through which such an application signs with it or with any other wallet.Interface.
Package carrier is an object's transport: one transaction that is never mined, whose record output holds the object's payload as a signed PushDrop [payload] under the producer's derivation, and whose txid is the commitment a mined token can carry.
Package carrier is an object's transport: one transaction that is never mined, whose record output holds the object's payload as a signed PushDrop [payload] under the producer's derivation, and whose txid is the commitment a mined token can carry.
Package cbor is the deterministic CBOR that committed records are written in.
Package cbor is the deterministic CBOR that committed records are written in.
Package chaintoken reads and writes the BEEF a host admits a mined chain token in, and the token's own output.
Package chaintoken reads and writes the BEEF a host admits a mined chain token in, and the token's own output.
Package chainview answers, from the network's own words and the node's view of outputs, whether a transaction can still mine: what a settlement leg's error means, and which input another transaction spent, in words over bcommon's view of the node (nodeapi.Asset.SpentElsewhere).
Package chainview answers, from the network's own words and the node's view of outputs, whether a transaction can still mine: what a settlement leg's error means, and which input another transaction spent, in words over bcommon's view of the node (nodeapi.Asset.SpentElsewhere).
Package chirp is a codec for CHIRP (BRC-167) major version 1 and its chunking profile 1: the root and branch node encodings, the canonical construction of a closure from content, the verification of a closure fetched object by object, and the UHRP object identifier and CHIRP URL of a hash.
Package chirp is a codec for CHIRP (BRC-167) major version 1 and its chunking profile 1: the root and branch node encodings, the canonical construction of a closure from content, the verification of a closure fetched object by object, and the UHRP object identifier and CHIRP URL of a hash.
Package commit computes RFC 6962 Merkle roots and inclusion paths: the root a store reference commits to, one per named store, over the commitments (carrier txids) of that store's members.
Package commit computes RFC 6962 Merkle roots and inclusion paths: the root a store reference commits to, one per named store, over the commitments (carrier txids) of that store's members.
Package funding keeps a producer's funding tree between runs, and the transactions it published before they mined.
Package funding keeps a producer's funding tree between runs, and the transactions it published before they mined.
Package goldentest holds the helpers a package's tests share when they check themselves against a committed test vector: a fixed test key, hex and transaction parsing that fail the test rather than return an error, and a chain tracker that knows only the roots the test hands it.
Package goldentest holds the helpers a package's tests share when they check themselves against a committed test vector: a fixed test key, hex and transaction parsing that fail the test rather than return an error, and a chain tracker that knows only the roots the test hands it.
Package guard checks bytes someone else supplied before the SDK is allowed to allocate for them or to trust them: a BRC-74 BUMP, a BEEF (BRC-62, BRC-96, and the Atomic BEEF of BRC-95 around either), a raw transaction or the Extended Format (BRC-30) of one, and a compressed public key.
Package guard checks bytes someone else supplied before the SDK is allowed to allocate for them or to trust them: a BRC-74 BUMP, a BEEF (BRC-62, BRC-96, and the Atomic BEEF of BRC-95 around either), a raw transaction or the Extended Format (BRC-30) of one, and a compressed public key.
Package headers is a chain tracker over a header source: an overlay bridge's native /v1 routes (github.com/lightwebinc/overlay-bridge), the public WhatsOnChain API, or a chaintracks v2 service.
Package headers is a chain tracker over a header source: an overlay bridge's native /v1 routes (github.com/lightwebinc/overlay-bridge), the public WhatsOnChain API, or a chaintracks v2 service.
Package hostset chooses which address answers for an overlay host.
Package hostset chooses which address answers for an overlay host.
Package keyed holds the part of BRC-369 keyed content that every application keyed under a random scalar shares: the content key, its symmetric key and its commitment (BRC-369 sections 2.1 and 2.2), the check a holder runs on a key it has just unwrapped, and BRC-2's symmetric form, in which a key is wrapped and a certificate field is encrypted.
Package keyed holds the part of BRC-369 keyed content that every application keyed under a random scalar shares: the content key, its symmetric key and its commitment (BRC-369 sections 2.1 and 2.2), the check a holder runs on a key it has just unwrapped, and BRC-2's symmetric form, in which a key is wrapped and a certificate field is encrypted.
Package knownkeys reads and writes a pin store: the key each address was last seen with, one line per record.
Package knownkeys reads and writes a pin store: the key each address was last seen with, one line per record.
Package lookup asks an overlay host a BRC-24 question and returns its output-list answer.
Package lookup asks an overlay host a BRC-24 question and returns its output-list answer.
Package mint builds the mined transactions an application's state lives on: a transition of its state token, a funding tree, and a plain payment, each with a fee input and a change output supplied by the caller.
Package mint builds the mined transactions an application's state lives on: a transition of its state token, a funding tree, and a plain payment, each with a fee input and a change output supplied by the caller.
Package nodeapi talks to a Teranode node over HTTP: JSON-RPC for mining and direct submission, the asset API for reading what got mined.
Package nodeapi talks to a Teranode node over HTTP: JSON-RPC for mining and direct submission, the asset API for reading what got mined.
Package payee is the payee side of BRC-105 payments for priced questions: the payee key a host is configured with, the ledger in which a host's listener records each payment it accepted, and settle, which takes those payments into the payee's coin pool.
Package payee is the payee side of BRC-105 payments for priced questions: the payee key a host is configured with, the ledger in which a host's listener records each payment it accepted, and settle, which takes those payments into the payee's coin pool.
Package producer is the orchestration a producer of committed records runs around the builders in mint and carrier: where the fee for a mined transaction comes from and where its change goes, the funding tree a carrier spends and when to mint the next one, the one copy of each transaction the producer keeps while it is unproven, and the collection of proofs for what was published before it mined.
Package producer is the orchestration a producer of committed records runs around the builders in mint and carrier: where the fee for a mined transaction comes from and where its change goes, the funding tree a carrier spends and when to mint the next one, the one copy of each transaction the producer keeps while it is unproven, and the collection of proofs for what was published before it mined.
Package publish is the publisher's dual submission: one signed transaction, two encodings, two transports, and never one writer for both.
Package publish is the publisher's dual submission: one signed transaction, two encodings, two transports, and never one writer for both.
Package purse is the two payment actions the embedded wallet does not implement, over the embedded wallet (the identity key and its coin pool): the client leg and the payee leg of a BRC-105 payment for a priced question.
Package purse is the two payment actions the embedded wallet does not implement, over the embedded wallet (the identity key and its coin pool): the client leg and the payee leg of a BRC-105 payment for a priced question.
Package pushdrop is the key derivation an application locks its PushDrop outputs under, and the tagged PushDrop those outputs carry: a leading tag field, the application's own fields, and the wallet's signature over them.
Package pushdrop is the key derivation an application locks its PushDrop outputs under, and the tagged PushDrop those outputs carry: a leading tag field, the application's own fields, and the wallet's signature over them.
Package record is the bounded, ordered reading of one application record: a canonical CBOR map with unsigned-integer keys, whose key 0 is the record's magic and whose keys above the last one a version defines are preserved and ignored.
Package record is the bounded, ordered reading of one application record: a canonical CBOR map with unsigned-integer keys, whose key 0 is the record's magic and whose keys above the last one a version defines are preserved and ignored.
Package resolve turns a user@domain into an identity key and the overlay host that serves it, using only the two documents a domain publishes about itself: its BRC-180 manifest and its BRC-169 handle-resolution endpoint.
Package resolve turns a user@domain into an identity key and the overlay host that serves it, using only the two documents a domain publishes about itself: its BRC-180 manifest and its BRC-169 handle-resolution endpoint.
Package sanitize filters text someone else wrote before a renderer shows it, in a terminal or on a web page, by one ordered set of character rules and one pinned Unicode property table, so that every implementation shows the same characters for the same value.
Package sanitize filters text someone else wrote before a renderer shows it, in a terminal or on a web page, by one ordered set of character rules and one pinned Unicode property table, so that every implementation shows the same characters for the same value.
Package store is how a record commits to a set of other records and how a reader opens that set: the refs entry that names a store and commits to its root, the manifest that lists a store's members, and the rule that computes the root from the entry and the members' commitments.
Package store is how a record commits to a set of other records and how a reader opens that set: the refs entry that names a store and commits to its root, the manifest that lists a store's members, and the rule that computes the root from the entry and the members' commitments.
Package termsafe filters text someone else wrote before it reaches a terminal, and checks text an application is about to publish against the same rules.
Package termsafe filters text someone else wrote before it reaches a terminal, and checks text an application is about to publish against the same rules.
Package testchain is a local stand-in for the chain an application's tests and local trials run against: a chain that mines what it is sent, served as a node's JSON-RPC (generatetoaddress, sendrawtransaction, getinfo) and asset API, as an ARC-compatible broadcaster under /arcade, as a fabric ingress (Ingress), and as a header source in the overlay bridge's native shape (/v1/root/<height>, /v1/tip).
Package testchain is a local stand-in for the chain an application's tests and local trials run against: a chain that mines what it is sent, served as a node's JSON-RPC (generatetoaddress, sendrawtransaction, getinfo) and asset API, as an ARC-compatible broadcaster under /arcade, as a fabric ingress (Ingress), and as a header source in the overlay bridge's native shape (/v1/root/<height>, /v1/tip).
Package verify is what a reader shares with every other reader: the outcome vocabulary it reports (codes.go), the verdict on one transaction against the reader's own headers (Check), and the check every carrier a host answers gets before a reader believes it (VerifyCarrier).
Package verify is what a reader shares with every other reader: the outcome vocabulary it reports (codes.go), the verdict on one transaction against the reader's own headers (Check), and the check every carrier a host answers gets before a reader believes it (VerifyCarrier).
Package wirewallet reaches a BRC-100 wallet over the wallet wire, the binary substrate both SDKs implement, and answers the one question an application asks a wallet before anything else: whose identity is this.
Package wirewallet reaches a BRC-100 wallet over the wallet wire, the binary substrate both SDKs implement, and answers the one question an application asks a wallet before anything else: whose identity is this.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL