infon

module
v0.0.0-...-b362443 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jun 11, 2026 License: MIT

README ΒΆ

TVCP β€” Terminal Video Communication Platform

πŸŽ₯ Video calls inside your terminal. 9Γ— less bandwidth than Zoom. No GUI required.

Go Report Card

TVCP is the first video communication platform designed to work entirely inside a text terminal, using Unicode block elements and ANSI colors to render video at ultra-low bandwidth.

πŸ€– AI integration (tvcp-ai/1)

This repo also includes an AI layer: an open tvcp-ai/1 format (JSON over HTTP) that lets any neural network be a partner for the terminal β€” drawing (draw-DSL + a simple sketch format), playing games (tic-tac-toe, Wordle, UNO), reacting with glyph cards, and acting as a video source. Swap brains by changing a URL β€” a reference brain (no model), local Ollama, or any OpenAI/Anthropic endpoint (demonstrated live with Claude Haiku). Even a plain text model (no diffusion, no image head) can paint via pseudo-images β€” a tiny JSON color grid, glyph art, sigils, or vector shapes expanded into terminal frames.

See ai/IMPLEMENTED.md for everything that was built, ai/BRAIN_PROTOCOL.md for the spec, and ai/showcase.html for a visual gallery. New code lives in pkg/scene, pkg/sketch, pkg/brain, internal/aisource, and the cmd/ai* commands; tvcp ai streams an AI video source.

A generative graphics pipeline builds on this: synthesized and model-painted video rendered with selectable high-fidelity modes and real pixel protocols.

tvcp synth plasma                      # live procedural synthesis
TVCP_RENDER_MODE=octant tvcp synth ripple   # 2Γ—4 octant glyphs (densest)
TVCP_KITTY=1 tvcp synth neural "a calm bay" # true bitmap on Kitty terminals
TVCP_LOCAL_BRAIN=1 tvcp synth neural "a storm at night"  # fully offline
tvcp avatar send <host:port>           # neural-avatar P2P (talking face, ~35 kbps)
tvcp game                              # real-time Snake (build with -tags experimental)
  • Render modes (TVCP_RENDER_MODE, else auto-detected): quadrant, perceptual, optimal, halfblock, sextant, octant, braille; plus TVCP_SIXEL=1 / TVCP_KITTY=1.
  • Neural backends (by env, best first): IMAGE_API_URL (raster) β†’ BRAIN_URL (sketch) β†’ TVCP_LOCAL_BRAIN (offline) β†’ placeholder; optionally wrapped with DIRECTOR_URL, RESTORE_API_URL, TVCP_STREAM_COHERENCE. See docs/EXTERNAL_MODELS.md and docs/NEURAL_GRAPHICS_ROADMAP.md.
🌍 Walk an AI-authored world β€” together, in the terminal

The thesis made literal: an AI director describes a 3-D world as a compact scene graph (game rayscene), and each machine renders it locally with a CPU ray/path tracer (pkg/raytrace). Several people (and the AI) walk the same growing world together β€” seeing each other, with chat and optional voice β€” while the world itself never crosses the wire. Only meaning does: region descriptions (~100 bytes), poses (44 bytes), short text/voice.

go run ./cmd/rayexplore                       # walk a world the AI grows ahead of you
go run ./cmd/raymeet -host 5000               # the director hub
go run ./cmd/raymeet localhost:5000 5001      # ...a guest joins; /msg to chat, -voice for audio
go run ./cmd/ray3d -renderer bdpt -spp 32 -png out.png   # any of 5 renderers

See docs/SHARED_WORLD.md for the full guide (group mode, voice, and driving it with a real BRAIN_URL model).

This grew into a wider ray/Q6/alife platform: a hexagram ↔ scene "meaning" bridge (SceneVector, byte-identical in Go and the Python director), an inverse reader (world/image β†’ hexagram + mood), a 64-world Gray-tour atlas, alife ecosystems with seasons, a Q6-hypercube roguelike with a learning agent and a taste-driven curator, sonification, and an end-to-end brain β†’ wire β†’ render demo (cmd/raypipe). For the current stage and how all of it composes/reuses, see docs/CONCEPT_MAP.md; to run any of it (quick start + the exact go run ./cmd/… lines, grouped), see docs/COMMANDS.md.

⚑ Key Features

  • πŸš€ Ultra-low bandwidth: 382 kbps total (vs 1.8 Mbps for Zoom)
  • πŸ“Š 170 MB/hour traffic (vs 540-1620 MB for Zoom)
  • 🎧 Full audio+video β€” 16 kHz voice + 15 FPS video
  • πŸ”’ P2P mesh networking via Yggdrasil β€” no servers, no accounts
  • πŸ–₯️ Headless-first β€” perfect for SSH sessions and remote servers
  • 🎨 True Color support β€” 24-bit color in modern terminals
  • 🌐 Works offline β€” local mesh network without internet
  • πŸ” E2E encrypted β€” built-in Yggdrasil encryption
  • πŸͺΆ Minimal resources β€” 256 MB RAM, runs on Raspberry Pi
  • πŸ›‘οΈ Packet loss recovery β€” automatic retransmission (NACK)

🎯 Use Cases

πŸ› οΈ DevOps / SRE
# You're in an SSH session, incident happens
ssh production-server
# Start video call without leaving terminal
tvcp call alice@200:abc:def::1
πŸ“Ή IoT Video Monitoring

Monitor cameras on cellular/satellite connection at 1/10th the bandwidth of traditional IP cameras.

πŸ›°οΈ Satellite Internet

Video calls at $90/hour instead of $2,700+ (on Iridium/Inmarsat).

πŸ”’ Privacy & Anonymity

No accounts, no servers, no metadata. Works over Tor and mesh networks.

πŸŽ–οΈ Military / Tactical Communications

Autonomous mesh network, works without infrastructure.

πŸ“¦ Installation

Build from Source

Linux / macOS:

# Clone the repository
git clone https://github.com/svend4/infon.git
cd infon

# Build the binary
make build

# Binary will be available at ./bin/tvcp
./bin/tvcp --help

Windows (PowerShell):

# Clone the repository
git clone https://github.com/svend4/infon.git
cd infon

# Run setup script (one-click install)
.\setup.ps1

# Or build manually
go build -o bin/tvcp.exe ./cmd/tvcp

# Binary will be available at .\bin\tvcp.exe
.\bin\tvcp.exe --help

πŸ“– Platform-specific guides:

Requirements
  • Go 1.21 or higher
  • Linux: ALSA audio (libasound2-dev), V4L2 for cameras
  • macOS: CoreAudio (built-in), cameras via future implementation
  • Windows: WASAPI (built-in), cameras via future implementation
  • Android (Termux): Works as relay server (no camera/audio)
  • Terminal with TrueColor support (recommended)

πŸš€ Quick Start

Try the Proof-of-Concept Demo
# Clone and build
git clone https://github.com/svend4/infon.git
cd infon
make build

# Generate a test image
./bin/tvcp generate test.png

# Display it in your terminal!
./bin/tvcp demo test.png

πŸ“– Read the full demo guide β†’

Try Live Video Preview
# Watch live animated video in your terminal!
./bin/tvcp preview

# Try different patterns
./bin/tvcp preview bounce    # bouncing ball
./bin/tvcp preview gradient  # flowing colors
./bin/tvcp preview noise     # TV static

πŸŽ₯ Read the preview guide β†’

Stream Video Over Network
# Terminal 1: Start receiver
./bin/tvcp receive 5000

# Terminal 2: Send video stream
./bin/tvcp send localhost:5000 bounce

# Works over LAN too!
./bin/tvcp send 192.168.1.100:5000 gradient

🌐 Read the network guide β†’

Make Video+Audio Calls
# Make a P2P call to Yggdrasil address
./bin/tvcp call [200:abc:def::1]:5000

# Or call over local network
./bin/tvcp call localhost:5000

# Receive calls on port 5000
./bin/tvcp call --listen 5000

# Full audio+video communication with:
#   - 15 FPS video at ~350 KB/s
#   - 16 kHz mono audio at 32 KB/s
#   - Automatic packet loss recovery
#   - Real-time statistics display

🎧 Learn more about audio β†’ | πŸ“Ή Camera setup guide β†’

πŸ—οΈ Architecture

TVCP uses a custom block-based video codec (.babe format) that encodes video frames as Unicode quadrant blocks with foreground/background colors:

Each block = 2Γ—2 pixels encoded as:
- 4 bits: glyph pattern (16 Unicode quadrants: β–€β–„β–Œβ–β––β–—β–˜β– etc.)
- 16 bits: foreground color (RGB565)
- 16 bits: background color (RGB565)
= 36 bits per block

Tech stack:

  • Video codec: Custom .babe format (Bi-Level Adaptive Block Encoding)
  • Audio codec: PCM 16 kHz mono (Opus planned)
  • Networking: Yggdrasil P2P mesh network
  • Transport: UDP with automatic retransmission (NACK)
  • Rendering: ANSI escape codes + Unicode block elements

πŸ“š Documentation

Getting Started
Core Features
Guides
  • 🌐 Network Streaming β€” Stream video over UDP
  • πŸŽ₯ Live Video Preview β€” Real-time video rendering
  • 🎨 Proof-of-Concept Demo β€” Static image rendering
  • 🧠 Generative Graphics β€” Synthesized frames, render modes (half-block / sextant / octant / Braille / Sixel / Kitty), and neural backends
  • πŸ–ŒοΈ Pseudo-Images β€” Let a plain text model paint without a diffusion model: pseudo-diffusion grid, glyph art, sigils, and vector shapes
  • πŸ—ΊοΈ Neural Graphics Roadmap β€” Design doc + current implementation status (graphics Γ— neural networks)
  • πŸ”Œ External Models β€” Wiring real models via HTTP sidecars or cloud APIs
Planning & Analysis

πŸ›£οΈ Roadmap

Phase 0: Preparation (Weeks 1-2) β€” βœ“ Complete
  • Create documentation
  • Repository setup
  • Setup CI/CD (GitHub Actions)
  • Proof-of-concept demo β€” Image-to-terminal renderer working!
  • Live video preview β€” Real-time streaming at 15 FPS! πŸŽ‰
  • Fork Say project
Phase 1: MVP (Weeks 3-8) β€” βœ“ Complete
  • Video capture interface and simulator
  • Real-time frame encoding (15 FPS)
  • Frame timing and synchronization
  • Network transport (UDP) β€” Video streaming works! πŸŽ‰
  • Frame fragmentation β€” Handles MTU limits
  • Packet loss recovery (NACK) β€” Automatic retransmission! πŸŽ‰
  • V4L2 camera capture β€” Real webcam support! πŸŽ‰
  • Yggdrasil integration β€” P2P mesh networking! πŸŽ‰
  • Audio encoding (PCM) β€” Voice transmission! πŸŽ‰
  • Two-way audio+video calls β€” Full communication! πŸŽ‰
Phase 2: Expansion (Weeks 9-16)
  • Text chat
  • Screen sharing
  • Call recording
  • Package managers (Homebrew, apt)
Phase 3: Production (Weeks 17-28)
  • Group calls (up to 5 participants)
  • Web portal
  • SaaS managed relay nodes
  • IoT SDK
Phase 4: Scale (Months 7-12)
  • Mobile clients (iOS/Android)
  • P-frames (inter-frame compression)
  • Enterprise integrations
  • Hardware partnerships

🀝 Contributing

TVCP is in early development. Contributions are welcome!

Areas where we need help:

  • Go development (codec, networking)
  • Video encoding algorithms
  • Terminal rendering optimization
  • Testing on various terminals
  • Documentation

πŸ“Š Comparison

Feature Zoom WebRTC TVCP
Min bandwidth 1.8 Mbps 1.5 Mbps 382 kbps
Video quality 720p 720p Terminal (40x30)
Audio quality 48 kHz stereo 48 kHz 16 kHz mono
Traffic/hour 540-1620 MB 450-900 MB 170 MB
GUI required βœ“ βœ“ βœ—
Central server βœ“ Signaling only βœ— (P2P)
Account needed βœ“ Varies βœ—
RAM usage 8-16 GB 2-4 GB 256 MB
Works headless βœ— βœ— βœ“
IoT/Embedded βœ— Limited βœ“

πŸ“„ License

MIT License - see LICENSE file for details.

πŸ™ Acknowledgments

πŸ“§ Contact


Status: πŸŽ‰ Alpha MVP Complete β€” Full audio+video P2P calling works! Try it out and report issues.

Directories ΒΆ

Path Synopsis
cmd
aclnegotiate command
Command aclnegotiate shows multiagent NEGOTIATION (pkg/acl, Contract Net): an initiator calls for proposals on a task, agents bid or refuse, and the best bid is awarded β€” the conversation printed performative by performative.
Command aclnegotiate shows multiagent NEGOTIATION (pkg/acl, Contract Net): an initiator calls for proposals on a task, agents bid or refuse, and the best bid is awarded β€” the conversation printed performative by performative.
aicam command
Command aicam streams an AI video source.
Command aicam streams an AI video source.
aicards command
Command aicards renders a glyph "card" message + a truecolor effect via pkg/terminal.Frame.
Command aicards renders a glyph "card" message + a truecolor effect via pkg/terminal.Frame.
aidraw command
Command aidraw renders to the terminal via pkg/scene.
Command aidraw renders to the terminal via pkg/scene.
aiimg command
Command aiimg renders a raster image into the terminal via the repo's own internal/codec/babe.ImageToFrame.
Command aiimg renders a raster image into the terminal via the repo's own internal/codec/babe.ImageToFrame.
anchordemo command
Command anchordemo is a hand-made bridge to the MDLM world-model paper (Patronus AI, 2026): it shows, on our symbolic grid, why ANY-ORDER decoding with ANCHORS beats strict LEFT-TO-RIGHT.
Command anchordemo is a hand-made bridge to the MDLM world-model paper (Patronus AI, 2026): it shows, on our symbolic grid, why ANY-ORDER decoding with ANCHORS beats strict LEFT-TO-RIGHT.
anyorderdemo command
Command anyorderdemo shows the MDLM "any-order with anchors" idea on the tangram address book: to identify a figure, reveal the most informative cell next (any-order) instead of scanning left-to-right.
Command anyorderdemo shows the MDLM "any-order with anchors" idea on the tangram address book: to identify a figure, reveal the most informative cell next (any-order) instead of scanning left-to-right.
areciboframe command
Command areciboframe renders the full Lingua-Cosmica plaque (pkg/arecibo): one frame that teaches its own alphabet.
Command areciboframe renders the full Lingua-Cosmica plaque (pkg/arecibo): one frame that teaches its own alphabet.
arena command
Command arena runs an "origami Warcraft" skirmish: two factions of tangram units, each driven by the reference Commander, charge across an isometric terrain board.
Command arena runs an "origami Warcraft" skirmish: two factions of tangram units, each driven by the reference Commander, charge across an isometric terrain board.
arenaai command
Command arenaai runs the origami-Warcraft skirmish with each side commanded by a tvcp-ai brain (game "rpg"): by default the reference commander on both, or a live model per side via -brain0 / -brain1.
Command arenaai runs the origami-Warcraft skirmish with each side commanded by a tvcp-ai brain (game "rpg"): by default the reference commander on both, or a live model per side via -brain0 / -brain1.
arenacall command
Command arenacall is the project's "three bodies into one core" demo: a live arena match (the agent-world) is rendered as marks pseudo-images and streamed through pkg/semvideo β€” the very codec TVCP uses for a semantic video call β€” so a spectator WATCHES THE WAR OF TWO NEURAL NETS AS A FEW-HUNDRED-BYTES/S CALL that survives packet loss.
Command arenacall is the project's "three bodies into one core" demo: a live arena match (the agent-world) is rendered as marks pseudo-images and streamed through pkg/semvideo β€” the very codec TVCP uses for a semantic video call β€” so a spectator WATCHES THE WAR OF TWO NEURAL NETS AS A FEW-HUNDRED-BYTES/S CALL that survives packet loss.
arenacast command
Command arenacast broadcasts an arena match as a loss-tolerant semantic stream and renders the SPECTATOR's view: keyframe+delta packets over Reed-Solomon are dropped and corrupted on a lossy channel, the spectator freezes on loss and resyncs at the next keyframe.
Command arenacast broadcasts an arena match as a loss-tolerant semantic stream and renders the SPECTATOR's view: keyframe+delta packets over Reed-Solomon are dropped and corrupted on a lossy channel, the spectator freezes on loss and resyncs at the next keyframe.
arenalive command
Command arenalive is the capstone: a LIVE war of two models, broadcast over a lossy channel to a spectator.
Command arenalive is the capstone: a LIVE war of two models, broadcast over a lossy channel to a spectator.
arenammo command
Command arenammo is the capstone of the origami-MMORPG: armies are SUMMONED from tangram figures, each side is commanded by a LIVE tvcp-ai brain (-brain0/-brain1), the match is broadcast as RS packets over real UDP to several networked spectators (with loss), and one spectator's reconstructed view is rendered to a GIF.
Command arenammo is the capstone of the origami-MMORPG: armies are SUMMONED from tangram figures, each side is commanded by a LIVE tvcp-ai brain (-brain0/-brain1), the match is broadcast as RS packets over real UDP to several networked spectators (with loss), and one spectator's reconstructed view is rendered to a GIF.
arenaplan command
Command arenaplan pits the lookahead Planner (blue) against the reactive RefCommander (red) on a symmetric board with a central ridge, prints the tick-by-tick score, and renders a top-down GIF (via pkg/arenacast) with a survivor bar.
Command arenaplan pits the lookahead Planner (blue) against the reactive RefCommander (red) on a symmetric board with a central ridge, prints the tick-by-tick score, and renders a top-down GIF (via pkg/arenacast) with a survivor bar.
arenaserver command
Command arenaserver is a persistent tick-server with multiple networked spectators: it runs an arena match and broadcasts each tick as an RS-protected packet over UDP (real localhost loopback) to several spectator sockets, dropping ~15% of sends per viewer.
Command arenaserver is a persistent tick-server with multiple networked spectators: it runs an arena match and broadcasts each tick as an RS-protected packet over UDP (real localhost loopback) to several spectator sockets, dropping ~15% of sends per viewer.
arenasummon command
Command arenasummon demonstrates crafting: a tangram figure is classified and, if it names a creature in the bestiary, a unit is summoned into the arena - "the address is the summoning spell".
Command arenasummon demonstrates crafting: a tangram figure is classified and, if it names a creature in the bestiary, a unit is summoned into the arena - "the address is the summoning spell".
arenatale command
Command arenatale plays an arena match, distils it into a few-byte chronicle (pkg/chronicle), and retells that byte-log as prose β€” the project's chain number -> image -> world -> story, end to end.
Command arenatale plays an arena match, distils it into a few-byte chronicle (pkg/chronicle), and retells that byte-log as prose β€” the project's chain number -> image -> world -> story, end to end.
autodemo command
Command autodemo shows the auto triangle/quadrant chooser (pkg/automode).
Command autodemo shows the auto triangle/quadrant chooser (pkg/automode).
blazondemo command
Command blazondemo renders example coats of arms (heraldic blazons) to PNGs, proving that a medieval visual-identity language compiles straight into the pseudo-image pipeline.
Command blazondemo renders example coats of arms (heraldic blazons) to PNGs, proving that a medieval visual-identity language compiles straight into the pseudo-image pipeline.
bmeaning command
Command bmeaning demonstrates bidirectional B-frames of meaning (pkg/semvideo): a constant-shape marks "video" is coded as anchors (keyframe + P-frames) with B-frames in between, each predicted from the nearer anchor.
Command bmeaning demonstrates bidirectional B-frames of meaning (pkg/semvideo): a constant-shape marks "video" is coded as anchors (keyframe + P-frames) with B-frames in between, each predicted from the nearer anchor.
braindemo command
Command braindemo proves the open tvcp-ai/1 format end-to-end over real HTTP: it starts the reference brain on localhost, then (1) plays a full tic-tac-toe where X's moves come from the brain via the protocol, O is random; and (2) asks the brain to draw a scene and renders the returned draw-DSL.
Command braindemo proves the open tvcp-ai/1 format end-to-end over real HTTP: it starts the reference brain on localhost, then (1) plays a full tic-tac-toe where X's moves come from the brain via the protocol, O is random; and (2) asks the brain to draw a scene and renders the returned draw-DSL.
brainserver command
Command brainserver serves the reference tvcp-ai/1 brain over HTTP, so any client (game, draw) can use it.
Command brainserver serves the reference tvcp-ai/1 brain over HTTP, so any client (game, draw) can use it.
capsdemo command
Command capsdemo shows tvcp-ai/1 capability negotiation (pkg/brain): a brain serves /v1/capabilities and /v1/decide on one endpoint; a client fetches the capabilities and checks support before sending.
Command capsdemo shows tvcp-ai/1 capability negotiation (pkg/brain): a brain serves /v1/capabilities and /v1/decide on one endpoint; a client fetches the capabilities and checks support before sending.
conform command
Command conform checks whether a tvcp-ai brain satisfies the protocol contract.
Command conform checks whether a tvcp-ai brain satisfies the protocol contract.
connect4demo command
Command connect4demo shows a SECOND game on the same session runner (pkg/session): Connect Four, a win/block tactician bot against a naive leftmost bot.
Command connect4demo shows a SECOND game on the same session runner (pkg/session): Connect Four, a win/block tactician bot against a naive leftmost bot.
debate command
Command debate stages a judged AI debate (pkg/debate): two debaters argue a topic over several rounds and a judge scores each one.
Command debate stages a judged AI debate (pkg/debate): two debaters argue a topic over several rounds and a judge scores each one.
dtncast command
Command dtncast streams an arena match over a DELAY-TOLERANT (deep-space) link (pkg/dtn over pkg/semvideo): the world's frames become bundles forwarded only during a few short contact passes, with a time-to-live.
Command dtncast streams an arena match over a DELAY-TOLERANT (deep-space) link (pkg/dtn over pkg/semvideo): the world's frames become bundles forwarded only during a few short contact passes, with a time-to-live.
foldcall command
Command foldcall sends an origami unfold of a tangram figure as a stream of per-piece fold angles (keyframe + deltas) over the Reed-Solomon channel, then corrupts a burst of wire bytes, recovers, and renders the reconstructed animation to a GIF - a pseudo-3D fold that travels in a few dozen bytes and survives loss, exactly like a semantic video call.
Command foldcall sends an origami unfold of a tangram figure as a stream of per-piece fold angles (keyframe + deltas) over the Reed-Solomon channel, then corrupts a burst of wire bytes, recovers, and renders the reconstructed animation to a GIF - a pseudo-3D fold that travels in a few dozen bytes and survives loss, exactly like a semantic video call.
folddemo command
Command folddemo folds flat tangram7 figures into a pseudo-3D isometric relief: it writes a hero still and an animated GIF of the figure rising out of the plane, and prints the tiny FoldSpec that describes the whole animation.
Command folddemo folds flat tangram7 figures into a pseudo-3D isometric relief: it writes a hero still and an animated GIF of the figure rising out of the plane, and prints the tiny FoldSpec that describes the whole animation.
glyphdemo command
Command glyphdemo renders the digitized alphabet chart, and compares the quadrant codec with the new diagonal/triangle codec on the same image.
Command glyphdemo renders the digitized alphabet chart, and compares the quadrant codec with the new diagonal/triangle codec on the same image.
glyphqrdemo command
Command glyphqrdemo shows the glyph-QR with Reed-Solomon error correction: encode a message into a glyph grid, damage several cells, and watch it decode back to the exact text β€” the self-correcting "crossword x QR" idea, applied to our glyph alphabet.
Command glyphqrdemo shows the glyph-QR with Reed-Solomon error correction: encode a message into a glyph grid, damage several cells, and watch it decode back to the exact text β€” the self-correcting "crossword x QR" idea, applied to our glyph alphabet.
glyphqrscan command
Command glyphqrscan demonstrates the optical glyph-QR: a framed code with finder marks in three corners decodes from ANY rotation.
Command glyphqrscan demonstrates the optical glyph-QR: a framed code with finder marks in three corners decodes from ANY rotation.
imagine command
Command imagine is the "protocol of shared imagination": one agent-world is broadcast ONCE as a semantic-video stream (pkg/arenacast + pkg/semvideo), and TWO independent receivers β€” with their own packet loss β€” each reconstruct it LOCALLY.
Command imagine is the "protocol of shared imagination": one agent-world is broadcast ONCE as a semantic-video stream (pkg/arenacast + pkg/semvideo), and TWO independent receivers β€” with their own packet loss β€” each reconstruct it LOCALLY.
linguaframe command
Command linguaframe builds a self-describing "Lingua Cosmica" frame for a tangram figure and then decodes it back using nothing but the bytes β€” the receiver learns to count, then learns the radix, the grid, the cells and the checksum, all from the stream itself (pkg/lincos).
Command linguaframe builds a self-describing "Lingua Cosmica" frame for a tangram figure and then decodes it back using nothing but the bytes β€” the receiver learns to count, then learns the radix, the grid, the cells and the checksum, all from the stream itself (pkg/lincos).
orbit3d command
Command orbit3d turns the pseudo-3D world into a turntable: it renders a relief voxel cat across a full 360-degree camera-yaw sweep (fold.RenderCam) and ships the camera path as a one-byte-per-frame deltastream - rotation costs nothing in the codec, it is just one more number in the record.
Command orbit3d turns the pseudo-3D world into a turntable: it renders a relief voxel cat across a full 360-degree camera-yaw sweep (fold.RenderCam) and ships the camera path as a one-byte-per-frame deltastream - rotation costs nothing in the codec, it is just one more number in the record.
paint command
Command paint shows the on-device painter (pkg/painter): with no model and no network it reads a prompt into a pseudo-image grid, which the deterministic pseudo-diffusion renderer turns into a painterly picture.
Command paint shows the on-device painter (pkg/painter): with no model and no network it reads a prompt into a pseudo-image grid, which the deterministic pseudo-diffusion renderer turns into a painterly picture.
planbrain command
Command planbrain serves the arena lookahead Planner as a tvcp-ai/1 endpoint, so any client can point -brain at it by URL.
Command planbrain serves the arena lookahead Planner as a tvcp-ai/1 endpoint, so any client can point -brain at it by URL.
pseudo3d command
Command pseudo3d is the synthesis of the three pseudo-3D paths in one scene and one stream.
Command pseudo3d is the synthesis of the three pseudo-3D paths in one scene and one stream.
pseudodemo command
Command pseudodemo renders the same scene ("a calm harbor at dawn") in every pseudo-image format, proving that an ordinary text model β€” one that can only emit JSON, no diffusion head β€” can paint pictures for the terminal.
Command pseudodemo renders the same scene ("a calm harbor at dawn") in every pseudo-image format, proving that an ordinary text model β€” one that can only emit JSON, no diffusion head β€” can paint pictures for the terminal.
ray3d command
Command ray3d renders a small CPU ray-traced scene β€” spheres on a checkerboard floor with Lambert/Blinn-Phong shading, hard shadows, a mirror and glass β€” into the terminal using truecolor glyph modes (no ASCII ramp).
Command ray3d renders a small CPU ray-traced scene β€” spheres on a checkerboard floor with Lambert/Blinn-Phong shading, hard shadows, a mirror and glass β€” into the terminal using truecolor glyph modes (no ASCII ramp).
rayagent command
Command rayagent puts the robots under a tvcp-ai/1 brain: whenever a robot is ready for a new destination the brain picks one of its stations, given the robot's position and status.
Command rayagent puts the robots under a tvcp-ai/1 brain: whenever a robot is ready for a new destination the brain picks one of its stations, given the robot's position and status.
rayarena command
Command rayarena stages a 3-D "arena": a tvcp-ai brain authors a moving world (orbiting, breathing spheres) AND flies the camera, the whole evolving scene is broadcast as independent Reed-Solomon packets (one per tick), and a spectator reconstructs it over a lossy channel β€” rendering whatever arrives and freezing on loss.
Command rayarena stages a 3-D "arena": a tvcp-ai brain authors a moving world (orbiting, breathing spheres) AND flies the camera, the whole evolving scene is broadcast as independent Reed-Solomon packets (one per tick), and a spectator reconstructs it over a lossy channel β€” rendering whatever arrives and freezing on loss.
rayask command
Command rayask asks a brain to author a world from a prompt and path-traces it.
Command rayask asks a brain to author a world from a prompt and path-traces it.
raybench command
Command raybench evaluates a rayscene director (the reference brain, or a live model via -url): it asks for many scenes and reports how renderable, rich and varied they are β€” a quick objective read before a live session.
Command raybench evaluates a rayscene director (the reference brain, or a live model via -url): it asks for many scenes and reports how renderable, rich and varied they are β€” a quick objective read before a live session.
raycall command
Command raycall is the semantic video call, end to end, over a real (loopback) UDP socket: it joins the pieces this project built separately β€”
Command raycall is the semantic video call, end to end, over a real (loopback) UDP socket: it joins the pieces this project built separately β€”
raycamp command
Command raycamp runs a robot logistics yard β€” Part 1's "logistics in a camp".
Command raycamp runs a robot logistics yard β€” Part 1's "logistics in a camp".
rayclimate command
Command rayclimate visualises the hexagram-cellular-automaton climate (block: hexca -> weather).
Command rayclimate visualises the hexagram-cellular-automaton climate (block: hexca -> weather).
raycurator command
Command raycurator is a curator agent that searches the Q6 hypercube for the world a viewer loves MOST (Block K: curator = engagement Γ— maze Γ— agent).
Command raycurator is a curator agent that searches the Q6 hypercube for the world a viewer loves MOST (Block K: curator = engagement Γ— maze Γ— agent).
raydebate command
Command raydebate stages adversarial co-direction (the "debate Γ— director" combination): two brains each author a region for a prompt, the rayscene validator referees, and the richer valid region wins β€” plus a MERGED region that unions both directors' forms.
Command raydebate stages adversarial co-direction (the "debate Γ— director" combination): two brains each author a region for a prompt, the rayscene validator referees, and the richer valid region wins β€” plus a MERGED region that unions both directors' forms.
raydetect command
Command raydetect closes the semantic-video chain: a vision model's detections become a rayscene, which is then path-traced.
Command raydetect closes the semantic-video chain: a vision model's detections become a rayscene, which is then path-traced.
raydirect command
Command raydirect shows meaning-driven direction in both directions (Block C).
Command raydirect shows meaning-driven direction in both directions (Block C).
raydungeon command
Command raydungeon plays the Q6 maze as a LIVING dungeon (Block E: alife Γ— rogue).
Command raydungeon plays the Q6 maze as a LIVING dungeon (Block E: alife Γ— rogue).
rayexplore command
Command rayexplore is the experience: you walk, in the terminal, through a 3-D world the AI director dreams up and extends on the fly.
Command rayexplore is the experience: you walk, in the terminal, through a 3-D world the AI director dreams up and extends on the fly.
rayface command
Command rayface renders a meeting INSIDE the world: participant avatars whose faces are drawn from keypoints (raydir.AvatarFace β€” the landmarks internal/avatar sends ~35 kbps over the wire) stand together in a shared world and look at you.
Command rayface renders a meeting INSIDE the world: participant avatars whose faces are drawn from keypoints (raydir.AvatarFace β€” the landmarks internal/avatar sends ~35 kbps over the wire) stand together in a shared world and look at you.
rayfilm command
Command rayfilm flies a cinematic camera through a brain-authored world and prints a contact sheet of the shots.
Command rayfilm flies a cinematic camera through a brain-authored world and prints a contact sheet of the shots.
rayfleet command
Command rayfleet watches a fleet of machines the way info150's triage4-drive watches a driver: it ingests per-unit signal readings, fuses them into a severity, tracks each unit against its own baseline, and reacts β€” printing short operator cues (text) and rendering the fleet in 3-D with an alarm glow (graphics), plus the relationship graph of shared faults.
Command rayfleet watches a fleet of machines the way info150's triage4-drive watches a driver: it ingests per-unit signal readings, fuses them into a severity, tracks each unit against its own baseline, and reacts β€” printing short operator cues (text) and rendering the fleet in 3-D with an alarm glow (graphics), plus the relationship graph of shared faults.
rayfx command
Command rayfx activates three renderers that shipped in pkg/raytrace fully tested but wired to no command (the "dormant code" of the audit): photon-mapped caustics, adaptive sampling, and temporal reprojection.
Command rayfx activates three renderers that shipped in pkg/raytrace fully tested but wired to no command (the "dormant code" of the audit): photon-mapped caustics, adaptive sampling, and temporal reprojection.
raygallery command
Command raygallery browses a directory of saved worlds (.rwld) and recordings (.rrec), printing a summary of each and how to open it β€” a little gallery of shareable worlds and walks, each a few KB of meaning (not pixels).
Command raygallery browses a directory of saved worlds (.rwld) and recordings (.rrec), printing a summary of each and how to open it β€” a little gallery of shareable worlds and walks, each a few KB of meaning (not pixels).
raygates command
Command raygates runs the sim-to-real conformance gates β€” Part 1's variant E. The same demo logistics scenario is assessed twice: once as clean "sim" readings and once perturbed by a sim-to-real gap (bias + noise).
Command raygates runs the sim-to-real conformance gates β€” Part 1's variant E. The same demo logistics scenario is assessed twice: once as clean "sim" readings and once perturbed by a sim-to-real gap (bias + noise).
raygather command
Command raygather is a meeting INSIDE a shared world (Block A: metaverse): N participants, each an avatar with a face (raydir.AvatarFace from keypoints), sit in a circle in a hexagram-authored world and look at one another.
Command raygather is a meeting INSIDE a shared world (Block A: metaverse): N participants, each an avatar with a face (raydir.AvatarFace from keypoints), sit in a circle in a hexagram-authored world and look at one another.
rayhard command
Command rayhard shows the integrator "renderer brain" (block L): on a caustic dream scene where the unidirectional path tracer is noisy, RenderBest probes the difficulty and switches to the bidirectional path tracer β€” BDPT, shipped and tested but previously reachable only from the ray3d demo.
Command rayhard shows the integrator "renderer brain" (block L): on a caustic dream scene where the unidirectional path tracer is noisy, RenderBest probes the difficulty and switches to the bidirectional path tracer β€” BDPT, shipped and tested but previously reachable only from the ray3d demo.
rayimagine command
Command rayimagine reads a picture and renders the 3-D world it implies β€” the project's idea in reverse: meaning extracted FROM pixels.
Command rayimagine reads a picture and renders the 3-D world it implies β€” the project's idea in reverse: meaning extracted FROM pixels.
raylife command
Command raylife runs a small artificial-life world that lives WITHOUT a player (Block B: alife).
Command raylife runs a small artificial-life world that lives WITHOUT a player (Block B: alife).
raymandala command
Command raymandala activates raydir.Mandala β€” dihedral (D_n) replication of a motif β€” which shipped with tests but no command.
Command raymandala activates raydir.Mandala β€” dihedral (D_n) replication of a motif β€” which shipped with tests but no command.
raymeet command
Command raymeet is the shared-world experience for a group: several people (and AIs) "call in" and walk the SAME 3-D world together, in the terminal, each seeing everyone else's avatar and able to talk.
Command raymeet is the shared-world experience for a group: several people (and AIs) "call in" and walk the SAME 3-D world together, in the terminal, each seeing everyone else's avatar and able to talk.
raymetaverse command
Command raymetaverse is a real networked meeting INSIDE a shared world (Block F: metaverse over the wire).
Command raymetaverse is a real networked meeting INSIDE a shared world (Block F: metaverse over the wire).
raypipe command
Command raypipe shows the closed triangle end to end, offline and without a server: an AI brain authors a world from a prompt (2 β€” tvcp-ai/1), the world crosses the "wire" as MEANING β€” a compact SceneSpec, exactly the bytes raymeet ships over UDP (1 β€” the network), and is rebuilt and ray-traced locally (3 β€” the renderer).
Command raypipe shows the closed triangle end to end, offline and without a server: an AI brain authors a world from a prompt (2 β€” tvcp-ai/1), the world crosses the "wire" as MEANING β€” a compact SceneSpec, exactly the bytes raymeet ships over UDP (1 β€” the network), and is rebuilt and ray-traced locally (3 β€” the renderer).
rayplay command
Command rayplay replays a recorded shared-world session (see raymeet -record): it reconstructs the world, the walkers and the chat over time from a tiny file of timestamped events β€” meaning, not pixels β€” and plays it back in the terminal from a participant's point of view.
Command rayplay replays a recorded shared-world session (see raymeet -record): it reconstructs the world, the walkers and the chat over time from a tiny file of timestamped events β€” meaning, not pixels β€” and plays it back in the terminal from a participant's point of view.
rayquest command
Command rayquest plays the Q6 hypercube as a roguelike (Block D).
Command rayquest plays the Q6 hypercube as a roguelike (Block D).
rayquestai command
Command rayquestai is an agent that PLAYS the Q6 roguelike (Block H: agent Γ— maze).
Command rayquestai is an agent that PLAYS the Q6 roguelike (Block H: agent Γ— maze).
rayread command
Command rayread points the inverse reader at the real world (Block G: reader Γ— vision).
Command rayread points the inverse reader at the real world (Block G: reader Γ— vision).
rayreading command
Command rayreading casts an I-Ching reading and renders it as a world transition: the primary hexagram's world dissolves into voxel blocks and the relating hexagram's world forms from them (raydir.Reading + raytrace.Materialize) β€” the oracle's narrative arc A -> B made into a moving image, and a deeper bridge to pro2 than the static Gray walk.
Command rayreading casts an I-Ching reading and renders it as a world transition: the primary hexagram's world dissolves into voxel blocks and the relating hexagram's world forms from them (raydir.Reading + raytrace.Materialize) β€” the oracle's narrative arc A -> B made into a moving image, and a deeper bridge to pro2 than the static Gray walk.
rayscore command
Command rayscore writes the world's adaptive soundtrack to a WAV β€” activating raydir.ScoreWAV, which shipped with tests but no command.
Command rayscore writes the world's adaptive soundtrack to a WAV β€” activating raydir.ScoreWAV, which shipped with tests but no command.
rayseasons command
Command rayseasons runs a living world through the turning year (Block L: seasons).
Command rayseasons runs a living world through the turning year (Block L: seasons).
raysound command
Command raysound gives the Q6 world a voice (Block J: sonification).
Command raysound gives the Q6 world a voice (Block J: sonification).
rayspectate command
Command rayspectate renders the raymeet shared world populated like an MMORPG: several player avatars and a swarm of patrolling robots in one world, shown both from a spectator's overhead view and through one player's eyes β€” the same scene raymeet builds (AvatarSpheres over World.SceneWith), so it is the multiplayer world of Part 1, with the robots of block H sharing it.
Command rayspectate renders the raymeet shared world populated like an MMORPG: several player avatars and a swarm of patrolling robots in one world, shown both from a spectator's overhead view and through one player's eyes β€” the same scene raymeet builds (AvatarSpheres over World.SceneWith), so it is the multiplayer world of Part 1, with the robots of block H sharing it.
raystream command
Command raystream is a call where the wire carries scene DELTAS, not pixels: a sphere orbits a small world over many frames, each frame sent as a rayscene P-frame (raydir.SceneStream), and the receiver reconstructs and ray-traces it locally.
Command raystream is a call where the wire carries scene DELTAS, not pixels: a sphere orbits a small world over many frames, each frame sent as a rayscene P-frame (raydir.SceneStream), and the receiver reconstructs and ray-traces it locally.
rayterrain command
Command rayterrain activates the Delaunay terrain (raytrace.ScatterTerrain / DelaunayMesh / Delaunay) β€” shipped with tests but reachable from no command.
Command rayterrain activates the Delaunay terrain (raytrace.ScatterTerrain / DelaunayMesh / Delaunay) β€” shipped with tests but reachable from no command.
raytour command
Command raytour renders the Gray-code grand tour of all 64 hexagrams as cinema (Block I: tour of every world).
Command raytour renders the Gray-code grand tour of all 64 hexagrams as cinema (Block I: tour of every world).
rayview command
Command rayview is an interactive terminal navigator for the ray tracer.
Command rayview is an interactive terminal navigator for the ray tracer.
rayvoice command
Command rayvoice shows voice prosody steering the world's mood (the audio/reactive -> mood combination): three synthetic voice profiles β€” quiet, loud-and-steady, loud-and-swinging β€” are fed to a world's mood sense, and the world authored under the induced mood is rendered.
Command rayvoice shows voice prosody steering the world's mood (the audio/reactive -> mood combination): three synthetic voice profiles β€” quiet, loud-and-steady, loud-and-swinging β€” are fed to a world's mood sense, and the world authored under the induced mood is rendered.
rayvoxel command
Command rayvoxel renders a voxel-space landscape β€” the blocky height-field look the dream hackers describe as how dreams form ("Π’ΠΎΠΊΡΠ΅Π»ΡŒΠ½Π°Ρ Π³Ρ€Π°Ρ„ΠΈΠΊΠ° Π² сновидСниях").
Command rayvoxel renders a voxel-space landscape β€” the blocky height-field look the dream hackers describe as how dreams form ("Π’ΠΎΠΊΡΠ΅Π»ΡŒΠ½Π°Ρ Π³Ρ€Π°Ρ„ΠΈΠΊΠ° Π² сновидСниях").
raywatch command
Command raywatch is the camera observer of Part 1 (variant A): a camera frame of a machine goes through the same engine as a telemetry stream β€” visual signatures (heat, occlusion, glare, blur) are extracted, assessed, and the verdict is composited back onto the frame as a status border and banner, with a bloom/dream pass so the hot motor glows.
Command raywatch is the camera observer of Part 1 (variant A): a camera frame of a machine goes through the same engine as a telemetry stream β€” visual signatures (heat, occlusion, glare, blur) are extracted, assessed, and the verdict is composited back onto the frame as a status border and banner, with a bloom/dream pass so the hot motor glows.
rayworld command
Command rayworld flies a ray-traced camera with a tvcp-ai brain and renders the result β€” neural directives -> camera -> real 3-D. By default the built-in reference brain drives it via game:"world"; -brain URL points at a live model (Ollama / OpenAI / Anthropic adapter); -ref uses the scripted director.
Command rayworld flies a ray-traced camera with a tvcp-ai brain and renders the result β€” neural directives -> camera -> real 3-D. By default the built-in reference brain drives it via game:"world"; -brain URL points at a live model (Ollama / OpenAI / Anthropic adapter); -ref uses the scripted director.
rayyard command
Command rayyard renders the shared world as a robot yard: several robots patrol loops with status beacons green->red, and the world is rendered over time into a contact sheet β€” proof that robots are first-class world entities.
Command rayyard renders the shared world as a robot yard: several robots patrol loops with status beacons green->red, and the world is rendered over time into a contact sheet β€” proof that robots are first-class world entities.
reliefdemo command
Command reliefdemo renders tangram grid figures as 2.5D isometric reliefs (path 2): each glyph cell is extruded into a block, the diagonal glyphs becoming lit facets.
Command reliefdemo renders tangram grid figures as 2.5D isometric reliefs (path 2): each glyph cell is extruded into a block, the diagonal glyphs becoming lit facets.
scenecall command
Command scenecall animates a 3-D scene of tangram pieces (orbit + spin + bob), ships it as a SceneAnim (keyframe + deltas) over the Reed-Solomon channel, corrupts a contiguous burst, recovers, and renders the reconstructed scene to a GIF - "a real game" that travels in a few dozen bytes per frame.
Command scenecall animates a 3-D scene of tangram pieces (orbit + spin + bob), ships it as a SceneAnim (keyframe + deltas) over the Reed-Solomon channel, corrupts a contiguous burst, recovers, and renders the reconstructed scene to a GIF - "a real game" that travels in a few dozen bytes per frame.
semcall command
Command semcall is a REAL semantic video call: it sends a marks-spec stream (keyframes + semframe P-frames, each Reed-Solomon protected) over an actual localhost UDP socket under lossy conditions β€” packets are dropped and bytes are corrupted in flight.
Command semcall is a REAL semantic video call: it sends a marks-spec stream (keyframes + semframe P-frames, each Reed-Solomon protected) over an actual localhost UDP socket under lossy conditions β€” packets are dropped and bytes are corrupted in flight.
semcodec command
Command semcodec measures the rate-distortion of MEANING.
Command semcodec measures the rate-distortion of MEANING.
semdemo command
Command semdemo shows semantic P-frames: a tiny "video" (a sun drifting across a sky grid) sent as one keyframe + per-frame deltas, and the byte savings vs sending every full frame.
Command semdemo shows semantic P-frames: a tiny "video" (a sun drifting across a sky grid) sent as one keyframe + per-frame deltas, and the byte savings vs sending every full frame.
semdistdemo command
Command semdistdemo prints the rate-distortion-of-MEANING benchmark (pkg/semdist): how many wire bytes buy how much surviving meaning (MarksIoU), as the keyframe interval is varied under packet loss and as Reed-Solomon parity is varied under byte corruption.
Command semdistdemo prints the rate-distortion-of-MEANING benchmark (pkg/semdist): how many wire bytes buy how much surviving meaning (MarksIoU), as the keyframe interval is varied under packet loss and as Reed-Solomon parity is varied under byte corruption.
semvideo command
Command semvideo is the "closed loop": a semantic video call.
Command semvideo is the "closed loop": a semantic video call.
sessiondemo command
Command sessiondemo shows the unified game session (pkg/session): the same runner plays one Game (tic-tac-toe) between any Participants β€” here a tvcp-ai brain against another brain, then a brain against a scripted bot.
Command sessiondemo shows the unified game session (pkg/session): the same runner plays one Game (tic-tac-toe) between any Participants β€” here a tvcp-ai brain against another brain, then a brain against a scripted bot.
solantype command
Command solantype shows two ways to set the myFront4Solan4 font: glyphs printed ADJACENT fuse their box borders into one continuous woven ornament/line, while a SPACE between them separates the letters into legible text.
Command solantype shows two ways to set the myFront4Solan4 font: glyphs printed ADJACENT fuse their box borders into one continuous woven ornament/line, while a SPACE between them separates the letters into legible text.
streamdemo command
Command streamdemo shows the streaming tvcp-ai transport (pkg/stream): a brain PUSHES a sequence of responses over Server-Sent Events on one connection.
Command streamdemo shows the streaming tvcp-ai transport (pkg/stream): a brain PUSHES a sequence of responses over Server-Sent Events on one connection.
tangram7demo command
Command tangram7demo renders the AUTHENTIC seven-piece geometric tangram: the canonical square (verified to tile) and an exploded tray of all seven pieces.
Command tangram7demo renders the AUTHENTIC seven-piece geometric tangram: the canonical square (verified to tile) and an exploded tray of all seven pieces.
tangram7fig command
Command tangram7fig renders the authored tangram7 figures (square, cat, swan) to PNGs and a combined menagerie sheet, printing each figure's verification.
Command tangram7fig renders the authored tangram7 figures (square, cat, swan) to PNGs and a combined menagerie sheet, printing each figure's verification.
tangrambench command
Command tangrambench is a spatial-reasoning benchmark for the tvcp-ai protocol.
Command tangrambench is a spatial-reasoning benchmark for the tvcp-ai protocol.
tangramcraft command
Command tangramcraft is a terminal "gate" prototype: you build a figure from the glyph ring while the AI (a pose-invariant classifier) names what you are becoming and reads your address; on completion the gate "locks" onto a known creature.
Command tangramcraft is a terminal "gate" prototype: you build a figure from the glyph ring while the AI (a pose-invariant classifier) names what you are becoming and reads your address; on completion the gate "locks" onto a known creature.
tangramdemo command
Command tangramdemo proves the tangram idea end to end: ONE small set of sub-cell pieces (β—€β—₯β—£β—’ β–€β–„β–Œβ– β–žβ–š β–ˆ) composes into many figures, every figure is checked against the tangram rule (pieces meet edge to edge, never stacking), procedural creatures are grown from a seed, and one figure MORPHS into another as a stream of semantic P-frames (cat -> swan), saved as a GIF.
Command tangramdemo proves the tangram idea end to end: ONE small set of sub-cell pieces (β—€β—₯β—£β—’ β–€β–„β–Œβ– β–žβ–š β–ˆ) composes into many figures, every figure is checked against the tangram rule (pieces meet edge to edge, never stacking), procedural creatures are grown from a seed, and one figure MORPHS into another as a stream of semantic P-frames (cat -> swan), saved as a GIF.
tangramgallery command
Command tangramgallery renders our figures as a framed "gallery wall": the catalog plus many procedural Creature(seed) figures, each in a wooden frame on a warm wall β€” the kind of geometric gallery the project naturally generates, where every framed piece is a figure with its own number/address.
Command tangramgallery renders our figures as a framed "gallery wall": the catalog plus many procedural Creature(seed) figures, each in a wooden frame on a warm wall β€” the kind of geometric gallery the project naturally generates, where every framed piece is a figure with its own number/address.
tangramhard command
Command tangramhard benchmarks silhouette-only ("hard") tangram solving: given just the figure's outline (no per-cell glyphs), recover the tiling.
Command tangramhard benchmarks silhouette-only ("hard") tangram solving: given just the figure's outline (no per-cell glyphs), recover the tiling.
tangramnum command
Command tangramnum gives every tangram figure a unique NUMBER, the way the I Ching numbers its 64 hexagrams: read the figure's glyph grid row-major as a base-16 integer.
Command tangramnum gives every tangram figure a unique NUMBER, the way the I Ching numbers its 64 hexagrams: read the figure's glyph grid row-major as a base-16 integer.
tangramsong command
Command tangramsong is the third face of the project's "see, hear, summon" triad: it reads a tangram figure cell by cell (the same row-major reading that gives the figure its NUMBER), turns each cell into a note via pkg/sona, and writes BOTH a .wav you can hear and a .gif you can watch β€” the playhead sweeps the very cells you hear, while a piano-roll of the melody grows beneath.
Command tangramsong is the third face of the project's "see, hear, summon" triad: it reads a tangram figure cell by cell (the same row-major reading that gives the figure its NUMBER), turns each cell into a note via pkg/sona, and writes BOTH a .wav you can hear and a .gif you can watch β€” the playhead sweeps the very cells you hear, while a piano-roll of the melody grows beneath.
tangramzoo command
Command tangramzoo renders the sixteen-figure tangram address book to a sheet and prints each figure's address and canonical id.
Command tangramzoo renders the sixteen-figure tangram address book to a sheet and prints each figure's address and canonical id.
tournament command
Command tournament runs a spectated tic-tac-toe LEAGUE (pkg/tournament over pkg/session): several participants β€” a minimax brain and a few scripted bots β€” play round-robin, home and away, and the standings print out.
Command tournament runs a spectated tic-tac-toe LEAGUE (pkg/tournament over pkg/session): several participants β€” a minimax brain and a few scripted bots β€” play round-robin, home and away, and the standings print out.
tvcp command
unodemo command
Command unodemo runs two reference brains through a full game of UNO on the session runner (pkg/session) β€” the first game on the frame with HIDDEN INFORMATION (each player sees only its own hand) and CHANCE (a seed-shuffled deck).
Command unodemo runs two reference brains through a full game of UNO on the session runner (pkg/session) β€” the first game on the frame with HIDDEN INFORMATION (each player sees only its own hand) and CHANCE (a seed-shuffled deck).
vocabdemo command
Command vocabdemo shows the plural, localizable vocabulary (pkg/vocab): one canonical scene spoken in several languages.
Command vocabdemo shows the plural, localizable vocabulary (pkg/vocab): one canonical scene spoken in several languages.
watch command
Command watch is the project's headline scenario, fused into ONE experience: two neural-or-reference commanders fight an arena match; the match is broadcast as a lossy SEMANTIC VIDEO CALL (pkg/arenacast + pkg/semvideo); a spectator reconstructs it; the events become a byte CHRONICLE (pkg/chronicle) shown as a live caption; and the match's energy is SONIFIED (pkg/sona) to a melody.
Command watch is the project's headline scenario, fused into ONE experience: two neural-or-reference commanders fight an arena match; the match is broadcast as a lossy SEMANTIC VIDEO CALL (pkg/arenacast + pkg/semvideo); a spectator reconstructs it; the events become a byte CHRONICLE (pkg/chronicle) shown as a live caption; and the match's energy is SONIFIED (pkg/sona) to a melody.
wordledemo command
Command wordledemo shows the reference brain playing WORDLE on the session runner (pkg/session) β€” the first SOLITAIRE game on the same frame that runs tic-tac-toe and Connect Four.
Command wordledemo shows the reference brain playing WORDLE on the session runner (pkg/session) β€” the first SOLITAIRE game on the same frame that runs tic-tac-toe and Connect Four.
worldai command
Command worldai drives the 3-D world through the tvcp-ai protocol: each tick a brain receives a Brief of the world (game "world") and returns directives {fold,rise,spin,camera}; the world physics applies them and renders the frame.
Command worldai drives the 3-D world through the tvcp-ai protocol: each tick a brain receives a Brief of the world (game "world") and returns directives {fold,rise,spin,camera}; the world physics applies them and renders the frame.
worldloop command
Command worldloop runs the closed loop: a Brain emits the next 51-byte world state each tick, the states ship as one deltastream over Reed-Solomon, a burst is injected and recovered, and every state is rendered into a 3-D frame.
Command worldloop runs the closed loop: a Brain emits the next 51-byte world state each tick, the states ship as one deltastream over Reed-Solomon, a burst is injected and recovered, and every state is rendered into a 3-D frame.
internal
aisource
BrainBackend bridges the open tvcp-ai/1 brain protocol (pkg/brain) to the device.NeuralBackend seam added by the generative pipeline.
BrainBackend bridges the open tvcp-ai/1 brain protocol (pkg/brain) to the device.NeuralBackend seam added by the generative pipeline.
audio/reactive
Package reactive extracts compact spectral features from audio frames so the graphics layer can react to sound (roadmap C4): a plasma that pulses to a voice, or a prompt that shifts with energy.
Package reactive extracts compact spectral features from audio frames so the graphics layer can react to sound (roadmap C4): a plasma that pulses to a voice, or a prompt that shifts with energy.
avatar
Package avatar implements the ultra-low-bandwidth "neural avatar" path (roadmap C5): instead of transmitting video, the sender extracts compact face KEYPOINTS and ships only those; the receiver reconstructs the face from the keypoints plus a one-time reference image, using a generative model.
Package avatar implements the ultra-low-bandwidth "neural avatar" path (roadmap C5): instead of transmitting video, the sender extracts compact face KEYPOINTS and ships only those; the receiver reconstructs the face from the keypoints plus a one-time reference image, using a generative model.
raysource
Package raysource exposes the pkg/raytrace CPU ray tracer as a device.FrameGenerator, so the whole terminal-video pipeline (preview, send, call, group calls, recording) can use a live ray-traced 3-D scene as its "camera": synthesized pixels, no capture, no GPU.
Package raysource exposes the pkg/raytrace CPU ray tracer as a device.FrameGenerator, so the whole terminal-video pipeline (preview, send, call, group calls, recording) can use a live ray-traced 3-D scene as its "camera": synthesized pixels, no capture, no GPU.
sfu
vision
Package vision provides image-analysis primitives for graphics overlays (roadmap C3).
Package vision provides image-analysis primitives for graphics overlays (roadmap C3).
pkg
acl
Package acl is a small agent communication layer in the FIPA-ACL spirit: agents exchange PERFORMATIVES (cfp, propose, accept, reject, inform...) to NEGOTIATE rather than merely compete.
Package acl is a small agent communication layer in the FIPA-ACL spirit: agents exchange PERFORMATIVES (cfp, propose, accept, reject, inform...) to NEGOTIATE rather than merely compete.
alttext
Package alttext realizes the project's accessibility isomorphism: because a pseudo-image IS a small structured description, every spec can emit its own human-readable alt-text.
Package alttext realizes the project's accessibility isomorphism: because a pseudo-image IS a small structured description, every spec can emit its own human-readable alt-text.
anyorder
Package anyorder is the MDLM idea on the project's verifiable substrate: a figure is reconstructed by revealing ANCHOR cells in information order (the most discriminating cell next) rather than left-to-right.
Package anyorder is the MDLM idea on the project's verifiable substrate: a figure is reconstructed by revealing ANCHOR cells in information order (the most discriminating cell next) rather than left-to-right.
arecibo
Package arecibo builds the FULL Lingua-Cosmica frame: a single message that carries not only a figure and a self-check, but the ALPHABET ITSELF β€” an in-frame legend giving each symbol's pixel shape (sub-cell coverage bitmap).
Package arecibo builds the FULL Lingua-Cosmica frame: a single message that carries not only a figure and a self-check, but the ALPHABET ITSELF β€” an in-frame legend giving each symbol's pixel shape (sub-cell coverage bitmap).
arena
Package arena is the seed of "origami Warcraft": a multi-entity isometric world where every unit is a coloured tangram block on a terrain board and each side is driven by a Commander - the reference bot, or an LLM agent over tvcp-ai.
Package arena is the seed of "origami Warcraft": a multi-entity isometric world where every unit is a coloured tangram block on a terrain board and each side is driven by a Commander - the reference bot, or an LLM agent over tvcp-ai.
arenacast
Package arenacast is the bridge that fuses the three bodies of the project into one core: it renders a live pkg/arena match as a marks pseudo-image (pkg/pseudo), so the agent-world can be streamed through pkg/semvideo exactly like a TVCP semantic video call β€” a keyframe plus semframe P-frame deltas wrapped in Reed-Solomon, a few bytes per tick that survive packet loss.
Package arenacast is the bridge that fuses the three bodies of the project into one core: it renders a live pkg/arena match as a marks pseudo-image (pkg/pseudo), so the agent-world can be streamed through pkg/semvideo exactly like a TVCP semantic video call β€” a keyframe plus semframe P-frame deltas wrapped in Reed-Solomon, a few bytes per tick that survive packet loss.
automode
Package automode picks, per cell, the sub-cell glyph whose coverage best matches a target mask β€” dynamically switching between triangles, diagonals, halves and quadrants instead of using quadrants alone.
Package automode picks, per cell, the sub-cell glyph whose coverage best matches a target mask β€” dynamically switching between triangles, diagonals, halves and quadrants instead of using quadrants alone.
blazon
Package blazon compiles a (simplified) heraldic blazon β€” the medieval language for describing a coat of arms β€” into a pkg/pseudo spec that renders in the terminal.
Package blazon compiles a (simplified) heraldic blazon β€” the medieval language for describing a coat of arms β€” into a pkg/pseudo spec that renders in the terminal.
braille
Package braille bridges the sub-cell glyph alphabet to Unicode Braille: each marks cell is sampled on a 2x4 dot grid (via glyphset coverage) and mapped to a Braille pattern (U+2800..U+28FF).
Package braille bridges the sub-cell glyph alphabet to Unicode Braille: each marks cell is sampled on a 2x4 dot grid (via glyphset coverage) and mapped to a Braille pattern (U+2800..U+28FF).
brain
Package brain defines an OPEN, transport-agnostic format ("tvcp-ai/1") for connecting ANY neural network as a partner for games and visual messages.
Package brain defines an OPEN, transport-agnostic format ("tvcp-ai/1") for connecting ANY neural network as a partner for games and visual messages.
chronicle
Package chronicle turns an arena match into an emergent NARRATIVE.
Package chronicle turns an arena match into an emergent NARRATIVE.
debate
Package debate stages a judged AI debate: two Debaters argue a topic over several rounds (each seeing the opponent's last point), and a Judge scores each round; the runner returns a transcript and a verdict.
Package debate stages a judged AI debate: two Debaters argue a topic over several rounds (each seeing the opponent's last point), and a Judge scores each round; the runner returns a transcript and a verdict.
deltastream
Package deltastream is the synthesis primitive shared by the three pseudo-3D paths: a generic keyframe + byte-delta animation codec over interleaved Reed-Solomon.
Package deltastream is the synthesis primitive shared by the three pseudo-3D paths: a generic keyframe + byte-delta animation codec over interleaved Reed-Solomon.
discovery
Package discovery implements the DNS-TXT peer discovery sketched in docs/dns-peer-discovery.md: instead of sharing a cryptographic Yggdrasil address out of band, a user publishes a TXT record at _tvcp.<user>.<domain> and is reached by a human handle like alice@example.com.
Package discovery implements the DNS-TXT peer discovery sketched in docs/dns-peer-discovery.md: instead of sharing a cryptographic Yggdrasil address out of band, a user publishes a TXT record at _tvcp.<user>.<domain> and is reached by a human handle like alice@example.com.
dtn
Package dtn is a delay-tolerant ("deep space") profile for the semantic stream: each semvideo packet is a BUNDLE that is stored and forwarded only during intermittent CONTACT windows (a satellite pass, a planetary line-of-sight), and is dropped if it waits longer than its time-to-live.
Package dtn is a delay-tolerant ("deep space") profile for the semantic stream: each semvideo packet is a BUNDLE that is stored and forwarded only during intermittent CONTACT windows (a satellite pass, a planetary line-of-sight), and is dropped if it waits longer than its time-to-live.
fleet
Package fleet is a decision-support engine for watching machines β€” robots, vehicles, equipment β€” the way info150's triage4 watches a casualty: ingest a few normalised observations, fuse them into a severity, track each unit against its own baseline so a sudden change escalates, and emit a short operator cue.
Package fleet is a decision-support engine for watching machines β€” robots, vehicles, equipment β€” the way info150's triage4 watches a casualty: ingest a few normalised observations, fuse them into a severity, track each unit against its own baseline so a sudden change escalates, and emit a short operator cue.
fold
Package fold lifts a flat tangram7 figure into a pseudo-3D relief: each piece is extruded to its own height and the solid is drawn in isometric projection.
Package fold lifts a flat tangram7 figure into a pseudo-3D relief: each piece is extruded to its own height and the solid is drawn in isometric projection.
glyphqr
Package glyphqr encodes data into a "glyph-QR": a grid of glyph-symbols carrying Reed-Solomon parity, so the code decodes correctly even when several cells are wrong (a model misplaced a piece, or the picture is damaged).
Package glyphqr encodes data into a "glyph-QR": a grid of glyph-symbols carrying Reed-Solomon parity, so the code decodes correctly even when several cells are wrong (a model misplaced a piece, or the picture is damaged).
glyphset
Package glyphset turns the hand-drawn sub-cell alphabet (dots, diagonals, triangles, crossed box) into two things:
Package glyphset turns the hand-drawn sub-cell alphabet (dots, diagonals, triangles, crossed box) into two things:
lincos
Package lincos builds a self-describing "Lingua Cosmica" frame for a tangram figure: a run of bytes that teaches a receiver how to read it from first principles, in the spirit of Freudenthal's Lincos and CosmicOS.
Package lincos builds a self-describing "Lingua Cosmica" frame for a tangram figure: a run of bytes that teaches a receiver how to read it from first principles, in the spirit of Freudenthal's Lincos and CosmicOS.
microfont
Package microfont is a tiny built-in 3x5 bitmap font so the project's image previews and GIFs can carry text labels with NO system font dependency β€” the "mini raster font from masks" the GLYPH_applications note asked for.
Package microfont is a tiny built-in 3x5 bitmap font so the project's image previews and GIFs can carry text labels with NO system font dependency β€” the "mini raster font from masks" the GLYPH_applications note asked for.
painter
Package painter is a tiny, on-device "painter" β€” the no-network counterpart to a diffusion model.
Package painter is a tiny, on-device "painter" β€” the no-network counterpart to a diffusion model.
planbrain
Package planbrain exposes the arena lookahead Planner as a tvcp-ai/1 brain, so "the planner is reachable by URL".
Package planbrain exposes the arena lookahead Planner as a tvcp-ai/1 brain, so "the planner is reachable by URL".
pseudo
Package pseudo turns the compact, text-friendly "pseudo-image" descriptions that ANY ordinary (non-diffusion) language model can emit into real graphics: a terminal.Frame for the live renderer, or an image.Image for the BABE video path.
Package pseudo turns the compact, text-friendly "pseudo-image" descriptions that ANY ordinary (non-diffusion) language model can emit into real graphics: a terminal.Frame for the live renderer, or an image.Image for the BABE video path.
raydir
fly.go assembles the pieces into one experience: walking through a world the brain authors and extends on the fly.
fly.go assembles the pieces into one experience: walking through a world the brain authors and extends on the fly.
raytrace
adaptive.go renders with per-pixel ADAPTIVE sampling.
adaptive.go renders with per-pixel ADAPTIVE sampling.
registry
Package registry is a tiny "DNS for brains": a directory of tvcp-ai/1 backends with capability negotiation.
Package registry is a tiny "DNS for brains": a directory of tvcp-ai/1 backends with capability negotiation.
relief
Package relief is path 2 of the pseudo-3D program: 2.5D shading of a marks grid.
Package relief is path 2 of the pseudo-3D program: 2.5D shading of a marks grid.
scene
Package scene renders the tvcp-ai draw-DSL (a small JSON drawing language) into the repo's terminal.Frame.
Package scene renders the tvcp-ai draw-DSL (a small JSON drawing language) into the repo's terminal.Frame.
scene3d
Package scene3d is path 3 of the pseudo-3D program: a tiny 3-D scene graph.
Package scene3d is path 3 of the pseudo-3D program: a tiny 3-D scene graph.
semdist
Package semdist measures RATE vs DISTORTION OF MEANING β€” not of pixels.
Package semdist measures RATE vs DISTORTION OF MEANING β€” not of pixels.
semframe
Package semframe encodes SEMANTIC P-frames for pseudo-images: instead of sending a whole spec each frame, send only the cells (and palette) that changed since the previous frame.
Package semframe encodes SEMANTIC P-frames for pseudo-images: instead of sending a whole spec each frame, send only the cells (and palette) that changed since the previous frame.
semvideo
Package semvideo closes the loop between TVCP's video path and the symbolic substrate: it sends a "video call" not as H.264 frames but as a stream of compact pseudo-image (marks) specs β€” a keyframe followed by semframe P-frame deltas β€” each wrapped in Reed-Solomon parity (pkg/glyphqr).
Package semvideo closes the loop between TVCP's video path and the symbolic substrate: it sends a "video call" not as H.264 frames but as a stream of compact pseudo-image (marks) specs β€” a keyframe followed by semframe P-frame deltas β€” each wrapped in Reed-Solomon parity (pkg/glyphqr).
session
Package session is the unifying frame the experimental games/bots/agents notes asked for: ONE turn-based game runner where every player β€” a human, a scripted bot, or a live tvcp-ai brain β€” is just a Participant, and any game is a Game.
Package session is the unifying frame the experimental games/bots/agents notes asked for: ONE turn-based game runner where every player β€” a human, a scripted bot, or a live tvcp-ai brain β€” is just a Participant, and any game is a Game.
sign
Package sign adds message authentication and explicit versioning to the tvcp-ai/1 transport.
Package sign adds message authentication and explicit versioning to the tvcp-ai/1 transport.
sketch
Package sketch is a HIGH-LEVEL, weak-model-friendly drawing format: named colors plus a handful of shapes.
Package sketch is a HIGH-LEVEL, weak-model-friendly drawing format: named colors plus a handful of shapes.
sona
Package sona sonifies a tangram figure: it reads the figure's cells in the same row-major order that pkg/tangram reads them to form the figure's NUMBER, and turns each cell-digit into a musical note.
Package sona sonifies a tangram figure: it reads the figure's cells in the same row-major order that pkg/tangram reads them to form the figure's NUMBER, and turns each cell-digit into a musical note.
stream
Package stream adds a streaming transport to tvcp-ai/1: instead of one request -> one response, a brain can PUSH a sequence of responses (animation frames, world ticks, progressive results) as Server-Sent Events over a single HTTP connection.
Package stream adds a streaming transport to tvcp-ai/1: instead of one request -> one response, a brain can PUSH a sequence of responses (animation frames, world ticks, progressive results) as Server-Sent Events over a single HTTP connection.
tangram
Package tangram builds pictures the way the Chinese game does: from a small, fixed set of sub-cell pieces (the glyphset alphabet β€” triangles β—€β—₯β—£β—’, halves β–€β–„β–Œβ–, the diagonals β–žβ–š and the full block β–ˆ) placed on a cell grid.
Package tangram builds pictures the way the Chinese game does: from a small, fixed set of sub-cell pieces (the glyphset alphabet β€” triangles β—€β—₯β—£β—’, halves β–€β–„β–Œβ–, the diagonals β–žβ–š and the full block β–ˆ) placed on a cell grid.
tangram7
Package tangram7 is the AUTHENTIC seven-piece geometric tangram: two large triangles, one medium, two small, the square and the parallelogram β€” as continuous polygons with free 45-degree rotation and placement, rendered as filled silhouettes.
Package tangram7 is the AUTHENTIC seven-piece geometric tangram: two large triangles, one medium, two small, the square and the parallelogram β€” as continuous polygons with free 45-degree rotation and placement, rendered as filled silhouettes.
tournament
Package tournament runs a round-robin league over pkg/session: any set of Participants β€” brains, bots, or human bridges β€” play a Game both home and away, and the package tallies standings (win 3, draw 1) and a match log.
Package tournament runs a round-robin league over pkg/session: any set of Participants β€” brains, bots, or human bridges β€” play a Game both home and away, and the package tallies standings (win 3, draw 1) and a match log.
visualchat
Package visualchat defines the runtime control surface for "communicating in pictures" (roadmap B2): a small, transport-agnostic Steer message that changes what a neural image source generates mid-stream, and a Controller that applies steers to the async neural generator.
Package visualchat defines the runtime control surface for "communicating in pictures" (roadmap B2): a small, transport-agnostic Steer message that changes what a neural image source generates mid-stream, and a Controller that applies steers to the async neural generator.
vocab
Package vocab makes the project's symbol vocabulary PLURAL and localizable.
Package vocab makes the project's symbol vocabulary PLURAL and localizable.
world
Package world closes the loop: a State is the whole pseudo-3D scene as one 51-byte record (fold angles + relief height + scene items + camera yaw); a Brain reads a State and emits the next one.
Package world closes the loop: a State is the whole pseudo-3D scene as one 51-byte record (fold angles + relief height + scene items + camera yaw); a Brain reads a State and emits the next one.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL