spinifex

module
v1.19.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Sep 8, 2026 License: AGPL-3.0

README

Go License mulgadc.com

What is Spinifex? · Platform · Deploy · AWS Compatibility · Live Demo · Components · Architecture · Installation · Docs


Spinifex: the open, AWS-compatible cloud you run yourself

Spinifex, built by Mulga, recreates the AWS services your software already uses (EC2, EBS, S3, VPC, IAM) on infrastructure you control. Move workloads off the hyperscalers, run AI at a fraction of the cost, or take the cloud to the edge, without rewriting a line. The exact build you ship to AWS, Spinifex serves on your own hardware: same APIs, same Terraform, same SDKs.

What is Spinifex?

Spinifex is an open-source infrastructure platform that recreates the AWS service surface (EC2, EBS, S3, VPC, IAM) on bare-metal, edge, and on-premises environments. Run cloud-native software without a hyperscaler.

Built for teams that need:

  • The AWS tooling you already use (AWS CLI, SDKs, Terraform), with nothing to rewrite
  • Full control of the stack: your hardware, your network, your data, your keys
  • A cloud that keeps running offline, through disconnection, with no external control plane
  • An open core (AGPL-3.0), auditable and yours to keep, with no lock-in

You change where your software runs, not what it is.

The Platform

From commodity hardware up to unmodified AWS tooling, every layer is replaceable and yours to own.

Three Ways To Deploy

The same AWS-compatible platform runs in three shapes. Pick the one that matches your hardware.

Neocloud

Lift and shift onto a partner Neocloud without rewriting workloads. GPU capacity (H100 / H200 / B200), cheaper, available now. Change an endpoint, keep the software.

On-premise

Host Spinifex on your own hardware in your own data centre. You get a multi-node HA cluster integrated with your storage and networking, so the stack, the data, and the jurisdiction stay yours.

Edge

Cloud where the cloud can't reach. Air-gapped sites, vehicles, vessels, factories, and clinics. Compute next to the data, running through disconnection, on hardware you own. The same AWS APIs your software already uses.

AWS Compatibility

Spinifex speaks the AWS API surface. The AWS SDKs, AWS CLI, and Terraform all work unchanged, whether you deploy at the edge, on-premise, or on a partner Neocloud.

Service What it is Status
EC2 Compute Available
EBS Block Storage Available
S3 Object Storage Available
VPC Networking Available
IAM Identity & Auth Available
ALB / NLB Load Balancers Available
EKS Kubernetes Available
ECR Container Registry Available
ECS Container Service Available
RDS Databases Available
Bedrock AI Deployment Q3 2026

Roadmap items ship under the same AWS API surface. Code written for AWS today keeps working the moment they land. Track what's shipped in the release notes.

Live Demo

Create a live sandbox in under a minute. The fastest way to experience the stack. Try Spinifex against one of your own workloads on infrastructure we run for you.

  • Live in under a minute. No card, no install.
  • Yours for 72 hours to test and experiment.
  • Real AWS-compatible endpoint, access keys and console.
  • EC2, EBS, S3, VPC, IAM, EKS and RDS, ready to call.
  • Point your existing AWS CLI or Terraform straight at it.

Sign up at https://mulgadc.com/signup

Core Components

Spinifex (Compute and Platform Services – EC2, EKS, ECS, RDS)

Spinifex is a minimal VM orchestration layer built on top of QEMU, exposing an EC2 compatible API. It manages lifecycle operations like start, stop, and terminate through QEMU's QMP interface. Designed to be straightforward and scriptable, Spinifex lets you launch VMs with the AWS CLI, SDKs, or Terraform, without Kubernetes or a heavyweight orchestrator.

The managed services build on that same instance layer. An EKS node group, an ECS container instance, and an RDS database are Spinifex VMs on your own hardware, each driven through its own AWS API.

  • EC2 – VM lifecycle on bare metal, cloud-init and IMDS metadata, key pairs, tags, spot instances, capacity reservations, and GPU passthrough
  • EKS – Managed Kubernetes on k3s, with HA control planes, managed node groups, cluster add-ons, an OIDC provider, and IAM access entries
  • ECS – Task and service scheduling across container instances, with awsvpc ENIs, capacity providers, rolling deployments, and GPU-aware placement
  • ECR – Private container registry backed by Predastore, with content-addressed blobs deduplicated per account and lifecycle policies
  • RDS – Managed PostgreSQL and MariaDB, with parameter groups, automated backups, and DNS endpoints served by Northstar
  • ALB / NLB – Layer 7 load balancing on HAProxy and layer 4 on nginx stream, with health checks and ACM-issued listener certificates
  • VPC and IAM – OVN-backed networking and security groups, with roles, policies, and SigV4 auth applied across every service
Viperblock (Block Storage – EBS Alternative)

Viperblock is a high-performance, WAL-backed block storage service that replicates volumes across multiple nodes. It's built for reliability and speed, with support for snapshots, recovery, and direct connection to QEMU instances using NBD or virtio-blk.

  • Fast, durable virtual disks
  • Replication for resilience
  • Exposed over NBD or embedded in VMs
  • High performance WAL logs on local NVMe drives, reducing IO traffic to S3
  • In-memory read/write block cache
Predastore (Object Storage – S3-Compatible)

Predastore is a fully S3-compatible object storage system. It supports the AWS S3 API, including Signature V4 authentication, multipart uploads, and Terraform provisioning. Predastore chunks data and distributes it across nodes using Reed-Solomon erasure coding, so it survives node loss and suits large-scale or low-bandwidth sites.

  • S3-compatible API and auth
  • Multipart uploads, streaming reads/writes
  • Data redundancy with Reed-Solomon encoding
Northstar (Authoritative DNS)

Northstar is a lightweight authoritative DNS server that handles both internal service discovery and public-facing DNS for a Spinifex cluster. Zones are human-readable TOML files, served from the local filesystem or synced from Predastore, keeping DNS configuration in the same object storage as the rest of your infrastructure.

  • Authoritative DNS over UDP, TCP, and DNS-over-TLS
  • Service discovery for cluster components via SRV records
  • Zone files stored locally or in S3-compatible storage

Architecture at a Glance

Every AWS API call is authenticated at the gateway, published to a NATS subject, and answered by whichever daemon claims it. Daemons are stateless: scale horizontally by starting more. No etcd, no Kubernetes, no external control plane. Just systemd units, a NATS cluster, and your hardware. Deep dive: docs/DESIGN.md.

Self-hosted Installation

Installation requires an Ubuntu 26.04 or Debian 13 system. See the detailed documentation at docs.mulgadc.com for installing Spinifex.

Bare Metal ISO

The recommended installation is a bootable x86 installer for bare-metal hardware.

curl -fLO https://iso.mulgadc.com/spinifex.iso

Follow the USB install guide to write the ISO to USB and install on your hardware.

Single Node Install

Prerequisite: Spinifex requires a Linux bridge configured on the host for VM networking. See the single-node install guide for setup details.

curl -fsSL https://install.mulgadc.com | bash

sudo /usr/local/share/spinifex/setup-ovn.sh --management

sudo spx admin init --node node1 --nodes 1

sudo systemctl start spinifex.target

export AWS_PROFILE=spinifex

aws ec2 describe-instance-types
Development Setup

For a complete development environment see the Source Install documentation.

Spinifex UI

Spinifex ships with a built-in web console, an optional alternative to the AWS CLI, SDKs, and Terraform. If you know the AWS Management Console, the Spinifex UI fills the same role: a browser-based view of your instances, volumes, buckets, VPCs, and IAM resources, without leaving your own network.

Spinifex web console dashboard

Each node serves the console on port 3000 over TLS, and it comes up with spinifex.target:

  • Same API, different surface. The UI issues the same AWS SigV4 calls the CLI does, so RBAC, audit trails, and IAM policies apply the same way.
  • Single sign-on against your AWS credentials. Log in with the access keys from ~/.aws/credentials on the node where Spinifex is installed. There is no separate user database.
  • Self-hosted, works offline. The Spinifex binary embeds the UI and each node serves it directly, with no external CDN or analytics calls.

For the full walkthrough, covering first-time TLS certificate trust, login, and a feature tour, see Launching the Web UI in the cluster setup guide.

Development Philosophy

Built by Engineers, For Engineers

Spinifex is developed by experienced infrastructure engineers with deep AWS expertise, including former AWS team members who understand the intricacies of building production-grade cloud services. Our team brings decades of combined experience from AWS, enterprise infrastructure, and edge computing environments.

AI-Assisted Development

Spinifex is architected and implemented by experienced engineers, with Claude Code accelerating certain development tasks. The split keeps the quality and reliability standards that production infrastructure demands:

How We Use Claude Code:

  • Code Generation: Boilerplate AWS API structures and handlers
  • Documentation: Comprehensive development guides and API documentation
  • Testing: Test case generation and validation scenarios
  • Refactoring: Large-scale code restructuring and optimization

What Remains Human-Driven:

  • Architecture Decisions: Core system design and scalability choices
  • Security Implementation: Authentication, encryption, and threat modeling
  • Performance Optimization: Real-world performance tuning and benchmarking
  • Production Operations: Deployment strategies and operational procedures

Trademarks

"AWS", "Amazon Web Services", and all related service names (EC2, EBS, S3, VPC, IAM, and others) are trademarks of Amazon.com, Inc. or its affiliates. Mulga Defense Corporation and Spinifex are independent and not affiliated with, endorsed by, or sponsored by Amazon.com, Inc. or Amazon Web Services, Inc. References to AWS services describe interoperability and compatibility only.

License

Spinifex is open source under the GNU Affero General Public License v3.0, with a commercial license available. You're free to use, modify, and deploy it anywhere you need reliable infrastructure without depending on centralized cloud platforms.

Directories

Path Synopsis
cmd
dhcptest command
dhcptest is a diagnostic tool that runs a DHCP DORA handshake using the same nclient4 library and options that spinifex-vpcd uses for gateway pool leases.
dhcptest is a diagnostic tool that runs a DHCP DORA handshake using the same nclient4 library and options that spinifex-vpcd uses for gateway pool leases.
ecr-credential-provider command
ecr-credential-provider is a kubelet exec credential provider that lets a Spinifex EKS worker node pull images from the internal Spinifex ECR registry.
ecr-credential-provider is a kubelet exec credential provider that lets a Spinifex EKS worker node pull images from the internal Spinifex ECR registry.
ecs-agent command
ecs-agent runs inside a Spinifex ECS container instance (a guest VM booted from the ECS-AMI, with containerd baked in).
ecs-agent runs inside a Spinifex ECS container instance (a guest VM booted from the ECS-AMI, with containerd baked in).
ecs-agent/credentials
Package credentials supplies AWS SigV4 credentials to the ecs-agent.
Package credentials supplies AWS SigV4 credentials to the ecs-agent.
ecs-agent/runtime
Package runtime is the ecs-agent's container-runtime seam.
Package runtime is the ecs-agent's container-runtime seam.
eks-gateway-fetch command
eks-gateway-fetch runs inside the EKS K3s control-plane VM and fetches a control-plane resource from the host through the AWS gateway, instead of dialing core NATS directly.
eks-gateway-fetch runs inside the EKS K3s control-plane VM and fetches a control-plane resource from the host through the AWS gateway, instead of dialing core NATS directly.
eks-gateway-publish command
eks-gateway-publish runs inside the EKS K3s control-plane VM and relays a single publication to the host through the AWS gateway, instead of dialing core NATS directly.
eks-gateway-publish runs inside the EKS K3s control-plane VM and relays a single publication to the host through the AWS gateway, instead of dialing core NATS directly.
eks-konnectivity-cert command
Command eks-konnectivity-cert mints, then reuses, an ECDSA-P256 serving certificate for the on-node konnectivity-server, signed by the K3s cluster CA.
Command eks-konnectivity-cert mints, then reuses, an ECDSA-P256 serving certificate for the on-node konnectivity-server, signed by the K3s cluster CA.
eks-token-webhook command
eks-token-webhook is the K8s TokenReview webhook authenticator baked into the eks-server AMI.
eks-token-webhook is the K8s TokenReview webhook authenticator baked into the eks-server AMI.
eks-webhook-cert command
Command eks-webhook-cert mints, then reuses, a self-signed ECDSA-P256 serving certificate for an in-cluster admission webhook and prints its base64 PEM so the addon renderer can embed it as the webhook Secret + each caBundle.
Command eks-webhook-cert mints, then reuses, a self-signed ECDSA-P256 serving certificate for an in-cluster admission webhook and prints its base64 PEM so the addon renderer can embed it as the webhook Secret + each caBundle.
installer command
installer/autoinstall
Package autoinstall reads headless install parameters from environment variables exported by spinifex-init.sh from the kernel cmdline.
Package autoinstall reads headless install parameters from environment variables exported by spinifex-init.sh from the kernel cmdline.
installer/branding
Package branding centralises Mulga/Spinifex visual identity constants used by the installer TUI.
Package branding centralises Mulga/Spinifex visual identity constants used by the installer TUI.
installer/firstboot
Package firstboot writes the oneshot systemd service and configuration that completes Spinifex provisioning on the first real boot after installation.
Package firstboot writes the oneshot systemd service and configuration that completes Spinifex provisioning on the first real boot after installation.
installer/install
Package install performs the disk installation steps after the UI has collected configuration.
Package install performs the disk installation steps after the UI has collected configuration.
installer/netprobe
Package netprobe identifies physical network interfaces by hardware rather than kernel name, so an operator choosing between eno1, ens1f0np0 and ens1f1np1 can tell the 1gbe Broadcom from the 25gbe Mellanox.
Package netprobe identifies physical network interfaces by hardware rather than kernel name, so an operator choosing between eno1, ens1f0np0 and ens1f1np1 can tell the 1gbe Broadcom from the 25gbe Mellanox.
installer/systemd
Package systemd writes systemd unit files and drop-ins into an installed system root during the Spinifex ISO installation process.
Package systemd writes systemd unit files and drop-ins into an installed system root during the Spinifex ISO installation process.
installer/ui
Package ui presents the interactive installer TUI using bubbletea and lipgloss.
Package ui presents the interactive installer TUI using bubbletea and lipgloss.
lb-agent command
lb-agent runs inside load balancer VMs and manages HAProxy configuration.
lb-agent runs inside load balancer VMs and manages HAProxy configuration.
rds-agent command
rds-agent runs inside a Spinifex RDS instance.
rds-agent runs inside a Spinifex RDS instance.
spinifex command
spx-loadgen command
spx-loadgen drives a measured request load at a Spinifex control plane and reports per-operation latency distributions as JSON and as a summary.
spx-loadgen drives a measured request load at a Spinifex control plane and reports per-operation latency distributions as JSON and as a summary.
docs
security/network-connections
Package networkconnections embeds the inbound-listener inventory doc that lives alongside it, so test binaries can read it on nodes with no Go toolchain.
Package networkconnections embeds the inbound-listener inventory doc that lives alongside it, so test binaries can read it on nodes with no Go toolchain.
internal
awsmodel
Package awsmodel loads the AWS api-2.json service definitions used by the conformance suite.
Package awsmodel loads the AWS api-2.json service definitions used by the conformance suite.
ecrauth
Package ecrauth mints ECR registry credentials by SigV4-signing GetAuthorizationToken against the Spinifex AWS gateway's ECR endpoint and decoding the returned AWS:<jwt> token into Basic-auth parts.
Package ecrauth mints ECR registry credentials by SigV4-signing GetAuthorizationToken against the Spinifex AWS gateway's ECR endpoint and decoding the returned AWS:<jwt> token into Basic-auth parts.
ecsgw
Package ecsgw is the on-VM SigV4 client the ecs-agent uses to reach the AWS gateway over HTTPS instead of connecting to NATS directly.
Package ecsgw is the on-VM SigV4 client the ecs-agent uses to reach the AWS gateway over HTTPS instead of connecting to NATS directly.
eksgw
Package eksgw is the on-VM SigV4 client used by EKS helpers (eks-gateway-publish, eks-token-webhook) to POST over HTTPS to the AWS gateway instead of NATS.
Package eksgw is the on-VM SigV4 client used by EKS helpers (eks-gateway-publish, eks-token-webhook) to POST over HTTPS to the AWS gateway instead of NATS.
guestenv
Package guestenv reads the static settings an in-guest binary is configured with at launch.
Package guestenv reads the static settings an in-guest binary is configured with at launch.
gwsign
Package gwsign SigV4-signs on-VM requests to the AWS gateway.
Package gwsign SigV4-signs on-VM requests to the AWS gateway.
imdscreds
Package imdscreds fetches AWS instance-role credentials from the in-guest IMDS endpoint (169.254.169.254) using IMDSv2.
Package imdscreds fetches AWS instance-role credentials from the in-guest IMDS endpoint (169.254.169.254) using IMDSv2.
rdsgw
Package rdsgw is the on-VM SigV4 client the rds-agent uses to reach the AWS gateway over HTTPS, keeping NATS host-internal.
Package rdsgw is the on-VM SigV4 client the rds-agent uses to reach the AWS gateway over HTTPS, keeping NATS host-internal.
stsauth
Package stsauth mints task-role credentials by SigV4-signing sts:AssumeRole against the Spinifex AWS gateway.
Package stsauth mints task-role credentials by SigV4-signing sts:AssumeRole against the Spinifex AWS gateway.
spinifex
accountteardown
Package accountteardown removes everything an account owns, in dependency order, and then the account itself.
Package accountteardown removes everything an account owns, in dependency order, and then the account itself.
arn
Package arn builds AWS resource ARNs.
Package arn builds AWS resource ARNs.
ebsmetadata
Package ebsmetadata owns Spinifex's control-plane view of EBS resources.
Package ebsmetadata owns Spinifex's control-plane view of EBS resources.
ebsprovider
Package ebsprovider defines Spinifex's provider-neutral block-storage contract.
Package ebsprovider defines Spinifex's provider-neutral block-storage contract.
ebsprovider/conformance
Package conformance exercises the ebsprovider.EBSProvider contract itself, not any one implementation's internals, so it can run unmodified against every implementation of the interface; no assertion here has changed from the original suite it was moved out of.
Package conformance exercises the ebsprovider.EBSProvider contract itself, not any one implementation's internals, so it can run unmodified against every implementation of the interface; no assertion here has changed from the original suite it was moved out of.
ebsprovider/hostile
Package hostile wraps any EBSProvider in one that misbehaves on purpose.
Package hostile wraps any EBSProvider in one that misbehaves on purpose.
ebsprovider/natsserve
Package natsserve is the provider-neutral NATS server for the ebs.provider.v1.* wire contract defined by spinifex/ebsprovider.
Package natsserve is the provider-neutral NATS server for the ebs.provider.v1.* wire contract defined by spinifex/ebsprovider.
ebsprovider/nullprovider
Package nullprovider serves the EBSProvider contract without any storage behind it.
Package nullprovider serves the EBSProvider contract without any storage behind it.
gateway
Package gateway provides the AWS-compatible API gateway for the Spinifex platform.
Package gateway provides the AWS-compatible API gateway for the Spinifex platform.
gateway/acm
Package gateway_acm is the HTTP-side glue between awsgw and the ACM handlers.
Package gateway_acm is the HTTP-side glue between awsgw and the ACM handlers.
gateway/bedrock
Package gateway_bedrock is the HTTP-side glue between awsgw and the Ochre (bedrock / bedrock-runtime) handlers.
Package gateway_bedrock is the HTTP-side glue between awsgw and the Ochre (bedrock / bedrock-runtime) handlers.
gateway/bedrock/hfhub
Package hfhub is a minimal Hugging Face Hub client: resolve a repo revision to an immutable commit SHA, list its file tree, and stream individual files.
Package hfhub is a minimal Hugging Face Hub client: resolve a repo revision to an immutable commit SHA, list its file tree, and stream individual files.
gateway/bodyscope
Package bodyscope reads the handful of identifier fields a policy scope resolver needs out of a JSON request body, without deserialising the typed input the handler will build from the same bytes.
Package bodyscope reads the handful of identifier fields a policy scope resolver needs out of a JSON request body, without deserialising the typed input the handler will build from the same bytes.
gateway/ec2
Package gateway_ec2 resolves the resource ARNs an EC2 request authorizes against.
Package gateway_ec2 resolves the resource ARNs an EC2 request authorizes against.
gateway/ec2/idem
Package gateway_ec2_idem holds the client-token plumbing shared by the EC2 gateway: the KV bucket every EC2 action's token records live in, and the extraction of a token and parameter hash from an SDK input struct.
Package gateway_ec2_idem holds the client-token plumbing shared by the EC2 gateway: the KV bucket every EC2 action's token records live in, and the extraction of a token and parameter hash from an SDK input struct.
gateway/ec2/spotinstance
Package gateway_ec2_spotinstance provides the gateway-side orchestration for AWS-compatible Spot Instance Requests.
Package gateway_ec2_spotinstance provides the gateway-side orchestration for AWS-compatible Spot Instance Requests.
gateway/ecr
Package gateway_ecr is the HTTP-side glue for the OCI Distribution Spec v2 registry surface (/v2/*) served by awsgw.
Package gateway_ecr is the HTTP-side glue for the OCI Distribution Spec v2 registry surface (/v2/*) served by awsgw.
gateway/ecrapi
Package gateway_ecrapi is the HTTP-side glue for the ECR control plane: the AWS JSON 1.1 surface dispatched by X-Amz-Target (AmazonEC2ContainerRegistry_V20150921.<Action>), matching aws-sdk-go's service/ecr request shape.
Package gateway_ecrapi is the HTTP-side glue for the ECR control plane: the AWS JSON 1.1 surface dispatched by X-Amz-Target (AmazonEC2ContainerRegistry_V20150921.<Action>), matching aws-sdk-go's service/ecr request shape.
gateway/ecrauth
Package gateway_ecrauth implements the ECR auth bridge: it mints and verifies the self-contained ES256 JWT that GetAuthorizationToken issues and the /v2/* registry surface accepts (Authorization: Bearer | Basic AWS:<jwt>).
Package gateway_ecrauth implements the ECR auth bridge: it mints and verifies the self-contained ES256 JWT that GetAuthorizationToken issues and the /v2/* registry surface accepts (Authorization: Bearer | Basic AWS:<jwt>).
gateway/ecs
Package gateway_ecs is the HTTP-side glue for the ECS control plane: the AWS JSON 1.1 surface dispatched by X-Amz-Target (AmazonEC2ContainerServiceV20141113.<Action>), matching aws-sdk-go's service/ecs request shape.
Package gateway_ecs is the HTTP-side glue for the ECS control plane: the AWS JSON 1.1 surface dispatched by X-Amz-Target (AmazonEC2ContainerServiceV20141113.<Action>), matching aws-sdk-go's service/ecs request shape.
gateway/eks
Package gateway_eks is the HTTP-side glue between awsgw and the EKS handlers.
Package gateway_eks is the HTTP-side glue between awsgw and the EKS handlers.
gateway/iam
Package gateway_iam contains IAM request validation and authorization helpers.
Package gateway_iam contains IAM request validation and authorization helpers.
gateway/rds
Package gateway_rds implements the RDS surface on awsgw.
Package gateway_rds implements the RDS surface on awsgw.
gateway/spx
Package spx implements spinifex platform-level gateway handlers (version, node status, VM inventory) that are distinct from the AWS-compatible APIs.
Package spx implements spinifex platform-level gateway handlers (version, node status, VM inventory) that are distinct from the AWS-compatible APIs.
gateway/tagging
Package gateway_tagging is the HTTP-side glue between awsgw and the Resource Groups Tagging API.
Package gateway_tagging is the HTTP-side glue between awsgw and the Resource Groups Tagging API.
gpu
handlers/bedrock
Package handlers_bedrock owns placement and lifecycle of self-hosted vLLM serving VMs: it decides where a model's endpoint runs, launches and probes the VM, and persists the result as the single source of truth other components (the gateway's inference path) read over NATS.
Package handlers_bedrock owns placement and lifecycle of self-hosted vLLM serving VMs: it decides where a model's endpoint runs, launches and probes the VM, and persists the result as the single source of truth other components (the gateway's inference path) read over NATS.
handlers/dns
Package dns is the control-plane DNS record writer.
Package dns is the control-plane DNS record writer.
handlers/ec2/volumestate
Package volumestate reads and writes the control-plane-owned attachment state for an EBS volume, persisted to a per-volume state.json object.
Package volumestate reads and writes the control-plane-owned attachment state for an EBS volume, persisted to a per-volume state.json object.
handlers/ecr
Package ecr holds the ECR registry handlers and the predastore storage layout that backs them.
Package ecr holds the ECR registry handlers and the predastore storage layout that backs them.
handlers/ecs/bus
Package bus defines the Layer-2 internal scheduler↔agent NATS subjects and wire payloads for the ECS control plane (ecs-v1.md Q14).
Package bus defines the Layer-2 internal scheduler↔agent NATS subjects and wire payloads for the ECS control plane (ecs-v1.md Q14).
handlers/eks
Package handlers_eks implements the EKS control-plane API surface for Spinifex.
Package handlers_eks implements the EKS control-plane API surface for Spinifex.
handlers/iam/mock
Package mock provides an in-memory implementation of handlers_iam.SystemInstanceRoleEnsurer for tests.
Package mock provides an in-memory implementation of handlers_iam.SystemInstanceRoleEnsurer for tests.
handlers/ochrevector
Package handlers_ochrevector holds Ochre's tenant vector store: the pgvector backend, the KV index registry, and the create/delete/list/ reconcile orchestration over both.
Package handlers_ochrevector holds Ochre's tenant vector store: the pgvector backend, the KV index registry, and the create/delete/list/ reconcile orchestration over both.
handlers/quota
Package handlers_quota enforces per-account service quotas in the AWS gateway.
Package handlers_quota enforces per-account service quotas in the AWS gateway.
handlers/rds
Package handlers_rds holds the RDS control plane: the KV state layout, the ARN and lifecycle-status models, and the db.* instance-class facade over the platform's EC2 sizing table.
Package handlers_rds holds the RDS control plane: the KV state layout, the ARN and lifecycle-status models, and the db.* instance-class facade over the platform's EC2 sizing table.
handlers/sysinstance
Package sysinstance holds the boot-agnostic contract for system-managed VMs.
Package sysinstance holds the boot-agnostic contract for system-managed VMs.
handlers/systemvpc
Package handlers_systemvpc builds the managed VPCs Spinifex platform components run their own VMs in — the analogue of AWS's hidden managed-account VPCs.
Package handlers_systemvpc builds the managed VPCs Spinifex platform components run their own VMs in — the analogue of AWS's hidden managed-account VPCs.
hostdns
Package hostdns points the node's own host resolver at the local northstar listener so the Spinifex authoritative zones (ELB/EKS names in the base zone and the AWS-parity private zone) resolve from the node itself, not just from guest VMs handed northstar over DHCP.
Package hostdns points the node's own host resolver at the local northstar listener so the Spinifex authoritative zones (ELB/EKS names in the base zone and the AWS-parity private zone) resolve from the node itself, not just from guest VMs handed northstar over DHCP.
idempotency
Package idempotency implements request idempotency over a TTL KV bucket: the first caller to present a token owns the work, and duplicates replay its result or wait for it.
Package idempotency implements request idempotency over a TTL KV bucket: the first caller to present a token owns the work, and duplicates replay its result or wait for it.
instancecache
Package instancecache is a read-only informer over the live instance record space: a cache of *vm.VM projections kept current by a JetStream KV watch and backstopped by a periodic whole-set resync.
Package instancecache is a read-only informer over the live instance record space: a cache of *vm.VM projections kept current by a JetStream KV watch and backstopped by a periodic whole-set resync.
kvlease
Package kvlease elects a single holder of a JetStream KV key.
Package kvlease elects a single holder of a JetStream KV key.
kvstore
Package kvstore provides a typed store over a single JetStream KV bucket: one memoised get-or-create accessor and a JSON codec for the record type, replacing the accessor each caller used to hand-roll.
Package kvstore provides a typed store over a single JetStream KV bucket: one memoised get-or-create accessor and a JSON codec for the record type, replacing the accessor each caller used to hand-roll.
kvutil
Package kvutil holds the shared NATS KeyValue helpers: bucket get-or-create at the cluster's replica count, bucket enumeration, and schema-version stamping.
Package kvutil holds the shared NATS KeyValue helpers: bucket get-or-create at the cluster's replica count, bucket enumeration, and schema-version stamping.
lbagent
Package lbagent implements the LB config agent that runs inside load balancer VMs.
Package lbagent implements the LB config agent that runs inside load balancer VMs.
loadgen
Package loadgen drives a measured request load at the control plane and reports per-operation latency distributions.
Package loadgen drives a measured request load at the control plane and reports per-operation latency distributions.
nbd
network/external
Package external is L5 of the spinifex network stack: VPC-facing external connectivity (IGW, EIP, NAT Gateway).
Package external is L5 of the spinifex network stack: VPC-facing external connectivity (IGW, EIP, NAT Gateway).
network/external/dhcp
Package dhcp provides an in-process DHCPv4 client (spinifex-vpcd) for single-attempt DORA/RENEW/RELEASE with KV-persisted leases.
Package dhcp provides an in-process DHCPv4 client (spinifex-vpcd) for single-attempt DORA/RENEW/RELEASE with KV-persisted leases.
network/host
Package host is L0 of the spinifex network stack: OVS bridges (br-int, br-ext), uplink port, and external CIDR.
Package host is L0 of the spinifex network stack: OVS bridges (br-int, br-ext), uplink port, and external CIDR.
network/invariants
Package invariants holds executable tests that pin the spinifex network layer tree to the safety and liveness invariants declared in ADR-0006 (docs/development/proposals/region-local-architecture/0006-spinifex-network-layer-contract.md).
Package invariants holds executable tests that pin the spinifex network layer tree to the safety and liveness invariants declared in ADR-0006 (docs/development/proposals/region-local-architecture/0006-spinifex-network-layer-contract.md).
network/listenerinventory
Package listenerinventory parses the "## 1.
Package listenerinventory parses the "## 1.
network/ovn
Package ovn is L1 of the spinifex network stack: the OVN Northbound DB client interface and implementations.
Package ovn is L1 of the spinifex network stack: the OVN Northbound DB client interface and implementations.
network/ovn/mock
Package mock provides an in-memory implementation of ovn.Client for tests.
Package mock provides an in-memory implementation of ovn.Client for tests.
network/ovn/nbdb
Package nbdb contains libovsdb model structs for the OVN Northbound tables used by Spinifex VPC networking.
Package nbdb contains libovsdb model structs for the OVN Northbound tables used by Spinifex VPC networking.
network/ovn/ovntest
Package ovntest boots an in-process OVN Northbound database for tests.
Package ovntest boots an in-process OVN Northbound database for tests.
network/policy
Package policy (L3) attaches data-plane policy — ACLs, NAT, routes — to L2 logical objects.
Package policy (L3) attaches data-plane policy — ACLs, NAT, routes — to L2 logical objects.
network/reconcile
Package reconcile is the network stack's intent-actual reconciliation layer.
Package reconcile is the network stack's intent-actual reconciliation layer.
network/subscribers
Package subscribers translates VPC lifecycle NATS events into calls against the network/{topology,policy,external} managers.
Package subscribers translates VPC lifecycle NATS events into calls against the network/{topology,policy,external} managers.
network/topology
Package topology is L2 of the spinifex network stack.
Package topology is L2 of the spinifex network stack.
objectstore
Package objectstore provides a common S3-like storage abstraction used by handlers to work with real backends (Predastore) or in-memory stores for testing.
Package objectstore provides a common S3-like storage abstraction used by handlers to work with real backends (Predastore) or in-memory stores for testing.
otelsetup
Package otelsetup carries spinifex's request instrumentation: the request counter/duration histogram, and a thin binding of the shared HTTP middleware to those instruments.
Package otelsetup carries spinifex's request instrumentation: the request counter/duration histogram, and a thin binding of the shared HTTP middleware to those instruments.
preflight
Package preflight verifies a host's managed helper scripts and sudoers grants — which a binary-swap deploy does not ship — against what this build of spinifex expects, comparing content so a stale asset is caught.
Package preflight verifies a host's managed helper scripts and sudoers grants — which a binary-swap deploy does not ship — against what this build of spinifex expects, comparing content so a stale asset is caught.
qmp
reconciler
Package reconciler runs a reconcile function on change rather than on a timer: it watches the KV buckets the function reads, coalesces a burst of updates into one pass, and falls back to a periodic resync so a gap in the watch cannot leave the world unconverged.
Package reconciler runs a reconcile function on change rather than on a timer: it watches the KV buckets the function reads, coalesces a burst of updates into one pass, and falls back to a periodic resync so a gap in the watch cannot leave the world unconverged.
resource
Package resource is the envelope a persisted control-plane record lives in: what an operator asked for, what a node observed, and the identity and lifecycle bookkeeping that is common to both.
Package resource is the envelope a persisted control-plane record lives in: what an operator asked for, what a node observed, and the identity and lifecycle bookkeeping that is common to both.
services/qemunbdd
Package qemunbdd implements ebsprovider.EBSProvider over qcow2 files and qemu-nbd.
Package qemunbdd implements ebsprovider.EBSProvider over qcow2 files and qemu-nbd.
services/qmpcollector
Package qmpcollector is the per-node guest-metrics producer: it discovers running VMs via their qmp-telemetry-*.json sidecar files, polls each VM's dedicated telemetry QMP socket (never the manager's control socket) plus host tap counters, and publishes CloudWatch-mappable series to NATS metrics.ec2.<instance-id>.
Package qmpcollector is the per-node guest-metrics producer: it discovers running VMs via their qmp-telemetry-*.json sidecar files, polls each VM's dedicated telemetry QMP socket (never the manager's control socket) plus host tap counters, and publishes CloudWatch-mappable series to NATS metrics.ec2.<instance-id>.
services/viperblockd/vbwire
Package vbwire is the contract between viperblockd and everything that has to read what it publishes: the NATS subjects it addresses, the shapes it puts on them, and the KV bucket recording which node holds a volume's only current copy.
Package vbwire is the contract between viperblockd and everything that has to read what it publishes: the NATS subjects it addresses, the shapes it puts on them, and the KV bucket recording which node holds a volume's only current copy.
tags
Package tags defines tag keys for Spinifex system-owned resources.
Package tags defines tag keys for Spinifex system-owned resources.
testutil/pagedstore
Package pagedstore provides an objectstore.ObjectStore fake that serves ListObjectsV2 across multiple deterministic pages, honouring ContinuationToken and IsTruncated the way a real paginating S3-compatible store does.
Package pagedstore provides an objectstore.ObjectStore fake that serves ListObjectsV2 across multiple deterministic pages, honouring ContinuationToken and IsTruncated the way a real paginating S3-compatible store does.
testutil/recordingstore
Package recordingstore provides an objectstore.ObjectStore fake that records every key it is asked to read and every prefix it is asked to list.
Package recordingstore provides an objectstore.ObjectStore fake that records every key it is asked to read and every prefix it is asked to list.
testutil/segscanoracle
Package segscanoracle is a storage-state oracle that runs the mulga umbrella repo's scripts/segscan against a copy of a real predastore node data dir, reporting live / dead-tombstoned / dead-orphan bytes per the on-disk .seg segments.
Package segscanoracle is a storage-state oracle that runs the mulga umbrella repo's scripts/segscan against a copy of a real predastore node data dir, reporting live / dead-tombstoned / dead-orphan bytes per the on-disk .seg segments.
testutil/vbscan
Package vbscan is a read-only storage-state oracle for viperblock volumes, driven directly over S3 rather than through any spinifex handler.
Package vbscan is a read-only storage-state oracle for viperblock volumes, driven directly over S3 rather than through any spinifex handler.
vm
vm/mock
Package mock provides a single shared in-memory fake for vm.StateStore, reused by every package that stands up a stopped/terminated instance store in its tests.
Package mock provides a single shared in-memory fake for vm.StateStore, reused by every package that stands up a stopped/terminated instance store in its tests.
tests
bench/ebsctl
Package ebsctl benchmarks EC2 control-plane volume-operation latency against a live Spinifex cluster under both [ebs] provider settings (embedded vs viperblockd), isolating API round-trip latency from time-to-desired-state settle time and tallying the error surface each provider produces.
Package ebsctl benchmarks EC2 control-plane volume-operation latency against a live Spinifex cluster under both [ebs] provider settings (embedded vs viperblockd), isolating API round-trip latency from time-to-desired-state settle time and tallying the error surface each provider produces.
bench/ebsctl/cmd/ebsctl-compare command
Command ebsctl-compare reads two ebsctl-bench result JSON files and emits a markdown comparison table (medians, p95s, deltas, sample counts, error rates, and a bootstrap-CI significance signal per operation).
Command ebsctl-compare reads two ebsctl-bench result JSON files and emits a markdown comparison table (medians, p95s, deltas, sample counts, error rates, and a bootstrap-CI significance signal per operation).
e2e/ddil
Package ddil is the root of the DDIL (Denied, Disrupted, Intermittent, Limited) E2E test harness.
Package ddil is the root of the DDIL (Denied, Disrupted, Intermittent, Limited) E2E test harness.
e2e/manifest-check
Package manifestcheck loads and validates spinifex/docs/service-interfaces.yaml.
Package manifestcheck loads and validates spinifex/docs/service-interfaces.yaml.
e2e/manifest-check/cmd/manifest-check command
Command manifest-check validates spinifex/docs/service-interfaces.yaml.
Command manifest-check validates spinifex/docs/service-interfaces.yaml.
e2e/manifest-lint
Package manifestlint implements the e2e manifest drift guards:
Package manifestlint implements the e2e manifest drift guards:
e2e/manifest-lint/cmd/manifest-lint command
Command manifest-lint runs the e2e manifest drift guards: fixture-create lint + NATS subject lint, both ratcheted against a checked-in baseline.
Command manifest-lint runs the e2e manifest drift guards: fixture-create lint + NATS subject lint, both ratcheted against a checked-in baseline.
e2e/select-suites
Package selectsuites derives the set of e2e suites a diff must exercise.
Package selectsuites derives the set of e2e suites a diff must exercise.
e2e/select-suites/cmd/select-suites command
Command select-suites prints the e2e suites a diff must run.
Command select-suites prints the e2e suites a diff must run.
fixtures/predastore
Package predastore starts a real predastore cluster for tests that need to exercise an actual S3-compatible backend rather than a mock.
Package predastore starts a real predastore cluster for tests that need to exercise an actual S3-compatible backend rather than a mock.
fixtures/scratch
Package scratch reclaims test scratch directories stranded in the system temp directory by earlier runs.
Package scratch reclaims test scratch directories stranded in the system temp directory by earlier runs.
fixtures/vpcd
Package vpcd builds the network managers a live vpcd runs, wired against a real in-process OVN Northbound DB (network/ovn/ovntest).
Package vpcd builds the network managers a live vpcd runs, wired against a real in-process OVN Northbound DB (network/ovn/ovntest).

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL