runner

README

Build

Setup Environment

Windows (x64)

Setup MSYS2

• winget install --id=MSYS2.MSYS2 -e
• add C:\msys64\usr\bin and C:\msys64\mingw64\bin to your PATH
• pacman -Syu
• pacman -S make mingw-w64-x86_64-gcc
• restart terminal

Setup GO Env

go env -w CGO_ENABLED=1

Windows (arm64)

Setup MSYS2

winget install --id=MSYS2.MSYS2 -e

Add MSYS2 bins to PATH (run in PowerShell):

[Environment]::SetEnvironmentVariable(
    "PATH",
    $env:PATH + ";C:\msys64\usr\bin;C:\msys64\clangarm64\bin",
    "User"
)
# Close and reopen PowerShell for the change to take effect

Open an MSYS2 shell and run:

pacman -Syu
pacman -S make mingw-w64-clang-aarch64-clang

Setup GO Env

go env -w CGO_ENABLED=1
go env -w CC=clang.exe
go env -w CXX=clang++.exe

MacOS / Linux

install make, gcc or clang via your package manager.

Setup GO Env

go env -w CGO_ENABLED=1

Install nexasdk-bridge

There are two ways to install the bridge library:

1. From S3 bucket

make download

1. From local files

make link

---

Build Project

Once the prerequisites and bridge library are installed, build the project:

make build

---

Run Project

Enable debug log

$env:NEXA_LOG="debug" # powershell

export NEXA_LOG="debug" # bash

Pull model without interactive

nexa pull <model>[:<quant>] --model-type <model-type>

Pull model from model hub

nexa pull <model>
nexa pull <model> --model-hub s3 # pull from specify model hub, [volces|modelscope|s3|hf]

Import model from local filesystem

# hf download <model> --local-dir /path/to/modeldir
nexa pull <model> --model-hub localfs --local-path /path/to/modeldir

---

Test Project

pip install psutil

python tests/run.py