Help us shape the future of Go! Take the 2026 Go Developer Survey

Why Go
- Case Studies
  
  Common problems companies solve with Go
- Use Cases
  
  Stories about how and why companies use Go
- Security
  
  How Go can help keep you secure by default
Learn
Docs
- Effective Go
  
  Tips for writing clear, performant, and idiomatic Go code
- Go User Manual
  
  A complete introduction to building software with Go
- Standard library
  
  Reference documentation for Go's standard library
- Release Notes
  
  Learn what's new in each Go release
- API
  
  Reference documentation for the pkg.go.dev API
Packages
Community
- Recorded Talks
  
  Videos from prior events
- Meetups
  
  Meet other local Go developers
- Conferences
  
  Learn and network with Go developers from around the world
- Go blog
  
  The Go project's official blog.
- Go project
  
  Get help and stay informed from Go
- Get connected

llama

package module

v0.0.5 Latest Latest Go to latest Published: Apr 20, 2024 License: Apache-2.0 Imports: 2 Imported by: 0

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/stanchino/go-llama-cpp

Links

Open Source Insights

Documentation ¶

Index ¶

type GoLlama
- func NewGoLlama(options Options) *GoLlama
- func (l *GoLlama) Free()
type Options
- func (o *Options) ToInitParams() unsafe.Pointer

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

This section is empty.

Types ¶

type GoLlama ¶

type GoLlama struct {
	State   unsafe.Pointer
	Params  unsafe.Pointer
	Options Options
}

func NewGoLlama ¶

func NewGoLlama(options Options) *GoLlama

func (*GoLlama) Free ¶

func (l *GoLlama) Free()

type Options ¶

type Options struct {
	ModelName string
	UseMMap   bool
}

func (*Options) ToInitParams ¶

func (o *Options) ToInitParams() unsafe.Pointer

Source Files ¶

View all Source files

Directories ¶

Path	Synopsis
examples
predictor
tokenizer