bench2

package module

v0.2.1 Latest Latest Go to latest Published: Mar 28, 2025 License: Unlicense Imports: 5 Imported by: 0

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

gitlab.com/cznic/sqlite-bench2

Links

Open Source Insights

README ¶

The SQLite Packages 25.03 Benchmarks Game

This repository is a modification of go-sqlite-bench, forked at 4df8bfd.

Category: non database/sql drivers

For the database/sql drivers cateogory please see modernc.org/sqlite-bench

[[TOC]]

Packages

These packages are benchmarked

craw, crawshaw.io/sqlite@v0.3.2, a CGO-based solution. This is not a database/sql driver.
eaton, github.com/eatonphil/gosqlite@v0.10.0, a CGO-based solution. This is not a database/sql driver. (added by @c4rlo)
sqinn, github.com/cvilsmeier/sqinn-go@v1.2.0, a solution without CGO. It uses github.com/cvilsmeier/sqinn@v1.1.41 to access SQLite database files. This is not a database/sql driver. This package is unfortunately not benchmarked, it is OOM killed even on a 16GB machine, but most of our builders are 8GB only.
zombie, zombiezen.com/go/sqlite@v1.4.0, a rewrite of the crawshaw driver. A pure Go solution based on the SQLite C code transpilled to Go using ccgo/v4. This is not a database/sql driver.

A general note on benchmarks and this repository

Do not trust benchmarks, write your own. These specific benchmarks are modelled after someone's very own database usage scenarios. Your scenarios may be totally different.

Each test is run twice, the recorded values are the averages of the two runs. This is not very scientific.

Database Schema

The test database consist of the following tables and indices:

PRAGMA journal_mode=DELETE;
PRAGMA synchronous=FULL;
PRAGMA foreign_keys=1;
PRAGMA busy_timeout=5000;

CREATE TABLE users (
    id INTEGER PRIMARY KEY NOT NULL,
    created INTEGER NOT NULL,
    email TEXT NOT NULL,
    active INTEGER NOT NULL);
CREATE INDEX users_created ON users(created);

CREATE TABLE articles (
    id INTEGER PRIMARY KEY NOT NULL,
    created INTEGER NOT NULL,  
    userId INTEGER NOT NULL REFERENCES users(id),
    text TEXT NOT NULL);
CREATE INDEX articles_created ON articles(created);
CREATE INDEX articles_userId ON articles(userId);

CREATE TABLE comments (
    id INTEGER PRIMARY KEY NOT NULL,
    created INTEGER NOT NULL,
    articleId INTEGER NOT NULL REFERENCES articles(id),
    text TEXT NOT NULL);
CREATE INDEX comments_created ON comments(created);
CREATE INDEX comments_articleId ON comments(articleId);

Benchmark Results

Result times are measured in milliseconds. Lower numbers indicate better performance.

Simple Benchmark

Insert 1 million user rows in one database transaction. Then query all users once.

Complex Benchmark

Insert 200 users in one database transaction. Then insert 20000 articles (100 articles for each user) in another transaction. Then insert 400000 comments (20 comments for each article) in another transaction. Then query all users, articles and comments in one big JOIN statement.

Many Benchmark

Insert N users in one database transaction. Then query all users 1000 times. This benchmark is used to simluate a read-heavy use case.

Large Benchmark

Insert 10000 users with N bytes of row content. Then query all users. This benchmark is used to simluate reading of large (gigabytes) databases.

Concurrent Benchmark

Insert one million users. Then have N goroutines query all users. This benchmark is used to simulate concurrent reads.

4GB RAM builders

On 32 bit architectures and on the linux/ppc64le builder - to avoid OOM

the Large benchmark uses 2.5k users instead of a 10k.
the Concurrent benchmark uses 250k users instead of a million.

Caveat emptor

Mistakes happen. If you find anything wrong about the results please report the problem at the issue tracker, thank you.

tl;dr: Scorecard

The best time in every test, shown in bold in the tables below individaul graphs, is worth one point. The scorecard shows where and how many points were awarded to each benchmarked package.

Total score ties are ranked alphabetically. Please read those as one shared rank.

This score is an ad hoc metric. Its usefulness is possibly at most in showing how the scores may evolve in time when new, improved versions of packages will get benchmarked.

	Total	Simple	Complex	Many	Large	Concurrent
1. zombie	`134`	`16`	`16`	`48`	`8`	`46`
2. eaton	`54`	`12`	`9`	`0`	`33`	`0`
3. craw	`20`	`4`	`7`	`0`	`7`	`2`

Disclaimer: The score and the ranking do not show how will any package perform in your particular application on a particular system.

Results: darwin/amd64

OS: macOS Sequoia 15.3.2
CPU: Apple M1, 2020
GOMAXPROCS: 8
RAM: 8GB
Disk: APPLE SSD AP0256Q Media (251GB)

darwin/amd64-simple-png