README
¶
Please read http://codesearch.debian.net/research/bsc-thesis.pdf first!
cmd/ dcs-unpack - tool to unpack a debian source mirror dcs-index - tool to create an index from a debian source mirror compute-ranking - computes the ranking of each package/file dcs-web - the code search web application itself index-backend - simple server which provides (a shard) of the index to dcs-web source-backend - simple server which provides the debian source to dcs-web
debian/ The Debian packaging, which currently is very hacky due to Go packaging being hard in Debian currently. Patches welcome.
index/ Copied from code.google.com/p/codesearch. Parts were re-written in hand-optimized C code (posting list decoding).
regexp/ Copied from code.google.com/p/codesearch. Returns results in a data structure instead of printing them to stdout.
static/ Static assets + HTML files (FAQ etc.)
Directories
¶
| Path | Synopsis |
|---|---|
|
cmd
|
|
|
dcs
Binary dcs is the swiss-army knife for Debian Code Search.
|
Binary dcs is the swiss-army knife for Debian Code Search. |
|
dcs-compute-ranking
vim:ts=4:sw=4:noexpandtab
|
vim:ts=4:sw=4:noexpandtab |
|
dcs-feeder
Takes care of feeding packages to the dcs-package-importer processes running on index/source backends.
|
Takes care of feeding packages to the dcs-package-importer processes running on index/source backends. |
|
dcs-package-importer
Accepts Debian packages via HTTP, unpacks, strips and indexes them.
|
Accepts Debian packages via HTTP, unpacks, strips and indexes them. |
|
dcs-reshard
Generates shell scripts to be run on each old shard.
|
Generates shell scripts to be run on each old shard. |
|
dcs-source-backend
vim:ts=4:sw=4:noexpandtab
|
vim:ts=4:sw=4:noexpandtab |
|
dcs-web
vim:ts=4:sw=4:noexpandtab vim:ts=4:sw=4:noexpandtab These handlers serve server-rendered pages for clients without JavaScript.
|
vim:ts=4:sw=4:noexpandtab vim:ts=4:sw=4:noexpandtab These handlers serve server-rendered pages for clients without JavaScript. |
|
dcs-web/common
common flags for dcs-web
|
common flags for dcs-web |
|
dcs-web/health
Health checking for sources.debian.net (and potentially other services in the future), so that we can reliably redirect to the service when it is available and fall back to our own /show if not.
|
Health checking for sources.debian.net (and potentially other services in the future), so that we can reliably redirect to the service when it is available and fall back to our own /show if not. |
|
dcs-web/search
vim:ts=4:sw=4:noexpandtab
|
vim:ts=4:sw=4:noexpandtab |
|
dcs-web/show
vim:ts=4:sw=4:noexpandtab
|
vim:ts=4:sw=4:noexpandtab |
|
contrib
|
|
|
genprodcerts
Generates self-signed TLS certificates to be used a DCS production installation.
|
Generates self-signed TLS certificates to be used a DCS production installation. |
|
dpkgversion is a pure-go implementation of dpkg version string functions (parsing, comparison) which is compatible with dpkg(1).
|
dpkgversion is a pure-go implementation of dpkg version string functions (parsing, comparison) which is compatible with dpkg(1). |
|
Provides the current goroutine stacks via HTTP.
|
Provides the current goroutine stacks via HTTP. |
|
Encapsulates common RPC server setup.
|
Encapsulates common RPC server setup. |
|
vim:ts=4:sw=4:noet
|
vim:ts=4:sw=4:noet |
|
internal
|
|
|
localdcs
Generates self-signed TLS certificates to be used a DCS production installation.
|
Generates self-signed TLS certificates to be used a DCS production installation. |
|
rpctest
Package rpctest provides convenience functions for common RPC testing setups.
|
Package rpctest provides convenience functions for common RPC testing setups. |
|
Post-ranking happens on the source backend (because it has the source files in the kernel’s page cache).
|
Post-ranking happens on the source backend (because it has the source files in the kernel’s page cache). |
|
Package regexp implements regular expression search tuned for use in grep-like programs.
|
Package regexp implements regular expression search tuned for use in grep-like programs. |
|
stringpool provides a pool of string pointers, ensuring that each string is stored only once in memory.
|
stringpool provides a pool of string pointers, ensuring that each string is stored only once in memory. |
|
Exports runtime variables using prometheus.
|
Exports runtime variables using prometheus. |