zip

Documentation

Overview

Package zip provides functions for creating and extracting module zip files.

Module zip files have several restrictions listed below. These are necessary to ensure that module zip files can be extracted consistently on supported platforms and file systems.

• All file paths within a zip file must start with "<module>@<version>/", where "<module>" is the module path and "<version>" is the version. The module path must be valid (see golang.org/x/mod/module.CheckPath). The version must be valid and canonical (see golang.org/x/mod/module.CanonicalVersion). The path must have a major version suffix consistent with the version (see golang.org/x/mod/module.Check). The part of the file path after the "<module>@<version>/" prefix must be valid (see golang.org/x/mod/module.CheckFilePath).

• No two file paths may be equal under Unicode case-folding (see strings.EqualFold).

• A go.mod file may or may not appear in the top-level directory. If present, it must be named "go.mod", not any other case. Files named "go.mod" are not allowed in any other directory.

• The total size in bytes of a module zip file may be at most MaxZipFile bytes (500 MiB). The total uncompressed size of the files within the zip may also be at most MaxZipFile bytes.

• Each file's uncompressed size must match its declared 64-bit uncompressed size in the zip file header.

• If the zip contains files named "<module>@<version>/go.mod" or "<module>@<version>/LICENSE", their sizes in bytes may be at most MaxGoMod or MaxLICENSE, respectively (both are 16 MiB).

• Empty directories are ignored. File permissions and timestamps are also ignored.

• Symbolic links and other irregular files are not allowed.

Note that this package does not provide hashing functionality. See golang.org/x/mod/sumdb/dirhash.

Index

• Constants
• func Create(w io.Writer, m module.Version, files []File) (err error)
• func CreateFromDir(w io.Writer, m module.Version, dir string) (err error)
• func CreateFromVCS(w io.Writer, m module.Version, repoRoot, revision, subdir string) (err error)
• func Unzip(dir string, m module.Version, zipFile string) (err error)
• type CheckedFiles
  • func CheckDir(dir string) (CheckedFiles, error)
  • func CheckFiles(files []File) (CheckedFiles, error)
  • func CheckZip(m module.Version, zipFile string) (CheckedFiles, error)
  • func (cf CheckedFiles) Err() error
• type File
• type FileError
  • func (e FileError) Error() string
  • func (e FileError) Unwrap() error
• type FileErrorList
  • func (el FileErrorList) Error() string
• type UnrecognizedVCSError
  • func (e *UnrecognizedVCSError) Error() string

Constants

const (
	// MaxZipFile is the maximum size in bytes of a module zip file. The
	// go command will report an error if either the zip file or its extracted
	// content is larger than this.
	MaxZipFile = 500 << 20

	// MaxGoMod is the maximum size in bytes of a go.mod file within a
	// module zip file.
	MaxGoMod = 16 << 20

	// MaxLICENSE is the maximum size in bytes of a LICENSE file within a
	// module zip file.
	MaxLICENSE = 16 << 20
)

Functions

func Create

func Create(w io.Writer, m module.Version, files []File) (err error)

Create builds a zip archive for module m from an abstract list of files and writes it to w.

Create verifies the restrictions described in the package documentation and should not produce an archive that Unzip cannot extract. Create does not include files in the output archive if they don't belong in the module zip. In particular, Create will not include files in modules found in subdirectories, most files in vendor directories, or irregular files (such as symbolic links) in the output archive.

func CreateFromDir

func CreateFromDir(w io.Writer, m module.Version, dir string) (err error)

CreateFromDir creates a module zip file for module m from the contents of a directory, dir. The zip content is written to w.

CreateFromDir verifies the restrictions described in the package documentation and should not produce an archive that Unzip cannot extract. CreateFromDir does not include files in the output archive if they don't belong in the module zip. In particular, CreateFromDir will not include files in modules found in subdirectories, most files in vendor directories, or irregular files (such as symbolic links) in the output archive. Additionally, unlike Create, CreateFromDir will not include directories named ".bzr", ".git", ".hg", or ".svn".

func CreateFromVCS

func CreateFromVCS(w io.Writer, m module.Version, repoRoot, revision, subdir string) (err error)

CreateFromVCS creates a module zip file for module m from the contents of a VCS repository stored locally. The zip content is written to w.

repoRoot must be an absolute path to the base of the repository, such as "/Users/some-user/some-repo".

revision is the revision of the repository to create the zip from. Examples include HEAD or SHA sums for git repositories.

subdir must be the relative path from the base of the repository, such as "sub/dir". To create a zip from the base of the repository, pass an empty string.

If CreateFromVCS returns UnrecognizedVCSError, consider falling back to CreateFromDir.

func Unzip

func Unzip(dir string, m module.Version, zipFile string) (err error)

Unzip extracts the contents of a module zip file to a directory.

Unzip checks all restrictions listed in the package documentation and returns an error if the zip archive is not valid. In some cases, files may be written to dir before an error is returned (for example, if a file's uncompressed size does not match its declared size).

dir may or may not exist: Unzip will create it and any missing parent directories if it doesn't exist. If dir exists, it must be empty.

Types

type CheckedFiles

type CheckedFiles struct {
	// Valid is a list of file paths that should be included in a zip file.
	Valid []string

	// Omitted is a list of files that are ignored when creating a module zip
	// file, along with the reason each file is ignored.
	Omitted []FileError

	// Invalid is a list of files that should not be included in a module zip
	// file, along with the reason each file is invalid.
	Invalid []FileError

	// SizeError is non-nil if the total uncompressed size of the valid files
	// exceeds the module zip size limit or if the zip file itself exceeds the
	// limit.
	SizeError error
}

CheckedFiles reports whether a set of files satisfy the name and size constraints required by module zip files. The constraints are listed in the package documentation.

Functions that produce this report may include slightly different sets of files. See documentation for CheckFiles, CheckDir, and CheckZip for details.

func CheckDir

func CheckDir(dir string) (CheckedFiles, error)

CheckDir reports whether the files in dir satisfy the name and size constraints listed in the package documentation. The returned CheckedFiles record contains lists of valid, invalid, and omitted files. If a directory is omitted (for example, a nested module or vendor directory), it will appear in the omitted list, but its files won't be listed.

CheckDir returns an error if it encounters an I/O error or if the returned CheckedFiles does not describe a valid module zip file (according to CheckedFiles.Err). The returned CheckedFiles is still populated when such an error is returned.

Note that CheckDir will not open any files, so CreateFromDir may still fail when CheckDir is successful due to I/O errors.

func CheckFiles

func CheckFiles(files []File) (CheckedFiles, error)

CheckFiles reports whether a list of files satisfy the name and size constraints listed in the package documentation. The returned CheckedFiles record contains lists of valid, invalid, and omitted files. Every file in the given list will be included in exactly one of those lists.

CheckFiles returns an error if the returned CheckedFiles does not describe a valid module zip file (according to CheckedFiles.Err). The returned CheckedFiles is still populated when an error is returned.

Note that CheckFiles will not open any files, so Create may still fail when CheckFiles is successful due to I/O errors and reported size differences.

func CheckZip

func CheckZip(m module.Version, zipFile string) (CheckedFiles, error)

CheckZip reports whether the files contained in a zip file satisfy the name and size constraints listed in the package documentation.

CheckZip returns an error if the returned CheckedFiles does not describe a valid module zip file (according to CheckedFiles.Err). The returned CheckedFiles is still populated when an error is returned. CheckZip will also return an error if the module path or version is malformed or if it encounters an error reading the zip file.

Note that CheckZip does not read individual files, so Unzip may still fail when CheckZip is successful due to I/O errors.

func (CheckedFiles) Err

func (cf CheckedFiles) Err() error

Err returns an error if CheckedFiles does not describe a valid module zip file. [CheckedFiles.SizeError] is returned if that field is set. A FileErrorList is returned if there are one or more invalid files. Other errors may be returned in the future.

type File

type File interface {
	// Path returns a clean slash-separated relative path from the module root
	// directory to the file.
	Path() string

	// Lstat returns information about the file. If the file is a symbolic link,
	// Lstat returns information about the link itself, not the file it points to.
	Lstat() (os.FileInfo, error)

	// Open provides access to the data within a regular file. Open may return
	// an error if called on a directory or symbolic link.
	Open() (io.ReadCloser, error)
}

File provides an abstraction for a file in a directory, zip, or anything else that looks like a file.

type FileError

type FileError struct {
	Path string
	Err  error
}

func (FileError) Error

func (e FileError) Error() string

func (FileError) Unwrap

func (e FileError) Unwrap() error

type FileErrorList

type FileErrorList []FileError

func (FileErrorList) Error

func (el FileErrorList) Error() string

type UnrecognizedVCSError

type UnrecognizedVCSError struct {
	RepoRoot string
}

UnrecognizedVCSError indicates that no recognized version control system was found in the given directory.

func (*UnrecognizedVCSError) Error

func (e *UnrecognizedVCSError) Error() string