Documentation ¶
Index ¶
- func ArchiveAndUploadFilesToS3(fileTree fs.FS, name, s3Base string, logger *zap.SugaredLogger) error
- func DeleteArchivedFileFromS3(name, s3Base string, logger *zap.SugaredLogger) error
- func DownloadAndExtractFilesFromS3(name, localBase, s3Base string, logger *zap.SugaredLogger) error
- func DownloadFilesFromSource(args *DownloadFromSourceArgs, rootNameGetter func(afero.Fs) (string, error)) (fs.FS, error)
- func PreloadFiles(name, localBase, s3Base string, logger *zap.SugaredLogger) error
- func SaveAndUploadFiles(fileTree fs.FS, name, localBase, s3Base string, logger *zap.SugaredLogger) error
- type DownloadFromSourceArgs
- type FileInfo
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func DeleteArchivedFileFromS3 ¶
func DeleteArchivedFileFromS3(name, s3Base string, logger *zap.SugaredLogger) error
func DownloadAndExtractFilesFromS3 ¶
func DownloadAndExtractFilesFromS3(name, localBase, s3Base string, logger *zap.SugaredLogger) error
func DownloadFilesFromSource ¶
func PreloadFiles ¶
func PreloadFiles(name, localBase, s3Base string, logger *zap.SugaredLogger) error
PreloadFiles downloads a tarball from object storage and extracts it to a local path for further usage. It happens only if files do not exist in local disk.
func SaveAndUploadFiles ¶
func SaveAndUploadFiles(fileTree fs.FS, name, localBase, s3Base string, logger *zap.SugaredLogger) error
SaveAndUploadFiles saves a tree of files to local disk, at the same time, archives them and uploads to object storage.
Types ¶
type DownloadFromSourceArgs ¶
Click to show internal directories.
Click to hide internal directories.