core

Documentation

Overview

Package core provides the core functionality for file finding and pattern matching.

Index

• Constants
• type FileContent
• type FileFinder
  • func NewFileFinder(includes, excludes []string, followSymlinks bool) *FileFinder
  • func (ff *FileFinder) FindMatchingFiles(basePaths []string) ([]string, error)
  • func (ff *FileFinder) GetRealPath(path string) (string, error)
  • func (ff *FileFinder) IsSymlink(path string) (bool, error)
• type FileGroup
• type FileManager
  • func NewFileManager(maxFileSize, maxOutputSize int64, outputType OutputType) *FileManager
  • func (fm *FileManager) DeriveOutputPaths(inputPaths []string, customOutputPath string) ([]string, error)
  • func (fm *FileManager) GroupFilesByOutput(files []string, outputPaths []string) ([]FileGroup, error)
  • func (fm *FileManager) ParseSize(size string) (int64, error)
  • func (fm *FileManager) ValidateFiles(files []string) ([]string, error)
• type FileProcessor
  • func NewFileProcessor(options *MixOptions) *FileProcessor
  • func (p *FileProcessor) ProcessFiles(paths []string) ([]FileContent, error)
• type FileResult
• type MixError
  • func (e *MixError) Error() string
• type MixOptions
  • func (m *MixOptions) Validate() error
• type OutputGenerator
  • func NewOutputGenerator(options *MixOptions) (*OutputGenerator, error)
  • func (g *OutputGenerator) Generate(contents []FileContent) error
• type OutputType
• type PatternError
  • func (e *PatternError) Error() string
• type PatternValidator
  • func NewPatternValidator() *PatternValidator
  • func (v *PatternValidator) ExpandPattern(pattern string) ([]string, error)
  • func (v *PatternValidator) ValidatePattern(pattern string) error
• type Result

Constants

const (
	ColorRed   = "\033[1;31m" // bold red
	ColorGreen = "\033[0;32m" // green
	ColorReset = "\033[0m"
)

Types

type FileContent

type FileContent struct {
	Path      string `json:"path"`
	Name      string `json:"name"`
	Content   string `json:"content"`
	Extension string `json:"extension"`
	Size      int64  `json:"size"`
}

type FileFinder

type FileFinder struct {
	// contains filtered or unexported fields
}

FileFinder handles file pattern matching and collection with support for glob patterns, symlinks, and parallel processing.

func NewFileFinder

func NewFileFinder(includes, excludes []string, followSymlinks bool) *FileFinder

NewFileFinder creates a new FileFinder with the specified include and exclude patterns. The followSymlinks parameter determines whether symbolic links should be followed.

func (*FileFinder) FindMatchingFiles

func (ff *FileFinder) FindMatchingFiles(basePaths []string) ([]string, error)

FindMatchingFiles returns all files that match the include patterns and don't match any exclude patterns. It processes directories in parallel using a worker pool for improved performance. Returns a slice of matched file paths and any error encountered during processing.

func (*FileFinder) GetRealPath

func (ff *FileFinder) GetRealPath(path string) (string, error)

GetRealPath returns the real filesystem path for a file, resolving any symbolic links.

func (*FileFinder) IsSymlink

func (ff *FileFinder) IsSymlink(path string) (bool, error)

IsSymlink checks if the given path has been seen as a symbolic link during processing.

type FileGroup

type FileGroup struct {
	OutputPath string
	Files      []string
}

FileGroup represents a collection of files destined for the same output

type FileManager

type FileManager struct {
	// contains filtered or unexported fields
}

FileManager handles file organization, path management, and size calculations

func NewFileManager

func NewFileManager(maxFileSize, maxOutputSize int64, outputType OutputType) *FileManager

NewFileManager creates a new FileManager with the specified size limits and output type

func (*FileManager) DeriveOutputPaths

func (fm *FileManager) DeriveOutputPaths(inputPaths []string, customOutputPath string) ([]string, error)

DeriveOutputPaths generates output paths for the given input paths

func (*FileManager) GroupFilesByOutput

func (fm *FileManager) GroupFilesByOutput(files []string, outputPaths []string) ([]FileGroup, error)

GroupFilesByOutput organizes files into groups based on their output destinations

func (*FileManager) ParseSize

func (fm *FileManager) ParseSize(size string) (int64, error)

ParseSize converts a size string (e.g., "10MB") to bytes

func (*FileManager) ValidateFiles

func (fm *FileManager) ValidateFiles(files []string) ([]string, error)

ValidateFiles checks files against size limits and returns valid ones

type FileProcessor

type FileProcessor struct {
	// contains filtered or unexported fields
}

FileProcessor handles the concurrent processing of multiple files, including content cleaning when enabled. It manages a pool of cleaners for different languages and ensures proper resource cleanup.

func NewFileProcessor

func NewFileProcessor(options *MixOptions) *FileProcessor

NewFileProcessor creates a new FileProcessor instance with the specified options. It initializes the cleaner map if cleaning is enabled but defers actual cleaner creation until needed.

func (*FileProcessor) ProcessFiles

func (p *FileProcessor) ProcessFiles(paths []string) ([]FileContent, error)

ProcessFiles processes multiple files concurrently using a worker pool pattern. It respects file size limits and handles errors gracefully, continuing to process files even if some fail.

Parameters:

• paths: Slice of file paths to process

Returns:

• []FileContent: Slice of successfully processed file contents
• error: First error encountered during processing, if any

type FileResult

type FileResult struct {
	Content FileContent // Processed file content and metadata
	Error   error       // Error that occurred during processing, if any
}

FileResult represents the outcome of processing a single file. It can contain either the processed content or an error, but not both.

type MixError

type MixError struct {
	File    string
	Message string
}

func (*MixError) Error

func (e *MixError) Error() string

type MixOptions

type MixOptions struct {
	InputPath         string
	OutputPath        string
	Pattern           string
	Exclude           string
	MaxFileSize       int64
	MaxOutputSize     int64
	MaxOutputFileSize int64
	OutputType        OutputType
	CleanerOptions    *cleaner.CleanerOptions
	IgnoreSymlinks    bool
}

func (*MixOptions) Validate

func (m *MixOptions) Validate() error

type OutputGenerator

type OutputGenerator struct {
	// contains filtered or unexported fields
}

OutputGenerator handles the creation of output files in various formats

func NewOutputGenerator

func NewOutputGenerator(options *MixOptions) (*OutputGenerator, error)

NewOutputGenerator creates a new OutputGenerator instance

func (*OutputGenerator) Generate

func (g *OutputGenerator) Generate(contents []FileContent) error

Modify the Generate method in internal/core/output.go to use the new functions:

type OutputType

type OutputType string

const (
	OutputTypeXML  OutputType = "XML"
	OutputTypeJSON OutputType = "JSON"
	OutputTypeYAML OutputType = "YAML"
)

type PatternError

type PatternError struct {
	Pattern string
	Reason  string
}

func (*PatternError) Error

func (e *PatternError) Error() string

type PatternValidator

type PatternValidator struct {
	// contains filtered or unexported fields
}

func NewPatternValidator

func NewPatternValidator() *PatternValidator

func (*PatternValidator) ExpandPattern

func (v *PatternValidator) ExpandPattern(pattern string) ([]string, error)

func (*PatternValidator) ValidatePattern

func (v *PatternValidator) ValidatePattern(pattern string) error

type Result

type Result struct {
	Path string // The path of the matched file
	Err  error  // Any error encountered during processing
}

Result represents the outcome of a file finding operation. It can contain either a matched file path or an error.