SpliTea

README

SpliTea

SpliTea allows you to split any splittable file into equally sized parts. SpliTea was born because working with datasets as single large .csv files can get tedious fast. Because this is often still the norm, SpliTea offers a memory and CPU-Efficient way to process your data.

This is possible, because SpliTea is Multithreaded by design and splits your files as it goes. The benefit is that at no point does the whole File need to be in your memory at once.

Look how easy it is to use:

SpliTea --split-count=5 my.csv

And there you go, your file just got split into five equally sized parts!

Features

• Split any plain text files like .csv or .txt files line by line into equally sized parts
• Do it really fast and handle big files gracefully

Get Started

First, download the most recent version from https://github.com/Transmitt0r/SpliTea/releases. Then use it like this:

/your/download/directory/splitea-amd64 --help

Advanced Installation

You can use this Path if you have Go installed on your system and want to be able to call SpliTea from anywhere.

Clone or download this repository and navigate to the root directory and follow the directions below.

git clone https://github.com/Transmitt0r/SpliTea.git
cd SpliTea
make install

Then use SpliTea anywhere by simply typing:

SpliTea --help

Usage

SpliTea has the following command line arguments:

  -header bool
        true if header row is present (default false)
        
  -outfile string
        output filename (default "split.csv")
        
  -split-count int
        number of files to split into (default 2)

Contribute

You are welcome to contribute or suggest new features!

• Issue Tracker: github.com/Transmitt0r/SpliTea/issues
• Source Code: github.com/Transmitt0r/SpliTea

Support

If you are having issues, please let us know by creating a new issue!

License

The project is licensed under the MIT license.