TaskC

README

TaskC

TaskC is for Task Closure, which provides an modular way to the Building, Upgrading, and Sharing of containers.

Requirements

1. containerd
2. CNI plugins

sudo mkdir -p /opt/cni/bin
curl -L https://github.com/containernetworking/plugins/releases/download/v1.6.0/cni-plugins-linux-amd64-v1.6.0.tgz | sudo tar -C /opt/cni/bin -xz

1. (Optional) For NVIDIA GPU support:

   # Run the installation script
   sudo ./scripts/install-nvidia-toolkit-debian.sh
   
   

Usage

User

1. In ./cmd/taskc, run $ bash build.sh build
2. run $ taskc

Server

1. In ./cmd/prefabservice/, run $ go build
2. run $ sudo ./prefabservice -v to start the Prefab Service

TODO List

• python -m compileall DIR
• should choose apt package version according to debian version
• should avoid assembling local existing apt packages and pypi packages
• unable to recognize the python version in Docker image pytorch/pytorch
• resolve jupyter_client
• normalize names
• do not assemble apt packages in the base image
• change dynamic linked packages to static linked packages
• move GPU, CNI, runtime-config functions to /pkg/runtime
• split Image.json to image directories
• Add entrypoint and targetDir for every python wheel
• support Provides-Extra in python wheel manual fabrication
• merge pypi manual fabricate into repo
• support comment in blueprint
• support GPU tag in python version
• move config to var/lib/taskc
• set imageID
• support pip install .
• support LOCAL Prefab
• support DATA Prefab
• Prefab parallel downloading & unpacking
• Merge cmd packages to one CLI
• Prefab CMD tag has only one item
• Optimize Prefab structure
• Fix: Got pythonVersion==3.11 in Docker image python:3.10
• Check whether taskc needs sudo
• Fix: unable to stop tcsrc with CTRL+C
• Add command purge
• Use io.Pipe to avoid disk writing
• purge do not delete ip:port config
• Use gzip for Prefabs
• Change Panicf to Printf in taskc
• Add pack command that generate an image directly from blueprint
• Remove Image directory if building process failed
• Add Deployability tag in blueprint
• Check Deployability during assembling
• Non-Interactive
• handle Ctrl+C in cmd
• taskc run URL
• ca-certificates