Install¶
Requirements¶
The project package metadata declares:
- Python
>=3.9 torchtritonnumpyscipytransformers
Recommended environment:
- Python virtual environment or conda environment
- PyTorch with CUDA support
- Triton
- Transformers
Environment¶
Create an environment before installing the package:
Package Install¶
From the repository root, install the package in editable mode:
For tests:
For documentation:
Build The Documentation Site¶
The generated site is written to site/.
Optional Runtime Packages¶
Some integration paths require optional packages at runtime:
| Path | Package |
|---|---|
| HuggingFace model capture | transformers |
| vLLM helpers | vllm |
| CUDA kernels | CUDA-capable PyTorch and Triton |
If an optional package is absent, helper code raises OptionalDependencyError
or a standard import/configuration error depending on the entry point.