Download Termite
Termite is a lightweight ML inference service for embeddings, reranking, and chunking. It's similar to Ollama but designed for non-generative AI models.
Standard Edition
Installation Instructions
brew install antflydb/antfly/termiteor tap homebrew-antfly and install separately:
brew tap antflydb/antfly
brew install termiteOmni Edition (Experimental)
The Termite Omni edition is experimental and may have bugs or compatibility issues.
The Omni edition includes bundled ONNX Runtime and XLA libraries for optimized ML inference without requiring external model runtimes.
Installation Instructions
brew install --cask antflydb/antfly/termite-omnior tap homebrew-antfly first:
brew tap antflydb/antfly
brew install --cask termite-omniThe Omni cask installs bundled libraries in lib/ alongside the binary. These are automatically found at runtime.