Welcome to the Termite Blog

Welcome to the Termite blog! This is where we'll share news, updates, tutorials, and insights about Termite and local ML inference.

What is Termite?#

Termite is a local ML inference server - like Ollama, but for all AI models. It provides:

• Embeddings - Generate vector embeddings for semantic search
• Chunking - Split text into optimal segments for processing
• Reranking - Improve search relevance with cross-encoder models
• Multimodal - Process images with CLIP and other vision models

What to Expect#

We'll be sharing:

• Release announcements and feature updates
• Tutorials and best practices
• Performance optimization tips
• Integration guides with Antfly and other tools
• Community highlights and use cases

Get Started#

If you haven't tried Termite yet, check out our Getting Started guide to install and run your first models.

Stay tuned for more updates!