Haystack

TypeScript toolkit for building AI-powered applications with React, Next.js, Vue, Svelte, and Node.js. Unified API for multiple AI providers with streaming.

LLM inference in pure C/C++. Run LLaMA and other models on consumer hardware with CPU and GPU support. The engine behind many local AI apps.

Hugging Face's state-of-the-art ML library. Access thousands of pretrained models for NLP, computer vision, audio, and multimodal tasks.