BrowserAI
Basic Information
BrowserAI is a developer-focused open source SDK and runtime for running production-ready large language models directly inside modern web browsers. It enables privacy-preserving local inference using WebGPU acceleration so models run on-device without sending data to servers. The project supports multiple engine backends including MLC and Transformers, provides pre-configured models for text generation, speech recognition, and text-to-speech, and includes utilities for loading models, tracking progress, and generating structured JSON outputs. It offers a simple npm package interface, examples for chat, transcription and TTS, built-in storage for conversations and embeddings, and is positioned to support RAG and multi-model orchestration on the client side. The README targets web developers, researchers, hobbyists and no-code builders who want zero-server, offline-capable AI in browser applications.