Stars
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
TencentDB Agent Memory is a team-level memory hub for AI Agents β turning conversations, docs, and code into four reusable memory assets (Chat Memory, Skill, LLM-Wiki, Code-Graph) that are governedβ¦
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Clβ¦
A vector index built on TurboQuant, written in Rust with Python bindings
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthrβ¦
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Menu bar gauges for Claude Code quota (SwiftBar plugin)
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
Desktop app to manage markdown knowledge bases
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
The AI that really does things. Any OS. Any Platform. The lobster way. π¦
MCP Aggregator, Orchestrator, Middleware, Gateway in one docker
π Token-Oriented Object Notation (TOON) β compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without β¦
Generic template to bootstrap your Python project.
LLM training code for Databricks foundation models
Universal Python binding for the LMDB 'Lightning' Database
Interpretability for sequence generation models π π
This repository contains the resource introduced in the paper: "Truth or Mirage? Towards End-to-End Factuality Evaluation with LLM-Oasis". LLM-Oasis is a large-scale resource for end-to-end factualβ¦
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
S-LoRA: Serving Thousands of Concurrent LoRA Adapters