🤖 Free Search with AI, 💡 Open-Source Perplexity, 📍 Support Ollama/SearXNG, Support Docker deployment. 让AI大模型和搜索引擎回答你的问题，支持本地大模型(Ollama)、聚合搜索引擎SearXNG，支持Docker一键部署。

AI模型聚合管理中转分发系统，支持将多种大模型转为统一格式调用，支持OpenAI、Claude、Gemini等格式，可供个人或者企业内部管理与分发渠道使用。🍥 The next-generation LLM gateway and AI asset management system supports multiple languages.

Coding项目协同数据迁移工具

批量迁移代码托管平台代码仓库到 CNB

LLM inference in C/C++ Fork from https://github.com/ggerganov/llama.cpp.git 自动化构建Docker镜像

A high-throughput and memory-efficient inference and serving engine for LLMs

https://github.com/vllm-project/FlashMLA.git

Fast and memory-efficient exact attention

https://github.com/oneapi-src/oneDNN.git

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

vLLM官方镜像部署DeepSeek模型，生产环境中提供类OpenAI接口服务。

DeepResearch Agent with LangGraph, using any LLM models, search engine, RAG retrieval.

Xorbits Inference(Xinference) is a powerful and versatile library designed to serve language, speech recognition, and multimodal models. With Xorbits Inference, you can effortlessly deploy and serve your or state-of-the-art built-in models using just a single command. Whether you are a researcher, developer, or data scientist...

SGLang is a fast serving framework for large language models and vision language models.

常用镜像制品库