Stars
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Conversion between Traditional and Simplified Chinese
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…
A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distributed online serving toolkits for large scale vector search sc…
Learning embeddings for classification, retrieval and ranking.
纯c++的全平台llm加速库,支持python调用,chatglm-6B级模型单卡可达10000+token / s,支持glm, llama, moss基座,手机端流畅运行
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
MITIE: library and tools for information extraction
🔳 Geometrize is a desktop app that geometrizes images into geometric primitives
🚀 A very efficient Texas Holdem GTO solver