Lists (7)
Starred repositories
A digital twin of the city of Colombo, Sri Lanka, implemented in Cities: Skylines, based on real data. Nearly 1:1 in terms of geography and population.
🔥 ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…
Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
AIFoundation 主要是指AI系统遇到大模型，从底层到上层如何系统级地支持大模型训练和推理，全栈的核心技术。
HTTP/HTTP2/HTTP3/Socks4/Socks5/Shadowsocks/ShadowsocksR/SSH/Redirect/Pf TCP/UDP asynchronous tunnel proxy implemented in Python 3 asyncio.
Python SDK, Proxy Server to call 100+ LLM APIs using the OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
Slides, notes, and materials for the workshop
Expose your TCP/UDP port behind full-cone NAT to the Internet.
The Learning Interpretability Tool: Interactively analyze ML models to understand their behavior in an extensible and framework agnostic interface.
Heterogeneous AI Computing Virtualization Middleware
Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)
Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
A high-throughput and memory-efficient inference and serving engine for LLMs
Fully open source, End to End Encrypted alternative to Google Photos and Apple Photos
A library for building fast, reliable and evolvable network services.
LangChain for Go, the easiest way to write LLM-based programs in Go
Building a quick conversation-based search demo with Lepton AI.
A new markup-based typesetting system that is powerful and easy to learn.
LlamaIndex is a data framework for your LLM applications
the AI-native open-source embedding database
Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.
High performance self-hosted photo and video management solution.
Omnivore is a complete, open source read-it-later solution for people who like reading.
