🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Large Language Model Text Generation Inference

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

An open-source and enterprise-level monitoring system.

Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.

Free, open-source SQL client for Windows and Mac 🦅

A familiar HTTP Service Framework for Python.

中ちゅう文ぶんnlp解かい决方案あん(大だい模型もけい、数かず据すえ、模型もけい、训练、推理すいり)

A high-performance web server for Ruby, supporting HTTP/1, HTTP/2 and TLS.

LLM Finetuning with peft

A friendly library for parsing HTTP request arguments, with built-in support for popular web frameworks, including Flask, Django, Bottle, Tornado, Pyramid, webapp2, Falcon, and aiohttp.

🩹Editing large language models within 10 seconds⚡

🦙 Integrating LLMs into structured NLP pipelines

The simplest way to serve AI/ML models in production

🤖 A PyTorch library of curated Transformer models and their composable components

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

a Python web framework generator supports Flask, Tornado, Falcon, Sanic

🤘 TT-NN operator library, and TT-Metalium low level kernel programming model.

Repo for fine-tuning Casual LLMs

Take Android screenshots with Falcons bright eye!