Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Faster Whisper transcription with CTranslate2
Zhong Wen LLaMA&AlpacaDa Yu Yan Mo Xing +Ben Di CPU/GPUXun Lian Bu Shu (Chinese LLaMA & Alpaca LLMs)
[updating ...] AI Zi Dong Liang Hua Jiao Yi Ji Qi Ren (Wan Quan Ben Di Bu Shu ) AI-powered Quantitative Investment Research Platform. online docs: https://ufund-me.github.io/Qbot :news: qbot-mini: https://github.com/Charmve/iQuant
Accessible large language models via k-bit quantization for PyTorch.
Lossy PNG compressor -- pngquant command based on libimagequant library
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Fast inference engine for Transformer models
[ICLR2025 Spotlight] SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models
Accelerate inference and training of Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.
Sparsity-aware deep learning inference runtime for CPUs
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
Add a description, image, and links to the quantization topic page so that developers can more easily learn about it.
To associate your repository with the quantization topic, visit your repo's landing page and select "manage topics."