Running large language models on a single GPU for throughput-oriented scenarios.
-
Updated
Oct 28, 2024 - Python
#
high-throughput
Here are 121 public repositories matching this topic...
Language: All
Filter by language
Sort: Most stars
Sort options
A thread-safe queue faster and more resource efficient than golang's native channels
go golang optimization concurrency ringbuffer low-latency lock-free fastest high-throughput memory-efficient thread-safe spsc-queue mpsc-queue highly-concurrent zero-allocations zenq
-
Updated
Mar 12, 2024 - Go
[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
-
Updated
Aug 1, 2024 - Python
Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning Framework on a GPU (JMLR 2022)
reinforcement-learning deep-learning gpu cuda pytorch numba high-throughput multiagent-reinforcement-learning
-
Updated
May 1, 2025 - Python
[ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
-
Updated
May 1, 2025 - Python
atomate2 is a library of computational materials science workflows
-
Updated
Feb 23, 2026 - Python
quacc is a flexible platform for computational materials science and quantum chemistry that is built for the big data era.
python workflow database dft chemistry hpc quantum-mechanics quantum-chemistry high-throughput computational-materials-science
-
Updated
Feb 18, 2026 - Python
Realtime distributed messaging platform built using Go and React (Fullstack)
-
Updated
Feb 21, 2025 - Go
One database for likes, views, follows -- pre-computed, served in real-time
-
Updated
Feb 23, 2026 - Kotlin
A snakemake-based workflow for FEP and MM(PB/GB)SA calculations with GROMACS
-
Updated
Feb 3, 2026 - Python
extremly light uart library for AVR 8 bit microcontrollers
c avr transmission optimized flow-control uart rs232 rs485 avr-gcc prematured usart high-speed low-overhead arduino-less high-throughput avr-microcontroller avr-microcontrollers
-
Updated
Mar 13, 2024 - C
A low-latency LRU approximation cache in C++ using CLOCK second-chance algorithm. Multi level cache too. Up to 2.5 billion lookups per second.
fast caching benchmark memoization cpp high-performance cache lru data-structures low-latency fastest high-throughput lru-cache cache-simulator multi-level-cache low-latency-queries least-recently-used set-associative-cache direct-mapped-cache clock-second-chance
-
Updated
Jan 18, 2024 - C++
An Intuitive, Lightweight, High Performance Full Stack Java Web Framework.
-
Updated
Feb 20, 2026 - Java
Automated Blood Vasculature Analysis of 3D Light-Sheet Image Volumes
docker bioinformatics snakemake high-throughput graph-analysis vessel-segmentation 3d-imaging 3d-skeleton light-sheet-microscopy
-
Updated
Jun 6, 2024 - Python
A reactive driver for Aeron transport (https://github.com/real-logic/aeron)
-
Updated
Feb 5, 2025 - Java
A Simple Way of Creating Job Workflows in Go running in Processes, Containers, Tasks, Pods, or Jobs
go macos linux docker kubernetes golang workflow hpc containers workflow-engine singularity processes k8s high-throughput
-
Updated
Dec 20, 2024 - Go
A Throughput-Optimized Pipeline Parallel Inference System for Large Language Models
-
Updated
Dec 24, 2025 - Python
Full automation of relative protein-ligand binding free energy calculations in GROMACS
-
Updated
May 3, 2021 - Python
Window-Based Hybrid CPU/GPU Stream Processing Engine
streaming stream gpu stream-processing hybrid high-throughput multicore sliding-windows streaming-data saber multicore-cpu
-
Updated
Nov 16, 2022 - Java
The Zavolab Automated RNA-seq Pipeline
docker workflow bioinformatics rna-seq snakemake pipeline reproducible-research conda singularity fair high-throughput transcriptomics
-
Updated
Jan 29, 2026 - Python
Improve this page
Add a description, image, and links to the high-throughput topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the high-throughput topic, visit your repo's landing page and select "manage topics."