Pinned Loading

1. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor...

   Python 13.1k 2.2k

2. PaddlePaddle/Paddle PaddlePaddle/Paddle Public

   PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice ({Fei Jiang } He Xin Kuang Jia ,Shen Du Xue Xi &Ji Qi Xue Xi Gao Xing Neng Dan Ji , Fen Bu Shi Xun Lian He Kua Ping Tai Bu Shu )

   C++ 23.8k 6k

3. PaddlePaddle/Anakin PaddlePaddle/Anakin Public archive

   High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.

   C++ 537 135