Popular repositories Loading

1. FasterTransformer FasterTransformer Public

   Forked from NVIDIA/FasterTransformer

   Transformer related optimization, including BERT, GPT

   C++

2. lmdeploy lmdeploy Public

   Forked from InternLM/lmdeploy

   LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

   C++

3. aix_infer_trt aix_infer_trt Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++