HTTP(S) benchmark tools, testing/debugging, & restAPI (RESTful)

Enabling PyTorch on XLA Devices (e.g. Google TPU)

Serve, optimize and scale PyTorch models in production

Apache Ignite

A guideline for building practical production-level deep learning systems to be deployed in real world applications.

This project is inspired by the design and development of the AWS Serverless Application Repository - a production-grade AWS service. Learn how AWS built a production service using serverless techn…

TVM integration into PyTorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

A cheatsheet of modern C++ language and library features.

gunicorn 'Green Unicorn' is a WSGI HTTP Server for UNIX, fast clients and sleepy applications.

Multi Model Server is a tool for serving neural net models for inference