Skip to content

Commit

Permalink
Add PyTorch 2.0 note (#100)
Browse files Browse the repository at this point in the history
  • Loading branch information
rmccorm4 committed Apr 14, 2023
1 parent 588c6ac commit 2c1889f
Showing 1 changed file with 13 additions and 1 deletion.
14 changes: 13 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -206,7 +206,7 @@ complex execution modes and dynamic shapes. If not specified, all are enabled by

`ENABLE_TENSOR_FUSER`

### Important Note
### Important Notes

* The execution of PyTorch model on GPU is asynchronous in nature. See
[here](https://pytorch.org/docs/stable/notes/cuda.html#asynchronous-execution)
Expand All @@ -223,3 +223,15 @@ a List of Strings as input(s) / produces a List of String as output(s). For thes
Triton allows users to pass String input(s)/receive String output(s) using the String
datatype. As a limitation of using List instead of Tensor for String I/O, only for
1-dimensional input(s)/output(s) are supported for I/O of String type.

#### PyTorch 2.0

Currently, the
[PyTorch Backend](https://github.com/triton-inference-server/pytorch_backend)
relies on LibTorch/TorchScript (C++) which has been deprecated from
[PyTorch 2.0](https://pytorch.org/get-started/pytorch-2.0/).

So, users interested in new features introduced in PyTorch 2.0 should try the
[Python Backend](https://github.com/triton-inference-server/python_backend)
route instead.

0 comments on commit 2c1889f

Please sign in to comment.