Skip to content

Commit

Permalink
Merge pull request mistralai#43 from quantumsheep/patch-1
Browse files Browse the repository at this point in the history
Update PyTorch to 2.2.0 to support NVIDIA H100 PCIe
  • Loading branch information
albertqjiang committed Oct 19, 2023
2 parents 7fbbfb3 + 3190161 commit 147c4e6
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions deploy/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,8 @@ ENV TORCH_CUDA_ARCH_LIST "7.0;7.2;7.5;8.0;8.6;8.9;9.0"

# We have to manually install Torch otherwise apex & xformers won't build
RUN pip3 install "torch>=2.0.0"
# To enable H100 PCIe support, install PyTorch >=2.2.0 by uncommenting the following line
# RUN pip3 install "torch==2.2.0.dev20231018+cu118" --index-url https://download.pytorch.org/whl/nightly/cu118

# This build is slow but NVIDIA does not provide binaries. Increase MAX_JOBS as needed.
RUN git clone https://github.com/NVIDIA/apex && \
Expand Down

0 comments on commit 147c4e6

Please sign in to comment.