Skip to content

Commit

Permalink
Uninstall transformer_engine (#110)
Browse files Browse the repository at this point in the history
Co-authored-by: Junda Chen <[email protected]>
  • Loading branch information
GindaChen and Junda Chen authored Aug 13, 2024
1 parent 30e8c2d commit eec6e52
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions .devcontainer/Dockerfile-vllm
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,10 @@ ENV NVTE_FRAMEWORK=pytorch
COPY vllm-requirements.txt /tmp/requirements.txt
RUN pip install -r /tmp/requirements.txt

# Uninstall the transformer engine that comes with the base image.
# Otherwise it will cause error when importing vLLM (LLAVA models).
RUN pip uninstall -y transformer_engine

# crashes docker?
# RUN pip install -v -U git+https://github.com/facebookresearch/xformers.git@main#egg=xformers

Expand Down

0 comments on commit eec6e52

Please sign in to comment.