malaysia-ai/GH200-ARM64-vLLM-wheel
GH200 ARM64 vLLM wheel We build wheels for GH200 ARM64 from Lambda AI for specific PyTorch version, torch==2.7.1+cu128 torchaudio==2.7.1 torchvision==0.22.1 Full requirements in requirements.txt, but PyTorch 2.7.1 Cuda 12.8 should be enough, pip3 install torch==2.7.1 torchvision==0.22.1 torchaudio==2.7.1 pytorch-triton==3.3.0 --index-url https://download.pytorch.org/whl/cu128 Build by yourself Step to reproduce at build.sh.
162
GH200 ARM64 vLLM wheel
We build wheels for GH200 ARM64 from Lambda AI for specific PyTorch version,
torch==2.7.1+cu128torchaudio==2.7.1torchvision==0.22.1
Full requirements in requirements.txt, but PyTorch 2.7.1 Cuda 12.8 should be enough,
pip3 install torch==2.7.1 torchvision==0.22.1 torchaudio==2.7.1 pytorch-triton==3.3.0 --index-url https://download.pytorch.org/whl/cu128Build by yourself
Step to reproduce at build.sh.
