H200

#9
by dho - opened

Any experiences using VLLM on 4xH200 for using NVFP4 ? I know its designed for Blackwell but would like to benefit from the Precision higher than AWQ INT4

Sign up or log in to comment