Can A100 run this model?
#2
by traphix - opened
Can A100 run this model?
You need a minimum of 325GB to 350GB of either unified memory or VRAM to run the quantized version of this model.
Can A100 run this model?
You need a minimum of 325GB to 350GB of either unified memory or VRAM to run the quantized version of this model.