The size seems perfect for many Mac Studio users, but FP8 quants are not on the horizon. Any way we might see BF16?
FP8
BF16
Looks like the MLX community has a conversion up, fingers crossed!
· Sign up or log in to comment
