Towards a hardware-invariant NVFP4 for GPUs without FP4: progress report 1
4-bit weights on the INT8 tensor cores every NVIDIA GPU from Ampere to Blackwell has, how the format got here, and where the evaluation is right now.
Read →~/whoami
Reverse engineering, ML, and systems notes from an independent researcher.
4-bit weights on the INT8 tensor cores every NVIDIA GPU from Ampere to Blackwell has, how the format got here, and where the evaluation is right now.
Read →