nvfp4
#1
by ktsaou - opened
@lukealonso it would be nice if you can convert this to nvfp4. This is going to fit in 1 rtx 6000 pro bw ws, at almost full context window.
@lukealonso it would be nice if you can convert this to nvfp4. This is going to fit in 1 rtx 6000 pro bw ws, at almost full context window.
