wire up nvfp4 bmm

[vkuzo]

Summary:

Wires up nvfp4 bmm with a for loop over nvfp4 mm's

We can hook up a faster kernel once we have one.

Test Plan:

pytest test/prototype/mx_formats/test_inference_workflow.py -s -k bmm

[vkuzo]

Stack from ghstack (oldest at bottom):

• install debug expert token counters on nvfp4 moe test script #4322
• hook up hf + moe + nvfp4 script to lm_eval #4321
• -> wire up nvfp4 bmm #4320

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/4320

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• Rolling out OSDC (ARC) runners on pull & trunk workflows in PyTorch main

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[jerryzh168]

I'm unsure if bmm is used right now actually, I feel we could delay this as well