[ET-VK] Statically quantized convolutions

[SS-JIA]

Stack from ghstack (oldest at bottom):

• [ET-VK] Statically quantized add #14649
• [ET-VK] AOT logic for quantized conv2d #14648
• -> [ET-VK] Statically quantized convolutions #14647

Changes

This diff adds implementations for quantized convolution under the following quantization conditions:

• activations statically quantized to 8-bit with per tensor scale and zero point
• weights quantized to 8-bit with per channel scales
• outputs statically quantized to 8-bit with per tensor scale and zero point

3 different implementations are added, which are selected between based on the input conditions.

The first is an direct convolution shader which uses the quantized int8 input directly.

The second is an im2col variant, which computes the convolution via a gemm like algorithm by first applying an im2col tranformation on the input tensor.

Finally, a specialized implementation is added for depthwise convolutions.

Differential Revision: D83437827

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14647

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 2 Cancelled Jobs

As of commit e24e6ee with merge base 049c9fc ():

NEW FAILURES - The following jobs have failed:

• pull / test-llama-lora-linux / linux-job (gh)
  RuntimeError: Command docker exec -t dbe6619c635909f66a83e08ad918d0d48bddf60fd8d91e6ccb3393752598c9c9 /exec failed with exit code 1
• pull / test-multimodal-linux (gemma3-4b) / linux-job (gh)
  RuntimeError: Command docker exec -t ed77525539e6d80e4080cade18cd43e0450f7e0b965186a856000b3c0482091b /exec failed with exit code 139

CANCELLED JOBS - The following jobs were cancelled. Please retry:

• pull / test-binary-size-linux-gcc / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-setup-linux-gcc / linux-job (gh)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

@SS-JIA has exported this pull request. If you are a Meta employee, you can view the originating diff in D83437827.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[facebook-github-bot]

@SS-JIA has exported this pull request. If you are a Meta employee, you can view the originating diff in D83437827.

[facebook-github-bot]

@SS-JIA has exported this pull request. If you are a Meta employee, you can view the originating diff in D83437827.