Skip to content

[TRITON]: Quantization updates(add int8 and use common fp8 dtypes) #588

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
valarLip merged 2 commits into from
Jul 1, 2025
Merged

[TRITON]: Quantization updates(add int8 and use common fp8 dtypes) #588

valarLip merged 2 commits into from
Jul 1, 2025

Conversation

@rahulbatra85
Copy link
Contributor

@rahulbatra85 rahulbatra85 commented Jun 26, 2025 •
edited
Loading

  1. Add int8 quantization ops
  2. Add doc
  3. Fix per_token_fp8 testcase

@rahulbatra85 rahulbatra85 requested a review from valarLip June 26, 2025 18:59
valarLip
valarLip reviewed Jun 27, 2025
View reviewed changes
@rahulbatra85 rahulbatra85 requested a review from valarLip June 30, 2025 19:02
@valarLip valarLip merged commit 4012b31 into main Jul 1, 2025
13 checks passed
@valarLip valarLip deleted the quant_updates branch July 1, 2025 00:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@valarLip valarLip valarLip approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@rahulbatra85 @valarLip