Skip to content

feat: EXAONE4.0 support#5696

Merged
QiJune merged 3 commits intoNVIDIA:mainfrom
yechank-nvidia:exaone4
Jul 14, 2025
Merged

feat: EXAONE4.0 support#5696
QiJune merged 3 commits intoNVIDIA:mainfrom
yechank-nvidia:exaone4

Conversation

@yechank-nvidia
Copy link
Copy Markdown
Collaborator

@yechank-nvidia yechank-nvidia commented Jul 3, 2025 •
edited
Loading

Description

This is the model support newly announced by LG-AI. Ref HF

@yechank-nvidia yechank-nvidia self-assigned this Jul 3, 2025
@yechank-nvidia yechank-nvidia requested a review from a team as a code owner July 3, 2025 04:24
@yechank-nvidia
Copy link
Copy Markdown
Collaborator Author

yechank-nvidia commented Jul 3, 2025

/bot run

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

tensorrt-cicd commented Jul 3, 2025

PR_Github #10753 [ run ] triggered by Bot

@yechank-nvidia
Copy link
Copy Markdown
Collaborator Author

yechank-nvidia commented Jul 3, 2025

/bot kill

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

tensorrt-cicd commented Jul 3, 2025

PR_Github #10755 [ kill ] triggered by Bot

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

tensorrt-cicd commented Jul 3, 2025

PR_Github #10753 [ run ] completed with state ABORTED

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

tensorrt-cicd commented Jul 3, 2025

PR_Github #10755 [ kill ] completed with state SUCCESS
Successfully killed previous jobs for commit 7aff7d4

@yechank-nvidia
Copy link
Copy Markdown
Collaborator Author

yechank-nvidia commented Jul 11, 2025

/bot run

1 similar comment
@yechank-nvidia
Copy link
Copy Markdown
Collaborator Author

yechank-nvidia commented Jul 12, 2025

/bot run

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

tensorrt-cicd commented Jul 12, 2025

PR_Github #11696 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

tensorrt-cicd commented Jul 12, 2025

PR_Github #11696 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #8658 completed with status: 'FAILURE'

@yechank-nvidia
Copy link
Copy Markdown
Collaborator Author

yechank-nvidia commented Jul 12, 2025

/bot run

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

tensorrt-cicd commented Jul 12, 2025

PR_Github #11704 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

tensorrt-cicd commented Jul 12, 2025

PR_Github #11704 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #8663 completed with status: 'SUCCESS'

@yechank-nvidia
Copy link
Copy Markdown
Collaborator Author

yechank-nvidia commented Jul 14, 2025

/bot run

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

tensorrt-cicd commented Jul 14, 2025

PR_Github #11739 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

tensorrt-cicd commented Jul 14, 2025

PR_Github #11739 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #8693 completed with status: 'FAILURE'

@yechank-nvidia
Copy link
Copy Markdown
Collaborator Author

yechank-nvidia commented Jul 14, 2025

/bot run

1 similar comment
@yechank-nvidia
Copy link
Copy Markdown
Collaborator Author

yechank-nvidia commented Jul 14, 2025

/bot run

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

tensorrt-cicd commented Jul 14, 2025

PR_Github #11758 [ run ] triggered by Bot

jaedeok-nvidia
jaedeok-nvidia approved these changes Jul 14, 2025
View reviewed changes
Copy link
Copy Markdown
Collaborator

@jaedeok-nvidia jaedeok-nvidia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your hard work, Yechan!

yizhang-nv
yizhang-nv approved these changes Jul 14, 2025
View reviewed changes
Copy link
Copy Markdown
Member

@yizhang-nv yizhang-nv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall LGTM. Some code style and performance-related code changes can be fixed in the following pr if we want to merge this pr ASAP.

Comment thread tensorrt_llm/_torch/models/modeling_exaone4.py
Comment thread tensorrt_llm/_torch/models/modeling_exaone4.py
@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

tensorrt-cicd commented Jul 14, 2025

PR_Github #11758 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #8709 completed with status: 'SUCCESS'

@yechank-nvidia
feat: EXAONE4.0 support
6882e25 
Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com>
@yechank-nvidia
address rebase
3f9e385 
Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com>
@yechank-nvidia
re-write troubleshooting section
ce18a01 
Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com>
@yechank-nvidia
Copy link
Copy Markdown
Collaborator Author

yechank-nvidia commented Jul 14, 2025

/bot run

@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

tensorrt-cicd commented Jul 14, 2025

PR_Github #11806 [ run ] triggered by Bot

@QiJune QiJune enabled auto-merge (squash) July 14, 2025 13:01
@tensorrt-cicd
Copy link
Copy Markdown
Collaborator

tensorrt-cicd commented Jul 14, 2025

PR_Github #11806 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #8748 completed with status: 'SUCCESS'
Pipeline passed with automatic retried tests. Check the rerun report for details.

@QiJune QiJune merged commit 63139fd into NVIDIA:main Jul 14, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@yizhang-nv yizhang-nv yizhang-nv approved these changes

@jaedeok-nvidia jaedeok-nvidia jaedeok-nvidia approved these changes

@shaharmor98 shaharmor98 Awaiting requested review from shaharmor98 shaharmor98 was automatically assigned from NVIDIA/trt-llm-torch-devs

Assignees

@yechank-nvidia yechank-nvidia

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@yechank-nvidia @tensorrt-cicd @jaedeok-nvidia @yizhang-nv @QiJune