Skip to content

[docs] Expert parallelism#42409

Merged
stevhliu merged 4 commits intohuggingface:mainfrom
stevhliu:parallelism
Dec 17, 2025
Merged

[docs] Expert parallelism#42409
stevhliu merged 4 commits intohuggingface:mainfrom
stevhliu:parallelism

Conversation

@stevhliu
Copy link
Copy Markdown
Member

updates the parallelism docs:

  • distributed inference is now tensor parallelism so it is easier to find
  • new expert parallelism guide

@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Copy link
Copy Markdown
Collaborator

@ArthurZucker ArthurZucker left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cc @3outeille if you want to have a look as well!

@stevhliu
Copy link
Copy Markdown
Member Author

added a warning that DistributedConfig is experimental and may change!

@stevhliu stevhliu merged commit 9e3568e into huggingface:main Dec 17, 2025
15 checks passed
@stevhliu stevhliu deleted the parallelism branch December 17, 2025 18:44
SangbumChoi pushed a commit to SangbumChoi/transformers that referenced this pull request Jan 23, 2026
* draft

* ep

* toctree

* warning
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants