Skip to content

Query TransformerConfig attributes when copying btw configs#9832

Merged
akoumpa merged 4 commits intomainfrom
akoumparouli/update_set_model_parallel_attributes
Jul 24, 2024
Merged

Query TransformerConfig attributes when copying btw configs#9832
akoumpa merged 4 commits intomainfrom
akoumparouli/update_set_model_parallel_attributes

Conversation

@akoumpa
Copy link
Collaborator

@akoumpa akoumpa commented Jul 22, 2024

What does this PR do ?

When copying a TransformerConfig use dir to get attribute names, instead of copying manually.
improves-maintainability= we don't have to manually change anything if the def. of TransformerConfig changes.

Collection: [Note which collection this PR will affect]

Changelog

  • Add specific line by line info of high level changes in this PR.

Usage

  • You can potentially add a usage example below
# Add a code snippet demonstrating how to use this 

GitHub Actions CI

The Jenkins CI system has been replaced by GitHub Actions self-hosted runners.

The GitHub Actions CI will run automatically when the "Run CICD" label is added to the PR.
To re-run CI remove and add the label again.
To run CI on an untrusted fork, a NeMo user with write access must first click "Approve and run".

Before your PR is "Ready for review"

Pre checks:

  • Make sure you read and followed Contributor guidelines
  • Did you write any new necessary tests?
  • Did you add or update any necessary documentation?
  • Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
    • Reviewer: Does the PR have correct import guards for all optional libraries?

PR Type:

  • New Feature
  • Bugfix
  • Documentation

If you haven't finished some of the above items you can still open "Draft" PR.

Who can review?

Anyone in the community is free to review the PR once the checks have passed.
Contributor guidelines contains specific people who can review PRs to various areas.

Additional Information

  • Related to # (issue)

@akoumpa akoumpa self-assigned this Jul 22, 2024
@akoumpa akoumpa force-pushed the akoumparouli/update_set_model_parallel_attributes branch from b6c99f9 to 2f21824 Compare July 22, 2024 21:52
@akoumpa akoumpa requested a review from hemildesai July 22, 2024 22:01
@akoumpa akoumpa force-pushed the akoumparouli/update_set_model_parallel_attributes branch 3 times, most recently from 2cb718f to 9aa075c Compare July 22, 2024 22:36
@akoumpa akoumpa added Run CICD and removed Run CICD labels Jul 22, 2024
@akoumpa akoumpa requested a review from hemildesai July 22, 2024 22:53
@akoumpa akoumpa force-pushed the akoumparouli/update_set_model_parallel_attributes branch from 1d0da78 to b2704d0 Compare July 22, 2024 23:39
@akoumpa akoumpa added Run CICD and removed Run CICD labels Jul 22, 2024
@akoumpa akoumpa force-pushed the akoumparouli/update_set_model_parallel_attributes branch from 5e12a02 to 1cc8810 Compare July 23, 2024 16:27
Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
@akoumpa akoumpa force-pushed the akoumparouli/update_set_model_parallel_attributes branch from 1cc8810 to 6feaca4 Compare July 23, 2024 16:27
@akoumpa akoumpa added Run CICD and removed Run CICD labels Jul 23, 2024
@akoumpa akoumpa force-pushed the akoumparouli/update_set_model_parallel_attributes branch 3 times, most recently from d91a9f3 to 2370034 Compare July 23, 2024 16:42
Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
@akoumpa akoumpa force-pushed the akoumparouli/update_set_model_parallel_attributes branch from 2370034 to f4ac304 Compare July 23, 2024 16:42
@akoumpa akoumpa added Run CICD and removed Run CICD labels Jul 23, 2024
Signed-off-by: akoumpa <akoumpa@users.noreply.github.com>
Copy link
Collaborator

@hemildesai hemildesai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@akoumpa akoumpa added Run CICD and removed Run CICD labels Jul 23, 2024
@akoumpa akoumpa added Run CICD and removed Run CICD labels Jul 23, 2024
@akoumpa akoumpa merged commit 10b5442 into main Jul 24, 2024
@akoumpa akoumpa deleted the akoumparouli/update_set_model_parallel_attributes branch July 24, 2024 03:35
akoumpa added a commit that referenced this pull request Jul 25, 2024
* Query TransformerConfig attributes when copying btw configs

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>

* test

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>

* Apply isort and black reformatting

Signed-off-by: akoumpa <akoumpa@users.noreply.github.com>

---------

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
Signed-off-by: akoumpa <akoumpa@users.noreply.github.com>
Co-authored-by: akoumpa <akoumpa@users.noreply.github.com>
Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
BoxiangW pushed a commit to BoxiangW/NeMo that referenced this pull request Jul 30, 2024
…eMo#9832)

* Query TransformerConfig attributes when copying btw configs

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>

* test

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>

* Apply isort and black reformatting

Signed-off-by: akoumpa <akoumpa@users.noreply.github.com>

---------

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
Signed-off-by: akoumpa <akoumpa@users.noreply.github.com>
Co-authored-by: akoumpa <akoumpa@users.noreply.github.com>
Signed-off-by: Boxiang Wang <boxiangw@nvidia.com>
xuanzic pushed a commit to xuanzic/NeMo that referenced this pull request Aug 1, 2024
…eMo#9832)

* Query TransformerConfig attributes when copying btw configs

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>

* test

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>

* Apply isort and black reformatting

Signed-off-by: akoumpa <akoumpa@users.noreply.github.com>

---------

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
Signed-off-by: akoumpa <akoumpa@users.noreply.github.com>
Co-authored-by: akoumpa <akoumpa@users.noreply.github.com>
Signed-off-by: Vivian Chen <xuanzic@example.com>
kchike pushed a commit to kchike/NeMo that referenced this pull request Aug 8, 2024
…eMo#9832)

* Query TransformerConfig attributes when copying btw configs

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>

* test

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>

* Apply isort and black reformatting

Signed-off-by: akoumpa <akoumpa@users.noreply.github.com>

---------

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
Signed-off-by: akoumpa <akoumpa@users.noreply.github.com>
Co-authored-by: akoumpa <akoumpa@users.noreply.github.com>
Signed-off-by: kchike <kohei.chike@jp.ricoh.com>
monica-sekoyan pushed a commit that referenced this pull request Oct 14, 2024
* Query TransformerConfig attributes when copying btw configs

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>

* test

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>

* Apply isort and black reformatting

Signed-off-by: akoumpa <akoumpa@users.noreply.github.com>

---------

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
Signed-off-by: akoumpa <akoumpa@users.noreply.github.com>
Co-authored-by: akoumpa <akoumpa@users.noreply.github.com>
hainan-xv pushed a commit to hainan-xv/NeMo that referenced this pull request Nov 5, 2024
…eMo#9832)

* Query TransformerConfig attributes when copying btw configs

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>

* test

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>

* Apply isort and black reformatting

Signed-off-by: akoumpa <akoumpa@users.noreply.github.com>

---------

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
Signed-off-by: akoumpa <akoumpa@users.noreply.github.com>
Co-authored-by: akoumpa <akoumpa@users.noreply.github.com>
Signed-off-by: Hainan Xu <hainanx@nvidia.com>
XuesongYang pushed a commit to paarthneekhara/NeMo that referenced this pull request Jan 18, 2025
…eMo#9832)

* Query TransformerConfig attributes when copying btw configs

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>

* test

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>

* Apply isort and black reformatting

Signed-off-by: akoumpa <akoumpa@users.noreply.github.com>

---------

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
Signed-off-by: akoumpa <akoumpa@users.noreply.github.com>
Co-authored-by: akoumpa <akoumpa@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments