Skip to content

add DeepSpeedZeroConfig __repr__ method#596

Merged
jeffra merged 2 commits intodeepspeedai:masterfrom
stas00:zero_config_repr
Dec 11, 2020
Merged

add DeepSpeedZeroConfig __repr__ method#596
jeffra merged 2 commits intodeepspeedai:masterfrom
stas00:zero_config_repr

Conversation

@stas00
Copy link
Copy Markdown
Collaborator

@stas00 stas00 commented Dec 11, 2020

DeepSpeedZeroConfig object isn't being shown during startup

before:

[2020-12-10 21:24:11,820] [INFO] [config.py:648:print]   zero_config .................. 
<deepspeed.runtime.zero.config.DeepSpeedZeroConfig object at 0x7f32d4c0dbb0>

after this PR:

[2020-12-10 21:59:46,612] [INFO] [config.py:648:print]   zero_config .................. {
    "allgather_bucket_size": 500000000,
    "allgather_partitions": true,
    "contiguous_gradients": false,
    "cpu_offload": false,
    "elastic_checkpoint": true,
    "load_from_fp32_weights": true,
    "overlap_comm": false,
    "reduce_bucket_size": 500000000,
    "reduce_scatter": true,
    "stage": 0
}

Also I'm not sure about other files, but this file is in DOS format (\r\n/^M line ending)... is this by design?

@jeffra jeffra merged commit 66268bd into deepspeedai:master Dec 11, 2020
@stas00 stas00 deleted the zero_config_repr branch December 11, 2020 20:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants