Skip to content

[hotfix] bump datasets pin to fix python compat#109

Merged
ifrit98 merged 4 commits intostagingfrom
hotfix/bump_datasets
Aug 1, 2023
Merged

[hotfix] bump datasets pin to fix python compat#109
ifrit98 merged 4 commits intostagingfrom
hotfix/bump_datasets

Conversation

@ifrit98
Copy link
Contributor

@ifrit98 ifrit98 commented Jul 26, 2023

This fixes a new issue (3 days old) with python updating multiprocessing for python 3.11 support. Borks all fresh python (any version) installs of bittensor as datasets was pinned at a lower version.

Does 2 things:

  • datasets pinned to 2.14.0.
  • bittensor version bump to 5.2.1 (hotfix for this issue)

See bittensor release 5.2.1
opentensor/bittensor#1468

@ifrit98 ifrit98 requested a review from camfairchild July 26, 2023 23:48
@ifrit98 ifrit98 changed the title bump (and loosen) datsets to fix python compat [hotfix] bump (and loosen) datsets to fix python compat Jul 26, 2023
@ifrit98 ifrit98 changed the title [hotfix] bump (and loosen) datsets to fix python compat [hotfix] bump (and loosen) datasets to fix python compat Jul 26, 2023
requirements.txt Outdated
transformers<=4.28.0
wandb==0.15.3
datasets==2.12.0
datasets>=2.14.0
Copy link
Contributor

@Eugene-hu Eugene-hu Jul 31, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a reason that we moved from a strict == version requirement to a loose one? Personally, I think it's a better practice to pin the version or a limited set of version with <= so that we are unaffected by sudden new releases of dataset. What do you think?

@ifrit98 ifrit98 changed the base branch from main to staging August 1, 2023 22:40
@ifrit98 ifrit98 changed the title [hotfix] bump (and loosen) datasets to fix python compat [hotfix] bump datasets pin to fix python compat Aug 1, 2023
@ifrit98 ifrit98 merged commit 5bf1d74 into staging Aug 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants