Conversation
Contributor
Eugene-hu
commented
Jul 20, 2023
Eugene-hu
commented
- Increases the base count limit to 3000. By increasing the history, the change decreases the variance observed by the miners due to fluctuations in data. This also ensures that any outlier in both the prompt dataset and answers have less effect on future responses
- Currently, at the limit of 1000 responses, we observe fluctuations are heavily impacted by outliers, which has lasting effects and increases the variance in rewards. This change will decrease the effects of outliers by 3x.
- 3000 responses at 80% response rate can be achieved most validators within 200-300 blocks; well within the expected lifetime of the validator. If we were to further increase the count limit, a saving mechanism should be implemented for the reward models to enable faster consensus.
Hotfix: Device errors
pull num_uids from subtensor
Hotfix: Device fixes gating changes
This reverts commit a6cb53f.
Eugene-hu
requested review from
isabella618033,
opentaco,
p-ferreira and
steffencruz
shibshib
approved these changes
Jul 20, 2023
steffencruz
approved these changes
Jul 20, 2023
p-ferreira
approved these changes
Jul 21, 2023
Contributor
|
Why was this approved and then reverted? EDIT: e422d2a |
Contributor
Author
This was an accident, we are going to release this change in the next release. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
6 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.