-
Notifications
You must be signed in to change notification settings - Fork 4.2k
Waheed/ora72 consistent rubric scores 2 #1837
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Waheed/ora72 consistent rubric scores 2 #1837
Conversation
|
@waheedahmed , can you explain why this PR is able to provide a normalized score on the fly without writing it to the db? |
|
@dianakhuang , can you take a look? |
|
@adampalay @dianakhuang In this PR we are overwriting latest_score and all_score in OpenEndedModule, where we are returning sum of rubric scores for ML grading otherwise returning attempt["score"] without modifying data in DB. For this purpose we wrote function score_for_attempt and if we want to update scores in DB then we can use normalize_scores which is currently not using in this PR. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
OpenEndedModule is a child class of OpenEndedChild. The method get_score of CombinedOpenEndedV1Module uses all_scores of OpenEndedChild to retrieve scores of all attempts of all task_states.
This all_scores() method in OpenEndedModule instead of simply picking the value from the attempt dictionary as is done in OpenEndedChild uses self.score_for_attempt()
|
I think this looks good. |
|
I think you might need to rebase off master as well because you have a few extraneous commits. |
|
@waheedahmed , be sure to touch base with @wedaly about testing before merging |
|
The unit tests look reasonable. As we discussed, this definitely needs end-to-end testing. I'd expect you to verify:
You can do this testing either in Vagrant fullstack or in a sandbox. I'd recommend testing the demo course, which contains all the ORA problem types. Please document the testing that you've completed in a wiki page. I'd also like @ormsbee to look this over for potential grading impact that we might have missed. |
|
@wedaly here the details of the testing we did: https://edx-wiki.atlassian.net/wiki/display/ORA/ORA-72+Testing |
|
Looks good to me, thanks for documenting the testing. 👍 Once the tests pass |
|
@waheedahmed , while you're rebasing, can you make this pull request against the current release branch? We're going to try to hotfix this in ASAP |
|
Rebased against release. |
… scores every time for ML grading. ORA-72
…)" (openedx#1848) This reverts commit d486226.
No description provided.