From b99f991f810aeb505c586ef5e7af07f1e2f6ceca Mon Sep 17 00:00:00 2001 From: spearce Date: Tue, 10 Dec 2013 11:45:52 -0500 Subject: [PATCH] ORA-237: Number in "Available for Grading" column drops rapidly Added the following under "Grade an Open Response Assessment Problem": After you've graded enough responses for AI assessments to start, the number of responses in the Available to grade column decreases rapidly as the algorithm grades responses and returns them to your students in just a few seconds. No student data is lost. Also corrected a few minor formatting problems. --- .../source/open_response_assessment.rst | 88 +++++++++---------- 1 file changed, 44 insertions(+), 44 deletions(-) diff --git a/docs/course_authors/source/open_response_assessment.rst b/docs/course_authors/source/open_response_assessment.rst index 40fb1bd4f38a..f2863e87fa66 100644 --- a/docs/course_authors/source/open_response_assessment.rst +++ b/docs/course_authors/source/open_response_assessment.rst @@ -160,23 +160,23 @@ Step 1. Create the Component Step 2. Add the Question ~~~~~~~~~~~~~~~~~~~~~~~~ -- In the component editor, locate the [prompt] tags. +#. In the component editor, locate the [prompt] tags. .. image:: Images/ORA_Prompt.gif -Replace the sample text between the **[prompt]** tags with the text of -your question. When you replace the sample text, make sure you follow -these guidelines to avoid common formatting mistakes. +#. Replace the sample text between the **[prompt]** tags with the text of + your question. When you replace the sample text, make sure you follow + these guidelines to avoid common formatting mistakes. -- Leave the **[prompt]** tags in place. -- Enclose all text in HTML tags. + - Leave the **[prompt]** tags in place. + - Enclose all text in HTML tags. Step 3. Add the Rubric ~~~~~~~~~~~~~~~~~~~~~~ -**Note** *After you release your problem to students in your live course, make sure -you don't make any changes to the rubric that affect scoring, such as adding or removing an option -in a category. Changing the rubric can cause errors in live courses.* +.. note:: After you release your problem to students in your live course, make sure + you don't make any changes to the rubric that affect scoring, such as adding or removing an option + in a category. Changing the rubric can cause errors in live courses.* #. In the component editor, locate the [rubric] tags. (The sample rubric is long, so you'll have to scroll down to locate the second tag.) @@ -186,14 +186,12 @@ in a category. Changing the rubric can cause errors in live courses.* #. Replace the sample rubric with the text of your rubric. Make sure to do the following. -- Include the beginning and ending [rubric] tags. -- Precede the categories with a plus (+) sign. -- Precede the options with a minus (-) sign. + - Include the beginning and ending [rubric] tags. + - Precede the categories with a plus (+) sign. + - Precede the options with a minus (-) sign. + - List the option that scores zero points first, followed by the option that scores one point, and so on. -- List the option that scores zero points first, followed by the option - that scores one point, and so on. - - For example, your rubric might resemble the following rubric. + For example, your rubric might resemble the following rubric. :: @@ -212,9 +210,9 @@ in a category. Changing the rubric can cause errors in live courses.* Step 4. Set the Assessment Type and Scoring ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ -**Note** *After you release your problem to students in your live course, make sure -you don't make any changes to the code for the assessment type and scoring. Changing -this code can cause errors in live courses.* +.. note:: After you release your problem to students in your live course, make sure + you don't make any changes to the code for the assessment type and scoring. Changing + this code can cause errors in live courses.* To set the assessment type and scoring for your open response assessment, you'll enter code that specifies the type and order of assessments to use along with @@ -267,14 +265,14 @@ Set the Type and Scoring Step 5. Set the Problem Name ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ -**Note** *After you release your problem to students in your live course, make sure -you don't change the name of the problem. Changing the display name when the problem -is live can cause a loss of student data.* +.. note:: After you release your problem to students in your live course, make sure + you don't change the name of the problem. Changing the display name when the problem + is live can cause a loss of student data. -*You can change the display name of a problem while you're still testing the problem. -However, note that all the test responses and scores associated with the problem -will be lost when you change the name. To update the problem name on the -instructor dashboard, submit a new test response to the problem.* + You can change the display name of a problem while you're still testing the problem. + However, note that all the test responses and scores associated with the problem + will be lost when you change the name. To update the problem name on the + instructor dashboard, submit a new test response to the problem. The name of the problem appears as a heading above the problem in the courseware. It also appears in the list of problems on the **Staff @@ -401,7 +399,7 @@ Step 7. Save the Problem The component appears in Studio. In the upper right corner, you can see the type of assessments that you have set for this problem. -.. image:: Images/ORA_Component.gif + .. image:: Images/ORA_Component.gif Step 8. Add the Peer Grading Interface (for peer assessments only) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ @@ -622,25 +620,27 @@ Click **Back to problem list** to return to the list of problems. You can also wait for a few minutes and click **Re-check for submissions** to see if any other students have submitted responses. -**Note** - -When a response opens for you to grade, it leaves the current "grading pool" -that other instructors or students are grading from, which prevents other -instructors or students from -grading the response while you are working on it. If you do not submit a score -for this response within 30 minutes, the response returns to the grading pool -(so that it again becomes available for others to grade), even if you still have -the response open on your screen. +.. note:: After you've graded enough responses for AI assessments to start, the number + of responses in the **Available to grade** column decreases rapidly as + the algorithm grades responses and returns them to your students in just + a few seconds. No student data is lost. + +.. note:: When a response opens for you to grade, it leaves the current "grading pool" + that other instructors or students are grading from, which prevents other + instructors or students from grading the response while you are working on + it. If you do not submit a score for this response within 30 minutes, + the response returns to the grading pool (so that it again becomes available + for others to grade), even if you still have the response open on your screen. -If the response returns to the grading pool (because the 30 minutes have passed), -but the response is still open on your screen, you can still submit feedback for -that response. If another instructor or student grades the response after it returns to the -grading pool but before you submit your feedback, the response receives two grades. + If the response returns to the grading pool (because the 30 minutes have passed), + but the response is still open on your screen, you can still submit feedback for + that response. If another instructor or student grades the response after it returns to the + grading pool but before you submit your feedback, the response receives two grades. -If you click your browser's **Back** button to return to the problem list before you -click **Submit** to submit your feedback for a response, the response stays outside -the grading pool until 30 minutes have passed. When the response returns to the -grading pool, you can grade it. + If you click your browser's **Back** button to return to the problem list before you + click **Submit** to submit your feedback for a response, the response stays outside + the grading pool until 30 minutes have passed. When the response returns to the + grading pool, you can grade it. Access Scores and Feedback ~~~~~~~~~~~~~~~~~~~~~~~~~~