Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
88 changes: 44 additions & 44 deletions docs/course_authors/source/open_response_assessment.rst
Original file line number Diff line number Diff line change
Expand Up @@ -160,23 +160,23 @@ Step 1. Create the Component
Step 2. Add the Question
~~~~~~~~~~~~~~~~~~~~~~~~

- In the component editor, locate the [prompt] tags.
#. In the component editor, locate the [prompt] tags.

.. image:: Images/ORA_Prompt.gif

Replace the sample text between the **[prompt]** tags with the text of
your question. When you replace the sample text, make sure you follow
these guidelines to avoid common formatting mistakes.
#. Replace the sample text between the **[prompt]** tags with the text of
your question. When you replace the sample text, make sure you follow
these guidelines to avoid common formatting mistakes.

- Leave the **[prompt]** tags in place.
- Enclose all text in HTML tags.
- Leave the **[prompt]** tags in place.
- Enclose all text in HTML tags.

Step 3. Add the Rubric
~~~~~~~~~~~~~~~~~~~~~~

**Note** *After you release your problem to students in your live course, make sure
you don't make any changes to the rubric that affect scoring, such as adding or removing an option
in a category. Changing the rubric can cause errors in live courses.*
.. note:: After you release your problem to students in your live course, make sure
you don't make any changes to the rubric that affect scoring, such as adding or removing an option
in a category. Changing the rubric can cause errors in live courses.*

#. In the component editor, locate the [rubric] tags. (The sample rubric
is long, so you'll have to scroll down to locate the second tag.)
Expand All @@ -186,14 +186,12 @@ in a category. Changing the rubric can cause errors in live courses.*
#. Replace the sample rubric with the text of your rubric. Make sure to
do the following.

- Include the beginning and ending [rubric] tags.
- Precede the categories with a plus (+) sign.
- Precede the options with a minus (-) sign.
- Include the beginning and ending [rubric] tags.
- Precede the categories with a plus (+) sign.
- Precede the options with a minus (-) sign.
- List the option that scores zero points first, followed by the option that scores one point, and so on.

- List the option that scores zero points first, followed by the option
that scores one point, and so on.

For example, your rubric might resemble the following rubric.
For example, your rubric might resemble the following rubric.

::

Expand All @@ -212,9 +210,9 @@ in a category. Changing the rubric can cause errors in live courses.*
Step 4. Set the Assessment Type and Scoring
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

**Note** *After you release your problem to students in your live course, make sure
you don't make any changes to the code for the assessment type and scoring. Changing
this code can cause errors in live courses.*
.. note:: After you release your problem to students in your live course, make sure
you don't make any changes to the code for the assessment type and scoring. Changing
this code can cause errors in live courses.*

To set the assessment type and scoring for your open response assessment, you'll
enter code that specifies the type and order of assessments to use along with
Expand Down Expand Up @@ -267,14 +265,14 @@ Set the Type and Scoring
Step 5. Set the Problem Name
~~~~~~~~~~~~~~~~~~~~~~~~~~~~

**Note** *After you release your problem to students in your live course, make sure
you don't change the name of the problem. Changing the display name when the problem
is live can cause a loss of student data.*
.. note:: After you release your problem to students in your live course, make sure
you don't change the name of the problem. Changing the display name when the problem
is live can cause a loss of student data.

*You can change the display name of a problem while you're still testing the problem.
However, note that all the test responses and scores associated with the problem
will be lost when you change the name. To update the problem name on the
instructor dashboard, submit a new test response to the problem.*
You can change the display name of a problem while you're still testing the problem.
However, note that all the test responses and scores associated with the problem
will be lost when you change the name. To update the problem name on the
instructor dashboard, submit a new test response to the problem.

The name of the problem appears as a heading above the problem in the
courseware. It also appears in the list of problems on the **Staff
Expand Down Expand Up @@ -401,7 +399,7 @@ Step 7. Save the Problem
The component appears in Studio. In the upper right corner, you can
see the type of assessments that you have set for this problem.

.. image:: Images/ORA_Component.gif
.. image:: Images/ORA_Component.gif

Step 8. Add the Peer Grading Interface (for peer assessments only)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Expand Down Expand Up @@ -622,25 +620,27 @@ Click **Back to problem list** to return to the list of problems. You
can also wait for a few minutes and click **Re-check for submissions**
to see if any other students have submitted responses.

**Note**

When a response opens for you to grade, it leaves the current "grading pool"
that other instructors or students are grading from, which prevents other
instructors or students from
grading the response while you are working on it. If you do not submit a score
for this response within 30 minutes, the response returns to the grading pool
(so that it again becomes available for others to grade), even if you still have
the response open on your screen.
.. note:: After you've graded enough responses for AI assessments to start, the number
of responses in the **Available to grade** column decreases rapidly as
the algorithm grades responses and returns them to your students in just
a few seconds. No student data is lost.

.. note:: When a response opens for you to grade, it leaves the current "grading pool"
that other instructors or students are grading from, which prevents other
instructors or students from grading the response while you are working on
it. If you do not submit a score for this response within 30 minutes,
the response returns to the grading pool (so that it again becomes available
for others to grade), even if you still have the response open on your screen.

If the response returns to the grading pool (because the 30 minutes have passed),
but the response is still open on your screen, you can still submit feedback for
that response. If another instructor or student grades the response after it returns to the
grading pool but before you submit your feedback, the response receives two grades.
If the response returns to the grading pool (because the 30 minutes have passed),
but the response is still open on your screen, you can still submit feedback for
that response. If another instructor or student grades the response after it returns to the
grading pool but before you submit your feedback, the response receives two grades.

If you click your browser's **Back** button to return to the problem list before you
click **Submit** to submit your feedback for a response, the response stays outside
the grading pool until 30 minutes have passed. When the response returns to the
grading pool, you can grade it.
If you click your browser's **Back** button to return to the problem list before you
click **Submit** to submit your feedback for a response, the response stays outside
the grading pool until 30 minutes have passed. When the response returns to the
grading pool, you can grade it.

Access Scores and Feedback
~~~~~~~~~~~~~~~~~~~~~~~~~~
Expand Down