Splitagain

source/instructors/authoring/assessments/add-assessment.rst

@@ -24,6 +24,7 @@ Auto-Graded Assessments
    free-text
    grade-book
    llm-based-rubric
+   llm-based-auto-rubric
    math-assessments
    multiple-choice
    parsons-puzzle
@@ -69,4 +70,5 @@ Refer to the specific topics for the type of assessment:
 - :ref:`Grade Book <grade-book>`
 - :ref:`Parsons Puzzle <parsons-puzzle>`
 - :ref:`Random Assessment <random>`
-- :ref:`LLM Rubric and LLM Rubric Autograde <llm-based-rubric>`
+- :ref:`LLM Rubric Grader <llm-based-rubric>`
+- :ref:`LLM Rubric Autograde <llm-based-auto-rubric>`

source/instructors/authoring/assessments/llm-based-auto-rubric.rst

@@ -0,0 +1,89 @@
+.. meta::
+   :description: Use an LLM to generate a rubric and grade based on that rubric. 
+
+.. _llm-based-auto-rubric:
+
+
+The LLM Rubric Auto-grader
+==========================
+
+The **LLM Rubric Autograde** assessment automatically grades student submissions using an LLM-generated rubric and displays feedback directly to students without requiring instructor approval.
+
+It can be found in the **Auto-Graded** section of the assessments menu. If you wish to approve the LLM grading before it is displayed to the student, see the :ref:`LLM Rubric <llm-based-rubric>` assessment in the **Manually Graded** section.
+
+More information about adding assessments can be found in our :ref:`assessment documentation <add-assessment>`.
+
+There are two steps to the **LLM Rubric Autograde** process:
+
+1. Rubric generation
+2. LLM-based grading using the generated rubric
+
+
+Add an **LLM Rubric Autograde** assessment to your guide page and follow the steps below.
+
+LLM-Based Rubric Creation (Step 1)
+----------------------------------
+
+Complete the sections below to set up your rubric grader. For more information on **General**, **Metadata** (optional) and **Files** (optional) see :ref:`Assessments <assessments>`.
+
+1. Complete **General**.
+
+2. Click **Grading** in the navigation pane and complete the following information:
+
+.. image:: /img/guides/llmbasedrubric.png
+   :height: 600
+   :alt: Generate a rubric
+
+- Add a solution file (1) if you wish the rubric creation process to consider your solution.
+
+- Click the **Generate Rubrics** (2) button to initiate the process.
+
+The **Rubric Creation Agent** uses the following items to generate the rubric items:
+
+- The assessment name
+- Instructions provided in the **General** tab of the assessment
+- Content of the Guide Page where the assessment is being added
+- Contents of the provided solution file
+- The Course, Module, and Assignment name
+- Requirements specified in the Rubric creation tab
+
+.. Note:: If you do not specify rubric requirements, the system will generate rubric items using general code grading norms.
+
+Add your requirements in the **Rubric Requirements** dialog (optional): 
+
+.. image:: /img/guides/llmrubricreqs.png
+   :height: 600
+   :alt: Area to add your rubric requirements
+
+
+- Once you are done, click **Generate Using AI**. 
+- You can provide additional rubric items by clicking **Add Rubric** and entering information.
+- Once you have reviewed the rubric items and other settings, click **Save** to save the assessment.
+
+
+LLM Grading Based on the Created Rubric (Step 2)
+------------------------------------------------
+
+The grading occurs when the student clicks the **Check It** button. The LLM Grading agent uses the following to grade the student's work:
+
+- Instructions provided in the **General** tab of the assessment
+- Contents of the Guide page where the assessment is located
+- Contents of the specified solution file
+- The student file
+- The rubric generated in the previous step to identify the grading criteria
+
+Sample feedback for the Auto-Graded Version:
+
+.. image:: /img/guides/rubricfinal.png
+    :height: 600
+    :alt: Final grading information displayed to the student
+
+Rubric Requirements Example
+---------------------------
+(You can view another example on the :ref:`LLM Rubric Grader <llm-based-rubric>` page.) 
+
+Use only the following criteria for evaluating the student code:
+
+- The code correctly implements the requested task and outputs the correct values.
+- Variable and function names are descriptive and clearly indicate their purpose in the program. 
+- The code includes at least two meaningful comments.

source/instructors/authoring/assessments/llm-based-rubric.rst

@@ -1,50 +1,44 @@
 .. meta::
-   :description: Use an LLM to generate a rubric and grade based on that rubric
+   :description: Use an LLM to generate a rubric and grade based on that rubric. Teacher manually approves the results.
 
 .. _llm-based-rubric:
 
 
-LLM-Based Rubric Grader
-=======================
+The LLM Rubric Grader
+=====================
 
-Codio has provided two versions of the **LLM-Based Rubric Grader**. One requires the instructor to approve the LLM-generated feedback, and the other automatically displays it to the student.
+The **LLM Rubric** assessment requires instructor approval before feedback is displayed to students. It can be found in the **Manually Graded** section of the assessments menu. 
+
+If you wish to skip the approval process see the :ref:`LLM Rubric Autograde <llm-based-auto-rubric>` assessment in the **Auto-Graded** section.
 
-The **LLM Rubric Autograde** assessment is in the **Auto-Graded** section of the assessments menu and the **LLM Rubric** assessment is in the **Manually Graded** section.
 More information about adding assessments can be found in our :ref:`assessment documentation <add-assessment>`.
 
-The first two steps are the same for both versions: 
+There are three steps to the **LLM Rubric** process:
 
 1. Rubric generation
 2. LLM-based grading using the generated rubric
-
-.. Note:: Step 3 is required only for the manually graded version - LLM feedback will not be released to the student until the instructor reviews and approves it.
-
 3. Manual approval of LLM-generated grades by the instructor
 
+.. Note:: Step 3 is required - LLM feedback will not be released to the student until the instructor reviews and approves it.
 
 
-LLM-Based Rubric Creation (Step 1)
-----------------------------------
-
-Add an **LLM Rubric** or **LLM Rubric Autograde** assessment to your guide page and follow the steps below.
-
+Add an **LLM Rubric** assessment to your guide page and follow the steps below.
 
-1. On the **General** page, enter the following information:
+LLM Based Rubric Creation (Step 1)
+----------------------------------
 
-   - **Name** - Enter a short name that describes the test. This name is displayed in the teacher dashboard so the name should reflect the challenge and thereby be clear when reviewing.
+Complete the sections below to set up your rubric grader. For more information on **General**, **Metadata** (optional) and **Files** (optional) see :ref:`Assessments <assessments>`.
 
-     Toggle the **Show Name** setting to hide the name in the challenge text the student sees.
-
-   - **Instructions** - Enter text that is shown to the student using optional Markdown formatting.
+1. Complete **General**.
 
 2. Click **Grading** in the navigation pane and complete the following information:
 
-   - Add a solution file (1) if you wish the rubric creation process to consider your solution.
-
 .. image:: /img/guides/llmbasedrubric.png
    :height: 600
    :alt: Generate a rubric
 
+- Add a solution file (1) if you wish the rubric creation process to consider your solution.
+
 - Click the **Generate Rubrics** (2) button to initiate the process.
 
 The **Rubric Creation Agent** uses the following items to generate the rubric items:
@@ -56,7 +50,7 @@ The **Rubric Creation Agent** uses the following items to generate the rubric it
 - The Course, Module, and Assignment name
 - Requirements specified in the Rubric creation tab
 
-.. Note:: If you do not add rubric requirements; the process will use general code grading norms to supply rubric items.
+.. Note:: If you do not specify rubric requirements, the system will generate rubric items using general code grading norms.
 
 Add your requirements in the **Rubric Requirements** dialog (optional): 
 
@@ -72,7 +66,6 @@ Add your requirements in the **Rubric Requirements** dialog (optional):
 
 LLM Grading Based on the Created Rubric (Step 2)
 ------------------------------------------------
-
 The grading occurs when the student clicks the **Check It** button. The LLM Grading agent uses the following to grade the student's work:
 
 - Instructions provided in the **General** tab of the assessment
@@ -81,24 +74,17 @@ The grading occurs when the student clicks the **Check It** button. The LLM Grad
 - The student file
 - The rubric generated in the previous step to identify the grading criteria
 
-Sample feedback for the Auto-Graded Version:
-
-.. image:: /img/guides/rubricfinal.png
-    :height: 600
-    :alt: Final grading information displayed to the student
-
-
-Manual Approval by Instructor (Step 3 - only for the manually-graded version)
------------------------------------------------------------------------------
 .. Note::  The student receives information about whether they have passed or failed each rubric item, but does not see the rest of the LLM-generated feedback until after the instructor conducts their review.
 
-
-Sample student view of the feedback, before instructor approval:
+Sample feedback displayed to the student (before instructor approval):
 
 .. image:: /img/guides/rubricprelim.png
     :height: 600
-    :alt: Preliminary grading information displayed to the student
+    :alt: Sample feedback displayed to the student before instructor approval
+
 
+Manual Approval by Instructor (Step 3)
+--------------------------------------
 In the case of the manually graded version of this assessment, the instructor must open the student's assignment and select the passing test cases as part of the :ref:`grading process <grading>`. The instructor can also edit the comments generated by the LLM. Once this process is complete, click on **Apply Grade**. 
 
 .. Warning:: Once feedback is released to students, it cannot be modified.
@@ -113,9 +99,9 @@ Sample Instructor view of LLM-generated feedback:
 
 Rubric Requirements Example
 ---------------------------
+(You can view another example on the :ref:`LLM Rubric Autograde <llm-based-auto-rubric>` page.) 
 
-.. code-block:: text
+Use only the following criteria for evaluating the student code:
 
-      Use the following criteria, assigning equal weight to each one.
-      - Program correctness
-      - Proper and efficient usage of a dictionary data structure
+- Program correctness
+- Proper and efficient usage of a dictionary data structure

source/instructors/getstarted/support/changelog.rst

@@ -27,6 +27,10 @@ We do not report small bug fixes or issues that affect individual users, who we
 
 - `[I] [29th]`: Option added to display expected answer and Rationale when grades have been released.
 
+**August 2025**
+
+- `[I] [21st]`: The Join a Course token is now four words instead of two. 
+
 **July 2025**
 
 - `[I] [30th]`: If a student tries to log in when they have an uncompleted assignment in Single Login mode, they have the option to mark that assignment as complete.

source/instructors/teaching/grading/grading.rst

@@ -28,38 +28,26 @@ Grading process
 ---------------
 Once students have completed their assignments, they notify the teacher by using the **Education > Mark as Completed** menu in the IDE. Instructors can also mark the assignment as complete or change the status to incomplete. Follow these steps to view and grade the assignments:
 
-1. Open the assignment and view the students that have a green check mark to the left of their name. This indicates that they have marked as complete.  
+1. Open the assignment and view the students who have a check mark to the left of their name in the **Completed** column. This indicates that they have marked as complete.  
 
   .. image:: /img/grading-unit.png
     :alt: Grading Access
 
-2. Optionally, click the **Filter** drop-down and choose one of the following options to filter the list of students based on the status of the assignments:
+2. You can click the status drop-down if you want to filter the list of students based on the status of their assignments. For example, **Started**, **Completed** or **Needs Grading**.
 
-  .. image:: /img/filter.png
-   :alt: Filtering
-
-  - Any Status
-  - Started
-  - Not Started
-  - Has Final Grade
-  - No Final Grade
-  - Completed
-  - Uncompleted
-  - Needs Grading
-
-3. Click the **Options** menu and choose **Open the Project** to start grading the student's assignment.
+3. Click the three vertical dots in the **Actions** column and choose **Open student's project** to start grading the student's assignment.
 
 4. Use one of the following methods to assign the grade:
 
-  - In the IDE, click the **Education** menu. You must have a student project open in the IDE.
-  - On the Course dashboard, click the **Grade** icon > **Add Grade** and complete the fields. You can also add comments.
+- If you have opened the student's project, click the **Grading** button. 
+- On the Course dashboard, click the item in the **Grade** column for that student and complete the fields. You can also add comments.
 
-  .. image:: /img/grading-assign.png
-     :alt: Assign Grade
+.. image:: /img/grading-assign.png
+   :alt: Assign Grade
 
-In the IDE, you can jump to next/previous student's assignment using **Next** or **Previous** button at the top.
+From inside a student's project, you can jump to next/previous student's assignment using **Next** or **Previous** button at the top.
 
-If there is another assessment that is ungraded in the assingment, the **Next Ungraded** and **Previous Ungraded** button will appear in the top menu. When clicked, you will be brought to the respective guide page where the ungraded assessment is present.
+If there is another assessment that is ungraded in the assignment, the **Next Ungraded** and **Previous Ungraded** buttons will appear in the top menu. When clicked, you will be brought to the respective guide page containing the ungraded assessment.
 
   .. image:: /img/speedgrading.png
      :alt: Speed Grading buttons
@@ -69,20 +57,9 @@ If there is another assessment that is ungraded in the assingment, the **Next Un
 Grading Queue
 -------------
 
-Information on all students that require grading for all assignments in the course can be seen from the course **Queue** area in the **Grading** section.
-
-By default the Grading Queue displays all students' submission that require grading, organized by module/assignment but using the Do Not Group button you can swap to view the queue where the list is sorted by submission time, with the oldest submission at the top but other filters can be set as required.
-
-  .. image:: /img/gradingqueue.png
-     :alt: Grading Queue
-
+Information on all students that require grading for all assignments in the course can be seen from the **Grading>Queue** item in your course.
 
-- Student Name
-- Answered
-- Points
-- Grade
-- Time
-- Graded
+By default the Grading Queue displays all students' submission that require grading, organized by module and assignment. You can use the **Do Not Group** button to sort the list by submission time, with the oldest submission at the top. Other filters can be set as required.
 
 
 As explained in the previous section, once you open a student's submission then you can use **Next**, **Previous**, **Next Ungraded** and **Previous Ungraded** buttons to move to the next/previous student submission or next/previous ungraded assessment in that specific assignment.
@@ -97,37 +74,25 @@ The **Override Grade** feature can also be used to provide comments at the assig
   .. image:: /img/class_administration/grading/assignment-comments.png
      :alt: Assignment Comments
 
-Grading rubric is no longer visible to student if teacher overrides grade
--------------------------------------------------------------------------
-When a teacher manually grades an assignment using the rubric and then overrides the grades, Grading rubric is no longer visible to students.
-
-This one has the grade overridden and this is what the student dashboard looks like
-
-.. image:: /img/Overridengarde.png
-     :alt: Overriden-grade
-
-This is the student's dashboard view if the grade has not been overridden
-
-
-.. image:: /img/No-overrindengrade.png
-     :alt: No-Overriden-grade
+.. This is a comment
+.. I took this whole bit about rubric not showing up with overriden grades because rubrics aren't showing up in any case and the screen shots were bad and had my name and a customer's name and I did not add them.
 
 Removing Penalties
 ------------------
 
-If required you can remove penalties currently applied to the students grade.
+In the **Grade Adjustments** section of the grading screen you can remove penalties by toggling the **Do not apply penalty** option.
 
    .. image:: /img/latepenalty.png
       :alt: Remove Penalties
 
 
 Anonymous grading
 -----------------
-If required, anonymous grading can be set for the course so students cannot see the names of the teachers who graded their work. The teacher names are hidden in the shared feedback, project, and dashboard. 
+Anonymous grading can be set for the course and then students cannot see the names of the teachers who graded their work. The teacher names are hidden in the shared feedback, project, and dashboard. 
 
 To enable anonymous grading, follow these steps:
 
-1. Open the course and click the **Grading/Basic Settings** tab.
+1. Open the course and select the **Grading>Basic Settings** tab.
 2. Toggle **Anonymous Grading** to enable it and then click **Save Changes**.
 
 Code Commenting