Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file modified source/img/guides/Grading-new-feature1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified source/img/guides/assessment_sct_check.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified source/img/guides/assessment_sct_execution.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added source/img/guides/customizeSubmitbutton.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified source/img/guides/random-sync.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified source/img/guides/random-update.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added source/img/guides/sql-helpers.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified source/img/guides/std-assessment-args.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified source/img/guides/std-assessment-error.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified source/img/guides/std-assessment-stdin-ignore.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified source/img/guides/std-assessment-stdin.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file removed source/img/sql-helpers.png
Binary file not shown.
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,8 @@ Assessments can be auto-generated using the text on the current guides page as c
:alt: Assessment Generation Prompt


4. When you are satisfied with the result, press **Apply** and then **Create**.
4. When you are satisfied with the result, press **Apply** and then **Create**. If you are not satisfied with the result, select **Regenerate** to create a new version of the assessment. You can provide additional guidance in the **Generation Prompt** field. For example, ``create assessment based on the first paragraph with 2 correct answers``.



.. important:: The generate assessment feature does not configure the page :ref:`layout; <layout>` you should specify the layout depending on how you want to present the information to the students.
Expand Down
4 changes: 3 additions & 1 deletion source/instructors/authoring/assessments/assessments.rst
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,9 @@
Assessments
===========

Assessments can be used to determine how well students understand course material, and can be automatically or manually graded. Codio offers a wide range of assessment types, including auto-graded code tests, multiple choice tests, fill in the blanks, drop-down selection, free text responses, and assignment grading. Assessments can be interspersed throughout tutorial materials or stand alone using an :ref:`assignment level script <auto-grade-scripts>`.
Codio offers assessments that determine how well students understand course material and provide automatic or manual grading options. Codio offers a wide range of assessment types, including auto-graded code tests, multiple choice tests, fill in the blanks, drop-down selection, free text responses, and assignment grading. Assessments can be interspersed throughout tutorial materials or stand alone using an :ref:`assignment level script <auto-grade-scripts>`.

Codio provides a Starter Pack project that contains examples for all assessment types and a guides authoring cheat sheet. Go to **Starter Packs**, search for **Demo Guides and Assessments**, click **Use Pack**, then click **Create** to install it to your Codio account.

You can view the results of assessments in a course from the teacher dashboard.

Expand Down
150 changes: 127 additions & 23 deletions source/instructors/authoring/assessments/random.rst
Original file line number Diff line number Diff line change
Expand Up @@ -6,55 +6,159 @@
Random Assessment
=================

The Random assessment type allows you to set up a group of assessments to then randomly assign one to each individual student assignment. Multiple Random assessments can be added on the same page but all of those random assessments must be of Simple layout type (1 Panel without tree). Random assessments with Complex layout (any layout other than 1 Panel without tree) can not be added on the same page or mixed with any other assessments. If you do mix Complex layout Random assessments with any other assessment, it may not function as intended and you will also get a warning when you Publish the assignment.
The Random assessment type allows you to define a pool of assessments, with each student receiving a randomly selected assessment from that pool. Note that specific layout requirements apply.

There is assignment level duplication prevention such that regardless of the query, Codio checks whether the library assessment IDs are unique. This prevents students from seeing the same assessment question multiple times in an assignment, as long as every question in the library is unique, and all randomized assessments are drawn from the same library.
If duplicate assessments are generated, it indicates that the assessment library does not have enough unique assessments for the set of random assessment queries in the assignment.
**Layout Requirements**

* **Simple Layout (1-panel)**: Multiple Random assessments can be added on the same page
* **Complex Layout (multi-panel)**:

* Cannot be added on the same page
* Cannot be mixed with any other assessments
* Warning will display when Publishing if mixed with other assessments
* May not function as intended if layout requirements are violated

**Duplication Prevention**

Codio automatically prevents duplicate assessments at the assignment level by checking library assessment IDs for uniqueness. This ensures students won't see the same assessment question multiple times within an assignment.

**Requirements for duplication prevention:**

* All questions in the assessment library must be unique
* All randomized assessments must be drawn from the same library

.. note::
If duplicate assessments are generated, the assessment library does not contain enough unique assessments to satisfy all random assessment queries in the assignment.

Creating a Random Assessment
~~~~~~~~~~~~~~~~~~~~~~~~~~~~

1. On the **General** page, enter the name of your assessment that describes the test. This name is displayed in the teacher dashboard so the name should reflect the challenge and thereby be clear when reviewing.

2. On the **Grading** page, enter the amount of points to assign to the assessment. Enter the score for correctly answering the question they are assigned. You can choose any positive numeric value. If this is an ungraded assessment, enter zero (0).

- **Use maximum score** - Toggle to enable assessment final score to be the highest score attained of all runs.
- **Use maximum score** - Enables selection of the highest score from all attempts as the final assessment score.

3. On the **Execution** page, browse to an assessment library where you can set up filters define the range of assessments to randomly assign. You can work from any assessment library you have access to.

.. list-table:: Filter Categories and Inputs
:widths: 30 70
:header-rows: 1

* - Category
- Available Inputs & Description
* - Bloom's Taxonomy Level
- .. tab-set::

.. tab-item:: Levels I-III

* Level I - Remembering
* Level II - Understanding
* Level III - Applying

.. tab-item:: Levels IV-VI

* Level IV - Analyzing
* Level V - Evaluating
* Level VI - Creating
* - Assessment Type (auto-detected)
- .. tab-set::

.. tab-item:: Code-Based

* Standard Code Test
* Advanced Code Test
* Parsons Puzzle

.. tab-item:: Text-Based

* Multiple Choice
* Fill in the Blanks
* Free Text Autograde
* - Programming Language
- Select the programming language for code-based assessments (e.g., Python, Java, C++, JavaScript)
* - Category (topic-level)
- Broad subject area or topic category for filtering assessments (e.g., variables, functions, loops).
* - Content (sub-topic level)
- Specific subtopic or concept within the category (e.g., modifying variables, creating functions, nesting for loops).
* - Learning Objective (SWBAT form)
- Define what "Students Will Be Able To..." accomplish after completing the assessment

Example: "Students will be able to implement binary search algorithms efficiently"


:ref:`Click here <assess-library>` for more information on how to use Assessment Libraries.


Updating Random assessments
---------------------------

If you wish to update, change or review the assessments assigned to the random assessment, select the **Update Search** button on the **Execution** tab and this will open the assessment library field with the saved search parameters.

Updating Random Assessments
~~~~~~~~~~~~~~~~~~~~~~~~~~~


Modifying Assessment Parameters
-------------------------------

To update, change, or review the assessments assigned to a random assessment:

1. Navigate to the **Execution** tab
2. Select the **Update Search** button
3. The assessment library field will open with your saved search parameters

.. image:: /img/guides/random-update.png
:alt: Update Random assessment
:width: 450px


Publishing Changes
------------------

After reviewing assessments, follow the appropriate publishing method based on your situation:

**If ONLY random assessment changes were made:**

* Students have not started: Publish normally
* Students have already started: Use the **Sync** button on the **Edit** tab (see Synchronizing Changes below)

**If other assignment changes were also made:**

* Publish normally first
* Then navigate to the **Edit** tab to sync if students have started

Synchronizing Changes from the Course
-------------------------------------

You can then review the assesments and publish the assignment if you wish in the usual manner, but if the only changes made are in relation to the random assignment and there are students who may have already started the assignment you should do go to the **Edit** tab and use the **Sync** button. If you have made other changes to the assignment though, publish in the usual manner as well and then go to the **Edit** tab. If students have already started the assignment, the **Sync** button will show
When random assessment changes are made (either by you or another organization member), synchronize them from the **Edit** tab in the course.

Publishing/Synchronising changes from the **Course**
----------------------------------------------------
A **Sync** button appears on the **Edit** tab when changes are available to synchronize.

If the only changes to a previously published assignment are for the random assessment(s), or if someone else in the organization has updated the assessments being used in the assignment, the changes made can be updated/synchronised from the **Edit** tab in the course.
.. image:: /img/guides/random-sync.png
:alt: Synchronize Random assessment
:width: 500px

A **Sync** button will be shown on the **Edit** tab for the assignment if there are changes that can be updated/synchronised.
.. warning::
Students who have already started the assignment will not receive updates unless their assignment is reset. Resetting will cause them to start "as new" and **all previous work will be lost**.

.. image:: /img/guides/random-sync.png
:alt: Synchronise Random assessment
Sync Options
------------

If there are students that have already started the assignment they will not get the updates/changes unless their assignments is also reset so they will start again 'as new' and any previous work will be lost.
When you press the **Sync** button, Codio will check if students have started and present appropriate options:

Pressing the **Sync** button will identify if there are students who have already started and then give you the option to reset and publish or just publish so then only students who have not started the assignment will get the update/changes
**No students have started**

**Synchronising where no students started assignment**
The assignment will sync and publish to all students.

.. image:: /img/guides/random-sync-nostudents.png
:alt: Synchronise Random assessment no students started
.. image:: /img/guides/random-sync-nostudents.png
:alt: Synchronize Random assessment - no students started
:width: 300px

**Synchronising where students have started assignment**
**Students have started**

.. image:: /img/guides/random-sync-studentsstarted.png
:alt: Synchronise Random assessment students started
You can choose to:

* **Reset and publish**: All students restart with new changes (previous work lost)
* **Publish only**: Only students who haven't started receive the changes

.. image:: /img/guides/random-sync-studentsstarted.png
:alt: Synchronize Random assessment - students started
:width: 450px
25 changes: 7 additions & 18 deletions source/instructors/authoring/assessments/splice.rst
Original file line number Diff line number Diff line change
Expand Up @@ -8,10 +8,13 @@ SPLICE Assessments

SPLICE (Standards, Protocols, and Learning Infrastructure for Computing Education) provides a protocol for information exchange between the assessment and the application in which it is embedded. To use a SPLICE assessment, provide a link to the assessment, and Codio will display it in an iframe. More information about SPLICE assessments may be found here: https://cssplice.org/.

**The assessment portion of a SPLICE assessment is created outside of Codio.**
.. note:: The assessment portion of a SPLICE assessment is created outside of Codio.

How to Use a SPLICE Assessment in Codio
---------------------------------------

For more information on **Metadata** (Optional) and **Files** (Optional) see :ref:`Assessments <assessments>`.

How to use a SPLICE Assesment in Codio
**************************************

1. On the **General** page, enter the name of your assessment that describes the test. This name is displayed in the teacher dashboard so the name should reflect the challenge and thereby be clear when reviewing.

Expand All @@ -21,18 +24,4 @@ How to use a SPLICE Assesment in Codio

- **Use maximum score** - Toggle to enable assessment final score to be the highest score attained of all runs.

4. (Optional) Click **Metadata** in the left navigation pane and complete the following fields:

.. image:: /img/guides/assessment_metadata.png
:alt: Metadata

- **Bloom's Level** - Click the drop-down and choose the level of Bloom's Taxonomy: https://cft.vanderbilt.edu/guides-sub-pages/blooms-taxonomy/ for the current assessment.
- **Learning Objectives** The objectives are the specific educational goal of the current assessment. Typically, objectives begin with Students Will Be Able To (SWBAT). For example, if an assessment asks the student to predict the output of a recursive code segment, then the Learning Objectives could be *SWBAT follow the flow of recursive execution*.
- **Tags** - The **Content** and **Programming Language** tags are provided and required. To add another tag, click **Add Tag** and enter the name and values.

5. (Optional) Click **Files** in the left navigation pane and check the check boxes for additional external files to be included with the assessment when adding it to an assessment library. The files are then included in the **Additional content** list.

.. image:: /img/guides/assessment_files.png
:alt: Files

6. Click **Create** to complete the process.
4. Click **Create** to complete the process.
Loading