Management > Reliability Page

Reliability Page: Allocate Re-assessments

Use this function to determine how assessments will be distributed when they are sent for re-assessment.

Following the link at the bottom of the Reliability Tab (shown above) takes you to the screen below:

In this page, you will have to firstly choose which rubrics you will re-assess, and then who will do the assessment. Finally, choose how many re-assessments are carried out. The process will try to find a certain number of assessments for every rubric, and then send them to assessors to be scored again. These scores will be compared anonymously with the original scores.

1. Rubrics

The rubrics you can choose for the reliability assessments are listed at the top of the page. Every rubric listed here has had a piece of work submitted that has been assessed using that rubric. If the rubric you want to check the reliability of isn't listed here, then work based on that rubric hasn't yet been submitted. You can choose to focus either on a particular rubric or a combination. By checking All rubrics with existing assessments, you can choose all the rubrics that are linked with completed assessments.

2. Assessors

You can decide who will carry out the re-assessment of the work by checking the boxes next to the names of the appropriate assessors. As the assessments are distributed randomly between assessors, a larger number of re-assessments should divide roughly evenly between assessors. Assessors who have been assigned reliability assessments will see a new category at the bottom of their My Assessments Tab which lists these.

3. Number of Re-assessments

This number determines how many times a re-assessment will be required for each rubric identified at the top of the page in step 1.

• Studies involving larger numbers of assessments, such as an institution-wide reliability re-assessment, will probably only need 1 re-assessment to be made per rubric
• Detailed studies, such as looking at a specific rubric, may need a higher number of re-assessments to ensure the validity of the results.
• Use a higher number of re-assessments when comparing rubrics

Management > My Assessments Page