Peer review is the evaluation of work by one or more people with similar competencies as the creator of the work. As an instructor on Teamie, you can create assessments that require a learner's attempt to reviewed by one or more of his/her peers, i.e other learners.
These assignments, that are created as peer reviewed assignments, will allow learners to grade the submissions made by other learners and share feedback on the submissions in the form of comments. The allotment of learners to be reviewed by each learner can be done by you manually or automatically. You can also choose the peer review to be done anonymously where learners reviewing and being reviewed will not see each others identity. Let's see how you can create and manage peer reviewed assignments.
The pre-condition to create an assignment as a peer-reviewed assignment is that the assignment should have a deadline attached to it. Once the deadline has passed, then the assignment submissions will be available to respective learners to review as per the peer review ‘available from’ and ‘deadline’ date and time.
Furthermore, you cannot enable group submissions for a peer reviewed assignment and vice versa.
This article will guide you on:
2. Add the required deadline for the assignment.
The due date (deadline) is mandatory for an assignment to enable the Peer Review setting.
3. Click to expand the Grading setting.
4. Click the Require Peer Review sub-setting.
2. On the Peer Review Allotments screen, you will be shown the Learner Name column with the list of all the learners in the classroom/module along with a Learners to Review column for selecting the learner whose submission the corresponding learner in the first column should review. By default, '1' learner's submission is assigned for each learner to review.
If the number of learners in the classroom/module is 50 or above, then manual allotments are not allowed. You will only be able to use automatic allotment.
3. Click the Learners to Review column for a learner. A list with all the other learners of the classroom will be shown. Select the required learner to be reviewed. For example, in the following screenshot, Cloe Chung is assigned to peer review Zach Gleeson's submission for the assignment.
4. The dropdown of the list of learner in each selection will have the following details:
- Learner's profile thumbnail
- Learner's name
- Number of reviewers (This number is the count of learners that have already been allotted to review this learner. The color of the count will be green if it matches the required count (Number of reviews for each learner, which is '1' as shown in the above screenshot) and orange if the required count is lower or higher.
The reason for highlighting the number of reviewers is that every learner would require the same number of reviewers for this to be an even split, but as an instructor, you can use your judgement if you want one particular learners attempt to be reviewed by more learners (for instance because the attempt is really good and other learners can learn from it).
However, we require teachers to give every learner exactly n learners to review, as that guarantees equal distribution of effort.
5. You can also increase the number of reviews for each learner to a maximum of 4. Therefore, a learner can be assigned a maximum of 4 learners' submissions to peer review. In the following scenario, we are allotting/assigning Cloe Chung two learners' (Zach and Jessica) submissions to peer review.
You cannot allot a learner to review the same learner multiple times. Also, a learner cannot review themselves.
6. Similarly, you can manually allot other learners for peer review. Click Save at the bottom right of the screen to save the peer review allotments and return to the assignment expanded view.
7. If required, you can clear the learners to review allotment one by one or all at once.
2. On the Peer Review Allotments screen, click the Automatically Allot Reviewers button. Clicking on this will automatically fill up the table evenly with the members of the classroom. Click Save at the bottom right of the screen to save the peer review allotments and return to the assignment expanded view.
1. Click to expand the required assignment's Grading setting.
2. Click the Peer Review Allotments link.
3. The Peer Review Allotments screen opens. Here you will be able to view all the peer review allotments and change/update them as per your requirement.
You can also click the View attempts button for the assignment to access its Submissions page and see the peer review allotments in the To Review column. The column shows the list of other learner(s) that needs to be reviewed by the corresponding learner.
An assignment is available for the reviewers to peer review as per the 'Review Available From' date and time. The peer review can start only after the assignment's deadline and late submission period, if any. By default, this time is set to 2 minutes after the due date of the assignment (+ any late submission time).
The peer review submissions will be available for the reviewers till the 'Review Deadline' which, by default, is set 3 days after the 'Review Available From' date and time. But as an instructor, you can change the Review available from / deadline as per your requirement.
1.Under the Grading setting of a peer review assignment, click Review Available From and set the required date and time from which the peer review should be available.
2. Similarly, click Review Deadline and set the required date and time till which the peer review should be available.
The publishing workflow of a peer review assignment is similar to how a normal assignment is published. Click the Publish button to publish the required assignment.
The assignment will be published immediately if no 'Available From' date is added, else it will get published as per the 'Available From' date. Once published, the assignment will be available to all the learners of the classroom/module.
1. Click the View Attempts button for the required assignment to access the Submissions page.
2. On the Submissions page, you can see the learner(s) that are allotted to be reviewed by each learner from the To Review column.
3. Click the Peer Review Status dropdown and select Completed Peer Review.
4. The list will be filtered to show only the learners who have completed the peer review of all the learners that were allotted to them. The green tick means the peer review has been done for a learner. The peer review will be considered as completed only when a learner has reviewed all the learners' submissions allotted to him/her.
5. Similarly, you can select the Pending Peer Review option and filter the list of learners who have not yet peer reviewed all their allotted learner submissions. The peer review will be considered as pending if a learner has not reviewed all the learners' submissions allotted to him/her.
1. As an instructor, you can view the peer review scores, grades and comments given on a learner's submission by the reviewer. Click the View Attempts link of the learner whose peer review scores you wish to see. You can also open the learner's submission by clicking the link from the To Review column.
2. The scores given by the reviewer for the learner's attempt will be listed in the Peer Review section. In case a grade scheme is attached to the assignment, then the corresponding grades will also be listed along with any comments added by the reviewer(s).
3. In case a rubric is attached to the assignment, you will be able to see which learner has selected which scale for a criterion.
4. You can then grade the assignment as per your requirement.
5. You can publish/unpublish the score and comments similar to how it is done for a normal assignment.
Take note that the publishing/unpublishing of your scores and comments will not affect the visibility of reviewers scores and comments. Publishing of instructors scores and comments is independent of peer review scores and comments.
As soon as an attempt is peer reviewed, the learner will be able to see the scores, grades and comments given by the reviewer on the attempt. A notification is also sent for comments added during the peer review.
As an instructor, you can enable the anonymous peer review setting so that the peer review process is completely done anonymously at the learners end. This would mean that the reviewer will not know which learner they are reviewing, and the reviewed learner will not know which of their peers reviewed their attempt.
While reviewing a submission, the anonymous learners will be labeled as Learner whereas while viewing the submission the anonymous reviewers will be labeled as Reviewer.
The enable the Peers will review anonymously sub-setting can be configured to be enabled/disabled at the site level by default. This means if this setting is enabled by default, then each time you enable Peer Review for an assignment the enable the Peers will review anonymously sub-setting will be checked by default. Kindly write to us in case you wish to change this default behavior on your Teamie site.
1.Under the Grading setting of a peer review assignment, tick to enable the Peers will review anonymously sub-setting.
2. The setting will be enabled and the peer review will be done anonymously now. Click again in case you wish to uncheck and disable the anonymous peer review workflow.