The manual SBGR workflows require instructors to review the assessment evidence and then use their professional judgement to assess the mastery of the learner for a particular learning standard or strand. This, however, would require instructors reviewing all the assessments, and then assessing mastering for all standards, and then for all strands, which in some cases could be a time consuming activity.
In order to reduce some of this effort that instructors need to put in, we have mastery automation logic for SBGR workflows. The mastery automation logic calculates the automation mastery based on the scores received by the learners on their last three graded assessments that are ordered on the basis of their deadlines (deadline (in case of assignment) and Test date (in case of an Offline test)). As an instructor, you can override the mastery record, if required.
- The automation would only happen for standards or lower levels of the curriculum, and not for strands.
- Assessments that doesn't have a deadline date/test date will not be considered for mastery.
This article will guide you on:
Following conditions need to be met for assessment(s) to be included in mastery automation:
- They should be summative.
- They should have a deadline/test date.
- They should be graded.
If the above conditions are met, then the assessments will be ordered as per their deadline/test date with the latest getting the most weightage.
The achieved Mastery will be dependent only on the scores and the dates, and not on:
- Assessment created/updated date
- Attempt start/submission date
- Attempt graded date
In the mastery progression, mastery score will be calculated based on the score for the latest graded assessment and the previous two graded assessments. The assessments will be ordered based on their deadline date/test date. The calculation logic for the eligible assessments is more clearly explained with the help of following scenarios:
1. If a classroom has one assessment, that is aligned with an objective, then the automated mastery scale will give 100% weightage to the scale by the learner in that assignment.
2. If two assessments are aligned with an objective, then the automated mastery scale will give 60% weightage to the scale received on the first assessment (with closest deadline/test date) and 40% to the scale received on the second assessment.
3. If three assessments are aligned with an objective, then the automated mastery scale will give 50% weightage to the scale received on the first assessment, 30% to the second assessment and 20% to the scale of the assessment whose deadline/test date is the farthest.
4. If more than 3 assignments are aligned to an objective, then the last three assessments (sorted by deadline/test date) will be considered for automated mastery.
You can hover over the assessment box to view its name.
5. If a new eligible assessment is graded, then a new automation mastery will be created. You can view all the automated mastery created for an objective for a learner.
As an instructor, you might assess a learner on a much higher mastery scale for a latest assessment, but the latest assessment might not be a clear indicator of the overall mastery for the learner. So, when a new automated mastery is recorded for a latest assessment which leeds to a change of 2 or more level of achievements for a learner, an automated mastery flag will be generated to highlight those mastery record(s).
1. Click a cell with the automated flag.
2. You will be shown the warning that the latest automated mastery has led to a change of 2 or more levels!
3. You can check by clicking the wand icon for the last two masteries to view how many levels did the latest automated mastery changed from the previously recorded automation mastery. For example, in the following screenshots, the latest automated mastery has led to a change of 2 levels, from 'D' to 'C' (the change of mastery level being C+ and C).
4. Click Dismiss to approve the changes after you have reviewed them. This action cannot be undone.
5. The automated flag will be removed from the cell.
6. You can dismiss all the automated mastery flags for a classroom at once by clicking Dismiss all automated mastery flags. This will remove all the mastery flags in a classroom's Mastery View. This action cannot be undone, so dismiss at your discretion.
7. You can click on a learner in the Mastery View to see the individual objective. You will be able to see the automated mastery flag warning for the corresponding objective and will have the option to dismiss it from there too.
In the mastery progression view, automated mastery will be recorded for the latest three eligible assessments (as per their deadline/test date). But, as this calculation only include graded assessments, so any ungraded assessment with the deadline/test date in between the latest three assessments will be skipped and the mastery will have the potential to change.
The above mastery scores (for all assessments) will be recalculated, each time, for the affected learners when the following changes occur:
- Instructor grades an assessment
- Instructor adds/publishes/unpublishes/deletes an assessment with an attached objective
- Instructor changes the deadline/test date
- Instructor changes the personalised sharing settings
During the recalculation, only if the mastery score for that assessment is updated, then the updated time will be changed, else it should have the older updated time. For other changes, such as, changing the deadline/test date, the automation of mastery data will run at a set interval. You will also be informed the last time the automation of mastery ran.
1. If the mastery scores can potentially change in the future once some assessments are graded, then it will be highlighted to the instructors. For this, the cell will filled with slanting lines as shown in the following screenshot:
2. Any cell with the special mastery highlight will indicate that its mastery has potential to change.
3. Click on a cell with special mastery to view the mastery progression. Click on the wand icon below a mastery progression to see the assessment(s) which can change the overall mastery for the learner.
A cell can have both the special mastery highlight as well as the automated mastery flags.
As an instructor, you can export mastery view data which will export an excel sheet with an overview tab and details tab for list of objectives. Let's see how to export mastery view data for a SBGR enabled classroom.
Any filters set on the Mastery View page will not be reflected in the export sheet.
1. On the Mastery View of the required classroom, click Export All Data.
2. The excel sheet with the mastery view data will be downloaded. Open the sheet.
3. The overview sheet will have the classroom name, date and time of export with time zone along with the list of mastery level achievements.
4. The Strands and Standards sheet will have the mastery achieved by the learners and will have the details of the mastery achievements along with their color codes.
Comments