The manual SBGR workflows require instructors to review the assessment evidence and then use their professional judgement to assess the mastery of the learner for a particular learning standard or strand. This, however, would require instructors reviewing all the assessments, and then assessing mastering for all standards, and then for all strands, which in some cases could be a time consuming activity.
In order to reduce some of this effort that instructors need to put in, we have mastery automation logic for SBGR workflows. The mastery automation logic calculates the automation mastery based on the scores received by the learners on their last three graded assessments that are ordered on the basis of their deadlines (deadline (in case of assignment) and Test date (in case of an Offline test)). As an instructor, you can manually override the mastery record, if required.
- The automation would only happen for the lowest levels of the standards which is then rolled up to a parent level using averages of the children.
- Assessments that doesn't have a deadline date/test date will not be considered for mastery.
This article will guide you on:
Following conditions need to be met for assessment(s) to be included in mastery automation:
- They should be summative.
- They should have a deadline/test date.
- They should be graded.
If the above conditions are met, then the assessments will be ordered as per their deadline/test date and considered for the automation mastery as per the classroom level / site level automation mastery logic - Latest Summative Assessment, Decaying Average, Statistical Mode, Statistical Mean.
The achieved Mastery will be dependent only on the selected standards and the deadline, and not on:
- Assessment created/updated date
- Attempt start/submission date
- Attempt graded date
We have the following 4 types of logic for calculation Mastery Automation logic.
- Latest Summative Assessment: This method calculates mastery based on the most recent summative assessment score, giving priority to the latest evaluation of a student's performance.
- Decaying Average: This method prioritises recent assessments by assigning higher weightage to the latest graded assessments while still factoring in older ones, with their influence gradually reduced over time. The mastery score is calculated based on the most recent graded assessment and the previous two graded assessments, if available. The weightage percentages for these assessments can be configured at the site level. For instance, a 50-30-20 weightage means 50% weight is assigned to the latest assessment, 30% to the next most recent, and 20% to the third.
- Statistical Mode: This method identifies the most frequently occurring mastery level among all assessments to calculate the mastery score.
- Statistical Mean: This method calculates mastery by averaging the scores of all assessments, providing an overall representation of a student's performance.
These methods can be configured, on request, at two levels - Site Level and the Classroom Level:
- Site Level: A single automation mastery calculation method is applied across all classrooms on the site with mastery settings enabled.
- Classroom Level: Admins have the flexibility to select automation mastery calculation methods for each classroom as per their requirements.
For 'Decaying Average' automation mastery logic, the mastery progression will be calculated based on the score for the latest graded assessment and the previous two graded assessments. The assessments will be ordered based on their deadline date/test date. The calculation logic for the eligible assessments is more clearly explained with the help of following scenarios:
1. If a classroom has one assessment, that is aligned with an objective, then the automated mastery scale will give 100% weightage to the scale by the learner in that assignment.
The mastery automation calculation logic will be listed under the mastery progression calculation.
2. If two assessments are aligned with an objective, then the automated mastery scale will give 60% weightage to the scale received on the first assessment (with closest deadline/test date) and 40% to the scale received on the second assessment.
3. If three assessments are aligned with an objective, then the automated mastery scale will give 50% weightage to the scale received on the first assessment, 30% to the second assessment and 20% to the scale of the assessment whose deadline/test date is the farthest.
4. If more than 3 assignments are aligned to an objective, then the last three assessments (sorted by deadline/test date) will be considered for automated mastery.
You can hover over the assessment box to view its name.
5. If a new eligible assessment is graded, then a new automation mastery will be created. You can view all the automated mastery created for an objective for a learner.
The Statistical Mode mastery automation logic determines a learner's mastery score by identifying the most frequently occurring score from all their graded assessments linked to a specific standard or objective. This method focuses on consistency, highlighting the level of mastery that a learner most regularly demonstrates over time. The mode logic, the value that appears most often, avoids being skewed by unusually high or low scores, providing a balanced representation of the learners typical performance.
The mode represents the most frequently achieved mastery scale (e.g., Emerging, Approaching, Meeting, Extending) for a specific standard across assessments. This allows educators to identify patterns in a learners progress and provide actionable insights based on consistent performance.
Practical Example:
A student is assessed on the standard ELA.Reading.1 across four assessments, with the following mastery scales:
| Assessment | Mastery Scale |
| Assessment 1 | Progressing |
| Assessment 2 |
Beginning |
| Assessment 3 |
Beginning |
| Assessment 4 |
Meeting |
Mastery Calculation:
The most frequent scale is Beginning, which will be the mastery score for ELA.Reading.1.
Mastery Progression:
- After Assessment 1: Progressing (since there is only a single assessment which has been assessed as Progressing)
- After Assessment 2: Beginning (since there are 2 assessments with 1 value each, we will pick the one with the latest deadline that has been graded - Beginning)
- After Assessment 3: Beginning (since there are 3 assessments out of which the most common scale attained is Beginning)
- After Assessment 4: Beginning (since there are 4 assessments out of which the most common scale attaining is Beginning)
This progression shows how the mastery for the standard evolves with each assessment.
The Statistical Mean mastery automation logic calculates a learner's mastery score by taking the average of all their graded assessments associated with a specific standard or objective. The mastery calculation is based on the arithmetic average of mastery scales across assessments. This method offers a balanced representation of a learner's overall performance and ensures that every assessment contributes equally to the final mastery score.
The Statistical Mean mastery automation logic provides an equitable and balanced way to calculate mastery by considering all assessments equally. It empowers educators with accurate and dynamic insights into student performance while simplifying mastery calculations.
Practical Example:
Mastery Scale Attainments for a Student for a Specific Standard (e.g., Math.Geometry.1):
| Assessment | Mastery Scale | Numeric Value Associated with Mastery Scale |
| Assessment 1 | Progressing | 1 |
| Assessment 2 |
Beginning | 2 |
| Assessment 3 |
Meeting |
3 |
| Assessment 4 |
Meeting | 3 |
Calculation:
- Mean = (1 + 2 + 3 + 3)/4 = 2.25
- Rounded to Beginning (corresponding to the numeric value of 2).
The Latest Summative Assessment mastery automation logic calculates a learner's mastery score based solely on the most recent summative assessment completed for a specific standard or objective. It focuses on assessing a learner’s most current performance by prioritising the mastery scale achieved in the most recent summative assessment. This method ensures that the mastery score reflects the student’s latest understanding and progress, offering a dynamic and up-to-date evaluation.
This approach is especially useful in cases where the curriculum is structured to allow learners to demonstrate incremental progress and improvement through multiple assessments. By using the latest summative assessment, teachers can ensure that mastery scores reflect the learner's most current level of understanding.
Practical Example:
Mastery Scale Attainments for a Student for a Specific Standard (e.g., Science.Inquiry.1):
| Assessment | Mastery Scale |
| Assessment 1 | Emerging |
| Assessment 2 |
Approaching |
| Assessment 3 |
Meeting |
| Assessment 4 |
Approaching |
Calculation:
- Mastery = Approaching, based on the mastery scale achieved in Assessment #4 (the most recent summative assessment).
Each time a new summative assessment is graded, the mastery score for the standard is updated to reflect the latest scale achieved. For example:
- After Assessment 1: Mastery = Emerging.
- After Assessment 2: Mastery = Approaching.
- After Assessment 3: Mastery = Meeting.
- After Assessment 4: Mastery = Approaching.
This progression ensures that the mastery score reflects the learners most recent performance, providing clarity and consistency.
As an instructor, you might assess a learner on a much higher mastery scale for a latest assessment, but the latest assessment might not be a clear indicator of the overall mastery for the learner. So, when a new automated mastery is recorded for a latest assessment which leeds to a change of 2 or more level of achievements for a learner, an automated mastery flag will be generated to highlight those mastery record(s).
1. Click a cell with the automated flag.
2. You will be shown the warning that the latest automated mastery has led to a change of 2 or more levels!
3. You can check by clicking the wand icon for the last two masteries to view how many levels did the latest automated mastery changed from the previously recorded automation mastery. For example, in the following screenshots, the latest automated mastery has led to a change of 2 levels, from 'D' to 'C' (the change of mastery level being C+ and C).
4. Click Dismiss to approve the changes after you have reviewed them. This action cannot be undone.
5. The automated flag will be removed from the cell.
6. You can dismiss all the automated mastery flags for a classroom at once by clicking Dismiss all automated mastery flags. This will remove all the mastery flags in a classroom's Mastery View. This action cannot be undone, so dismiss at your discretion.
7. You can click on a learner in the Mastery View to see the individual objective. You will be able to see the automated mastery flag warning for the corresponding objective and will have the option to dismiss it from there too.
In the mastery progression view, automated mastery will be recorded for the latest three eligible assessments (as per their deadline/test date). But, as this calculation only include graded assessments, so any ungraded assessment with the deadline/test date in between the latest three assessments will be skipped and the mastery will have the potential to change.
The above mastery scores (for all assessments) will be recalculated, each time, for the affected learners when the following changes occur:
- Instructor grades an assessment
- Instructor adds/publishes/unpublishes/deletes an assessment with an attached objective
- Instructor changes the deadline/test date
- Instructor changes the personalised sharing settings
During the recalculation, only if the mastery score for that assessment is updated, then the updated time will be changed, else it should have the older updated time. For other changes, such as, changing the deadline/test date, the automation of mastery data will run at a set interval. You will also be informed the last time the automation of mastery ran.
1. If the mastery scores can potentially change in the future once some assessments are graded, then it will be highlighted to the instructors. For this, the cell will filled with slanting lines as shown in the following screenshot:
2. Any cell with the special mastery highlight will indicate that its mastery has potential to change.
3. Click on a cell with special mastery to view the mastery progression. Click on the wand icon below a mastery progression to see the assessment(s) which can change the overall mastery for the learner.
A cell can have both the special mastery highlight as well as the automated mastery flags.
As an instructor, you can export mastery view data which will export an excel sheet with an overview tab and details tab for list of objectives. Let's see how to export mastery view data for a SBGR enabled classroom.
Any filters set on the Mastery View page will not be reflected in the export sheet.
1. On the Mastery View of the required classroom, click Export All Data.
2. The excel sheet with the mastery view data will be downloaded. Open the sheet.
3. The overview sheet will have the classroom name, date and time of export with time zone along with the list of mastery level achievements.
4. The Strands and Standards sheet will have the mastery achieved by the learners and will have the details of the mastery achievements along with their color codes.
Comments