Overview

Rubric reporting helps you keep track of your students' ratings across specific assessment criteria and accreditation standards for the span of their academic careers.

 

Report Parameters

Report parameters establish how a report is generated. Not all parameters will be available for every report. As a general rule, the fewer parameters you use, the more data you're likely to see in the report's output. Using additional parameters will allow you to filter the report output to a more specific subset of data. 

The four types of parameters that may be used to determine a report's output are:

• Source
• Subject
• Timeframe
• Format

Source

Parameters found under the "Source" category will allow you to specify the source of the data you expect to see in the report's output. 

Examples of "Source" parameters include: 

• Accreditation Standard: Select the list of standards you would like to report on. This list will show any standards that have been aligned to rubrics in your database (available on the #604, 605, and 606 reports).
• Select Individual Standard(s): Select individual standards from the entire list to zone in on outcomes aligned to those specific requirements (available on the #604, 605, and 606 reports).
• Rubric: This required filter allows you to select a single rubric. The report output will show any outcomes for an individual student (not excluded by other parameters) that are tied to that rubric. A rubric may be equivalent in size and scope to one assessment form. Or you may have larger rubrics whose criteria are divided amongst multiple assessment forms, in which case you'll be able to aggregate the data collected on multiple forms using this report (available on the #601, 602, and 603 reports). 
• Include N/A responses: If this box is checked, any ratings in which students received a N/A response will show up in the report output. If this box is not checked, N/A responses will not be included. 
• Assignments Used In: If the selected rubric or accreditation standard is used across a number of different assignments, you can tailor your output to specific assignments from which you would like to pull data. For example, if you use the same underlying rubric for both midterm and final evaluations but you only need to analyze students’ final evaluations, you could choose to filter by the final evaluation assignment. 
• Group(s) assigned to: This will limit the data to information collected via assignments in the selected group(s). You will be able to select both current groups and expired groups (groups with an end date in the past). 
• Assessor Role: If your program uses the same rubric for student self-evaluations, faculty evaluations of the student, and site supervisor evaluations of the student, the assessor role allows you to zero in on data provided by a specific assessor. (This filter references who an assignment is set to be “completed by” in the assignment settings).

Subject

Report parameters found under the "Subject" category will allow you to tailor your report's output to show data about an identified individual or group. 

Examples of "Subject" parameters include: 

• Program: Select the program(s) to which the students whose outcomes you want to review are associated.
• Sub-Program: Select the sub-program(s) to which the students whose outcomes you want to review are associated.
  • The checkbox "Display Student Sub-Program(s)" will add a "Sub-Program(s)" column to the report output, and each student's sub-program(s) should be listed in their row(s) of the report. 
• Get Students from Group: This will show data from all rubrics or standards about students who are part of the selected group. You will be able to select both current groups and expired groups (groups with an end date in the past). 
  • For example: if you have students in a particular cohort or specialization who were in different sections of a class or took the class in different terms, you could still get all of the data related to those students in one report by selecting their common cohort from this parameter. 
• Student: Select an individual student whose outcomes you would like to review. 
• Include Demographics:  If this box is checked, the selected student's date of birth, graduation date, race, ethnicity, gender, sex, and sexual orientation will be displayed as columns in the spreadsheet output if that information has been entered in the student's profile (available on the #602 and 606 raw data reports). 
• Demographic Filters: Use these filters to refine your report output. Any filters selected will be included as part of the header information displayed on the PDF output, for your reference. If multiple demographics are selected, the report will display anyone who meets any of the identified demographics (available on the #601, 603, 604, and 605 reports). 

  DOB: Select a single date or range of dates.
  Graduation Date: Select a single date or a range of dates.
  Race: Single or multiple selections can be made.
  Ethnicity: Single or multiple selections can be made.
  Gender: Single or multiple selections can be made.
  Sex: Single or multiple selections can be made.
  Sexual Orientation: Single or multiple selections can be made.

Timeframe

The timeframe parameter category allows you to narrow your report output to show data from a given time frame. Note that the timeframe relies on the "creation date" of a document, or the date on which it was started, rather than the date on which it was completed. 

• Date Range: Enter the date range you would like to report on. 

Format

The format parameter category is available in the raw data reports (#602 and 606 reports) and will allow you to identify the format in which you would like to export the data. 

• Format: If this parameter is available, the default format is an Excel spreadsheet, but you can change the format to Comma Separated Values (CSV) or Tab Separated Text if you prefer. 
  • If the Format parameter is not available, your report will be generated as a PDF document.

NOTE: Only the parameters with a red outline are required. You may choose to use the optional parameters to further filter the report output.
 

#601 - Individual Student Rubric

Pull individual student outcomes on one rubric. If students are assessed on rubric criteria multiple times, see outcomes side by side to analyze student progress.

 

Report Output




 

602 - Group Rubric Raw Data

Pull group or individual raw data from one rubric. Report output shows assessor names, names of students, and assessment dates for highly contextualized insights.

Report Output  

603 - Group Rubric Analysis

Pull rubric outcomes for a group of students. Output includes distrbution of scores on that rubric for the selected group, along with mean, mode, and standard deviation of scores.  

Report Output 

604 - Accreditation Standards - Individual Student

Pull individual students outcomes on one list of assessment standards. If students are assessed on one standard multiple times, see those outcomes side by side to gauge student progression over time.

The 604 report shows progress on standards for a single student. You’ll want to use this report when you want to view the progress of one student on your accreditation standards or your school’s specific KPIs or SLOs. 

Report Output 

 

605 - Accreditation Standards - Group Analysis

Pull reports demonstrating the distribution of students in your program, or specific groups of students who are meeting or failing to meet your assessment standards benchmarks.

The 605 report shows progress on standards for a group of students across one or more programs. You’ll want to use this report when you want to view the progress of multiple students on your accreditation standards or your school’s specific KPIs or SLOs. The total number of students being assessed is displayed on page 1, just above the Standard Level Counts.

Report Output  

606 - Accreditation Standards Raw Data

Pulls group or individual raw data from one list of assessment standards. Report output shows assessor name, student name, date of assessment, and scores received for highly contextualized data.

The 606 report allows you to export the raw data for a particular set of standards across one or more programs. This report is a great option for programs that use another system for analytics or need to further manipulate the data obtained on accreditation standards.

Report Output 

 

Setting your program up for successful rubric reporting:

1. Consider Sub-Programs, Cohorts, and Specializations: By adding students to any sub-programs, cohorts, and specializations that you need to divide outcomes into, you will be able to easily filter report outputs using these groups later on. Learn more here . 
2. Ensure that your program’s standards have been built and aligned to rubrics as necessary and confirm that your rubrics have been built optimally to support the reporting you need to do. Learn more here. 
3. Confirm that the “completed by” setting in all assignments has been set up correctly, so that you can report by assessor role. Learn more about assignment setup here.