Benefits and successes of CD2?

[Jeff_F]

What are the new capabilities that came with the transition to Canvas Data 2? What new reports or benefits have been realized? 

For example: 

• late_policies: We can now see if assignments have a missing submission policy set and how many points are deducted when an assignment is missing. That helped us see where a person errantly assigned a deduction of 0 points, meaning students would get a 100% when they do not post a submission.
  
  
• I am seeing a rubrics_assessments table and will be eager to dive into creation of new visualizations to help faculty aggregate rubric score results. However, this data field is a YAML data type which will require additional processing to deserialize it ahead of making good use of it. That is not something I can do using Tableau. 
  
  
• the use_for_grading field within rubrics_associations lets us see where someone added a rubric to an assignment but missed checking off the little box in the settings. 

How about you? What is new and useful?

[KeithSmith_au]

Biggest single benefit is the ability to obtain incremental updates, rather than having to fetch the entire dataset all the time.  The data lag is border-line - less time between updates would be much better.

[Jeff_F]

I don't often reply to my own post, but when I do I try to add value.

------- 

By the way, we are carrying over dozens of reports from CD1. Examples of benefits and capabilities:

Students:

• Early Warning Report - Combining CD with our SIS data we created a dashboard that reports on the status of students.
  
  • Date of last course access
  • Which students are failing/ passing?
  • Which students have/ have not been active in the course in the past 8 days?
  • How many zero grades are assigned?
  • How many assignments are missing?
  • Advisor info
• Assignment and Course Grade History
• How frequently are students accessing Canvas and through what type of device? What is the distribution of usage?
• What type of content within Canvas is being accessed by course? What is the level of activity? What are the specific percentages of engagement?
• How many students fail the course? What are the top 5-10 most failed courses? What courses should students avoid taking at the same time

Instructors:

• Are courses set up by the instructor and ready for term start?
• Has the instructor posted an announcement?
• Has the instructor added biographical information?
• Did the instructor include their contact info to the course bio page?
• Are the dates in modules entered?
• Are any modules locked by date?
• Are availability dates for midterm/final exams set?
• Has the Syllabus and Important Info page been updated?
• Are instructors accessing courses, and how recently? When did they last grade, post an announcement, give feedback, message a student, or reply to a discussion?
• The timeliness of the grading - was grading completed within the 7-day window post due date; the number of teacher comments, and a summary of comments entered.
• What is the distribution of assignment scores?
• How often does the instructor assign a 100%?
• What is the distribution of final course grades?
• Are instructors participating in graded discussions? Do the instructors provide sufficient replies to initial posts by students?
• When do instructors access their courses? Login by month/ hour and day/ hour
• What is the level of participation?
• Are teachers providing comments in the gradebook while grading? Note: does not include instructor comments or annotations made onto the documents in Docviewer.
• How many assignments and quiz essay responses with ungraded questions are 8 days past due date?
• Count the number of students, the assignment names, shows the assignment due date, if the submission was on time or late (filters out late by default), the date the submission was posted by the student and graded by the instructor.
• The amount of time between each grade entered. Used to help administration visualize if there is an issue with how grades are being entered. I.e., grades being entered without a review of the student submission materials, etc.
• Frequency diagram that depicts final course grades across the term/ course over time/ etc.

Templates & course content:

• List of Templates
• List courses by term, College, Department, etc.
• List of Modules and Module Items
• Gradebook Weighting
• Assignment Grading Type & Points
• Pages Content
• Count of the number of published assignments by week of the course.
• Assignment-Breakdown-Count: types of assignments
• Lists assignments that are quizzes
• Details quiz settings and points
• Where embedded videos are located: Studio, YouTube, etc.
• List of assignments that use Turnitin
• A frequency diagram that depicts final course grades
• Is an assignment configured for peer review?
• Lists courses that have groups, details the group structure, as well as the settings.
• Do the details in the assignment/ quiz/ discussion/ page contain specific text strings? e.g. youtu, Twitter, etc. i.e., content search
• A report creates a list of submission download links, which can be used by a Canvas admin to quickly download student file submissions. Used when academic assessment requires independent review of student submissions.

And dozens more....

[JimEgan]

Jeff, thanks for that great list.  The school has been using Canvas for four years (Blackboard before that).  We're just now getting the Canvas data into our EDW.  The rollout delay of CD2 is why it took so long.  Our biggest limitation could be that not all instructors are using Canvas.  That's becoming a rather interesting discussion.

[Jeff_F]

Here are a few details on the benefit of being able to see if the rubric setting 'Use this rubric for assignment grading' is applied.

rubric settingsCD2 Tables in Tableau

Use for grading null - Tableau