Brainstorming self-assessment and results aggregation methods

[imerricks]

I am seeking ideas from the community about how to optimise our regulator-mandated self-assessment process.

Our current process is:

1. At the start of a course, students rate themselves in a range of skills, using a Classic Quizzes survey.
2. At the end of the course, student fill in an identical survey.
3. Our data analyst compares the results to gauge the extent of perceived improvement by students.

Given we run many hundreds of intakes per year, the task of downloading and collating stats from individual quizzes is extremely inefficient.

Can any community members suggest alternative tools (native or third-party) or methods for conducting this type of assessment?

Thank you, Isobel

[paul_fynn · Accepted solution]

@imerricks 

Have you investigated Canvas Mastery Outcomes as a way of reporting Quiz Outcomes at sub-account level (ie from different Canvas Courses ?

See https://community.canvaslms.com/t5/Canvas-Basics-Guide/What-are-Outcomes/ta-p/75 

[masantos · Accepted solution]

Hello @imerricks,

My institution is HigherEd as well. We have a different department that handles what we call Course Experience Surveys. I am not sure what survey tool they use (I'll look into it), but we added a Course Experience button to our global navigation to make it easy for students to access the survey (I believe it is Qualtrics). To advertise it in Canvas during survey time, we previously used Global Announcements and now use Impact campaign messaging.

Google Forms is very simple and free to use, but if you want more data, you may be interested in using a platform like Qualtrics.

[masantos]

Hello,

Could you share what kind of institution you are at? Is it K-12 or HigherEd? I'd like to get a better understanding of how you want the data collected.

Some ideas I have:

1. Separate Course - Create a separate course for all students to enroll in and provide the Classic Quizzes survey there. This way you can get all of the results in one location and download a CSV. To get demographic data include those types of data.
2. Google Form - Create a Google form for all students to use. This can be embedded (visually and easier to access for students) in a Canvas course, and the results can be displayed in a single space.
3. Use other survey tools outside of Canvas and provide a link in Canvas - Survey Monkey, Qualtrics, etc.

I hope this helps.

-MaryAnn

[imerricks]

Thanks very much @masantos, for these suggestions. 

Having a separate course could work, but our students already have a lot of enrollments so we're reluctant to add more.

The survey tools we use don't have the ability to track individual respondents, but we will look around to see if any others do have this ability.

We haven't tried Google forms before, so will definitely investigate this.

We are a higher education institution. 

[masantos · Accepted solution]

Hello @imerricks,

My institution is HigherEd as well. We have a different department that handles what we call Course Experience Surveys. I am not sure what survey tool they use (I'll look into it), but we added a Course Experience button to our global navigation to make it easy for students to access the survey (I believe it is Qualtrics). To advertise it in Canvas during survey time, we previously used Global Announcements and now use Impact campaign messaging.

Google Forms is very simple and free to use, but if you want more data, you may be interested in using a platform like Qualtrics.

[masantos · Accepted solution]

@imerricks 

I just reread your response and just realized your comment "track individual respondent". I see what you mean by this, and it is tricky because there is no tool in Canvas that will allow you to connect both. Quiz outcomes that @paul_fynn may be an option for you to look into, but for the most part you will need to look at two or more separate data points. Other data points to look at in addition to your Survey data are:

• Account and Course Analytics
• Admin Analytics
• Canvas Data 2
• Impact (separate paid platform through Instructure)

These analytics, of course, vary depending on the type of role you have in Canvas.

[paul_fynn · Accepted solution]

@imerricks 

Have you investigated Canvas Mastery Outcomes as a way of reporting Quiz Outcomes at sub-account level (ie from different Canvas Courses ?

See https://community.canvaslms.com/t5/Canvas-Basics-Guide/What-are-Outcomes/ta-p/75