[ARCHIVED] Override Quiz Grades - Human vs. Machine

[bwarner1]

Hi All, yesterday marked my first attempt to build a quiz, and the first problem that I found is that if students didn't write the answer exactly as I created it, it marked them wrong. In my case, working with ESL students, many students might have something like a spelling error that doesn't matter in the context of the quiz, but Canvas marked them as wrong.

I'm looking for a way to override answers marked as incorrect. It seems to me there must be a way to go in as a teacher to fix this, but I can't see it. Can anyone point me in the right direction?

Thanks so much!

[Chris_Hofer]

Hello  @bwarner1 ...

I don't believe anything really exists in the current Canvas interface, but I did want to point you to a Guide related to the Quizzes.Next project that Instructure has been working on: How do I create a Fill in the Blank question in the Quizzes LTI?.  In this Guide, you'll see that you can choose the "Close Enough" option (see the screen shot about half way down the page).  Quizzes.Next isn't available to everyone yet (no release date has been announced).  If you are not yet a part of the https://community.canvaslms.com/groups/quizzes group here in the Community, you can use the group link I've provided and then click on the "Follow" button at the top right corner of the page.  Also, you may need to choose the "Actions" >> "Join groups" menu option which is located near that same are of the page.

I hope this helps, Brent.

[bwarner1]

Thank you Chris, this is very helpful, though I'm admittedly a bit surprised that it wasn't built to allow for any flexibility. I guess it's all one step at a time!

[ericwerth]

Hi  @bwarner1 , I thought I would add that if you open the quiz in Speedgrader, you can give credit or partial credit to questions one student at a time. I use this often to award partial credit for various response.

Good luck!

[bwarner1]

Thanks Eric, after reading your response, I found the "fudge points" option at the bottom. This does loosely what I'm looking for, but doesn't serve a great purpose for helping students understand their mistakes. At least they'll get their points, though!

[James]

 @bwarner1 , in case you missed it in Eric's comment, you can also change the points on the specific problems rather than just the fudge points. That way they will know which individual question correct, rather than just 3 of them were marked incorrectly.  Still, it's not an efficient way, but Canvas should not automatically try to figure out whether an instructor wanted to accept close answers or not -- but in the new Quizzes (currently in beta testing) there are more options for flexibility in grading.

[bwarner1]

Oh - I did miss that! Thank you, James. I designed this particular quiz to have up to 10 points per question (lots of fill in the blanks), so that would help narrow the problem area, but not specify exactly where I had a problem. Still, I'm getting closer! I'll look into the new beta quizzes this afternoon.

[James]

Things with multiple answers are always tricky. Until we're allowed to tie questions together, there's not really a better way to ask multiple questions about the same scenario, though. We end up doing things because we have to do them a certain way, but it's not the way that we want things to work. Sometimes we lose beneficial information like which of those 10 parts did the teacher give you credit for? Changing the point value doesn't make it show up as correct when Canvas shows the list of parts that were answered correctly or incorrectly.

When you check out Quizzes LTI, be sure you check out the Quizzes LTI Feature Comparison to see what is supported in comparison with the existing quizzes to make sure you're going to be able to accomplish what you want to do. There are some other requirements and our school isn't even participating in the beta testing so our faculty don't have the option to try it out. The same thing applies with the new gradebook. Some of us, especially places with a small support department, want things a little more stable before we turn them on for the masses. That means that even if you want to use the Quizzes LTI, you may not be able to just yet. 

[breklis]

Hi James and Canvas Community,

This is a somewhat related question: If an instructor manually overrides the point value in speedgrader like you outlined, the quiz question still displays as incorrect for the student, even with full credit.  It also does not update the mastery level if the quiz question was aligned to an outcome for the learning mastery gradebook.  Do you know of a way that an instructor can not just manually override the score for that quiz question, but also have that correction reflect in the student's learning mastery progress?

Thank you!

Barbara

#learning mastery gradebook‌

[Robbie_Grant]

 @bwarner1 ,

Were you able to find an answer to your question? I am going to go ahead and mark this question as answered because there hasn't been any more activity in a while so I assume that you have the information that you need. If you still have a question about this or if you have information that you would like to share with the community, by all means, please do come back and leave a comment.  Also, if this question has been answered by one of the previous replies, please feel free to mark that answer as correct.

Robbie

[Maksymilian]

I think that this issue would be easily solved with the help of machine learning algorithms. the guys from IBM suggested a product that would solve a similar problem, we need a little more info