Cult of Pedagogy Search

How to Make a Quiz Work Harder for You

Close

Can't find what you are looking for? Contact Us

Running-Quiz

 

When you give a test or quiz, do you basically just grade it, give it back to students, go over the answers, then move on? If you don’t do anything else with the information, if you don’t look carefully at how students answer your test questions, you’re missing a BIG opportunity.

Assessments should give us loads of information about what our students understand, what they don’t understand, and how well we’ve taught them. It took me years of teaching before I realized I was using my tests and quizzes to sort out, reward and punish my students, rather than measure and inform my teaching. I needed to make my assessments work harder for me.

So one year, I added an extra step while grading tests: I kept track of all the wrong answers on one page, tallying exactly which items were being chosen instead. Once I started doing this, I found myself far better equipped to respond to wrong answers: I could reteach specific concepts only to students who needed reteaching, rather than wasting everyone’s time with unnecessary review. I could identify specific misconceptions students had about the material and get better at addressing those the next time around. I also became a much better test maker.

The best part about this system is you only need a pencil, an answer key, and a few extra minutes.

Here it is:

 

If you’re already doing something like this, I would love to hear about it in the comments. If you have some kind of electronic reporting system that can crunch all these numbers for you and give you the information you need to move forward, awesome. If not, adding this extra step to your assessment routine will make a difference. ♦

Keep in touch.
Join my mailing list and get weekly tips, tools, and inspiration — in quick, bite-sized packages — all geared toward making your teaching more effective and fun. To thank you, I’ll send you a free copy of my e-booklet, 20 Ways to Cut Your Grading Time in Half. I look forward to getting to know you better!

 

66 Comments

  1. Jeannie Ferguson says:

    This is excellent information. I will do this with my midterm exam next week! Thank you for always sharing your great ideas!

    • I’m so glad you like it! Let me know how it goes, Jeannie!

      • Kathy Sites says:

        Have you ever used ZipGrade? It does this for you and more! The only drawback is it has to be answers that are able to be bubbled as A. B. C. D. or E. I love following your blog. I have gained a lot from it. Thanks for doing this ☺️

  2. maura lincoln says:

    I love this and should do it for each quiz! But , i do this on my mid term and finals. It definitely demonstrates where some learning was not taking place!! UGH.. I realize which unit I really delivered and my students really engaged in the learning process. I go back and redesign where I think there were weaknesses.. Love the Cult of Pedagogy and all the learning and reflecting you make me do!!!

    • Yes, it helps SO much when it’s time to revise units for the future. If I’m not ready to take that step, I’ll just file the summary with all the other unit materials for the future.

  3. Elaina says:

    I do this with my tests as well but with a small change. I teach third grade, so I don’t just use tally marks. I put the name of the student next to the answer choice they picked. This gives me data to know who I need to reteach in small groups.

    • Oh, that’s a good one, Elaina. Thanks for taking the time to share this!

    • Laurel says:

      I do the same thing, except I just use initials. This is really helpful when I plan for small groups and tutoring. I even do this as I teach, in my journal I put initials of anyone with misconceptions or who I can tell needs more practice off to the side where they won’t be seen on the document camera. I love having the data right there so I can address it quickly, and it helps me not lose the data.

    • Rebecca Carlock says:

      Someone already mentioned zipgrade. The best 7 bucks you’ll ever spend. I laminate my answer docs and kids use dry erase markers. Magic eraser takes it right off! Kids dont even leave the room before I have remediated.

  4. Paris says:

    I use Gradecam to do this very thing. I also use Flubaroo. I absolutely agree with you about the importance of aggregate scores. I do exit tickets throughout my unit to see how well I’m doing with the concepts.

    Great topic 🙂

    • Hey Paris! Thanks for telling me about GradeCam; I had never heard of it and now I have a new tool to add to my Tech Guide.

    • caroline clayton says:

      I use Zip Grade. it uses camera on smart phone/iPad, aggregates all data. you can download into a spreadsheet on your computer– then you can sort it in all those crazy ways!!! love it! worth the $7/year for unlimited use!!

      • Kati says:

        Amen, zip grade does this for you. I found more misconceptions and holes in my instruction with this tool.

  5. Daniel Minger says:

    Hi Jennifer,
    I do the same thing except I do not go by test question I tally according to which standard my students messed up on because then I have a specific itemized detail to address. When I create my tests I align them with a rubric of standards that I also give to the students as a study guide which now becomes more meaningful, they can look at standards they feel need more preparing for versus others. When I go through a test and grade I look for what standard the mistake best aligns with. I do this for each student then share it with them after the test. I have found it also prompts them to ask questions because if they know they know what standard it is then it becomes a much more direct question and instead of evaluating the big picture we can look at the small step or process needed to correct to make the entire thing work. This does take time though at first, but I created an excell spreadsheet with some simple coding on it to crunch my numbers when done and some conditional formatting to color code percentages. With all that said this is quite possible the best thing you can do to improve student learning and your teaching craft because now you have solid data to reflect back upon and begin to analyze to see what improvements can be made.

  6. Hi Jenn! I love the way you explain everything! You always show how easy things are!!

    If you use Google Forms for w
    quizzes, you can get a summary of responses in the Sheet the form creates. I’m on my iPad, so I can’t check on my Chromebook or PC, but I think you clicke the “Form” drop down menu and then choose “summary of responses.” It gives you nice pie charts and percentages of the answers the students gave. (I also mail-merge the spreadsheet into a Word doc so I have quizzes to hand back. And Word mail merge also grades it for me!!)

    • Yikes! Please ignore the mistakes in my post!!

    • Alexis Snider says:

      After reading Jenn’s post and watching the tutorial, I immediately thought of Google Forms too. I teach 4th Grade, and knew of the quizzes capability, but have never tried it out. I just created a little practice quiz, and the results from the Responses page summarize the data as well.

      I think I will give this a try for my next quiz. Thanks so much! Finally a way to quickly analyze student data 🙂

  7. Jennifer,
    Great video! It’s so important for us to take that last step and analyze the results, but, as a high school English teacher with 170 kids, I’ll confess that manual tallying just wasn’t happening. I found a solution last year with the ZipGrade app. No business relationship with the company, I just think it’s great that I can zap every quiz with my phone and all of the item analysis tallying is automatically done for me. Saves this harried teacher a TON of time. I wrote a bit more about it here, if you’re interested: http://laurarandazzo.com/2015/04/02/feelin-zippy/

    Have a great weekend!
    Laura

  8. My problem is that I hardly ever give multiple choice quizzes anymore. I like the short answer and essay format because it allows me to see more of their thought process at times. How would you go about easily and quickly aggregating data for this type of response? I think it would be beneficial, but I also feel it would take so much more time because of the variety of responses you may get. What are your thoughts? I’m just about to tackle a paragraph response to a novel, and I’m wondering how I can quickly collect the data. Ideas?

    • I think I would consider what skills or information you’re looking for in each response. So say there’s a piece that’s content-driven (they need to identify a character trait), a piece that’s skill-driven (they need to support their ideas with textual evidence), and a piece that’s test-taking-driven (they need to remember to provide 2 pieces of evidence and include one direct quote). For each question, I would create codes that identify these three areas (trait, evidence, 2 pieces), then each time a student misses in any of these areas, put a tally. That way instead of just saying lots of kids got number 7 wrong, you can better target what area brought them down and address that.

      • I would want to add some notes in those areas. For example, if they consistently use a direct quote out of context to try to support their ideas — are they using the same quote and misinterpreting the intention? (Does that make sense?) Or are they addressing a content-driven piece that is not the “strongest” choice when obviously there is a better answer? Here is where I end up making it take longer to aggregate data for short responses because there are more possibilities. Plus, I’m reviewing 132 papers. I’m thinking — would I make up a chart with those areas and maybe include space to note misconception…. It’s worth it, but it will take longer.

        • It sounds like something that would take some time to set up, but you would get so much useful, targeted information from it, you would ultimately save time that you would have spend just randomly re-teaching concepts to the whole class. You would also save yourself the energy suck caused by thinking everything you teach is going in one ear and out the other. For me it was this second part that I loved — if half the class got a question wrong, but I could determine one broad misconception that came from it, it meant I just needed to make an adjustment, not that I was a crap teacher in general.

    • Rebecca says:

      I look for patterns in incorrect responses. If I’m really a step ahead I jot down potential incorrect responses on my answer key (that only happens until about mid-October realistically). Usually I can spot the trends as I go.

  9. Kate Berry says:

    I use the quiz feature in Edmodo. It’s free and also aggregates the data for T/F or MC questions. Probably similar to Google Forms. I also use it for short-answer responses. Although it doesn’t score the response, it is an electronic way and I can correct/give feedback right from my laptop. No more remembering to bring a stack of papers home.

  10. Melanie says:

    I teach middle school math. I am trying a new system this year where I’m analyzing by student. I have a table with their names and for each test & quiz I write down the types of mistakes they made. It was helpful to have this specific information for conferences, as well as targeting specific skills to work with individual students.

    • That’s a great idea, Melanie. Is it time-consuming? I would love to see a picture of this table. If you are able to send me an image, I can put it up on the site and link people to it.

    • Jake says:

      I also teach math (HS) and usually keep a spreadsheet of the scores. A lot of analysis can be done this way, and when combined with file merges you can generate custom reports for your students. I use google sheets and Autocrat to create the file merge. With autocrat you can really customize these and even email them as PDFs to students (automatically) or as google docs (if a reflection is necessary).

      This was a fast way to customize feedback but not take too much time for me. The setup is where the largest investment of time is, but if you teach the class more than once it is worth it and like all things, it gets easier with time. I can usually generate feedback/reports for all students in a class in less than a hour after I finish grading. That includes data entry, creating the custom feedback sheet and running/sharing the reports. Sounds like a lot, but it’s a good bang for your buck and if you have more than one class, it only takes a few more minutes for data entry but the other steps are the same. This is great for benchmark assessments for a grade level or final exams as it gives a great summary for the students next teacher (or for you to compare year to year).

  11. Frederika Jenner says:

    I looked for the top 4-5 wrongs in order to re teach or bring to group’s attention and discuss. As a science teacher, also looking for misconceptions to correct. I agree, it took me years to conclude that student performance was as much a demonstration of my teaching as their learning. So important.

  12. For online quizzes on Google Forms, I like to use Flubaroo — AMAZING add-on to the response spreadsheet that not only grades the assignment for you, but also gives you data back about each question (graphs of which questions students missed, pie charts detailing student responses for each question, etc.). Absolutely fantastic way to quickly grade assignments and analyze data! Did I mention that I can also email students their grades back? Win for all parties! 🙂

    Love this article — always enjoy reading what you write. Great information for teachers everywhere!

    • Hey Allison! You and several others have sung the praises of Flubaroo, so I definitely need to check it out and get more teachers using it. Thank you!!

  13. This came at a great time. I was just grading quizzes, and I’m going to do this with my next round of papers (and go back and do the same for my other classes).

    I usually use Google Forms/Flubaroo, but this is a great idea for paper!

    Thanks!

  14. Judy says:

    How do you know WHO needs the re teaching if you are only using tally marks?

    • That’s a really good question, Judy. Other people in the above comments have added initials or names to their notes. In my case, I usually addressed that in class when we were going over the test results. Since I did this mostly as a college instructor, I would just say to the class “anyone who missed number 5, let’s gather up over here for a few minutes,” and we’d just have a little pow-wow. Other times, when the problem was more serious, I would make a list of names of students who needed concentrated re-teaching. If you look over the comments here, you’ll see that several other teachers have a system similar to mine with improvements, including a few apps that will take care of it for you!

  15. Bill Gabrielson says:

    Here’s an unusual analytical tactic for multiple choice tests.. In the belief that it is better to be closer to the bulls eye I would have students write their answer choices in order e.g. CDBA. if the correct answer were D the student would receive 3 points out of a possible 5 or 2 or 1 depending on where the right answer was placed. As a subsidiary benefit you will avoid the tyranny of the zero.

  16. I like to split my assessments up into “memory” and “thinking” portions and give them on different days. But when it comes to memory types of tests I really like to use Google Forms/Flubaroo or Socrative. Flubaroo has been mentioned, but Socrative has not. Socrative can be used to create MC, Matching, and T/F questions. What is awesome is it will automatically randomize question and answer order which is something Forms/Flubaroo cannot do. Then it creates a report for you that shows who missed what question and the % of the class that missed that question. That report can be placed right into Google Drive or it can be downloaded. Socrative also gives the ability to generate individual pdf reports. Another reason why I love is it allows my students to take the quiz multiple times and be a little different each time.

  17. Hi, I really love this idea and agree with it. As a matter of fact, I have tried to do this myself in the past; however, I tend to do a lot of open-ended type questions, which proves to be more difficult to track like this. Do you have strategies for doing this with open-ended questions?

    • Yes. I would just make notes beside the question on the answer key. The notes would summarize the missteps students took, like “Only gave 2 instead of 3 examples” or “No text evidence” or “Thought I meant _____ instead of _____.” And then I would tally those to see how many students either didn’t follow the instructions correctly (and in what way) or misinterpreted the question. Does that make sense?

  18. Nick Zaveri says:

    Great tip! I’ll be sure to share this with my fellow instructional coaches. A lot of our focus lately has been around data and formative assessment. I enjoy the simplicity of this strategy. Rather than modeling new tools for teachers, here’s a great way to get even more use out an existing tool-the Answer Sheet. Great post, Jen!

  19. Greg says:

    I guess I must have been lucky, when I did my GradDipEd in 1986 this was expected of us. It was part of the reflection on our teaching methods and effectiveness.

  20. Paula Navarro says:

    Hey Jennifer! This has been very helpful. I’m a teacher-student of English and I’m doing my final practice. One of my classes at university is methodology and I’m just about to start doing my final paper on the assessment process. I will definitely take this under consideration.
    Regards from Chile!

  21. ER Schneider says:

    FLUBAROO!!!!!!
    http://www.flubaroo.com/

  22. I teach HS Math and RARELY give multiple choice. I do note what’s up with my students, but here is a comment that has not been mentioned. More often than not, I find that I could have done a better job WRITING the question that who either trigger the concept better or is more clear to the student!

  23. Becky says:

    I use theanswerpad.com. It will let me put in standards so I can analyze by standard. It gives me wonderful feedback for each question. And a nice visual for weyone who took the test. Best for mc or something short. Could work for some short answer as well.

  24. This is a really great concept that I think is gaining more momentum as educators are realizing that we are teaching skills more than facts. I like how you explained this in a way that a reluctant teacher would be able to fit into their current routine. I always think about the time we spend outside of the instructional day and what kind of work we are doing. Using that time in this way to better prepare for instruction takes away from the time I would have to spend intervening, retesting, calling parents (the not-so-fun part). This is a great post that I plan to keep handy in the future!

  25. Rebecca says:

    Simple time saving tweak – just tally the incorrect answers and then write the total by the question. Why tally twice?

  26. Jennu says:

    Use Google Forms and set it up as a quiz. It gives you all of the information in multiple ways. It shows top missed questions, it’ll break down each question and show the percentage of what answer was selected. It shows the breakdown of total grades. It provides lots of data, plus grades it for you. Forms does all of the work you’re saying to do by hand.

  27. Caroline says:

    I do this, but with a small alteration. I put the initials of students who missed certain concepts/steps in the problems, and then group them. That way, I can create stations and homogeneous traveling groups and can reteach or build up depending on what each group needs. It lets me let those who can, move on, and those who need remediation get special attention at my station.

  28. Cristina Anderson Caramella says:

    Have you used Google Forms to make quizzes? I have used ZipGrade and Google Forms, and I like the latter better. Data analysis is amazing because you can see which questions were answered incorrectly, and which questions had the distractor chosen. You can go back quickly and easily to see how a specific child answered a certain question. I can’t live without it as an ELA teacher (for multiple choice only.) Google Quizzes also allow a teacher to explain the answer once a question is marked incorrect.

  29. Emily says:

    I think this is a great idea. I do something similar when I grade essays in Google Classroom. I create comments that I can easily paste into students’ essays as feedback. After I finish grading, I look back at all the comments and see which ones I use the most. Those are the teaching points I am sure to go over with my students the following day. I noticed that for each major paper I grade, I am using different comments, so it’s clear that students are growing as writers. (I teach 8th grade ELA.)

  30. Roger Laubengayer says:

    I have used http://www.Quia.com/web for years for all of my quizzes and exams. It has help me find numerous items that were poorly written or wrong on my assessments. Another feature I love about it, is that it has several types of review games (i.e. jeopardy, who wants to be a millionaire, battleship, etc). Once I make a question and put it in the question bank. I can use it on both the review activities and tests. For short answer questions, I like that I don’t have to look at individual test, but rather I can see all the students responses in one spot (like google forms). I can’t tell you how many hours this has saved me over the years.

  31. Robert Lewis says:

    Hi Jennifer,

    I am truly being edified by COP. Thank you!

    I might be (probably am) old school, but if an assignment or test is worth grading in my class we trade papers and do it whole-class. I avoid taking as much work home as I can. Using a doc cam, we score the number right out of the total and make a bar graph out of the tally marks. It’s a great time to then calculate the median and percentages. After that, we go over the missed questions and look at which questions were the most difficult (what I didn’t teach well enough).

    However, what I liked from your video was taking the extra step of analyzing the actual wrong answers. I will definitely add this step next time.

    I know there are many computerized programs that do this for the teacher, but I find that doing it with the students is much more informative for them and for me.

    Thanks again, for all you do.

  32. Grace says:

    We use a web based program called SmarterMarks and we love it. It gives great stats and shows graphically for each question which distractor was most popular. You can also build your assessments in the program which makes it really powerful over time because you can track individual questions instead of them being tied to an assessment. The first 6 months is free!

  33. Marcia says:

    In addition to the great comments already given, I would add the suggestion that when using MC, construct the incorrect answers with particular anticipated misconceptions in mind. Then it is even easier to know where the students’ misunderstandings lie.

  34. Jenny Paulsen says:

    Hi, Jennifer! I rely on your posts every week for my favorite new experiments to try! No one has mentioned Plickers, which my kids love. They glue the qr code inside their notebook and use it all year. We can track opinions over time as they examine a document for its claim (Columbus was a hero or villain) and also whether they are persuaded to agree/disagree after reading. If it is mc or t/f ? I can show graph of answers BEFORE revealing which one is correct. This is a great formative and re-teaching tool. Plickers lets you download a spreadsheet of results, so you can track progress over time. I use a lot of these tools already as well but I found some new ones to try also! Thank you for the fantastic weekly professional learning!

Leave a Reply

Your email address will not be published.