The A's of Addressing and Responding to Good Questions

When I conduct my professional development on developing good questions that address the cognitive rigor of college and career readiness, I am always asked, "How should students answer these questions?"

My answer to this question is, "It depends on the question and the student."

Questions for assessing learning are meant to be answered, and they are generally evaluated as correct or incorrect based upon the accuracy of the response.  Questions that set the instructional focus of a lesson or unit are meant to be addressed, and how deeply and extensively the student responds depends upon not only the intent and purpose of the question but also the interest of the student.

Good questions that promote cognitive rigor are assessed and evaluated based upon the following criteria:

• Accuracy: Is the response correct or incorrect (i.e. Does the student provide a response that is proven to be absolute, defensible, or irrefutable?).
• Acceptability: Does the response meet certain or specific criteria for addressing the question (i. e. Does the student meet or exceed the expectations for addressing to the question or do they respond to the question incompletely or unacceptably)?  
• Appropriateness: Does the response address the subject or topic in-depth and in detail (i.e.. Does the student support the response with examples, explanations, and evidence or does it just make a blanket statement or provide the result without explaining how or why)?
• Authenticity: Does the response reflect and represent the depth and extent of the student's learning  (i.e. Does the student express and share the depth and extent of their knowledge and thinking insightfully and in their own unique way or do they simply repeat or restate the information they have acquired and gathered as it's presented or provided?)

 These are the criteria for how responses to good questions should be assessed and evaluated -- qualitatively rather than quantitatively.  How good a response is depends upon how deeply or how extensively a student addresses the subject or topic of a question.   Consider the following scenario in which students are expected to determine how the novel The Outsiders and its characters address the theme of stereotyping.

You are teaching a book study on The Outsiders by S.E. Hinton.  Your students will demonstrate and communicate the following:

• Determine central ideas or themes of a text and analyze their development; summarize the key supporting details and ideas. (CCSS.ELA-LITERACY.CCRA.R.2)
• Analyze how and why individuals, events, or ideas develop and interact over the course of a text. (CCSS.ELA-LITERACY.CCRA.R.3)
• Analyze the structure of texts, including how specific sentences, paragraphs, and larger portions of the text (e.g., a section, chapter, scene, or stanza) relate to each other and the whole. (CCSS.ELA-LITERACY.CCRA.R.5)
• Delineate and evaluate the argument and specific claims in a text, including the validity of the reasoning as well as the relevance and sufficiency of the evidence. (CCSS.ELA-LITERACY.CCRA.R.8)
• Write informative/explanatory texts to examine and convey complex ideas and information clearly and accurately through the effective selection, organization, and analysis of content. (CCSS.ELA-LITERACY.CCRA.W.2)

Your students will address and respond to the following good question:

How do each of the characters in The Outsiders reflect, reject, and respond to the social stereotypes of their community and culture?

This is the topical essential question of this book study that sets the instructional focus and serves as the formative and summative assessment.  That one question is so rigorous -- or good -- that it addresses all the performance objectives of these college and career ready standards.  It also not only engages but also encourages students to delve deeper into the central ideas and themes of this novel.  How good a student's response to this question depends on the following: 

• Did the students respond to the question accurately by defining what is a social stereotype, distinguishing between the different social stereotypes in The Outsiders, and describing how the different characters reflected, rejected, and responded to these social stereotypes?
• Did the students respond to the question acceptably by providing specific examples from the text and explaining how and why these examples serve as evidentiary support for their response?
• Did the students respond appropriately by demonstrating and communicating how The Outsiders and its characters address the social stereotypes of their community and culture clearly and comprehensively as well as correctly?
• Did the students respond authentically by expressing and sharing their own ideas, opinions, and perspectives on how the novel The Outsiders and the characters reflect, reject, and respond to the social stereotypes of their community and culture insightfully and in their own unique way?

These guiding questions assess and evaluate students' responses based upon its quality. It’s also not a simple question students can answer with a yes or no or even one or two sentences. Good students expect students to express themselves in-depth, in detail, and insightfully. They also require students to address and respond using some form of oral, written, creative, or technical expression.

With mathematics, the quality of the response is based not only on whether they can solve the problem correctly but explain how and why they used the concepts and procedures they are learning clearly, comprehensively, and even creatively.  Consider the following scenario in which students are learning about equivalent fractions.

You are teaching a unit on fraction equivalence and ordering.  Your students are expected to demonstrate and communicate the following:

• Explain why a fraction a/b is equivalent to a fraction (n × a)/(n × b) by using visual fraction models, with attention to how the number and size of the parts differ even though the two fractions themselves are the same size. Use this principle to recognize and generate equivalent fractions. (CCSS.MATH.CONTENT.4.NF.A.1)
• Compare two fractions with different numerators and different denominators, e.g., by creating common denominators or numerators, or by comparing to a benchmark fraction such as 1/2. Recognize that comparisons are valid only when the two fractions refer to the same whole. Record the results of comparisons with symbols >, =, or <, and justify the conclusions, e.g., by using a visual fraction model. (CCSS.MATH.CONTENT.4.NF.A.2)

Your students will address and respond to the following good question:

How can you recognize, generate, and explain why fractions are equivalent?

The quality of the student's response to this question depends on the following: 

• Does the student respond to the question accurately by defining what is an equivalent fraction and applying the concept and procedures to make and match the fractions presented to them be equivalent?
• Does the student respond to the question acceptably by completing all the problems and showing their work?
• Does the student respond appropriately by providing the answer and explaining why each of the fractions they make and match are equivalent and how they determined they were equivalent?
• Does the student respond authentically by showing and telling how they personally recognized and generated the equivalent fractions verbally in their own words or visually using fraction models?

The key to promoting cognitive rigor through classroom questioning is communication. Knowing what is the correct answer and showing how can the answer be attained correctly is half the battle. Students should also be expected to tell why this is the answer and think deeply about how could share their knowledge and understanding in detail, in-depth, insightfully, and in their own unique way.

Here are some ways to encourage students to address and respond to good questions:

1. Show and tell. Set the expectations right from the beginning that students will be required to demonstrate and communicate -- or show and tell -- what they are learning. Let them know that knowing what is the answer and showing how can concepts and procedures be used is half the battle. Students must also be able to tell why is this the answer and think deeply about how else can concepts and procedures be used. That’s what will be expected of them and also how their learning will be assessed and evaluated.
2. Discourage one-word or one-sentence responses. Identifying what is the Earth as a planet or who is Edgar Allan Poe as an author who wrote Gothic tales during the 1800s should not be considered acceptable or appropriate responses. Yes, these responses are accurate, but going into details and depth would be more acceptable and appropriate expressions of deep knowledge.  Encourage students to describe and explain further. Have them use examples from the text as explanations and evidentiary support.    
3. Ask, “What do you mean?” Every time a student gives an answer in the form of a simple statement, ask them, “What do you mean?” This prompts them to explain why is this the answer and elaborate upon how was the answer attained. It also challenges them to defend and justify their responses and even question their own thinking and reasoning. For example, if you ask what is the relationship between fractions and division and the student responds, A fraction is a way to divide numbers, asking what do you mean prompts the student not only to explain their response but also think about how they can phrase their response clearly, correctly, and comprehensively.   You can also ask how do you know to prompt students to justify their knowledge.
4. Paraphrase or transcribe information. Students should also not be permitted to recite, repeat, or restate information explicitly as presented by the text or teacher. They should paraphrase or transcribe the information and cite or credit the source from where they obtained the information. For example, students should define what is volume or describe where and when did World War II take place in their own words instead of just simply copying what the text says.   Having students explain in their own words “encourages a deeper processing of ideas, which can lead to a better understanding of the material” -- especially if the students write the information longhand (Mueller & Oppenheimer, 2014).
5. Teach like an expert. Teachers generally teach students what is the answer by presenting the question or problem and showing and telling students how to use concepts and procedures to answer the question correctly. Experts, however, pose the question, present their answer, explain how and why they achieved their outcome or result, and show how it can be applied in different contexts. That’s the deep knowledge students need to learn -- how to transfer and use knowledge and thinking. To do this, present students the question or problem with its answer or solution and ask them to examine how and why. You can even show them visually the procedures and prompt them to explain how is the concept and procedure used. Then, once they provide an explanation that is accurate, acceptable, appropriate, and authentic, challenge them to investigate and inquire how else can the concept and procedure be used in a different context.
6. Have students choose their grade. Unfortunately, some students may not go into the detail and depth they should with the responses. They might also feel as if answering the question correctly or the information they provide is “good enough”.   While we want our students to go deeper with their responses, we also don’t want to discourage them or make them feel defensive about their responses. Here’s a dialogue I use with students to encourage them to provide more depth and detail in their responses:

Mr. Francis: Is this your answer?

Student: Yes.

Mr. Francis: Is this your final answer?

Student: Yes.

Mr. Francis: Is that your A answer?

Student: I think it is.

Mr. Francis: Okay. Do you want an A?

Student: Yes (Hopefully, they’ll say yes.)

Mr. Francis: If you want an A, why don’t you look into this and tell me a little more about how you came to this response. However, that’s up to you. What you have here is accurate. However, your grade is based upon whether the response is acceptable, appropriate, and authentic.   So if you want that A, why don’t you look into this or tell me how you came to this response. However, it’s up to you.

Notice what’s happening in this exchange. Instead of telling the student their response is not “good enough”, they are being ask to consider and reflect upon the quality of their response by asking them what they think and what their perception is. You’re validating their response as accurate but challenging and encouraging them to go further so it meets all the criteria for responding to good questions. You’re also suggesting to them what exactly they should examine and investigate further in order to improve their response. However -- and this is key -- you’re allowing the student to choose whether they want to expand upon their answer and earn that higher grade.   Not only are you teaching them how to delve deeper but you’re also teaching them a life lesson about making good choices and the importance of producing quality work (and if they choose not to go further, then they need to accept the grade they earn).

Keep in mind cognitive rigor is qualitative, not quantitative. Promoting cognitive rigor through classroom questioning involves asking good questions that prompt students to think deeply about how they can transfer and use what they are learning. The quality of their responses should be evaluated not only based upon whether they are accurate but also whether they truly express and share the depth of students’ learning in an acceptable, appropriate, and authentic manner.

Erik M. Francis, M.Ed., M.S., is the lead professional education specialist and owner of Maverik Education LLC, providing professional development and consultation on teaching and learning for cognitive rigor. His book Now THAT'S a Good Question! Questions for Cognitive Rigor will be published by ASCD in 2016.  For more information, please visit www.maverikeducation.com.