Mary Lindquist, Ray Philpot, Ina V.S. Mullis, and Kerry E. Cotter

Download TIMSS 2019 Mathematics Framework (pdf)

Mathematics Cognitive Domains–Fourth and Eighth Grades

In order to respond correctly to TIMSS test items, students need to be familiar with the mathematics content being assessed, but they also need to draw on a range of cognitive skills. Describing these skills plays a crucial role in the development of an assessment like TIMSS 2019, because they are vital in ensuring that the survey covers the appropriate range of cognitive skills across the content domains already outlined.

The first domain, knowing, covers the facts, concepts, and procedures students need to know, while the second, applying, focuses on the ability of students to apply knowledge and conceptual understanding to solve problems or answer questions. The third domain, reasoning, goes beyond the solution of routine problems to encompass unfamiliar situations, complex contexts, and multistep problems.

Knowing, applying, and reasoning are exercised in varying degrees when students display their mathematical competency, which goes beyond content knowledge. These TIMSS cognitive domains encompass the competencies of problem solving, providing a mathematical argument to support a strategy or solution, representing a situation mathematically (e.g., using symbols and graphs), creating mathematical models of a problem situation, and using tools such as a ruler or a calculator to help solve problems.

The three cognitive domains are used for both grades, but the balance of testing time differs, reflecting the difference in age and experience of students in the two grades. For the fourth and eighth grades, each content domain will include items developed to address each of the three cognitive domains. For example, the number domain will include knowing, applying, and reasoning items as will the other content domains.

Exhibit 1.4 shows the target percentages of testing time devoted to each cognitive domain for the fourth and eighth grade assessments.

Exhibit 1.4: Target Percentages of the TIMSS 2019 Mathematics Assessment Devoted to Cognitive Domains at the Fourth and Eighth Grades

Cognitive Domains Percentages
Fourth Grade Eighth Grade
Knowing 40% 35%
Applying 40% 40%
Reasoning 20% 25%

Knowing

Facility in applying mathematics, or reasoning about mathematical situations, depends on familiarity with mathematical concepts and fluency in mathematical skills. The more relevant knowledge a student is able to recall and the wider the range of concepts he or she understands, the greater the potential for engaging in a wide range of problem solving situations.

Without access to a knowledge base that enables easy recall of the language and basic facts and conventions of number, symbolic representation, and spatial relations, students would find purposeful mathematical thinking impossible. Facts encompass the knowledge that provides the basic language of mathematics, as well as the essential mathematical concepts and properties that form the foundation for mathematical thought.

Procedures form a bridge between more basic knowledge and the use of mathematics for solving problems, especially those encountered by many people in their daily lives. In essence, a fluent use of procedures entails recall of sets of actions and how to carry them out. Students need to be efficient and accurate in using a variety of computational procedures and tools. They need to see that particular procedures can be used to solve entire classes of problems, not just individual problems.

Recall Recall definitions, terminology, number properties, units of measurement, geometric properties, and notation (e.g., a × b = ab, a + a + a = 3a).
Recognize Recognize numbers, expressions, quantities, and shapes. Recognize entities that are mathematically equivalent (e.g., equivalent familiar fractions, decimals, and percents; different orientations of simple geometric figures).
Classify/Order Classify numbers, expressions, quantities, and shapes by common properties.
Compute Carry out algorithmic procedures for +, –, ×, ÷, or a combination of these with whole numbers, fractions, decimals, and integers. Carry out straightforward algebraic procedures.
Retrieve Retrieve information from graphs, tables, texts, or other sources.
Measure Use measuring instruments; and choose appropriate units of measurement.

Applying

The applying domain involves the application of mathematics in a range of contexts. In this domain, the facts, concepts, and procedures as well as the problems should be familiar to the student. In some items aligned with this domain, students need to apply mathematical knowledge of facts, skills, and procedures or understanding of mathematical concepts to create representations. Representation of ideas forms the core of mathematical thinking and communication, and the ability to create equivalent representations is fundamental to success in the subject.

Problem solving is central to the applying domain, with an emphasis on more familiar and routine tasks. Problems may be set in real life situations, or may be concerned with purely mathematical questions involving, for example, numeric or algebraic expressions, functions, equations, geometric figures, or statistical data sets.

Determine Determine efficient/appropriate operations, strategies, and tools for solving problems for which there are commonly used methods of solution.
Represent/Model Display data in tables or graphs; create equations, inequalities, geometric figures, or diagrams that model problem situations; and generate equivalent representations for a given mathematical entity or relationship.
Implement Implement strategies and operations to solve problems involving familiar mathematical concepts and procedures.

Reasoning

Reasoning mathematically involves logical, systematic thinking. It includes intuitive and inductive reasoning based on patterns and regularities that can be used to arrive at solutions to problems set in novel or unfamiliar situations. Such problems may be purely mathematical or may have real life settings. Both types of items involve transferring knowledge and skills to new situations; and interactions among reasoning skills usually are a feature of such items.

Even though many of the cognitive skills listed in the reasoning domain may be drawn on when thinking about and solving novel or complex problems, each by itself represents a valuable outcome of mathematics education, with the potential to influence learners’ thinking more generally. For example, reasoning involves the ability to observe and make conjectures. It also involves making logical deductions based on specific assumptions and rules, and justifying results.

Analyze Determine, describe, or use relationships among numbers, expressions, quantities, and shapes.
Integrate/Synthesize Link different elements of knowledge, related representations, and procedures to solve problems.
Evaluate Evaluate alternative problem solving strategies and solutions.
Draw Conclusions Make valid inferences on the basis of information and evidence.
Generalize Make statements that represent relationships in more general and more widely applicable terms.
Justify Provide mathematical arguments to support a strategy or solution.