Closing the Visibility Gap: Why K-12 Math Leaders Need a New Approach to Student Understanding

The state of K-12 mathematics is at a crossroads. Despite a decade of heavy investment in curriculum, instructional reform, and edtech, the data remains sobering: 70 percent of U.S. school districts lost ground in math between 2015 and 2025. For math leaders, this isn’t just a performance statistic; it’s a systemic challenge. We are facing a national math emergency, and the traditional approach—delivering content to groups and grading the final output—is failing to address the root cause.

The core issue isn't a lack of knowledge; it is a visibility problem.

The Invisible Gap in Math Instruction

In a standard classroom of 25 students, a teacher has limited time to observe how each child thinks. Current assessment tools and software excel at recording the final answer, but they fail to record the reasoning that produced it. We see the output, but the cognitive process—the steps, the misconceptions, the “productive struggle”—remains entirely invisible. Until this gap is closed, curriculum and tutoring often fail to deliver meaningful, long-term change because they address the surface-level errors that students make in their math work rather than the underlying misunderstandings behind those errors.

To bridge this, we must shift our focus from the answer to the thinking.

A Peek Inside the Classroom: Leveraging Thinking as Data

In the Poway Unified School District, one third-grade teacher chose to tackle this visibility problem by integrating KAIT (Key AI Training) into their existing instructional routine. The goal of this pilot wasn't to replace their established curriculum, but to illuminate the thinking happening inside the classroom.

The setup was intentional and minimal: for just 15 minutes, twice a week, the third-graders worked on physical paper using a KAIT smartpen. By using handwriting, students engaged their motor systems and visual attention in a way that typing on a screen cannot replicate. This physical act required them to sequence, monitor, and self-correct their own work in real time.

When the teacher observed the class working with the smartpen, their "teacher moves" changed. Because the smartpen captured every stroke, the platform transformed the student's work into visible reasoning data called “pencasts.” The teacher could distinguish between a lucky guess and a conceptual breakthrough. Instead of waiting for a graded assessment to see where a student struggled, the teacher used these pencasts to make on-the-spot adjustments to their instruction. They weren't just grading papers; they were analyzing the cognitive path each student took to arrive at—or stumble on—their solution.

By treating the student’s process as the primary data point, the teacher shifted their role from a deliverer of content to a facilitator of mathematical reasoning.

Does It Work? The Emerging Evidence

We are not talking about a hypothetical future; these results are happening in classrooms today. In a controlled comparison within the Poway Unified School District, we found that students using KAIT for just 30 minutes a week alongside their existing curriculum produced 2.5 times the expected growth in math proficiency.

The impact is equitable across the spectrum, not just for struggling learners:

• Severe underperformance is reduced: In the Poway Unified pilot, students performing two or more grade levels behind dropped from 25 percent to 8 percent.

• High-performers are accelerated: Students already at or above grade level surged from 8 to 46 percent.

• Cross-population replication: Data consistently shows that when students receive immediate, personalized feedback on their written work, they move bands—from Emerging to Developing, and from Developing to Proficient.

Recommendations for the Path Ahead

As we look to rebuild the foundation of K-12 mathematics, the goal shouldn't be more screen time or more automated grading. It should be a deeper attendance to students' thinking. For math leaders, we recommend three key priorities:

1. Prioritize the "Show Your Work" Imperative: Data shows that handwriting mathematical processes engages deeper memory encoding. Ensure you capture the entire sequence of a student’s work, not just the final digit.

2. Focus on Real-Time Instructional Adjustments: Provide professional development that helps teachers analyze student thinking in the moment. Use data tools that distinguish between a conceptual misunderstanding and a procedural error so that you can intervene with precision.

3. Bridge the Gap, Don't Replace the Foundation: The most effective interventions are those that act as a layer—like a "pencast" layer—that works alongside your current tools to maximize the return on your existing investments.

Note: KAITLab is a paid member of the LEAP Innovations EdTech Design Collective.

Photo at top by Katerina Holmes from Pexels