The Journey to Create a Data Driven School Culture

Collaborative inquiry posters showing causal analysis based on San Mateo Elementary School data

The Data-Aware Principal: Reflection #1
Guest Blogger: Lindsay P. Sharp, Principal, San Mateo Elementary School, Duval County Public Schools, Jacksonville, FL

As a principal, it’s clear to me that I need to be data informed. My job depends on it—literally, since I am evaluated by my school’s achievement. More importantly, though, my heart depends on it—I am committed to seeing data not as just numbers, but connected to the success of the students and teachers in my school.

As the school’s leader, my thoughts turn to the best way to translate my own state of “data informed-ness” into meaningful action, and I have come to understand the key lies in putting my efforts into creating data leaders beyond the principal’s office. My Using Data colleagues are now in every classroom in my school! Accomplishing this level of a “using data school culture” depends on a process that involves professional development, support, and dedication over time. We work at it every day.

 

One Teacher Talks About Using Data to Drive Instruction in the Classroom

GUEST BLOGGER: Mary Anne Mather, Using Data Senior Facilitator & Social Media Liaison on Twitter & FaceBook

I very much enjoyed Part I of Jill Thompson’s blog series about “Using Data to Drive Instruction in the Classroom.” According to her bio, Jill is an elementary math and science facilitator.

I applaud her for sharing her insights and passions about this subject. As a former classroom teacher, and currently as a facilitator for TERC’s Using Data process, I find myself in step with her thinking. Regularly integrating formal and informal assessments into the instructional planning process is a must. It’s not adding more to the plate — it IS the plate…understanding the impact of the teaching process on student learning and using that information to plan the necessary next steps—not only what to teach, but how to engage kids in the learning.

These days there is so much negative emphasis on testing, and I understand the rub when I see test scores being used to punish teachers and categorize kids. But let’s be clear that using data and testing are not the same thing. Data comes in many shapes and forms, well beyond test results and grades (these are just one data point). Teachers have the opportunity to use data as a valuable resource to guide a teaching and learning approach that can ignite learning for all students. As Jill notes–it just takes time and know-how (and an understanding that it’s a non-negotiable).

I plan to follow Jill’s blog series on this topic, and I recommend it to you. Thank you, Jill, for sharing your experiences and helping those who might be uncertain about how to put their data to work as an instructional tool. Your ideas illuminate understanding of a process for using data that can profoundly impact student engagement and achievement.

 

Using Data Tip #6: Beginning a Causal Analysis Process: Why Asking “Why” Once is Not Enough

GUEST BLOGGER: Mary Anne Mather, Using Data Senior Facilitator & Social Media Liaison on Twitter & FaceBook

“Learn from yesterday, live for today, hope for tomorrow. The important thing is not to stop questioning.” Albert Einstein

Once a school or grade-level data team has analyzed several data sources to pinpoint a student learning problem, they often feel ready to leap into action and solve it. To ensure that the solution pursued produces the hope-for results, it’s essential to engage in a collaborative process of causal analysis to identify the “root” cause of the problem.

There are many tools that support root cause analysis, one of them is referred to as Why-Why-Why—a question-asking technique used to explore cause and effect relationships. Why-Why-Why helps a group look beyond symptoms to underlying causes by taking the identified problem and asking why it exists at least three times—each time probing more deeply.

 

Using Data Tip #5: Getting to the Bottom of “Why” Before Investing in Solutions — Make Inferences and Question Your Data’s Story

GUEST BLOGGER: Mary Anne Mather, Using Data Facilitator & Social Media Liaison on Twitter & FaceBook

“Make data observations. Then generate possible explanations that inform next-steps to finding the best teaching and learning solutions.”
(from: Love, Nancy et al. The Data Coach’s Guide to Improving Learning for All Students, 2008.)

Data analysis is more effective, and more on-target for getting student achievement results, if a team of stakeholders first observe and list as many details as possible about what the data reveal, followed by making inferences about these observations, and then asking “why is this happening?” “what else do we need to know to be sure?”.

Infer/Question is the fourth stage in a team-based, 4-phase dialogue process* that guides deep discussion toward deriving accurate meaning from performance data. (See more information about Step 1: Predict, Step 2: Go Visual, and Step 3: Make Observations.)

These action steps will help you and your data team share inferences about the story the data reveal—inferences that will inform important next-steps toward identifying a valid student learning problem and its true causes.

 

Anatomy of a School Improvement Communications Plan

Guest Blogger: Dr. William L. Heller, Using Data Program Director, Teaching Matters*

Summer has arrived, and the last of our current data institutes, like the school year itself, has come to an end. But as the participating data teams leave, carrying not a diploma but an action plan, they realize that their work is only just beginning. It is not a graduation; it is a commencement. And the first step in the journey ahead is to introduce the action plan they developed to the principal, administrators, teachers, parents, and other stakeholders in their school communities. This requires another planning document—a strategic communications plan, inviting others to invest in a shared vision for bringing the action plan to reality.

So…what are the elements of a good communications plan that will get others behind the action plan?

 

Taking Standardized Testing’s Higher Road

GUEST BLOGGER: Mary Anne Mather, Using Data Facilitator & Social Media Liaison on Twitter & FaceBook

Since the story broke, the media and bloggers have actively covered the details about a recent test-score-fixing fiasco—and the news continues (links provided below). There have been commentaries about who really suffers from a scam of this magnitude (students robbed of remedial opportunities) and who is to blame—their motivations…and their motivators (“…targets were implemented…in such a way that teachers and administrators believed that they had to choose between cheating to meet targets or failing to meet targets and losing their jobs.” Volume 3: Conclusions: Why cheating occurred and cover-up allegations, p. 4). I’m particularly taken with “the data-made-me do-it” explanation. There’s even talk of legal prosecution. This whole mess feels like a major attraction in a very tawdry sideshow of the school reform circus. And sadly, although the media is focused on one district at the moment, test score and data manipulation is not new news.

Yes, there’s explaining to do, and some one (or many) will need to be held accountable, but wouldn’t it be great if the lion’s share of the energy fueling our collective indignation, disbelief, and need for retribution could be channeled to establishing more positive, long-term improvements to a testing and assessment system that has surely gone awry. I’m not yet so tainted that I can’t believe we (saints and cheaters alike) all really want the same thing: exemplary schools, highly qualified teachers, and well-educated students who are life-long learners ready to succeed in their adult lives.

I weigh in with Diane Ravitch on this one,

 

Data Blind Spots—Data Use Continuum Tool Can Improve a School’s Vision

By Diana Nunnaley, Director, TERC’s Using Data

Depending on where you sit, and which frame of reference shapes your work, you either celebrate charter school efforts or think charters reflect a “right” wing or “left” wing  (take your pick) conspiracy to undermine the role of public education in the United States.

A blog post is too short a space to weigh into the considerable arguments both pro and con that can be made regarding the place for charter schools in America. To my thinking, charters are a natural consequence of Americans seeking a solution to a social problem. We may not agree on the substance of the problem or the direction of the solution, but in a society that values and applauds entrepreneurial efforts, charters are here to stay. That is, they have a place until we learn more about the experience (hopefully by examining the data) or, have a collective epiphany about the impact of poverty on kids’ success in learning and activate the collective will to change the way we fund and support local education.

Charter School Vision Equally Blurred

Based on my experience working in schools across the country, the reality is that teachers in charter schools bring the same passion and desire to help children learn as teachers in any other public or private setting. They face the same staggering challenges and then some. And they bring the same blind spots to the table when examining their student learning data.

 

Why Norm? It’s Good Form!

Guest Blogger: Dr. William L. Heller, Using Data Program Director, Teaching Matters*

Data-savvy investigators never make important decisions based on a single source. When teams following the Using Data process believe they may have found a student learning problem, based on their analysis of standardized testing results, they know to confirm the problem through an examination of student work and other common formative assessments. When they do this, it’s important for them to have a norming process in place to ensure that the data being generated is reliable and useful.

Norming is the process of calibrating the use of a single set of scoring criteria among multiple scorers. If norming is successful, a particular piece of work should receive the same score regardless of who is scoring it. With the advent of the Common Core State Standards Initiative, we may anticipate that curriculum-embedded performance tasks will begin to gain prominence over traditional multiple-choice tests, and it will be even more important for teachers to be aware of how to make the best use of these assessments. Whether or not they are rigorous about norming can make a very big difference.

 

Mixing Business and Pleasure: A Conversation About Teacher Evaluation

GUEST BLOGGER: Mary Anne Mather, Using Data Facilitator & Social Media Liaison on Twitter & FaceBook

A beautiful morning walk in Falmouth, Massachusetts

A recent weekend wedding celebration on Cape Cod brought together a stirring mix of sapphire shimmering ocean, stunning bride (who I had the joy of watching transform over the years from little girl to accomplished young woman), and satisfying conversation with long-time friends—an enjoyable mix of hilarity, nostalgia, and sometimes serious discourse.

During several early-morning walks with friends connected through our work as educators, the more serious discourse returned time and again to an impassioned discussion about teacher evaluation. This conversation was prompted in particular by a June 4 Washington Post article, Maryland Teacher Evaluation Redesign Bogs Down. We were somewhat stunned to learn two pieces of data: 1) Almost a year ago, Maryland won a $250 million federal grant to build a “transparent and fair” teacher and principal evaluation model that would tie their success to student test scores and learning, and 2) The state is seeking a year’s extension to fully execute the evaluation system it has yet to develop.

“Two-hundred fifty million,” my friend mused. “They could hire 250 people and pay them a million dollars each. With that kind of brain trust you’d think something could be developed in a year.” We laughed, but think about it.

 

Using Data Tip #4: Make Data Observations — Before Identifying Solutions, Get All the Facts on the Table

GUEST BLOGGER: Mary Anne Mather, Using Data Facilitator & Social Media Liaison on Twitter & FaceBook

Set aside assumptions, and focus on just the “data facts” before leaping to explanation and interpretation.
The Data Coach’s Guide to Improving Learning for All Students

Teachers are natural problem solvers. When we see evidence of individual students struggling, or indicators in our data that groups of students are underachieving, we are anxious to find solutions. The Using Data process advocates a “hold your horses” mindset that can help teachers to better pinpoint a student learning problem before jumping to explanations, interpretations, and quick-fix solutions. Data analysis is more effective if a team of stakeholders takes the time to observe and record as many details as possible about what the data reveal.

Observe is the third stage in a 4-phase dialogue process* that guides deep discussion toward deriving accurate meaning from the data. (See more information about Step 1: Predict and Step 2: Go Visual.) Engaging in this process as a data team, rather than individually, can garner the greatest impact toward improved student achievement.