APPENDIX C:
C: Developing a Robust Measurement Strategy
FIGURE 23: DEVELOPING YOUR MEASUREMENT STRATEGY MILESTONES
The visual below illustrates the key milestones in the development of a robust measurement strategy.

FIGURE 24: DEFINITION AND EXAMPLES FOR MEASUREMENT STRATEGY MILESTONES
Figure 24 provides guidance on each of these milestones as you work to put in place a robust yet practical measurement strategy.
Milestone |
Definition |
Example |
|---|---|---|
Aim(s) |
The overall goal(s) of the improvement effort. “What are we trying to accomplish?” We often recommend sub-aims to focus your team on intermediate goals. You can develop data-informed specific, measurable, achievable, relevant, time-bound, inclusive and equitable (SMARTIE) goals focused on increasing adherence to specific AAP preventive care guidelines year over year among attributed patients or subpopulations of patients. |
Adults who are diagnosed with diabetes will regularly monitor their hemoglobin A1c. Example sub-aim: The percentage of Black patients aged 18 years or older with elevated or hypertensive blood pressure who have a follow-up plan documented will increase from 60% to 90% by December 2025. |
Concept(s) |
A general abstract notion (approach, thought, belief or perception) related to the aim(s) of focus. |
Ensure adequate monitoring of diabetes management for patients. |
Measures |
Specific objective ways to determine the extent to which an aim has been met or to determine if there has been improvement in the concepts of focus. Measures help us to answer the second question in the model for improvement: “How will we know that a change is an improvement?” Measures generally fall into one of three types:
|
For the purpose of this example, we will examine the percentage of adults who regularly monitor their hemoglobin A1c. |
Operational definitions |
Detailed descriptions in quantifiable terms of what to measure and the steps to follow to do so consistently each time and over time. The operational definitions help make the measures clear and unambiguous and often contain criteria for inclusion and exclusion and numerator/denominator. |
Percentage of 18- to 75-year-old people with diabetes whose hemoglobin A1c was not under control (>9%). See CMS122v11 for more information on inclusion criteria. |
Data collection plan |
A detailed set of instructions that generally includes:
|
Percentage of 18- to 75-year-old people with diabetes whose hemoglobin A1c was not under control (>9%): Who:
How:
Where and how the data will be stored:
When the data will be collected:
How often:
|
Data collection |
The process of collecting the agreed upon measures in accordance with the relevant operational definitions and the agreed upon data collection plan. |
Data will be collected through automated EHR reports. |
Analysis and action |
The process of analyzing the data, including instructions for the analysis and visualization of the data, disseminating the data to relevant parties, and using the data to track progress and guide improvement efforts. |
The quality improvement team reviews the percentage of 18- to 75-year-old people whose hemoglobin A1c was not under control (>9%) on a monthly basis, and the care team and panel manager review the data subsequently once per quarter or every six months for ongoing monitoring. |
Creating a SMARTIE goal
A SMARTIE goal is important because it clearly states a purpose or direction, ensures everyone is on the same page, and sets a realistic target, all while ensuring the outcome is equitable and inclusive. The template below can help your team ensure your goals are SMARTIE.
MAKE IT SMARTIE
- Specific: Use explicit language that details the intended outcome of your change initiative.
- Measurable: Quantitatively define what success will look like by using baseline data and stating the intended outcome to facilitate progress tracking.
- Achievable/Ambitious: Consider what you can achieve in 2026 and how much you want to stretch your team and organization in achieving the goal.
- Relevant: Explain who or what the project will impact (e.g., specific population) and provide a rationale for why this is important.
- Time-bound: Establish a date or period by which you want to accomplish the goal (include a specific date).
- Inclusive: Bring the people who are most impacted into processes, activities, and decision making in a way that shares power (this may be reflected in how you implement the goal).
- Equitable: Seek to address systemic injustice or inequity.
SMARTIE GOAL TEMPLATE
Improve / Increase / Reduce _____________________________ (specific measure, e.g., vaccine completion rate) of/for ______________ (add population / subpopulation or area of focus – e.g., children between 0-2 years of age) from ___________ (baseline) to ______________ (target goal) by _________ (specific date within 2026).
EXAMPLE
Increase the rate of diabetes control (defined as A1c < 7.0%) for empaneled patients aged 45 and older, from 55% to 70% by December 31, 2026, with a particular focus on reducing the 12% control gap currently seen in the Hispanic/Latinx population to under 5% gap.
POPULATION HEALTH GUIDE FOR UNDERTAKING 3 PART DATA REVIEW
The three part data review is a tool that can be used to advance work related to population health. It draws on asset-based inquiry, to surface to identify needs and opportunities to understand the ways in which systems have discarded or undervalued the assets of individuals and communities. Groups can then work together to ensure that all can contribute to advancing population health and well-being and dismantling inequities. Access the full resource.