Continuous Improvement
Continuous Improvement
Jeannie Myung
Kelsey Krausen
Hayin Kimner
Corey Donahue
September 2020
Policy Analysis for California Education
Acknowledgements
This report, like all PACE publications, has been thoroughly reviewed for factual accuracy and
research integrity, and we thank this publication’s reviewers. We would also like to acknowledge
our colleagues Heather Hough, Jason Willis, Alix Gallagher, Ben Cottingham, and Sandra Park
for their feedback and assistance. We are grateful to the Stuart Foundation and Kabcenell
Foundation for their support of this work.
Executive Summary
California’s school accountability and support system, the Statewide System of Support (System
of Support), was designed to transform California’s approach to school improvement. Rather than
focusing on punitive consequences for underperformance, the System of Support is designed to
provide education leaders and educators with needed support to build their skills and knowledge.
Central to the state’s theory of action is that building system capacity to improve will lead to
increases in student achievement and will reduce disparities in outcomes. In practice, this has
resulted in heightened interest and investment in continuous improvement approaches in
California schools. Continuous improvement entails collective problem identification; rapid
development of potential solutions; feedback mechanisms to quickly assess the effectiveness of
potential solutions; and willingness to learn from failures in order to deploy successful solutions.
The effective implementation of continuous improvement requires structures, practices, cultures,
and capacities that are often in contrast to traditional school improvement strategies, which
have prioritized scaling ideas quickly or presenting top-down mandates.
This report describes the contextual factors of organizations and the capacities of individuals
that can foster the success of continuous improvement and the goals of the System of Support.
As schools, districts, counties, and state agencies embark upon the work of continuous
improvement, they must also attend to the enabling conditions and capacities that undergird the
success of continuous improvement efforts.
There are four general organizational conditions of improvement systems that have emerged
from the research literature and the experiences of improvement professionals. These
organizational conditions are: (a) shared purpose, (b) culture of mutual trust, (c) structures
and resources that foster collaborative work, and (d) preparation and mobilization of
improvement capacities. The capacities that equip individuals to improve include the ability to:
(a) apply continuous improvement approaches to problems, (b) support others to engage in
continuous improvement, (c) provide resources and support based on local needs, (d) take a
relational approach, and (e) engage others to inform the ongoing improvement of support
at all levels. These conditions and capacities lay the groundwork for continuous improvement to
take hold in California’s school system and advance outcomes for students.
Policy Analysis for California Education
Introduction
In December 2017, California launched a new school accountability and support system,
the Statewide System of Support (System of Support). The System of Support was designed to
transform California’s approach to school improvement. Rather than focusing on heavy-handed
consequences for underperformance, designers of the System of Support believed that in order
to address persistent achievement gaps, education leaders and educators needed support to
continue to build their skills and knowledge. In other words, the System of Support was designed
based on the premise that prior accountability efforts were unsuccessful, at least in part, because
they ignored the need to build local capacity to improve. Therefore, the state’s goal for the
System of Support is:
To help local educational agencies (LEAs) and their schools meet the needs of
each student they serve, with a focus on building local capacity to sustain
improvement and to effectively address disparities in opportunities and outcomes.
(California Department of Education, n.d.-a, para. 1).
Central to the state’s theory of action is that building system capacity to improve will lead
to improved student achievement and will reduce disparities in outcomes. As a result, there
has been increased interest and investment in continuous improvement approaches in California
schools.
A few years into implementation of the System of Support, there is a small but growing
research and practice literature highlighting the work of schools and districts that have effectively
implemented continuous improvement strategies. Researchers studying California’s early
implementation of continuous improvement find that “when it’s well understood and appropriately
applied, a continuous improvement approach can improve education quality” (Grunow & Hough,
2018, p. 3). Some of the bright spots, for example, include increases in academic success, specific
gains for traditionally underserved student subgroups, higher graduation rates, and increased use
of data and evidence to drive change (Grunow & Hough, 2018).
edpolicyinca.org 1
Although there have been several demonstrations of the viability of continuous
improvement in schools in California (Gallagher & Cottingham, 2019; Krausen, Caparas, Mattson,
2019), as can be expected, not all efforts to apply continuous improvement achieve their goals.
Even in the corporate context, where continuous improvement strategies have been in use
for decades, research indicates that over 70 percent of improvement efforts fail (Chakravorty,
2010). A study of improvement projects in healthcare facilities showed that half of the process
improvement projects failed to meet their stated goals, and of those that were deemed successful,
only half sustained their improvements after 1 year (Ziaee & Bologna, 2015).
Such variation in outcomes may lead to skepticism about the state’s focus on continuous
improvement as the foundation of its System of Support. Alternatively, the explanation for the
variation in success may lie not in the methods themselves but in the contextual factors of the
organizations that foster or attenuate the success of continuous improvement. This might include
an incomplete understanding or inadequate investment in the capacity of individuals to engage
in continuous improvement, which requires a specific set of skills, knowledge, and mindsets.
According to the estimation of improvement pioneer W. E. Deming (2018), 94 percent of the
problems and opportunities for improvement belong to the system (p. 248), and contextual
factors are part of the system. One California district superintendent reflected:
Objectives
The shift to continuous improvement is about introducing new ways of organizing and
engaging in work. It takes both organizational conditions and a set of skills and knowledge to
advance and sustain improvement efforts at different levels of the system—state, county, district,
and school. Yet, despite the core premise of the System of Support—that all improvement
assistance should build the capacity of Local Educational Agencies (LEAs) to design and
implement programs responsive to student needs—what is meant by “capacity” has been left
largely unspecified, as have the conditions that must be in place for those capacities to be
effective. Moreover, state leaders of the System of Support have not clearly articulated how
improvement capacities will be developed, and what specific capacities are needed for leaders
tasked with designing and providing support in districts, in county offices of education (COEs),
and in state agencies such as the California Department of Education (CDE), the California
Collaborative for Educational Excellence (CCEE), and the State Board of Education (SBE).
In particular, COEs are central actors in the System of Support in that they are charged with
providing differentiated assistance to eligible LEAs. However, it is widely recognized that COE
capacity to guide improvement efforts is uneven across counties, with some county offices
being very capable of supporting their identified districts while others are themselves in need of
additional improvement support (Humphrey & O’Day, 2019).
In an effort to more fully articulate the System of Support’s components and to guide
the development of an improvement framework for assessing whether the design is working,
PACE and WestEd conducted a study of the organizational conditions and individual capacities
necessary to enact continuous improvement and achieve the goals of the System of Support.
This latest exploration of how to strengthen continuous improvement efforts in California
included development of a framework that outlines the organizational conditions necessary
to support improvement efforts; the primary roles and functions of system leaders at each
level of the System of Support; and the capacities needed at the school, district, county, and
state levels to successfully embed continuous improvement in California schools.
Methods
It became increasingly clear that the enabling organizational conditions and the key
capacities (skills and knowledge) work together and are dependent on each other. For example,
if a district leader has the ability to analyze and monitor data, this ability cannot have an impact
1
Survey items were developed by the California Comprehensive Center at WestEd staff with input from the System of Support
Coordination Team, Association of California Superintendents and Administrators (ACSA), and the California County Superintendents
Educational Services Association (CCSESA).
edpolicyinca.org 3
if the district does not have an effective data infrastructure in place. Similarly, having a
sophisticated data infrastructure without leaders who know how to use the data system for
improvement will not advance improvement goals. The interdependence between organizational
conditions and individual capacities for the advancement of improvement efforts in the state
led to the development of the full framework.
Another round of interviews was conducted with state, county, and district leaders
between November 2019 and early 2020. These interviews included a review of the framework
and discussions about how it might more closely reflect the roles and capacities necessary
at each level of the system. The organizational conditions component of the framework was
vetted at a research conference hosted by PACE in fall 2019 focused on the System of Support.
The full framework, including both the organizational conditions and the capacity framework,
was shared as part of a panel presentation for an audience of over 150 participants at PACE’s
annual research conference in February 2020.
Spreading the work of continuous improvement across all levels of California’s education
system to affect teaching and learning in the classroom is a complex and ambitious endeavor.
Retooling the entire system (i.e., state, county, district, school) acknowledges that continuous
improvement requires focus and coherence across all levels. In addition, it means that all of the
different organizational contexts, histories, and relationships within and between the levels can
either help or detract from meaningful, sustainable improvement. Outlining the specific functions
and responsibilities of each level of the system provides a frame for understanding where
additional support might be needed when improvement is not occurring. For example, if a school
district that is eligible for differentiated assistance is not improving outcomes for students, it may
indicate a need to improve the organizational conditions and individual capacities within the
district and/or it may indicate that the support provided by the COE is insufficient and capacity
should be strengthened at the county level. Similarly, if there is a lack of clarity around the vision
and theory of action for the System of Support, this indicates the need to reinforce organizational
conditions and improvement capacities at the state level.
The following section outlines the primary function or responsibility of education leaders
at each level of the system for enacting continuous improvement through the System of Support.
Roles were refined based on multiple rounds of input from system leaders. However, despite
general consensus on the roles outlined in the capacity framework, they will likely require
continued clarification as the System of Support evolves. The descriptions below are intended to
differentiate clearly the focus of the improvement work of system leaders at each level.
The list focuses solely on the primary role of system leaders in achieving the goals of the System
of Support and is not intended to be an exhaustive list of the many other important aspects
of system leaders’ daily work. Though other actors play pivotal roles in fostering continuous
improvement (including unions, school boards, and advocacy groups), the following agencies
and organizations are limited to those that have formal roles in the System of Support.
The state agencies named above are charged primarily with creating effective policy levers
to enable successful implementation of the Statewide System of Support, including supporting
lead agencies and disseminating information about the state’s approach to accountability and
improvement. The CDE also provides differentiated assistance to eligible COEs. The focus of the
state’s work in the System of Support is to:
• Guide ongoing improvements to the System of Support based on the needs identified
through the Dashboard, feedback from system leaders, and other data sources.
• Align state funding and policies to support systemwide improvement.
• Connect lead agencies, COEs, and LEAs to resources.
• Clarify and disseminate information about the System of Support and its components
to increase understanding and buy-in.
• Provide capacity-building, coordination, and collaboration support for lead agencies.
The COE’s primary function in the System of Support is to provide support to school
districts. Those that serve as Geographic Leads also serve as resource providers (in the form of
technical assistance and content expertise), capacity builders, and liaisons so that COEs can learn
from each other. The focus of the work of COEs in the System of Support is to:
• Provide universal support (i.e., Level 1) to all LEAs and county-run schools in the county.
• Provide differentiated assistance (i.e., Level 2 support) to LEAs in the county.
The focus of the work of Geographic Lead Agencies (Geo Leads) in the System of Support is to:
• Build the capacity of county offices within their geographic area to provide effective
improvement support to their respective districts.
• Connect counties to each other, to external assistance providers, and to other leads
that can support them and the districts they serve.
• Communicate the needs of LEAs and COEs back to state agencies.
edpolicyinca.org 5
School Districts
School districts are considered the unit of change in the System of Support. Their focus
is both on implementing system improvements in the district office and on supporting school
sites to improve outcomes for students. In the System of Support, districts aim to: (a) support
schools to improve student outcomes; (b) engage in sustainable district-level improvement work;
(c) use the Local Control Accountability Plan (LCAP) to guide improvement planning; and
(d) facilitate regular, meaningful engagement opportunities with schools, families, and community
stakeholders as part of all phases of the improvement process.
Schools
Schools are most directly responsible for student success, and students are intended to
be the ultimate beneficiaries of the state’s improvement infrastructure. The focus of schools in
the System of Support is to: (a) meet the learning needs of every student; (b) address disparities in
learning opportunities and outcomes; and (c) sustain improvement efforts.
There are four general organizational conditions of improvement systems that have
emerged from the research literature and the experiences of improvement professionals. These
organizational conditions are: (a) shared purpose, (b) culture of mutual trust, (c) structures
and resources that foster collaborative work, and (d) preparation and mobilization of
improvement capacities.
Shared Purpose
A common purpose reflects the organization’s fundamental reason for existence (Adler
& Heckscher, 2018). Captured by the notion of “start with why” (Sinek, 2009), shared purpose
within an organization provides focus and direction for improvement efforts. W. E. Deming
(2000) believed that developing and maintaining a constancy of purpose was the most important
step towards achieving quality and organizational improvement. Indeed, noteworthy scientific
breakthroughs, sweeping social movements, and rapidly growing organizations are often the
result of a clear, shared unifying purpose (Ismail, 2014). Purpose that propels motivation and
transformation does not describe what is possible today but rather depicts a different future that
is worth aspiring towards. Key questions to guide an organization’s development of a shared
purpose include: (a) Why does our organization exist, (b) how will we be successful, and
(c) how will we know that we have succeeded?
Similarly, Fullan and Quinn (2015) write about coherence—what is at work in the minds and
actions of people individually and collectively—as a central “driver” of change. Key to coherence
is a focusing direction. School staff and leaders need to have a shared purpose that guides their
priorities and actions as well as a shared sense of responsibility for the outcomes of their work.
A shared purpose among school staff should reflect the unique characteristics and circumstances
of the school community. In addition, shared purpose and responsibility should:
• Be codeveloped with differentiated roles. Individuals within the system should clearly
understand their specific contribution to the purpose and goals of the organization as
well as how the parts work together. Engaging school and community stakeholders—
including students, teachers, and families—as part of defining the purpose is foundational
to their continued involvement in ongoing continuous improvement processes.
All system actors share responsibility for improving student outcomes.
2
See the main CDE site for the System of Support at https://www.cde.ca.gov/sp/sw/t1/csss.asp as well as the CCEE’s about page at
https://ccee-ca.org/system-of-support/about-the-system
edpolicyinca.org 7
• Reflect a sense of urgency. Administrators and staff should see the need for change
and understand that the status quo is no longer acceptable. According to research
on organizational change, over 50 percent of change efforts fail due to the lack of a
sufficient sense of urgency for change (Kotter, 2012).
David and Talbert (2012) write about how Sanger Unified School District balanced tight
and loose control by defining clear parameters around when and how schools have discretion
over their priorities:
Reflecting on results and plans, trying new ideas, and collecting data on new approaches
are all strategies that can lead to improvement, but a realistic improvement journey also includes
3
The CDE’s eight priority areas for school districts include: basic services, implementation of state standards, course access,
student achievement, other student outcomes, student engagement, parent involvement, and school climate (see California
Department of Education, n.d.-b).
failure along the way. Accordingly, improvement work requires trusting that change efforts will
not be penalized—even when they fall short of their intended goals. As one district superintendent
said: “The system has to be created so that the organization feels safe enough to actually try
something different” (Hough et al., 2017, p. 8). Mutual trust in school is what “fosters a set of
organizational conditions, some structural and others social-psychological, that make it more
conducive for individuals to initiate and sustain the kinds of activities necessary to affect productivity
improvements” (Bryk & Schneider, 2002, p. 116). It is the connective tissue that binds individuals
together as they work to advance a common purpose.
Bryk and Schneider, in their studies of over 400 public schools in Chicago, refer to the
foundational importance of “relational trust”—where teachers, students, parents, and leaders
understand their obligations and also hold expectations about the contributions of others:
As in any other relationship, such trust must be cultivated and constantly renewed, especially
in the context of work that is highly interdependent and historically fraught with uncertainty and
stress.
Similarly, Amy Edmonson (2019) studies what she calls “psychological safety” in
workplaces—that is, the extent to which individuals trust their peers and believe that inquiry
and vulnerable conversations are foundational to their professional environment. This notion is
especially significant for low-performing schools and districts that experienced defensiveness,
anxiety, and self-protection under previous accountability regimes. In a comprehensive analysis
of the factors that make a team successful at Google, researchers sought to understand the
components of an effective team. They ran statistical models on hundreds of variables, including:
education level, similarities in hobbies, personality types, degree of overlap in social networks,
and gender balance. These researchers discovered that what made a team effective was less
about who was on the team and more about the way the team worked together. Psychological
safety was found to be the factor that best predicted team effectiveness (Duhigg, 2016).
Organizations that prioritize and develop high psychological safety are able to support
dynamic collaboration and “teaming,” creating settings in which colleagues are able to work
together without interpersonal anxiety or fear. Edmonson writes:
They feel willing and able to take inherent interpersonal risks of candor. They
fear holding back their full participation more than they fear sharing a potentially
edpolicyinca.org 9
sensitive, threatening, or wrong idea. The fearless organization is one in which
interpersonal fear is minimized so that team and organizational performance can
be maximized in a knowledge intensive world. (2019, p. xv)
Particularly relevant to continuous improvement work, a culture of mutual trust can allow
people to focus on achieving shared goals—including supporting and strengthening individual
learning behaviors and collective performance—instead of focusing on self-protection. Research
shows that psychological safety shapes an employee’s propensity to engage in learning behaviors
such as information sharing, asking for help, and experimenting.
To foster a culture of trust, leaders must develop and maintain an emphasis on support
and collaboration—as opposed to mandate and compliance. Organizational leaders are able to
earn and maintain the trust of their colleagues by explicitly and consistently modeling learning
and inquiry in their own work, in addition to concretely supporting the collaborative efforts
of staff and partners. Leaders must also demonstrate that they trust and respect the decisions
and expertise of staff and teachers by minimizing reliance on mandates and compliance for
improvement, and by emphasizing support and collaboration. In addition, members of the
school community believe in their collective ability to make a difference for students—groups
with greater collective efficacy demonstrate greater improvement in student outcomes (Bandura,
1993; Donohoo et al., 2018; Goddard et al., 2004). Collective efficacy strengthens and sustains
a community’s capacity for improvement, and is developed over time with evidence of impact,
including “small wins.”
• School staff, leaders, families, and students feel psychologically safe. They are able
to engage in learning behaviors—such as admitting to lack of knowledge, making
mistakes, expressing dissenting perspectives, asking for help, or taking risks—without
fear of punishment or interpersonal or social threat (Edmonson, 2019).
• School staff and leaders engage in continuous improvement in their own work.
School staff and leaders demonstrate vulnerability, seek feedback, and apply disciplined
inquiry methods to engage in the testing of ideas and learning from failures. This is
especially important for counties and state organizations that need to “walk the talk” of
the approach they promote and expect from districts and schools.
• School staff and leaders prioritize support. Support is prioritized for teachers,
students, and the community; school staff and leaders are explicit about investing in
the relationships and resources that are needed to succeed.
• School staff and leaders believe in their collective ability to affect all students’
outcomes together. This occurs regardless of student race, ethnicity, socioeconomic
status, background, or disability classification.
The state’s shift from a culture of compliance to one of support is easier said than done.
To change cultures and mindsets, systems leaders (especially those who have traditionally held
the most decision-making power and authority) must recognize where trust has been broken or
eroded. For example, there is preliminary evidence that some COEs are intentionally working on
strengthening trust with their districts by implementing and modeling continuous improvement
processes in their own work (Manansala & Cottingham, 2019).
However, the broader theory of action for COEs in supporting district improvement
efforts remains unclear. The state must better articulate the assumptions behind the processes
or mechanisms across the full System of Support, including what data is needed, who
analyzes it, how improvement priorities are determined, and how feedback will be integrated
into decision-making and governance structures, especially with regards to funding and
accountability.4 All of these assumptions affect the ability of leaders and practitioners to build
and strengthen the trust necessary for improvement work.
Historically, the work of teaching has been isolated work. Sociologist Dan Lortie (1975)
described schools as organizational “egg crates” in which each teacher conducts their work alone
within the confines of the classroom, focused on their own students with limited interaction with
colleagues. Teacher autonomy has traditionally rested on freedom from scrutiny and the largely
unexamined right to exercise personal preference, with teachers acknowledging and tolerating the
individual preferences or styles of others (Little, 1990). It is well established in research, however,
that teacher collaboration in joint work reaps benefits for student learning, teacher practice, and
4
In 2019, the California Comprehensive Center at WestEd conducted a formal feedback plan for the CDE and SBE in the first 2 years
of the System of Support to gather data on early implementation. The state has now hired an evaluation firm to carry out this work.
edpolicyinca.org 11
school improvement (Hargreaves & Fullan, 2012; Ronfeldt et al., 2015). School reform is replete
with strategies attempting to dismantle this traditional approach to isolated teaching, yet for many
schools and districts, ideas of collaboration and teaming are often at odds with the dominant
cultures of order and control. School improvement work is not an individual task but depends
on the ability of school staff—leaders, educators, and support staff—to work together to identify
challenges and to try and test different solutions. However, traditional school structures offer
limited opportunities for teachers to partner substantively with others outside of their classrooms,
and instead often rely on “one-shot” workshops (Darling-Hammond & Richardson, 2009). That, in
turn, limits continuous improvement practices and opportunities to build a culture of mutual trust,
support, and collaborative learning.
Schools and districts that invest in a continuous improvement approach have adequate
and sustainable resources to support the ongoing work of improvement and are intentional
about creating and maintaining integrated structures and practices that facilitate and encourage
collaboration and collective learning. This includes:
• Protected time and norms for collaboration. There is protected time and space for
teacher and staff collaboration built into the master schedule so that teachers are
able to work together. Similarly, there are clear and formal working norms around how
teachers and staff effectively use their collaboration times (e.g., grade-level teams,
coordination of services teams, cycles of inquiry).
• Breaking down silos. Working deliberately across departments and disciplines is not
the same as just being together in the same meeting. Instead, leaders must have
explicit rationale about who meets when and what the focus is; follow well-designed
processes and protocols to facilitate important and productive interactions; and
include those who are most often left out (e.g., students and families).
Amid the continuing budget shortfalls and concerns around teacher and administrator
retention (Darling Hammond et al., 2018; Grissom & Sutcher, 2018), California must be realistic
about what it takes to support a sustainable nested System of Support. Improvement work across
the ecosystem, particularly at the district and county levels, generally mirrors the same enabling
conditions at the school level in terms of protected time, process, and resources. However,
it is important to recognize that at the school level, conditions are highly dependent on the
surrounding funding and accountability context (i.e., district, county, and state resources, policies,
and priorities). For example, district collective bargaining agreements can strengthen school-level
collaboration efforts, specifically in terms of ensuring that there is protected time to engage in
professional learning and improvement activities.
For the System of Support to be most effective, structures that foster collaborative work
must include clear and consistent expectations, timing, and resources to support specific
improvement processes not only at the district and school levels but also in the ways that county
and state actors work together. For instance, most COEs were traditionally organized to focus on
compliance monitoring activities on behalf of the state. COEs are expected to continue in this
role but are now also called on to build the capacity of the districts they support to continuously
improve, which requires a completely different set of structures, skills, knowledge, relationships,
and processes than those traditionally held in COEs (Humphrey & O’Day, 2019; Manansala &
Cottingham, 2019).
Similarly, the state’s role—policy, guidance, tools, and funding—is shifting and, as the
work evolves, there is a better understanding of the refinements that must be in place to help
schools, districts, and counties address state priorities (Henig et al., 2018). For instance, the
tensions discussed above around defining a “shared purpose” have process and resource
implications; the state’s priorities and multiple initiatives might unintentionally hinder focused
and coherent improvement efforts. In addition, aside from piecemeal funding from the
legislature, there has yet to be a clearly designated, sufficient, and sustainable revenue stream to
support the comprehensive improvement efforts that are supposed to take place at the school,
district, county, and state levels. Revenue streams must also include ongoing investments in
strengthening the state’s data infrastructure to be user-friendly for families and communities as
well as agile and responsive to the improvement needs of practitioners and decision makers.
edpolicyinca.org 13
Science; Improvement Science; Lean; Positive Deviance; and Six Sigma; among others. There
are relevant differences among these methodologies, most notably (a) who the problem solver
is, (b) the kinds of problems the methodologies are designed to solve, and (c) the specific tool
sets they employ. Regardless of the methodology selected, experts agree that it is important
for an organization to select and use a common methodology to promote discipline within
their continuous improvement efforts. Having a common improvement methodology fosters a
common language and enables the building of expertise with the practical tools of improvement
over time (Hough et al., 2017). A common continuous improvement methodology equips an
organization with a new way of addressing problems. To enable improvement work, leaders and
staff must be equipped for this new way of working. Primarily, they need to have identified:
• The set of knowledge and skills for improvement. This includes, for instance, having
a basic knowledge of a particular improvement methodology; the ability to analyze
data and identify areas for improvement; strategies to identify and address root causes
of problems; content knowledge to support instruction; and sufficient information
about students and families to tailor instruction and support. These are discussed in
more detail in the next section on core improvement capacities that are foundational
to the System of Support.
• Which staff needs which skills. While there are some basics of improvement
methodology around purposeful action, assessment, and adjustment, as well as
a reliance on data with which all staff could benefit, improvement work will not
uniformly engage all staff or stakeholders. Related to developing a culture of and
structures to support collaborative learning, it is important to differentiate roles and
skills, and to create the learning environments and supports for those for whom more
specialized improvement expertise is needed. The section that follows identifies which
capacities are needed at different levels of the System of Support, but these should be
further differentiated by role at each level.
What, specifically, are the skills, knowledge, and abilities that are necessary for individuals
to develop within an organization for improvement? And what capacities and roles are necessary
to advance continuous improvement in different levels of the school system in California? The
next section focuses on detailing a core capacities framework for continuous improvement that
identifies the roles and responsibilities necessary at each level of the System of Support to meet
its goals.
Education leaders across California are increasingly investing time and professional
development resources in continuous improvement methods, yet at the same time, system
leaders have also acknowledged considerable gaps in the ability of system actors to engage
in or coach others to engage in a continuous improvement approach, especially to close equity
gaps (Hough et al., 2017; Valdez et al., 2020).
From the outset, the System of Support Planning Team—the body charged with organizing
early implementation of the system—recognized the importance of defining the core capacities
for continuous improvement and engaged staff from the California Comprehensive Center at
WestEd to begin this work. Specifically, system leaders believed that defining the individual roles,
responsibilities, and capacities at the state, county, and district level would allow education
leaders to understand better how to allocate resources (e.g., funding, technical assistance)
to different levels of the system and where to focus and prioritize capacity-building efforts. For
example, many county leaders received training in improvement science during the first year
of implementation of the System of Support. Many of those county leaders found themselves
serving as improvement coaches for school districts. Therefore, it seemed critical to understand
the degree to which improvement coaching capacity, specifically, had been built in the system,
and where greater capacity-building was necessary in order to successfully carry out this role.
Defining core capacities is also a way to measure progress in the System of Support. By
defining capacities throughout the system, leaders can use corresponding capacity indicators to
measure progress over time. In addition, capacity measures may serve as important intermediary
measures while waiting to see if the System of Support has a meaningful effect on student and
school-level outcomes, as shown on the Dashboard.
The capacity framework (presented for each level in Appendices A–D) builds on the
assumptions and goals of the System of Support—building local capacity and improving student
outcomes—and identifies the specific roles and responsibilities needed to meet those goals at
each level of this system, as described earlier. For each of these roles, there are specific skills and
knowledge (i.e., capacities) that are required of staff in county offices, for instance, to successfully
fulfill this role. These capacities are described in further detail underneath each of the roles.
For example, the COE capacity framework in Appendix C shows one of the primary roles
of COEs in advancing the goals of the System of Support: providing differentiated assistance
(i.e., Level 2 support) to LEAs in the county. Interviews with state, county, and district leaders
suggest that in order for counties to provide differentiated assistance to LEAs, COE staff must
have the ability to support LEAs to use qualitative and quantitative data to measure and monitor
edpolicyinca.org 15
improvement at the district level. As such, a number of the other capacities for this county staff
role involve the ability to support district offices in continuous improvement.
This structure is replicated at the school, district, county, and state levels: capacities are
mapped onto specific roles at each level of the system. The only variance is that within the COE
capacity framework, there are specific capacities outlined for Geo Leads—those COEs that seek
to build the capacity of county offices within their geographic area; connect counties to each
other; and identify, collect, and distribute relevant resources. The full, detailed capacity-building
framework is included in the appendices. We provide an overview of some of the core capacities
below.
The state capacity framework—and, to some extent, the school district capacity framework—
similarly focus on this improvement coaching role, as the state is charged with providing
differentiated assistance to eligible COEs, and school districts must provide improvement coaching
to school sites. This coaching role also includes the ability of coaches to act as thought partners
to COE, district, or school-level improvement teams to support them in addressing their identified
challenges. Because this coaching role, particularly around county-led needs assessments of
school districts, is critical to the System of Support, Geo Leads must also have the capacity to
support counties in how to conduct a meaningful needs-assessment process with LEAs.
In setting a vision for the System of Support, state leaders and staff need the abilities
to clearly articulate the system’s purpose; to delineate roles and responsibilities across state
organizations; and to provide clear, ongoing communication to all bodies.
Capacities to provide resources and support based on local needs. Especially critical for
the state and COEs (including Geo Leads) is the ability to provide resources and support that
are responsive to the needs of COEs and school districts. For example, schools and districts need
to be able to support teachers and schools in using effective instructional strategies based on
local needs. Relatedly, staff at COEs (including those that are also Geo Leads) and within state
organizations should be able to broker connections between districts and appropriate support
providers. Resource brokers must also have the ability to provide meaningful opportunities for
system leaders to connect with each other—that is, to collaborate and learn from each other.
This set of capacities requires the ability both to assess local needs and to match resources,
opportunities for collaboration, and technical assistance based on those needs.
Capacities to engage others to inform the ongoing improvement of support at all levels.
As some system leaders reported, the System of Support should function as “one big feedback
loop,” requiring ongoing and meaningful engagement as well as robust communication channels
between the state, COEs, and school districts to ensure continuous improvement of the System
of Support itself. This requires the ability of Geo Leads and the state to gather comprehensive
feedback from LEAs and other COEs on their needs and the quality of support currently provided,
as well as the ability to hear from people on the ground about what improvements to state policies
are needed. It also necessitates the ability of Geo Leads to serve as liaisons to the Coordination
Team when specific needs arise, or to share concerns with the Coordination Team on behalf
of COEs.
edpolicyinca.org 17
Application of the Capacity Framework
The capacity framework provides additional nuance to the theory of action behind how
the System of Support will lead to system improvement. As such, the framework has at least four
potential uses.
• Provide clear objectives for building capacity. The first use is to provide leaders and
staff at each level of the system a clear sense of the kinds of capacities they are aiming
to develop in both their organization and the organizations they support. This can act
as a “north star” that facilitates the use of common language and practices throughout
the System of Support. One state leader noted that they would like to share the
framework with their team to determine whether they are providing clear learning
opportunities that are linked to the capacities.
• Act as a self-assessment tool. The second use, which was most frequently cited by
county and state leaders, is to allow organizations to assess their own abilities when
it comes to their roles in the System of Support. Knowing which capacities are being
developed statewide can better inform the areas that system leaders might seek to
improve. State and county leaders noted that if the capacity framework were linked
to a self-assessment rubric, leaders at all levels of the system could rate themselves
in each of the capacities and use the assessment as a tool for self-reflection and
development. One state leader also noted that a self-assessment tool could be used
at the end of a differentiated assistance process to reflect on that engagement:
A county leader similarly noted that county leaders “want to think through
where they are in their own ability to address the improvement needs of their districts
and what they would need to do to improve how they’re operating.” Another leader
noted that the capacity framework could be used as a capacity development tool
through which a district might be able to know whether and how it is fulfilling its role.
• Assess where additional support is needed. The third use is to allow leaders and staff
to more easily determine how best to support other organizations. For example, COEs
can use the capacity framework to assess the capacities of a given district in order to
determine how best to coach district leaders and staff. Geo Leads can use the capacity
• Guide evaluation of the system. The fourth use, as noted earlier, is to use standardized
indicators, based on the capacity framework, to measure progress statewide at all
levels of the system. Several leaders noted that it would be helpful to connect each of
the capacities with examples of evidence. Specifically, they asked for clear, concrete
features of each capacity, and what it is expected to look like in practice. Leaders also
noted that there is value in creating a shared understanding across different levels of
the system of what the roles are, which can help alleviate uncertainty. Accordingly, the
capacity framework may help to inform a process evaluation of the System of Support.
Questions posed to leaders of LEAs and COEs can help assess the degree to which the
System of Support has developed these specific capacities in order to know where
the state has made progress and where there is still work to be done.
Conclusion
To realize a successful System of Support that is based upon the principles and practices
of continuous improvement, implementation must go deeper than specific tools, protocols,
or processes of improvement methods themselves. Furthermore, it is critical to identify explicitly
and test the full set of assumptions that are part of the state’s new accountability system. The
research conducted for this project was intended to contribute to the development of a more
robust framework for testing the assumptions behind the System of Support and allowing for
the deployment of support where organizational conditions or capacities are falling short.
Prior to engaging in improvement work, leaders and their staff need to prepare for
a new way of working. Preparing for improvement is an opportunity to engage staff and the
community in conversations about the current state of the organization and the extent
to which the organizational conditions enable the work of continuous improvement. Some
questions that can support these preparations include: What are our strengths? What are the
areas where we need improvement? Who needs more support? What kinds of support?
How can we work better together?
In addition to specifying the improvement roles and responsibilities of leaders, staff, and
partners—and investing in a robust professional learning strategy—resources must be developed to
support the practical application of the framework. For example, a resource that provides a series
of “look-fors” for each of the individual capacities could help leaders to assess more effectively the
capacities of their own organization and the organizations they support. In addition, some county
and state leaders indicated that a rubric would help them better assess themselves, their teams,
and their organizations.
edpolicyinca.org 19
The organizational conditions and individual capacities framework was drafted based
on input from state, county, and district leaders over the course of 2 years and reflects the
experiences and perspectives of the improvement professionals and education leaders who are
part of the System of Support. As we continue to better understand the evolution of roles and
responsibilities of the state, COEs, districts, and schools, this framework serves as a working
hypothesis of how the full improvement ecosystem should continue to develop to meet the
goals of the System of Support.
References
Adler, P. S., & Heckscher, C. (2018). Collaboration as an organization design for shared purpose. In L. Ringel, P. Hiller, & C. Zietsma (Eds.),
Research in the sociology of organizations: Vol. 57. Toward permeable boundaries of organizations? (pp. 81–111). Emerald Publishing
Limited. https://doi.org/10.1108/S0733-558X20180000057004
Bandura, A. (1993). Perceived self-efficacy in cognitive development and functioning. Educational Psychologist, 28(2), 117–148. https://doi.org/
10.1207/s15326985ep2802_3
Bryk, A. S., & Schnieder, B. (2002). Trust in schools: A core resource for improvement. Russell Sage Foundation.
Bryk, A. S., & Schneider, B. (2003). Trust in schools: A core resource for school reform. Educational Leadership, 60(6), 40–45. http://www.ascd.
org/publications/educational-leadership/mar03/vol60/num06/[email protected]
California Department of Education (n.d.-a). California’s System of Support. https://www.cde.ca.gov/sp/sw/t1/csss.asp
California Department of Education. (n.d.-b). LCFF priorities/whole child resource map. https://www.cde.ca.gov/eo/in/lcff1sys-resources.asp
Chakravorty, S. S. (2010, January 25). Where process-improvement projects go wrong. The Wall Street Journal. https://www.wsj.com/articles/
SB10001424052748703298004574457471313938130
Darling-Hammond, L., & Richardson, N. (2009). Research review/teacher learning: What matters. Educational Leadership, 66(5), 46-53.
outlier.uchicago.edu/computerscience/OS4CS/landscapestudy/resources/Darling-Hammond-and-Richardson-2009.pdf
Darling-Hammond, L., Strunk, K., Goldhaber, D., & Sutcher, L. (2018, September). Getting down to facts II: Teacher supply falls short
of demand in high-need fields, locations [Policy brief]. Policy Analysis for California Education. https://www.edpolicyinca.org/
publications/teacher-supply-falls-short-demand-high-need-fields-locations
David, J. L., & Talbert, J. E. (2012). Turning around a high-poverty school district: Learning from Sanger Unified’s success. Bay Area Research
Group and Center for Research on the Context of Teaching.
Deming, W. E. (2000). The new economics for industry, government, education (2nd ed.). MIT Press.
Deming, W. E. (2018). Out of the crisis. MIT Press.
Donohoo, J., Hattie, J., & Eells, R. (2018). The power of collective efficacy. Educational Leadership, 75(6), 40–44. https://www.ascd.org/
publications/educational-leadership/mar18/vol75/num06/The-Power-of-Collective-Efficacy.aspx
Duhigg, C. (2016, February 25). What Google learned from its quest to build the perfect team. The New York Times Magazine.
https://www.nytimes.com/2016/02/28/magazine/what-google-learned-from-its-quest-to-build-the-perfect-team.html?mcubz=0
Edmondson, A. C. (2019). The fearless organization: Creating psychological safety in the workplace for learning, innovation, and growth.
John Wiley & Sons.
Fullan, M., & Quinn, J. (2015). Coherence: The right drivers in action for schools, districts, and systems. Corwin Press.
Gallagher, A. & Cottingham, B. (2019). Learning and practicing continuous improvement: Lessons from the CORE districts. Policy Analysis for
California Education. https://www.edpolicyinca.org/publications/learning-and-practicing-continuous-improvement-lessons-core-districts
Goddard, R. D., Hoy, W. K., & Woolfolk Hoy, A. (2004). Collective efficacy beliefs: Theoretical developments, empirical evidence, and future
directions. Educational Researcher, 33(3), 3–13. https://doi.org/10.3102/0013189X033003003
Grissom, J. A., & Sutcher, L. (2018, September). Getting down to facts II: The development and distribution of school leadership in California
[Policy brief]. Policy Analysis for California Education. https://www.edpolicyinca.org/publications/development-and-distribution-
school-leadership-california
Grunow, A., & Hough, H. J. (2018, September). Getting down to facts II: Continuous improvement: Building system capacity to learn
[Research brief]. Policy Analysis for California Education. https://edpolicyinca.org/publications/continuous-improvement
Hargreaves, A., & Fullan, M. (2012). Professional capital: Transforming teaching in every school. Teachers College Press.
Henig, J. Lyon, M., Moffitt, S., & Plank, P. Getting down to facts II: Creating coherent systems to support education improvement [Policy
brief]. Policy Analysis for California Education. https://gettingdowntofacts.com/publications/creating-coherent-systems-support-
education-improvement
Hough, H. J., Willis, J., Grunow, A., Krausen, K., Kwon, S., Steen Mulfinger, L., & Park, S. (2017, November). Continuous improvement in
practice [Report]. Policy Analysis for California Education. https://edpolicyinca.org/publications/continuous-improvement-practice
Humphrey, D. & O’Day, J. (2019). The early implementation of California’s system of support: Counties, differentiated assistance, and the
new School Dashboard. Policy Analysis for California Education. https://www.edpolicyinca.org/publications/early-implementation-
californias-system-support
Ismail, S. (2014). Exponential organizations: Why new organizations are ten times better, faster, and cheaper than yours (and what to do
about it). Diversion Books.
Kotter, J. P. (2012). Leading change. Harvard Business Press.
Krausen, K., Caparas, R., & Mattson, H. (2019). ”We shake hands at the door”: How a focus on relationships is driving improvement in Chula
Vista. WestEd.
Little, J. W. (1990). The persistence of privacy: Autonomy and initiative in teachers’ professional relations. Teachers College Record, 91(4),
509–536.
Lortie, D. C. (1975). Schoolteacher: A sociological study. University of Chicago Press.
Manansala, E. & Cottingham, B. (2019). Leadership for continuous improvement: The vision for county offices of education. Policy Analysis
for California Education. https://www.edpolicyinca.org/publications/leadership-continuous-improvement
Reeves, D. B. (2015). Finding your leadership focus: What matters most for student results. Teachers College Press.
Reimer, E. C. (2017). A relational approach to practice: An ethical alternative to working with parents in out-of-home care processes.
Journal of Social Work Values and Ethics, 14(2), 7–19. https://jswve.org/download/fall_2017_vol._14_no._2/6-Relational-Approach-to-
Practice-2017-14-2.pdf
Ronfeldt, M., Owens Farmer, S., McQueen, K., & Grissom, J. A. (2015). Teacher collaboration in instructional teams and student
achievement. American Educational Research Journal, 52(3), 475–514. https://doi.org/10.3102/0002831215585562
Sinek, S. (2009). Start with why: How great leaders inspire everyone to take action. Penguin.
Valdez, A., Takahashi, S., Krausen , K., Bowman, A., & Gurrola, E. (2020, March). Getting better at getting more equitable: Opportunities and
barriers for using continuous improvement to advance educational equity [Report]. WestEd.
https://www.wested.org/wp-content/uploads/2020/03/Continuous_Improvement__Equity_Report_FINAL_508.pdf
Ziaee, R., & Bologna, J. S. (2015). Preparing for continuous quality improvement for healthcare: Sustainability through functional
tree structures. CRC Press.
Author Biographies
Jeannie Myung is Director of Policy Research at PACE. She was the managing director of the research project
Getting Down to Facts II: Current Conditions and Paths Forward for California Schools. Previously, she was
a program director at the Carnegie Foundation for the Advancement of Teaching, where her work focused on
fostering continuous improvement in networks. She is also a former public school teacher.
Kelsey Krausen is a senior engagement manager with the Comprehensive School Assistance Program at
WestEd. Her areas of expertise include accountability systems, education finance, and systems improvement.
Krausen has worked on a range of a research projects including research on early implementation of
California’s Statewide System of Support and an investigation of continuous improvement practices in California
school districts.
Hayin Kimner is an educational practitioner, researcher and evaluator, and policy advocate with a focus on
community school systems and partnerships. She served as a senior program director for The Opportunity and
has led the development of districtwide and citywide community school strategies for San Francisco Unified
and Emery Unified School Districts. She currently works with organizations focused on advancing whole-child
and equity research, policies, and practices.
Corey Donahue is an improvement specialist at WestEd, where he provides support to schools, districts, and
higher education institutions to help them better learn how to improve. Prior to joining WestEd, Corey worked
as a coordinator of school performance at the Oakland Unified School District, which he entered as an
Education Pioneers Analyst Fellow. Prior to that, he was Special Associate to the President for the Carnegie
Foundation for the Advancement of Teaching.
edpolicyinca.org 21
Appendix A
Shared Purpose Student-Centered Staff and leaders have codeveloped (with school stakeholders) an ambitious and
purpose student-centered school purpose.
Equity focus Staff and leaders are committed to improving all students' outcomes—regardless
of race, ethnicity, socioeconomic status, background, or disability classification.
Differentiated roles Staff and leaders know their individual role in achieving the school’s purpose
and goals.
Sense of urgency Staff and leaders share a sense of urgency to achieve this purpose.
Constancy of purpose Leaders have processes in place to limit strategically the number of school
initiatives to maintain a constancy of purpose.
Culture of Relational trust Relational trust exists between and among staff, leaders, students, and families.
Mutual Trust
Psychological safety Staff and leaders are able to engage in learning behaviors (e.g., admitting failures,
expressing dissent, or taking risks) without fear of punishment or threat.
Leading improvement by School leaders engage in continuous improvement in their work; model testing
example ideas as well as learning from failures.
Support, not mandate Leaders model service and support to staff, students, and families (as opposed to
enforcing mandates and compliance).
Collective efficacy School staff and leaders believe in their collective ability to affect all students'
outcomes.
Structures Protected time and There is protected time for leaders and staff to work together to improve.
and Resources effective processes
that Foster
Collaborative Sufficient and sustainable The school has sufficient resources to sustain improvement, including support
Work improvement resources personnel, training, funding, and materials.
Breaking down silos Leaders and staff establish norms and routines for working together and across
disciplines.
Data infrastructure Infrastructure and staffing exists to collect, manage, and facilitate the use of
data, including problem diagnosis, testing change ideas, and improvement
monitoring.
Preparation and Identification of the set Schools understand the set of knowledge and skills for improvement necessary
Mobilization of knowledge and skills to develop within the organization.
of Improvement for improvement
Capacities
Role assignment Baseline improvement capacity is developed in all staff, with specialized capacity
developed for differentiated improvement roles.
Professional learning The school has consistent and intentional professional learning strategies in
place for increasing staff improvement capacities.
School-Level Capacities (Knowledge and Skills) for Achieving the Goals of the
System of Support
edpolicyinca.org 23
Appendix B
Shared Purpose Student-Centered The district has codeveloped (with school and community stakeholders) an
purpose ambitious and student-centered school purpose.
Equity focus District staff are committed and take action to improve all students' outcomes—
regardless of race, ethnicity, socioeconomic status, background, or disability
classification.
Differentiated roles District staff know their individual role in achieving the school's purpose and
goals.
Sense of urgency District staff share a sense of urgency to achieve this purpose.
Constancy of purpose District leaders have processes in place to limit strategically the number of
initiatives it takes on itself and requires from schools.
Culture of Relational trust Relational trust exists between and among district staff, schools, and community.
Mutual Trust
Psychological safety District and school staff are able to engage in learning behaviors (e.g., admitting
failures, expressing dissent, or taking risks) without fear of punishment or threat.
Leading improvement by The superintendent or cabinet-level official actively promotes and applies the
example use of an improvement approach.
Support, not mandate The district has an orientation towards service and support to schools
(as opposed to enforcing mandates and compliance).
Collective efficacy District staff believe in their collective ability to affect all students' outcomes.
Structures Protected time and Collective bargaining agreements support effective school-level improvement
and Resources effective processes efforts as well as districtwide collaboration and shared learning.
that Foster
Collaborative Sufficient and sustainable Resources are sufficient and sustainable to support school- and district-level
Work improvement resources improvement efforts (including adequate staffing and time).
Breaking down silos District departments have norms, routines, and opportunities for working
together within and across departments.
Data infrastructure Infrastructure and staffing exists to collect, manage, and facilitate the use of
data, including problem diagnosis, testing change ideas, and improvement
monitoring.
Stakeholder engagement The district meaningfully engages a wide range of stakeholders in improvement
work, including teachers, students, families, and community members.
Preparation and Identification of the set District leaders understand the set of knowledge and skills for improvement
Mobilization of knowledge and skills necessary to develop within the organization.
of Improvement for improvement
Capacities
Role assignment Baseline improvement capacity is developed in all district staff, with specialized
capacity developed for differentiated roles.
Professional learning The district has consistent and intentional professional learning strategies in
place for increasing staff improvement capacities.
District Capacities (Knowledge and Skills) for Achieving the Goals of the System of Support
Facilitate regular, meaningful engagement opportunities with schools, families, and community stakeholders as part of
all phases of the improvement process.
• Ability to engage the community to identify and understand the root cause(s) of underperformance.
• Ability to engage students, families, and the community in decisions about how to address challenges in the district.
• Ability to take a relational approach to engagement with students, families, and community members.
edpolicyinca.org 25
Appendix C
Shared Purpose Student-Centered The COE has an ambitious and student-centered purpose that prioritizes
purpose affecting students’ outcomes and supporting districts and schools.
Equity focus COE staff are committed to improving all students' outcomes—regardless of
race, ethnicity, socioeconomic status, background, or disability classification.
Differentiated roles COE staff know their individual roles in achieving the COE's purpose and goals
as well as how that directly contributes to affecting students and supporting
districts.
Sense of urgency COE staff share a sense of urgency to achieve the COE’s purpose.
Constancy of purpose COE leaders have processes in place to limit strategically the number of
initiatives it takes on for itself, as well as how many it builds support for among
districts.
Culture of Relational trust Trust exists among COE staff and between the COE and districts.
Mutual Trust
Psychological safety County and district staff are able to engage in learning behaviors (e.g., admitting
failures, expressing dissent, or taking risks) without fear of punishment or threat.
Leading improvement by The COE itself engages in continuous improvement and models the testing of
example ideas and learning from failures.
Support, not mandate The COE is oriented towards service and support to schools and districts (as
opposed to enforcing mandates and compliance).
Collective efficacy COE staff believe in their collective ability to affect all students' outcomes.
Structures Protected time and COE support to districts reflects a commitment to improvement, prioritizing
and Resources effective processes process and the time it takes to progress.
that Foster
Collaborative Sufficient and sustainable Resources are sufficient and sustainable to support school-, district-, and county-
Work improvement resources level improvement efforts (including adequate staffing and time).
Breaking down silos COE departments have norms, routines, and opportunities for working together
within and across departments.
Data infrastructure Infrastructure and staffing exists to collect, manage, and facilitate the use of data,
including problem diagnosis, testing change ideas, and improvement monitoring.
Stakeholder engagement The COE meaningfully engages a range of stakeholders in improvement work,
including teachers, students, community, and external support providers.
Preparation and Identification of the set COE leaders understand the set of knowledge and skills necessary to lead
Mobilization of knowledge and skills improvement efforts within the county, and can support districts to do the same.
of Improvement for improvement
Capacities
Role assignment Baseline improvement capacity is developed in all COE staff, with specialized
capacity developed for differentiated roles.
Professional learning The COE has consistent and intentional professional learning strategies in
place for increasing staff improvement capacities and has capacity to facilitate
professional learning of improvement in districts.
County Office of Education Capacities (Knowledge and Skills) for Achieving the Goals of the
System of Support
Provide universal support (i.e., Level 1) to all Local Educational Agencies and county-run schools in the county.
• Ability to take a relational approach to support for LEAs and county-run schools.
• Ability to analyze student-, school-, and district-level data to identify areas for improvement.
• Ability to use qualitative and quantitative data to measure and monitor improvement at the district level.
• Ability to connect resources to address district needs.
• Ability to identify, support, and share knowledge about high-quality instruction and other successful practices, particularly
strategies for improving outcomes for specific student groups (e.g., English learners, students with disabilities).
• Ability to identify and provide support that is responsive to district needs.
Provide differentiated assistance (i.e., Level 2 support) to Local Educational Agencies in the county.
• Ability to support LEAs to analyze student- and school-level data to identify areas for improvement.
• Ability to support LEAs to apply a systems lens to understanding the root cause(s) of underperformance and introducing
changes.
• Ability to support LEAs to select strategies to address identified root cause(s).
• Understanding of the value of testing ideas on a small scale.
• Ability to act as a thought partner to LEA improvement teams to support them in addressing the LEA’s identified challenges.
• Ability to support LEAs to make decisions using data and evidence.
• Ability to support LEAs to use qualitative and quantitative data to measure and monitor improvement at the district level.
• Ability to support LEAs to engage in difficult conversations about racism and other systemic inequities in a way that is safe
and productive.
• Ability to support LEAs to establish a high-functioning, cross-disciplinary improvement team that can collectively address
specific district challenges.
• Ability to support LEAs to identify strategies of successful schools.
• Ability to support LEAs to secure and deploy the necessary resources and supports to schools based on need.
• Ability to broker connections between LEAs receiving differentiated assistance and resource providers with the expertise to
address identified areas for improvement.
• Ability to support LEA leaders in articulating the district’s improvement approach/methodology.
• Understanding of how bias can influence interpretations of data and a willingness to challenge biases.
edpolicyinca.org 27
Geographic Lead Agencies Capacities (Knowledge and Skills) for Achieving the Goals of the
System of Support
Build the capacity of county offices within their geographic area to provide effective improvement support to their
respective districts.
• Ability to take a relational approach to support for COEs in the region.
• Ability to measure the capacity of COEs and determine necessary support.
• Ability to provide high-quality professional learning opportunities to counties that increase improvement capacity.
• Ability to support counties to conduct a meaningful needs-assessment process with LEAs.
• Ability to identify and provide support that is responsive to county needs.
• Ability to engage in their own continuous improvement work, and modeling the testing of ideas and learning from failures.
• Ability to support counties to improve data use (both visualization and discussions around data) to guide improvement efforts.
Connect counties to each other and to external assistance providers, as well as to lead agencies that can support them
and the districts they serve.
• Ability to develop trusting relationships among counties in the geographic area.
• Ability to provide opportunities for COEs to learn from each other both within their geographic area and beyond.
• Ability to collaborate with other Geo Leads and other state leads in order to facilitate networked learning.
• Ability to connect COEs with other state leads based on their specific needs.
• Ability to assess and map assets among COEs in their geographic area.
Communicate the needs of Local Educational Agencies and County Offices of Education to state agencies.
• Ability to serve as liaisons with the Coordination Team (CCEE, SBE, and CDE) when specific needs arise, or to share concerns
with the Coordination Team on behalf of COEs.
• Ability to develop a relational approach to problem solving between county and state agencies as well as with LEAs.
• Ability to hear from people on the ground what improvements to state policies are needed.
• Ability to gather comprehensive feedback from LEAs and other COEs on their needs for support and the quality of support
currently provided.
Appendix D
Shared Purpose Student-Centered The state (SBE) has developed and communicated: (a) a focused set of student-
purpose centered priorities for LEAs to pursue, with an emphasis on equity, and (b) a
system of support and accountability for reaching those goals.
Equity focus State agency staff are committed to affecting all students’ outcomes—regardless
of race, ethnicity, socioeconomic status, background, or disability classification.
Differentiated roles State actors and agencies have a clear understanding of their individual roles in
supporting school improvement and student outcomes, and how these directly
contribute to supporting COEs and LEAs.
Sense of urgency State leaders share a sense of urgency to fulfill and achieve the state’s purpose.
Constancy of purpose The state (SBE) develops systems and processes to streamline legislative
requirements for schools, districts, and COEs.
Culture of Relational trust Trust exists among state staff and between the state and COE/LEA staff.
Mutual Trust
Psychological safety State agency, COE, and district staff are able to engage in learning behaviors
(e.g., admitting failures, expressing dissent, or taking risks) without fear of
punishment or threat.
Leading improvement by State agencies work in collaboration to routinely review data and feedback on
example policy implementation to refine policy development, resource allocation, and
the state’s theory of action.
Support, not mandate State agencies have an orientation towards service and support to counties and
districts (as opposed to a culture of mandate and compliance).
Collective efficacy State agency staff believe in their collective ability to affect all students’ outcomes.
Structures Protected time and The expectations, timing, and level of support from the state reflect a
and Resources effective processes commitment to focused improvement that protects the process as well as the
that Foster time it takes to make progress.
Collaborative
Work Sufficient and sustainable The state (e.g., SBE, Legislature, Governor’s Office) provides sufficient, effective,
improvement resources and sustainable funds for county-, district-, and school-level improvement efforts.
Breaking down silos State agencies have norms, routines, and opportunities for working together
within and across agencies.
Data infrastructure The state (CDE) develops a user-friendly data infrastructure aligned to state
priorities to inform local improvement and to target support.
Preparation and Identification of the set The state (CDE) has framed the set of knowledge and skills for improvement.
Mobilization of knowledge and skills
of Improvement for improvement
Capacities
Role assignment The state (CDE) provides guidance for what constitutes baseline improvement
capacity and has identified roles at each level of the System of Support.
Professional learning State agencies have provided content to support county-, district-, and school-
level improvement efforts (e.g., guidelines, training materials, professional
development).
edpolicyinca.org 29
State Capacities (Knowledge and Skills) for Achieving the Goals of the System of Support
Guide ongoing improvements to the System of Support through active participation and collaboration on the
Coordination Team.
• Ability to take a relational approach to support for lead agencies and COEs.
• Ability to create a vision for the System of Support.
• Ability to evaluate, support, and track ongoing improvement across all levels of the system (state, COEs, LEAs).
• Ability to engage COEs and LEAs in the continuous improvement of the System of Support.
• Ability to help other system leaders understand how their work fits into the broad goals of the System of Support.
• Ability to create a coherent communication structure and ensure decisions are informed by leaders within each of the three
lead state entities.
• Ability to deploy support where it is needed (at all levels of the system).
Align state funding and policies based on research and the needs identified through the Dashboard, feedback from system
leaders, and other data sources.
• Ability to provide clear, ongoing communication about core components of the work of the System of Support to the SBE and
to the Department of Finance to ensure alignment between the System of Support and other key policies.
• Ability to hear from people on the ground what improvements to state policies are needed.
Connect lead agencies, County Offices of Education, and Local Educational Agencies to resources.
• Ability to share existing research-based instructional strategies for improving learning outcomes for specific student groups
(e.g., English learners, students with disabilities).
• Ability to identify, support, and share knowledge about high-quality instruction, operations, systems management, and other
ancillary student supports based on the needs of the COE or LEA.
• Ability to gather comprehensive feedback from LEAs, COEs, and lead agencies on their needs for support and the quality of
support currently provided.
Clarify and disseminate information on the System of Support and its components to increase understanding and buy-in.
• Ability to articulate clearly what constitutes Level 1, Level 2, and Level 3 support.
• Ability to articulate clearly the “why” of the System of Support.
• Ability to articulate clearly the roles and responsibilities at different levels of the system (lead agencies, COEs, LEAs).
• Ability to define clearly SBE, CDE, and CCEE’s roles and responsibilities in the System of Support.
edpolicyinca.org 31
Policy Analysis for California Education (PACE)
Improving education policy and practice and advancing equity
through evidence
1 bringing evidence to bear on the most critical issues facing our state;
edpolicyinca.org