Masson 2010
Masson 2010
3, 2010, Part II
Introduction
This article reflects on the development of the European approach towards quality
and quality assurance in vocational education and training (VET) and its relevance
for reforms in the European Training Foundation (ETF) partner countries. The
analysis is based on an ETF project conducted in 2007-2008 in the Mediterranean
partner countries to promote exchanges of information and experience between
the decision makers and experts of the countries concerned and within the EU.
More precisely, it aims to analyse how quality assurance (QA) initiatives could
promote the quality of systems and support best practices already established in
the EU and in the Mediterranean region in order to lay the foundations for specific
actions at national and regional level. It was part of a larger project, Education and
Training for Employment (ETE), which was implemented by ETF on behalf of the
European Commission. In this context, education and training were seen as some
of the main tools for fostering the economic and social development of the
Mediterranean region and achieving the goal of becoming competitive economies
in open markets established within the political agenda of the Euro-Mediterranean
region. Quality and QA in VET1 were identified as issues to be addressed.
At the European level, although many member states have developed their
own QA systems and mechanisms, the EU designed common tools that could
either be used by some EU Members in order to enhance their own systems or
support those that had not established QA systems. These tools were seen as
being relevant in terms of addressing some of the issues hampering the devel-
opment of VET systems in the Mediterranean region.
In the meantime, through the implementation of different projects in its partner
countries, ETF has been reflecting on the value of EU messages and tools for the
work in partner countries. These reflections were highlighted during the ETF
Advisory Forum meeting in 2006, which focused on the impact of European
vocational training policies on reforms in the partner countries of the EU, and in
a number of publications (McBride, 2005; Masson, 2007; Masson & Pevec, 2008).
The key findings were that EU messages and tools did have value for ETF partner
countries, but there was a great need for prior clarification of concepts relating to
quality and QA, to policy learning and to other issues. EU approaches seem
complex and sometimes ambiguous. In addition, several conditions need to be met
in order for EU tools to be successfully implemented in other contexts. The
differences in cultures, traditions, economic systems and political organisations
between the EU and its partner countries are key factors to consider in designing
and implementing such projects. Therefore, it was interesting to reconsider the
© 2010 The Authors. Journal compilation © 2010 Blackwell Publishing Ltd., 9600 Garsington Road, Oxford OX4 2DQ,
UK and 350 Main Street, Malden, MA 02148, USA.
Jean-Raymond Masson, Mounir Baati & Erwin Seyfried 515
different steps and outcomes of the ETF project on quality and QA in VET in
Mediterranean partner countries in the light of the issues mentioned above. The
following are some key questions:
• How should the system and/or the initiatives in place in Mediterranean
partner countries for QA and improvement in VET be assessed?
• How should the relevance of the European approach to QA in VET be
analysed in the context of the VET systems in Mediterranean partner
countries?
• What lessons should be drawn in the context of further ETF intervention on
QA in VET?
Vocational Education and Training Systems in the Mediterranean
Partner Countries
Most Southern Mediterranean countries have made substantial efforts to reform
their VET systems from a second-choice option for school drop-outs to a more
complex role that includes addressing the skills required by economies willing to
integrate the world market (Seyfried, 2008). These efforts have been translated in
investment in VET centres to modernise equipment and train trainers, together
with greater involvement of employers and employers’ organisations in the defini-
tion of their needs in terms of qualifications. A shift, albeit a slow one, has taken
place from input- to outcome-based training with the introduction of competency-
based training, mainly in the Maghreb region, and a greater emphasis on work-
based training.These efforts began in the mid-90s. During this period,Tunisia and
Morocco signed free-trade agreements with the EU to establish the conditions for
the gradual liberalisation of trade in goods, services and capital. As part of their
strategy to support their economy to be more competitive, some governments in
the region invested in their VET systems to improve their relevance to labour
market needs and provide the economy with intermediate qualifications. These
efforts have been supported by the World Bank and the EU and by many coop-
eration agencies (Agence Française de Développement, GTZ, Canadian Interna-
tional Development Agency).
Various studies conducted by ETF (Carrero & Hakim, 2006; Sultana & Watts,
2007; Homs, 2007; Seyfried, 2008) on the on-going reforms in the region suggest
that many issues are hampering the development of these systems and the quality
of the services to learners, employers and the community in general. In particular,
studies have identified the heavy centralisation of the system, the difficulties of
involving the social partners, the divorce between funding and results, and the lack
of capacity to identify labour market needs.
While autonomous VET institutions are better able to adapt to their immediate
labour market needs by providing the most appropriate and rapid response to their
environments, VET systems in the region remain centralised. Individual institu-
tions cannot make decisions on key issues such as curricula, financial and person-
nel management, and sectors of involvement, thus limiting their capacity to change
and adapt. In this regard, the funding system of VET schools in the Mediterranean
region is quite revealing. Budget allocations are generally based on the previous
year’s allocations and on input measures such as number of students and staff,
rather than on outcomes. There are no performance-based indicators to help to
decide which amounts should be allocated to training institutions, or benchmark-
Jordan and Morocco, the organisation of a study visit to Italy to present represen-
tatives from the Mediterranean partner countries with the developments of QA
systems and procedures in a widely decentralised system, and field visits to Algeria,
Egypt and Morocco.
Main Project Findings
It seems (Seyfried, 2008) that the quality of VET provision in the Mediterranean
region is often related to whether the curriculum is recent and competence-based,
the qualifications of teachers and trainers sufficient, and the technical equipment
up to date. Compared with the importance placed on these input factors, there
seems to be less concern with output and outcome factors for assessing the quality
of VET programmes: the adequacy of the skills acquired during training, drop-out
and completion rates, employment rates and the type of employment obtained are
hardly taken into consideration. In most cases, this can be attributed to the
weaknesses in the monitoring and evaluation systems that support the delivery of
VET programmes.
Moreover, the prevailing criteria for QA in the provision of training and the
approach to evaluation in the provision of training, particularly of teachers and
trainers, seem to be inspection.This could be pedagogical inspection of teachers or
administrative inspection to establish to what extent the school is complying with
regulations, especially financial ones. There appears to be no system for assessing
the overall performance of schools in terms of achievements or objectives.
In addition, in some countries, statistical instruments have been put in place,
which, together with the inspection reports, assist decision-making. However, the
information provided by these instruments is used neither systematically nor
efficiently. This is particularly true in Tunisia, which has recently implemented a
set of standards that covers all the functions and processes in a VET school,
from management to the delivery of courses. The indicators defined for each
standard allow for both self-assessment and ‘external’ assessment and give a
clear indication of the performance of the centre. However, there is no clear
policy on the implications of the result of these assessments in terms of rewards
or sanctions.
The same applies to tracer studies on employability. The development of an
observatory function as part of the MEDA-ETE project revealed that different
countries were carrying out such studies, some on a regular basis. There is,
however, no clear indication of the extent to which the existing data are used for
the planning, monitoring and steering of the system. Despite the numerous evalu-
ation activities, a number of stakeholders have stated the need for improvement.
Most tools seem to collect opinions and simply accompany the training pro-
grammes, while the evaluation of the results is still considered to be weak.
Although ETF has supported the Mediterranean partners in defining a common
set of indicators and collecting data on the labour market and training provision,
the usability of the results seems limited.
Institutions that ensure monitoring, evaluation and control of the VET systems
do exist in all Mediterranean partner countries, although their roles and func-
tions vary. In Morocco, a body (Instance Nationale d’Evaluation du Système
d’Education et de Formation) was established in 2006 under the supervision of the
Higher Council of Education to evaluate the effectiveness of the education system.
A first report on the internal evaluation (Etat et perspectives du système
the systematic involvement of all key partners, particularly regarding QA. Thus, in
the EU, quality in VET refers to a range of dimensions and does not have a
well-delimited definition. The focus on quality is a result of the diversification of
the needs of trainees and employers. The quality concept is driven by a growing
European market, particularly for continuous VET, and the liberation of market
forces. The quality subject is linked to a broad range of reforms covering:
(i) the architecture of VET pathways and their links with other components
of education and training and the labour market;
(ii) the content and design of training programmes, qualifications and peda-
gogical aspects;
(iii) governance, partnership and financing issues.
QA is a means of ensuring that quality standards are achieved by private and public
providers and that the reforms are implemented efficiently. In EU countries,
particularly with the impetus given by the Copenhagen process, these reforms have
already received substantial attention. For the Mediterranean partners (as well as
for most ETF partner countries), where quality is at stake at all levels of the VET
systems, the European multidimensional and global approach to quality simply
highlights a range of fundamental issues where action should be taken. It can serve
as a guideline to identify strategic priorities for future reforms, but it does not
provide a well-delimited concept to be implemented in the short term.
In the EU, the idea is widely shared (European Commission, 2008) that the
quality and attractiveness of VET can be substantially improved by reinforcing the
links between the components of the education and training systems, in particular
the permeability and continuity of learning paths between VET, general education
and higher education. This makes sense in EU countries, where borders between
VET and higher education are blurred (McCoshan et al., 2008; Dunkel & Le
Mouillour, 2006) and where general, technical and vocational initial education
come under the same education ministry. But it is much more difficult to conceive
and implement in Mediterranean partner countries, where a culture of elitism
prevails and VET is considered to be a low-status alternative to higher education
(Sultana & Watts, 2007, p. 21), where few pathways exist, and where initial VET
comes under a specific ministry (or is divided between several technical minis-
tries), with little cooperation with the education ministry (Masson & Pevec, 2008).
The Ambiguities of the EU Approach: an implicit culture of governance
The EQARF recommendation is introduced as ‘an instrument for continuous
improvement of VET, based on a quality cycle, (. . . which supposes) an explicit
focus on the roles of actors at different levels and the ways they relate to each other’
(European Commission, 2008a). Even if the ultimate goal is to improve the VET
system, the framework should be ‘a means of giving a new impetus to the con-
tinuous improvement of quality management practices’. Although not mentioned
explicitly, this new culture of quality improvement is implicitly about developing a
new governance model (Grek et al., 2009) based on the decentralisation of respon-
sibilities, the autonomy of VET providers, the accountability of training delivery,
the transparency of results achieved, public–private partnerships, and the evalua-
tion and measurement of achievements.
The quality cycle, the related criteria and the indicators in the recommenda-
tion, as well as the accompanying guidelines for the self-assessment of training
providers focus on the results and outcomes of VET processes and systems. The
outcomes are the learners’ achievements, their situation in the labour market after
graduation, and the satisfaction of customers, both students (graduated or not)
and their employers. Schools and training centres are urged to refer to such
performance indicators, to develop projects and action plans in close partnership
with local and regional stakeholders, and to adopt appropriate and transparent
management tools. Teachers and administrators are asked to implement flexible
pedagogical tools that support the success of each learner. European experiences
in developing QA systems highlight the key role played by local governments in
improving quality in education (Simola et al., 2009 for Finland; Croxford et al.,
2009 for Scotland).
The new culture of governance is both a top-down and a bottom-up process.
The central state (ministry or national agency) therefore needs to set up appro-
priate QA procedures to manage, monitor, assess and review the coherence of local
activities with the nationwide frameworks.This requires the adoption of policies on
certification, assessment and accreditation, including new performance-based
financing procedures, with new management tools implemented at local level, and
new types of partnership with other stakeholders, including employers. It also
implies the development and systematic use of appropriate statistics and/or the
setting up of observatories. Thus, although there is a profound unity in the
approaches foreseen in the recommendation, there is also a wide variety of policies
and reforms which are an integral part of the new culture of governance. In fact,
the European quality framework may apply as a guiding principle to many reforms
undertaken in VET.
However, this new culture of governance is not very clearly expressed in the
recommendation or in the documents developed in the context of the Copenhagen
process (Council of the European Union, 2004). This is because EU systems are
very diverse, since decentralisation has not been implemented in all countries and,
when implemented, it has been done so differently and covers very different
schemes and items. Therefore, as the EU does not have exclusive competence in
the areas of education and training, its message refers only to general principles
that are intended to be applied in different ways. Although implicitly calling for a
new culture of governance, the flexible EU framework for quality cannot easily be
used to challenge the over-centralised approaches in some ETF partner countries.
The new mode of governance can appear simply as a long-term goal, without
indicating what needs to be progressively changed and what new items should be
introduced in the short, medium or long term.
Thus, it is clear that it will be difficult to implement such an approach in
Mediterranean partner countries, where VET systems are very centralised and
compartmentalised. Other ETF work (Nielsen et al., 2008, p. 37; Baati & Schuh,
2008, p. 68) has identified the types of problem linked to the politicised model of
governance (Chakroun, 2008), and in particular the difficulties of cooperation
between national stakeholders, the resistance of the public system to accept new
stakeholders (Mayen, 2008, pp. 20–23), and the lack of a tradition of analysis and
data collection (Chakroun, 2008, p. 13; Homs, 2007). In this respect, the interest
shown by Mediterranean partner countries in implementing NQFs is understand-
able, since they may be defined and implemented in a centralised way. They even
offer ways and means to better control non-formal training providers, without
changing the traditional administrative system.
VET). One interesting side-effect has been to tackle corruption in entry to university.
Per-capita financing schemes or better career progression in teachers’ salaries, which
would have a substantial positive impact,could also be introduced,as could tracer studies
on the impact of the relevance of the curricula for labour market needs.
To summarise, the EU approach to QA in VET appears as a panoply of tools, the
most important of which are the CQAF, the self-assessment guide and the ten
indicators, which all contribute to a general culture of governance based on decentrali-
sation, autonomy and partnership and cover all aspects of the VET reforms in the
context of lifelong learning. Rather than a coherent framework, this is a set of
incomplete and insufficiently fine-tuned tools for immediate action. Nevertheless, they
are indispensable ingredients of an overall new governance culture. Quality improve-
ment strategies can only be gradual, with short, medium and long-term goals. It would
be unadvisable to implement some of the tools without a broad and long-term strategy.
Quality Assurance and National Qualification Frameworks
Since the EQARF provides a general philosophy that could be seen as being more
important than the tools already identified, the European approach to QA in VET
differs from the European Qualifications Framework (EQF) approach and the
EUROPASS instrument for transparency, which both provide well-delimited tools,
although they are embedded in wider concepts.
The development of NQFs in the Mediterranean partner countries with ref-
erence to the EU recommendation on EQF has received strong support from
policy makers and first steps have been taken, particularly in Egypt, Jordan,
Morocco and Tunisia. Meanwhile, much less attention has been given to quality
and QA, although the recommendation on EQF includes a list of common prin-
ciples for QA in higher education and in VET in its annex (European Parlia-
ment, Council, 2008, p. 7). In addition to principles aimed at providers, these
principles also cover the global system, including clear references to cooperation
with and involvement of all relevant stakeholders at all levels in order ‘to ensure
overview, coherence, synergy and system-wide analysis’. Even if it is not as detailed
as the draft recommendation on EQARF, it is based on the same concept.
However, first experiences of developing NQFs in ETF partner countries and
territories show a tendency to impose them by regulation (Albania, Kosovo,
Montenegro, Tunisia), before or instead of having achieved in-depth dialogue with
stakeholders, including social partners. This centralised way of implementing NQFs
appears to be very different from, and even contradictory to, the new governance
culture embedded in the QA philosophy. If NQFs are based only on education diplo-
mas and certificates, without taking into account qualifications that are developed in the
non-formal sector and in companies, this will contribute to increase fragmentation.
Thus, ETF experiences in the Mediterranean region have shown that NQFs
and QA are perceived as two different tools for supporting VET system reform. But
in order to reap the full benefits of the EU recommendation on EQF, NQFs need
to be seen as tools that are parallel and complementary to specific tools from the
QA panoply, all embedded in the global QA philosophy on governance. In this
respect, a framework for quality and QA should be seen as a necessary precondi-
tion to fully exploit the potential of NQFs. QA would help to focus on the learner,
to bring the client to the forefront and to create tailor-made training programmes,
taking into account the demands of local employers, regional labour markets and
the individual needs of trainees, by fully respecting NQFs.
Conclusion
Mediterranean partners are modernising their VET systems, but many issues
remain unresolved. In particular, the heavy centralisation and the difficulties of
efficiently involving social partners are hampering the development and the quality
of the systems. QA initiatives in VET are developing, but they are fragmented and
partial and lack monitoring and assessment. Moreover, they are being developed at
local level, while little change is taking place at system level. Analysing the situation
in relation to the quality cycle shows the difficulties of involving partners in the
planning function and the lack of development of the evaluation function.
The EU approach to quality and QA in VET is a good framework to analyse the
achievements, issues and challenges of the VET reforms. It has helped to identify
systemic issues concerning the role of VET in the education and training system as
a whole and its relevance to the needs of the labour market and society. It also
helped to raise questions about performance, functioning and governance and
provided a platform for discussions between the EU and stakeholders in Mediter-
ranean partner countries about quality and QA in VET. Moreover, it seems to
provide general guidelines for identifying strategic priorities, as well as a general
and flexible approach allowing each country to shape its own QA system.
The EU approach to quality and QA in VET has brought about some very
significant changes in the way VET and education in general are conceived. This
includes an orientation towards outcomes and performance, a focus on clients, a
new model of management for schools, the promotion of transparency, partnership
approaches at all levels, separation between delivery and evaluation, and the
introduction of self-assessment. The approach is not feasible for top-down imple-
mentation, but must include encouragement of bottom-up initiatives, resulting in
self-motivation and ownership of the process on the part of local actors. Thus, full
implementation demands more than the modernisation of existing patterns. It
demands in-depth systemic changes and it is not clear how far Mediterranean
partners are ready for such changes, in particular in the governance of the system.
The limited resources allocated to the MEDA-ETE project on quality and QA,
as well as its limited duration, did not allow for more than an exchange of quality
and QA practices in VET between Mediterranean partners and EU countries and
a first exposure to the EU approaches. One limitation is that the project was a
simple component juxtaposed with other components, with little interaction
between them. Indeed, common work should have been promoted between the
quality and QA component and the components relating to developing the obser-
vatory function, apprenticeships, vocational guidance and others. Quality and QA
messages could have been seen as overarching messages covering the whole
MEDA-ETE project and the parallel project on developing NQFs.
Going further and making the best use of the EQARF in Mediterranean partner
countries would need more in-depth work and could be facilitated by the development
of mutual learning through networks such as the ENQAVET,which was set up in Europe
to give a ‘new impetus to the continuous improvement of quality management practices’
in VET (European Commission, 2008a, p. 3), and also by working closely with the
ENQA VET, as proposed in the final report of the ETF project (Seyfried, 2008).
In this context it is important to clarify some ambiguities in the EQARF
recommendation, in particular that the EU approach promotes a new culture of
governance that moves away from input steering and control towards an output