OECD Knowledge Management Project: Report - Danish Pilot-Survey
OECD Knowledge Management Project: Report - Danish Pilot-Survey
OECD Knowledge Management Project: Report - Danish Pilot-Survey
project
Report - Danish pilot-survey
Page 1
15-04-2002
The final report will be sent out 14 days after the fourth OECD meeting, due to be held in March 2002.
This report can be downloaded on www.systematic.dk
3
See for example Drucker (1993), who directly refers to the age we live in as the knowledge society in Post-capitalist
society , New York: HarperBusiness, 1993; Peter Holdt Christensen (ed.) Viden om ledelse, viden og virksomheden,
(Knowledge about management, knowledge and business), Samfundslitteratur, 2000; George Von Krogh, Kazuo
Ichijo, Ikujiro Nonaka Enabling Knowledge Creation How to Unlock the Mystery of Tacit Knowledge and Release the
Power of Innovation, Oxford University Press, 2000
2
Page 2
15-04-2002
OECD governments will be able to use the results of the study in deciding what forms of
intervention could help promote business competitiveness through Knowledge Management.
Private companies will be able to use the results as an inspiration and a starting point for
comparative studies.
Trade associations and researchers will be able to use the results to evaluate the impact and
effects of various practices, among other things by linking the data with other national
databases.
It is intended that the survey of Knowledge Management be carried out on a regular basis
within the OECD with a view to establishing a benchmarking database which would facilitate
international comparison among OECD countries. It is hoped that this database will be linked
with other data through using existing official surveys in the respective countries. At the same
time the aim is to standardise the terminology used throughout the OECD.
The aim of the main survey is to investigate what kinds of practices are
used to promote the sharing, transfer, assimilation and maintenance of
knowledge in the private sector in the OECD countries, and to what extent
organizations find these practices effective.
In addition, the Centre has done separate analyses which give some indication as to how
Danish companies are working with Knowledge Management, but it must be stressed that a
representative survey has not been carried out.
The results of the Danish study will be compared with the results from the other pilot studies.
i.e. those from Canada and Germany. This will happen at a meeting of the OECD in March
2002.
The pilot study has resulted in this interim report, which contains the Centre
of Managements proposals for improving the questionnaire and gives a first
indication of how KM is used in Denmark.
Pilot surveys may also be carried out in the USA and Australia
Page 3
15-04-2002
The Centre of Management took part in the third OECD meeting in July 2001.
The latter is not in the target group (private firms). However, at this point in the survey it was thought relevant to
test out the questionnaire in an organization whose existence is based on the ability to gather and process knowledge,
since an organization of this kind could be expected to have given thought to the management questions under
consideration.
6
Page 4
15-04-2002
respondent was then asked to verbally explain his/her thoughts while filing out the
questionnaire. In this way the interviewers were able to get quite a good picture of the
questions and formulations that c aused difficulty, and in the process a number of modifications
were made to the phrasing of individual questions.
The translation process
In the first instance the OECD questionnaire was translated directly from American-English into
Danish, and the first interviews were carried out on the basis of this questionnaire. The
experience of these interviews and the survey group meetings led after considerable
discussion to a substantial reformulation of most of the questions, so that their meaning and
significance were expressed more precisely in terms that made sense to the respondents.
Translation is a critical factor in ensuring that a cross-border comparison of the results of the
final survey can be made.
Those countries that wish to participate in the eventual survey must be prepared to devote
significant resources to the translation process, so that appropriate adjustments are made for
differences of both language and management procedure.
The pilot survey
The pilot survey was carried out in 400 enterprises in Canada, 200 in Germany and 200 in
Denmark.
In this pilot study Denmark chose not to link up with other databases, since the purpose of the
pilot study was to test out and improve the questionnaire, rather than to conduct a
representative study of Knowledge Management practices. Instead, the Danish questionnaire
for the pilot survey was supplemented with a number of background variables.
During October 2001 the Danish questionnaires were sent out with the aim of making a pilot
survey which could be compared with the other pilot surveys in Canada and Germany.
The respondents interviewed expressed the view that the questionnaire was too
comprehensive, and several of them would have chosen not to fill it out. It was therefore felt
necessary to devote further resources to obtaining as high a percentage of respondents as
possible. A very large proportion of the respondents were therefore contacted by telephone
before the questionnaire was sent out; similarly, respondents were reminded to return the
questionnaire after the deadline had passed. As a result, 61 questionnaires were filled out and
returned representing a 30% response rate. There are strong indications that this response
rate could not be obtained with an ordinary survey involving no tele phone contact. Obtaining a
reasonable rate of response is therefore another critical element in the success of the final
survey, and methods of gathering data should therefore be discussed.
For the pilot survey a random group of private firms and organizations was selected from a
total database7 containing all Danish enterprises with more than 50 employees and all
corporations and private limited companies with fewer than 50 employees.
The number of respondents is too low to make a representative study, nor indeed was this the
intention. However, efforts were made to ensure that the distribution of different types of
enterprise in the survey in terms of both size and trade corresponded approximately to
that in the database as a whole. The distributio n of the different types of enterprise within the
survey is shown in the figures below.
Page 5
15-04-2002
Antal Employees:
1-19
20-49
50-99
100-249
250-499
500-1.999
2000+
Distribution in the
total database:
36%
27%
20%
10%
4%
3%
0%
As can be seen, there is a relatively large percentage of enterprises with fewer than 20
employees, a fact that should be borne in mind when the results of the pilot study are
analysed. Even though this gives a true picture of the private sector in Denmark, the relevance
of including such small enterprises in the final study should be discussed.
Table2.2: Distribution in the pilot survey by sector
Trade:
Not answered
Agriculture, fishing, primary product
development
Manufacturing
Energy and water supply
Building and construction
Hotel and restaurant industry
Transport, post and telecommunications
Advisory and finance services
Public and private service industries
Other
Distribution in
total database:
Distribution in
test group of
200
respondents
2%
24 %
0%
13 %
25 %
9%
12 %
15 %
0%
1%
24 %
1%
10 %
26 %
8%
18 %
12 %
0%
Distribution
among
questionnaires
returned (61
respondents)
5%
2%
20%
2%
7%
21%
5%
11%
3%
24%
Page 6
15-04-2002
The Danish pilot study has shown that it is unfortunate that the utilization of knowledge has
been left out. Further finessing of the definition, or discussion of alternatives to it, is crucial to
the success of the final survey
Knowledge Management involves any systematic activity related to the
capture and sharing of knowledge by the organization
Page 7
15-04-2002
This is underscored by the fact that Question 1 whether in the interviews or in the pilot
survey sorts the respondents into those who do, and those who do not use Knowledge
Management. There were in fact no respondents among those interviewed who chose to
answer no to Question 1 and go straight to Question 10 not even among those who
indicated at the outset of the interview that they did not use Knowledge Management. The
same tendency can be seen in the pilot survey. Altogether seven of the 61 respondents chose
to use the skip possibility. Of these only three followed the skip-pattern envisaged. The others
either answered yes to Question 1 or skipped other parts of the questionnaire. This suggests
either that they had misunderstood the possibility of skipping, or that they did not understand
what they should do with the questionnaire. 8
This may be due to the fact that Knowledge Management has been defined too broadly, and
hence as something that everyone works with albeit perhaps unconsciously. If it is intended
that the concept be treated in this way, the questionnaire should be modelled accordingly,
partly by not giving respondents the chance to skip questions, and partly by formulating the
questions to make clear that Knowledge Management is a part of management per se.
In this case the definition is not particularly useful, and it will make no great difference to the
respondent which particular definition is selected. One suggestion would therefore be to leave
out the definition altogether and instead give a series of examples of the kinds of practices
that are being asked about, or examples of what Knowledge Management is not.
Alternatively, one could choose to see Knowledge Management as a series of particular
initiatives, over and above ordinary management, whose purpose is to make use of, and
hence derive benefit from, an organizations existing resources of knowledge. If this is the
intention that is, to ask about Knowledge Management as a set of systematic practices that
are consciously set in motion to promote the capturing and sharing of knowledge, and as
something over and above ordinary management the concept should be defined with
sufficient specificity to allow certain respondents to recognize their own organization as one
that did not use Knowledge Management.
It is essential to the success of the survey that the above should be clarified in relation to the
project as a whole, and that the questionnaire should then be designed accordingly. On the
basis of discussions with the survey group, and with participants from Canada and the OECD,
the Danish pilot survey has chosen to treat Knowledge Management as a part of management
in general, and the questionnaire has been designed accordingly. Apart from in the initial
definition and the headings, the term Knowledge Management has not been used.
Simple as opposed to complex practices for capturing and sharing knowledge
Question 1, which outlines a long series of practices designed to capture and share knowledge,
acts as a barrier because it begins by mentioning certain very abstract activities, namely
Policies and strategies. The interviews revealed that organizations which had not previously
worked with the concept of Knowledge Management first recognized the practices described in
Question 1.4, concerning Knowledge capture and acquisition, and 1.5, concerning Training
and mentoring. The order has therefore been reversed in the Danish pilot survey, so that
these more simple activities are mentioned before the more complex ones. The results of the
pilot survey also show that it is precisely these more simple practices that are used by most
respondents. Policies and strategies and Incentives are used by fewest.
In general the formulation of these questions should be made more accessible, possibly by
including brief examples under the practices mentioned.
These seven organizations were tested to see whether they differed in any particular characteristic from the other
respondents, but this was not found to be so.
Page 8
15-04-2002
The answers should also be simplified to just yes or no. In Denmark it is hard to find any
justification for distinguishing between practices introduced before or after 1999.
The weakness in the formulation of Question 1 also emerged in the responses to Question 2,
where the respondents were asked to state whether they used practices other than those
mentioned in Question 1. In the interviews everyone answered yes, plenty, thereby
expressing their feeling that the field had not been sufficiently covered - without however
being able to list other Knowledge Managament activities. In the pilot survey a quarter of
respondents cited other areas of Knowledge Management see Appendix 1 many of which
were supposed to have been designated by the formulations in Question 1. This merely serves
to emphasise that the content and formulation of Question 1 are critical. It was evident from
the interviews that, after filling in their answers to Questions 1 and 2, the respondents were
still vague about the meaning of Knowledge Management.
Reasons and results must be more nuanced
In Question 3 respondents are asked to give their reasons for engaging in practices designed
to acquire and share knowledge. In the interviews there was a marked tendency, in response
to these questions, to indicate that these activities were of crucial importance. The positive
bias in these responses is no doubt due to the fact that all the reasons listed were formulated
in positive terms, so that it was difficult not to accord significance to the practices mentioned.
If we are to get meaningful answers to these questions, this problem must be remedied, either
by finding a more neutral formulation, or by asking respondents instead to list different
activities in order of priority.
In Question 4 respondents are asked to report on the results they obtained by using practices
designed to capture and share knowledge. In the interviews, virtually all respondents wished
to answer Not applicable. Their argument was that a respondent might well believe that the
practice in queston was effective in a certain area - for example in increasing the number of
markets - but that this area was not relevant to his/her particular enterprise. It should also be
emphasised that these answers depend on the respondents own perception, and that it does
not matter therefore if the results in question cannot be documented.
The same questionnaire for all respondents?
The interviews were conducted in two service enterprises (one small, one large), two
manufacturing firms (one small, one large) and a large commercial enterprise. The attitude in
the latter organization was clearly we dont know anything about this sort of thing and the
individual questions were perceived as having little relevance to the daily work of a commercial
enterprise.
There are presumably differences in the kinds of knowledge that are important for different
types of organization, and therefore differences too in the kinds of practices required for
sharing knowledge. Further consideration should therefore be given to the surveys target
groups.
Rate of response
In the interviews respondents said that they would be unlikely to fill in the questionnaire if it
were simply sent by post. One argument for doing so, however, would be that the
questionnaire had research value, since they would prefer to answer this type of
questionnaire than one of the numerous ones sent by consultancies. It was considered
important that the questionnaire came from the former Danish Ministry of Business Affairs,
and some respondents stressed the fact that it was international.
Another reason for filling in the questionnaire was that it appeared to be well worked out and
easily accessible, and demystified the concept of Knowledge Management. This indicates the
Page 9
15-04-2002
importance of the accompanying letter and the phrasing of the Danish version of the
questionnaire.
Respondents were contacted in advance by telephone before the questionnaires were sent out.
For the most part it was the smaller enterprises that declined to participate. In the vast
majority of cases the reasons given were lack of time and resources to answer the many
questionnaires they receive each week. A small group declared that they had no interest in
participating, while a very few said that the questionnaire was simply too difficult and
inaccessible for them to answer.
The response rate in the Danish pilot survey was 30%, which is reasonable for a postal survey.
However, this percentage was obtained only with exceptional effort. The possibility of finding
other ways of collecting data, for example via telephone interviews rather than written
questionnaires, should be considered.
Formulation and phrasing translation bias
In the course of the interviews most of the questions were reformulated, and in certain places
the final phrasing was very different from the original translation. This points to a significant
problem with international surveys: namely, that translation bias may make it difficult to
conduct cross-border comparisons.
The main purpose of doing an international survey, however, is to promote the use of
Knowledge Management in each of the participating countries, and this aim can be achieved
even if the surveys are not directly comparable.
Nevertheless, the many reformulations required in the Danish case indicate that those OECD
countries that have not yet undertaken pilot surveys will have to reckon on doing so in order
appropriately to adapt their questionnaire to local conditions.
At the same time the difficulties experienced point to the fact that there is obviously a need to
standardise the terminology involved which is one of the purposes of this survey.
3.6 Adjustments in the Danish survey in relation to the OECD questionnaire 9
Attempts have been made in the Danish version to meet the difficulties described in paragraph
3.4, to the extent that this is possible without destroying the possibility of comparison with
pilot surveys in other countries. These adjustments, and their effects, are described below.
The abstract nature of the concept
To counter the problem that the concept is too abstract, the order of the sub-sections in
Question 1 has been switched around, so that the more commonly occurring Knowledge
Management activities come first. Thus the first sub-sections concern Knowledge capture and
acquisition, Training and mentoring and Communications , while Policies and Strategies,
Leadership and Incentives come last. The interviews had revealed that those respondents
who reported not having previously worked with Knowledge Management were liable to be
frightened off by over-abstract questions, and the aim was to avoid this.
If we look at Chart 1 0 25 together with Charts 1-6, it is clear that the most commonly used
practices are Knowledge capture and acquisition and Training and Mentoring, followed by
Communications, Leadership, and Policies and Strategies, and that the least used category
is Incentives. There are therefore good arguments for keeping this order of categories if the
aim is to signal that Knowledge Management is a part of ordinary management.
10
Page 10
15-04-2002
Percentage that answer Yes, since 1999 or Yes, since the question
was put...
80
70
60
50
40
30
20
10
0
Time for obtaining
knowledge
Budget for
communicating
knowledge
Page 11
15-04-2002
strategies for capturing and sharing knowledge. If we study 4b it emerges that only 6. 6% gave
dont know/not answered, hence fully 45% responded actively by saying that the question
was not applicable.
Reasons for implementing Knowledge Management practices
In the Danish questionnaire, four possible answers have been added to the responses to
Question 3, which aims to reveal the reasons for implementing the practices indicated:
-
To
To
To
To
The decision to include these possible answers was taken at a meeting of the survey group.
These four additions mean that there are a total of 16 options. As Chart 8 shows, profiling the
organization and revealing tacit knowledge are among the reasons accorded highest
significance, while sharing knowledge with suppliers and the possibility of taking out patents
are considered of low importance, being listed respectively as nos. 14 and 16 when the options
are ranked in order of significance.1 1
Figure 3.2: Average significance of each of the four additional reasons
Crucial
importance
Great
importance
Some
importance1
No
importance0
To improve knowledge
sharing with suppliers
To identify unspoken
knowledge
As previously mentioned, there is a tendency to answer all the questions very positively. In an
attempt to overcome this problem, the Danish questionnaire turned the scale around so that
the weakest answers come first. It cannot be shown conclusively what impact this has had, but
some indication of its effect will be given when the results of the Danish pilot survey are
compared with those from other countries. There is however still a tendency to see all the
possible answers as significant. Thus, as Chart 8 shows, one of the answers in the OECD
questionnaire that was accorded least significance to ease collaborative work among teams
that are physically separated - was nevertheless accorded great or crucial significance by
29%.
11
Thus 74% indicate that the implementation of practices relating to knowledge acquisition and sharing is of no
importance for their ability to take out patents, and 32% answer that these practices are of no importance for their
ability to share knowledge with suppliers.
Page 12
15-04-2002
Options
0%
12
10%
20%
30%
40%
50%
60%
This may also be a result of the inaccessible way in which the question is formulated.
Page 13
15-04-2002
Page 14
15-04-2002
Page 15
15-04-2002
activities designed to acquire and share knowledge, while the most commonly reported
external sources are competitors, customers and clients.
Approximately half reported dedicating economic resources to these activities, and half of
these expect to dedicate more resources in the next 24 months. Only a quarter of those who
do not currently set aside resources for Knowledge Management activities plan to do so within
the next 24 months.
Only 9% of respondents had encountered resistance to implementing these activities.
Increased competitiveness is the key motivation for implementing Knowledge Management
activities or increasing such activities, but the desire to attract workers, to avoid losing key
workers and to improve corporate image are also important motivating factors.
4.2 Characteristics of respondents who do not practise Knowledge Management
It is impossible from the data to conclude that there are any particular characteristics that
distinguish the few organizations that do not practise Knowledge Management from those that
do, and the skip-pattern in the questionnaire does not really work. This points to weaknesses
in the questionnaire which should be dealt with in the final version.
4.3 Answers seen in relation to background variables
Only the answers to Question 1 choice of practices relating to knowledge capture and
acquisition have been analysed in relation to background variables.
Geographical location ( chart 25)
-There are only small deviations among the respective data from from Zealand, Fyn and
Jutland.
Size as measured by number of employees (chart 26)
There is a tendency for activities involving communications, as well as policies and
strategies, to be used more frequently among large enterprises than among small ones. Small
enterprises are defined as those having between one and 19 employees, so perhaps what is
most surprising is that in other respects they resemble the medium-sized and large enterprises
so closely.
Trade ( chart 27)
There is a tendency for service enterprises to implement practices aimed at obtaining and
sharing knowledge to a higher degree than do manufacturing and trading enterprises.
Geographic location of owners (chart 28)
Overall it makes no great difference whether the owners of the enterprise are located in
Denmark or abroad.
4.4 Correlation between results obtained and level of activity
In what follows, level of activity refers to the length of time that a given Knowledge
Management activity has been practised. Thus the statement Yes, we have done this since
before 1999 is considered indicative of a higher level of activity than the statement Yes, we
have done this since 1999.
Chart 9 shows how respondents evaluated the effect of these activities on various areas. It can
be seen from this that Knowledge Management activities are seen as having been most
effective in the area of improving workers skills and knowledge.
If we compare the answers to Question 4 (results of practices implemented) with the answers
to Question 1 (activities) there is no very clear correlation. Surprisingly (in view of the above)
Page 16
15-04-2002
there is nothing to suggest that a higher level of activity improves workers knowledge and
skills. This is an interesting contradiction which merits further investigation.
Table 4.1 below shows the extent to which individual results have an important explanatory
effect on the level of activity. The tendency indicated here is that policies and strategies,
training and mentoring and leadership have the greatest impact on results.
Table 4.1: The explanatory effect of results on level of activity1 3
Average level of activity
Results
Knowledge
capture and
acquisition
activities
Training and
mentoring
activities
Communications
activities
Policies and
strategies
Leadership
Incentives
0,662
0,802
0,924
0,115
0,933
0,114
0,819
0,174
0,560
0,401
0,957
0,604
0,026
0,017
0,647
0,006
0,103
0,141
0,997
0,435
0,381
0,078
0,787
0,077
0,576
0,047
0,171
0,062
0,202
0,071
0,894
0,034
0,355
0,339
0,018
0,091
0,004
0,232
0,477
0,001
0,108
0,108
0,127
0,000
0,126
0,003
0,009
0,595
0,457
0,146
0,232
0,017
0,717
0,084
0,430
0,011
0,028
0,040
0,069
0,112
0,837
0,652
0,436
0,078
0,047
0,685
0,128
0,004
0,143
0,003
0,038
0,025
0,102
0,260
0,358
0,068
0,799
0,748
0,144
0,141
0,372
0,009
0,012
0,554
0,340
0,778
0,054
0,094
0,527
0,737
0,107
0,033
0,118
0,016
0,319
0,707
13
The table shows the significance (bold text) by comparing the average level of activity per cluster of sub-questions
in Question 1 (dependent variable), with the result variables in Question 4 divided into 2 levels: high effect (very
effective and effective) and low effect (somewhat effective and not effective) (independent variable).
Page 17
15-04-2002
Page 18
15-04-2002
The pilot study points to a number of hypotheses which it would be interesting to investigate
further:
Hypothesis: The acquisition and sharing of knowledge takes place primarily between
experienced and inexperienced workers as a part of their training.
Hypothesis: Most organizations do not see any reason to systematise the acquisition
and sharing of knowledge
Hypothesis: Meetings are not often used as a means of transferring knowledge.
Hypothesis: Activities designed to acquire and share knowledge are undertaken
primarily with a view to increasing competitiveness.
Hypothesis: Organizations do not dedicate specific budgets to the acquisition and
sharing of knowledge.
Hypothesis: Workers immediately accept, as part of their job, activities designed to
acquire and share knowledge.
Hypothesis: In small enterprises (fewer than 50 employees) the acquisition and sharing
of knowledge is perceived as something which the management and employees practise
daily.
Hypothesis: Large enterprises systematise practices designed to acquire and share
knowledge
Hypothesis: The acquisition and sharing of knowledge have a great impact on
employees level of skills and knowledge
Hypothesis: Knowledge sharing is promoted most effectively in so far as it is
incorporated in an organizations strategic activities.
Hypothesis: Intellectual capital reports are not perceived as a relevant tool for
knowledge sharing.
Hypotese: Fewer than 50% of enterprises make use of public sources of knowledge.
An investigation of these hypotheses is likely to lead to a variety of initiatives being
undertaken on the part of government to influence business enterprises in the desired
direction.
There is no doubt that the OECDs goal to put the spotlight on Knowledge Management - is
relevant for Denmark. Although no direct correlation can be proved between Knowledge
Management activities and business results, those who practise these activities have a clear
sense that the acquisition and sharing of knowledge, and especially the utilization of it, have a
considerable impact on a firms competitiveness. It is therefore important to raise awareness
of these activities. A large international survey is an effective means of doing this.
The greatest problem in this connection is the lack of clarity in terminology relating to the field,
but one of the aims of the survey is precisely to address this.
Cross-border comparison gives rise to technical problems, but also, more particularly, to
conceptual challenges which must be dealt with. The value of the study, however, does not
Page 19
15-04-2002
rest solely on such comparisons, and great inspiration will in any case be derived from putting
Knowledge Management into international focus.
In section 5 we looked at those areas which should be adapted in order to ensure the studys
relevance for Denmark most of them relating to a simplification of the terminology and
clarification of the concepts involved. Provided that these problem areas are addressed at the
OECD meeting in March , our recommendation is that Denmark should partcipate in the further
development of an international study on the practice of Knowledge Management activities and
the extent to which these are perceived to be effective.
Page 20
15-04-2002
Acknowledgements
We would like to thank the following for their useful remarks:
Peter Holdt Christensen, Institut for Ledelse, Politik og Filosofi, Handels hjskolen i Kbenhavn,
Kbenhavn N. (Institute of Management, Politics and Philosophy, Copenhagen Business
School)
Marie-Louise Winther Green, the former Erhvervsministeriet, Kbenhavn K (The Danish
Ministry of Business Affairs, Copenhagen)
Lars Kiertzner, Institut for Regnskab, Handelshjskolen i rhus (Aarhus Business School)
Heine Larsen, Ementor Denmark A/S, Kbenhavn N and Handelshjskolen i Kbenhavn,
Frederiksberg (Copenhagen Business School)
Henning Madsen, Handelshjskolen i Aarhus, Aarhus V (Aarhus Business School)
Peter Stendahl Mortensen, Analyseinstitut for forskning, Aarhus (Institute of Analysis and
Research)
Flemming Poulfelt, Institut for Ledelse, Politik og Filosofi, Handelshjskolen i Kbenhavn,
Kbenhavn N (Institute of Manageme nt, Politics and Philosophy, Copenhagen Business School)
Bettina Hst Poulsen, the former Erhvervsministeriet, Kbenhavn K (The Danish Ministry of
Business Affairs, Copenhagen)
Benedicte Stakemann, Erhvervsfremme Styrelsen, Kbenhavn (Committee to Promote
Industry, Copenhagen)
Marianne Stang Vland, Learning Lab Denmark, Copenhagen
Page 21
15-04-2002
14
In this section we refer consistently to the numbers in the OECD version, since our purpose is to make
recommendations for improving this basic questionnaire.
Page 22
15-04-2002
These headings moreover were adapted to each sub-group of questions in order to get a clear
correspondence between question and answer.
It is hard to find any real justification in Denmark for dividing up the Yes category into In use
Before 1999 and Used since 1999. The respondents interviewed had difficulty in
remembering when a given practice had been implemented. Some respondents did not
distinguish between practices implemented before and after 1999. Others instead used the
scale to suggest different degrees of implementation, treating the column furthest to the left
as the one for activities practised to a high degree, while the second column was for activities
practised to a lesser degree.
On the No side, too, the various answers offered are not exhaustive. For though a given
Knowledge Management activity may well be thought relevant, there may nevertheless be no
plans to introduce it - for financial reasons, for example. Respondents who have not
implemented that practice, and who do not plan to do so within the next 24 months, are forced
to answer dont know or not applicable. Several of the respondents interviewed could point
out activities which they considered relevant, but which nonetheless for quite other reasons
would not be implemented within the next 24 months.
Simple as opposed to abstract activities
Question 1 is important, for it is here that the respondent makes up his mind whether he is
going to continue filling in the questionnaire. The interviews showed that respondents found it
difficult to get going on the questionnaire. The activities emphasised are too abstract, and
everyone interviewed was left with the feeling that there must be many more relevant
Knowledge Management activities than these. It is important that respondents do reply to
questions concerning activities which they use regularly and systematically.
The interviews showed that it was inadvisable to begin with questions concerning policies and
strategies, which respondents may find it difficult to relate to. For this reason the order has
been changed in the Danish questionnaire, so that 1.4 and 1.6 come before 1.1 and 1.3.
Recommendations
The scale should be divided up, so that not applicable is separated from dont know.
Yes since 1999 and Yes since before 1999 should possibly be put together.
The introduction to the questionnaire should be made easier, e.g. by changing the order
of the questions in Part 1, so that the more simple activities (1.4 1.6) come before the
more abstract ones
Page 23
15-04-2002
Leadership
Results of the pilot survey
The majority of respondents indicate that the activities in question are the responsibility of the
managers and executives (72.1%), but non- management workers are also emphasised by
many (57.4%).
Most surprising, perhaps, is that almost one fifth give the response not applicable to the
question whether activities relating to knowledge management practices are the responsibility
of managers and executives, and still more (29%) give this response with regard to nonmanagement workers.
14.8% state that their organization has a knowledge officer, while 62.3% state not applicable
on this point.
Only a few have plans to implement internal management practices relating to knowledge
acquisition within the next 24 months.
A quarter used knowledge management practices as explicit criteria for assessing worker
performance. More than half answered no to this of whom the majority (49.2%) considered
it not applicable.
Page 24
15-04-2002
Incentives
Results of the pilot survey
23% reward the positive effects of knowledge sharing with monetary incentives, while 28%
reward it with non- monetary incentives.
Approximately 60% of respondents consider these two forms of reward to be not applicable,
and only a few are considering introducing them.
Results of the interviews
All the respondents interviewed found it difficult to answer the question concerning incentives.
In an attempt to solve this problem the Danish questionnaire made it clear that it was the
positive effect of knowledge sharing that was being rewarded.
Recommendations:
This sub-question should be reconsidered in its entirety
With regard to the question concerning non-monetary incentives (1.6 B) it might be
interesting to find out in more detail what this incentive structure looked like.
It would also be interesting to investgate the effect of rewarding the positive results
of knowledge sharing.
Page 25
15-04-2002
Half the respondents use knowledge obtained from public research institutions, which is on the
face of it surprising, but we do not know what kind of knowledge is being referred to. 41%
consider this option not applicable.
Again it is surprising how many state that they do not consider the activities in question
applicable. In addition to the use of knowledge from public research institutions, 45.9%
consider it inapplicable to dedicate budgets to obtaining knowledge, and 57.4% consider it
inapplicable to dedicate budgets to communicating such knowledge. By contrast only a fifth
consider it inapplicable to dedicate time respectively to obtaining (16.4) and to communicating
(24.6%) knowledge.
Results of interviews
Certain respondents requested the option to state that they used internal sources for capturing
and acquiring knowledge. These internal sources have been included in the group of questions
concerning training and mentoring, but in a form where the respondent is asked what is
encouraged, not what is actually done.
These questions (especially 1.4 C, concerning the dedication of resources to obtaining and
communicating knowledge) contains too many elements, which meant that respondents found
it difficult to answer. In the Danish questionnaire it was therefore divided up to good effect.
Recommendations:
Question 1.4 C should be divided up, since it contains too many elements. This was
done in the Danish questionnaire and has yielded interesting differences.
It would be relevant to investigate what kinds of knowledge were obtained from
public research institutions for example, one could imagine that this applied more to
product-related knowledge.
The list of sources from which knowledge is obtained should be reconsidered.
Training and Mentoring
Results of the pilot survey
In general there is more support for informal than for formal training where Knowledge
Management is concerned.
The most widely-used practices are: encouraging experienced workers to transfer their
knowledge to new or less experienced workers (83.6%); encouraging workers to continue their
education (73.8%), and giving informal training related to knowledge management (59%).
Formal mentoring and formal training in knowledge management is regarded as not applicable
by respectively 57.4% and 42.6%. 15% of respondents however have plans to introduce
formal training within the next 24 months.
Results of interviews
Many of the respondents interviewed found it difficult to see any real difference between
Question E, which refers to encouraging workers to continue their education by reimbursing
their tuition fees, and Question F which refers to off-site training, since the basic difference lies
in who is paying for the training. The pilot survey also shows almost identical responses to
these two questions, which suggests that respondents in the survey also considered them to
mean roughly the same.
Recommendatons
Question 1.5E concerning reimbursement of expenses to take job-related courses and
Question 15F concerning the offer of off-site training should be put together in one
question.
Page 26
15-04-2002
Communications
Results of the pilot survey
The most widespread practice in the area of communications is the use of IT, e.g. in the form
of an intranet, followed by the physical arrangement of the workplace to promote
communications, the promotion of corporate memory, and the updating of databases recording
good work practices etc.
Many respondents indicated the practices listed under this heading in general to be not
applicable. Thus 57.4% indicated that using virtual teams to facilitate collaborative work by
physically separated teams was not applicable, and 30% gave this response to the practice of
updating databases of good work practices. A quarter considered the use of written
documentation to record lessons learned (i.e. the promotion of corporate memory), and the
physical arrangement of the workplace, to be not applicable, while a fifth indicated that the use
of IT was not applicable.
Results of the interviews
Some respondents had difficulty in understanding the question about corporate memory, and
the difference between this practice and that of updating databases. There was also some
doubt about the difference between updating databases and preparing written documentation.
In the present formulation of Question 1.6C: In your firm or organization workers share
knowledge or information by facilitating collaborative work by projects teams that are
physically separated (virtual teams), the key phrase is facilitating collaborative work. This
is not consistent with the form of the other questions, which all concern means rather than
aims. The question is therefore turned around in the Danish version, so that the phrase virtual
groups (the means) comes first. The purpose of this should be clarified.
Recommendations:
The inclusion of a question concerning the use of IT e.g. in the form of an intranet
should considered. This was tested out in the Danish questionnaire.
The inclusion of a question concerning the physical arrangement of the workplace should
also be considered. This was tested out in the Danish questionnaire.
It would be useful to clarify the difference between the question concerning databases
(1.5 A) and the question concerning written documentation. (1.5 B)
Are there any Knowledge Management practices that your firm or organization uses
that we have not included in this survey? (Question 2)
Results of the pilot survey
62% of respondents answered no to this question, thereby indicating that the content of
Question 1 is sufficiently exhaustive. A quarter practise other activities and mentioned the
following:
Participation in national and international knowledge sharing groups
Advisory Boards, internal meetings to exchange knowledge, knowledge database
(intranet-based)
Procedure for acquiring interdisciplinary knowledge in order to get a holistic overview of
a given task, as well as insight into when a task should be passed onto, or involve,
experts from other fields.
From parent company
Trade journals
Extensive extranet
Internal workshops in connection with staff meetings
Internet, purchased information
Experience sharing group, trade council, local management forum, other types of
companies, auditors
Page 27
15-04-2002
Page 28
15-04-2002
Recommendations
Question 3B about helping to integrate knowledge should be formulated more directly.
Consideration should be given to formulating the questions more neutrally to get a more
realistic spread in the answers.
In the Danish questionnaire the scale was changed round, so that the answer critical
came furthest to the right. The aim was to counterbalance the tendency to cross the
most positive responses most frequently.
Four additional questions were tested out in the Danish questionnaire:
To improve knowledge sharing with suppliers.
To identify the unspoken knowledge of employees
To profile the organization as an up-to-date organization
To improve the ability to take out patents and possibility of doing so
The questions concerning profiling and unspoken knowledge have proved relevant in the
Danish survey.
Question 3A about competitive advantage and 3G about strategic objectives logically
belong together, and should therefore follow on from one another.
Question 3F about protecting from loss of knowledge due to departure of staff, and
Question 3I about worker retention logically belong together, and should therefore follow
on from one another.
Please indicate the achieved results of the knowledge management practices in use
in your organisation? (Question 4)
Results of the pilot survey
In this question respondents were asked how effective their activities had been in terms of a
series of results.
The result which these activities had been most effective in achieving was to improve the skills
and knowledge of workers. Here, 69.8% of respondents answered effective or very effective.
Next comes increased adaptation of products or services to client requirements (62.3);
increased knowledge-sharing horizontally (60.3), and helped us add new products and
services(54.7).
The practices indicated were considered not at all effective in preventing duplication of
research and development or increasing the number of markets (geographically).
Results of the interviews
During the interviews several respondents requested not applicable as a possible option. One
might suppose that respondents who did not consider the question applicable would choose not
to answer it, but this was not the case with these interviewees. A not applicable column has
therefore been added to the Danish questionnaire.
Many respondents had difficulty in understanding the relation between the question and the
possible answers. For this reason, the tense in these questions was changed in the Danish
questionnaire from the past to the pluperfect. In the later interviews this appeared to have
clarified the question. There were also a number of respondents who thought only in terms of
measurable results. This was helped by phrasing the question as follows: what results do you
feel you have achieved?
Certain respondents emphasised other consequences (negative results) of working with
Knowledge Management practices, namely that these had led to an overload of information.
Page 29
15-04-2002
Recommendations:
It should be made clear that it is not necessarily measurable results that are being asked
about. This can be done by asking what results do you feel you have achieved by using these
practices?
All the respondents interviewed missed having the option not applicable. This has been
added in the Danish questionnaire.
Option 4N concerning the improved involvement of workers and 4D concerning improved
skills and knowledge of workers belong naturally together and should therefore be set
alongside each other.
A new option, 4O, has been added: Has led to new relations with suppliers.This belongs
naturally with 4F, concerning customer relations, so these two questions should be placed
together.
A new option, 4P, has been added: Has led to new partnerships (cooperators). This
belongs naturally with Question 4F concerning customer relations, and should be placed
alongside it.
Page 30
15-04-2002
Page 31
15-04-2002
In the Da nish questionnaire the options advisory board and unions were also tested out, but
none of the respondents crossed these answers.
Results of interviews
No contribution on this point.
Recommendations
Consideration should be given to including the Board and owners and shareholders
under internal sources
The survey group suggested the following additional question: Which role-models have
you used in Knowledge Management? This was not included in the pilot survey on the
grounds that it was already so extensive, but it could be considered for the final survey.
Do you have dedicated budgets or spendings for the activities? (Question 8)
Result of the pilot survey
58% of respondents dedicate financial resources to these activities, and half of these expect to
devote increased resources to them in the future. None of them anticipates that the budget for
these activities will be reduced within the next 24 months.
42% dedicate non-monetary resources to these activities, and only a quarter of these
anticipate that they will devote monetary resources to them within the next 24 months. 20%
do not know whether they will dedicate such resources.
Results of the interviews
The wording Does your firm or organization have dedicated budgets or spendings worried
several of the respondents. They argued that the resources used on activities related to
knowledge acquisition and sharing are integrated in many different places in the budget and
cannot therefore be considered specific.
Recommendations
The answer Stay the same should moved so that it is placed between Increase and
Decrease. ( In the OECD questionnaire the order is Increase , Decrease, Stay the
same.)
Did your firm or organization experience significant resistance to implementing any
of the knowledge management practices? (Question 9)
Results of the pilot survey
Only 9% of respondents had experienced resistance to implementing these activities, and in all
cases this resistance came from non- management workers.
Results of the interviews
None of the respondents interviewed had experienced resistance to implementation. Surprise
was expressed, however, at the fact that distribution, purchasing and communications staff
had been placed in the same category, and that administration/accounting and HR had been
put together in the same category.
A more nuanced picture might be given if, instead of asking whether there had been any
resistance or not, respondents were asked about the degree of resistance.
Recommendations
The answers should be changed to a scale ranging from full backing to opposition.
If it is important to ask about significant resistance, this should emphasised as it was in
the Danish pilot survey.
Page 32
15-04-2002
Page 33
15-04-2002
Page 34
15-04-2002
Miscellaneous
Recommendations for increasing the response rate:
It was suggested that we get in direct personal contact with the firms by phone before
the questionnaires were sent out, and in that way involve the respondents in advance.
It has also been suggested that we give respondents several benefits in order to raise
their motivation to use time and mental effort on filling in the questionnaire. Such
benefits could be the offer of networking cooperation or access to relevant links (e.g.
from the OECDs or the former Ministry of Business Affairs home page.)
Recommendations for dealing with the abstract nature of the concept:
Consideration could be given to omitting the concept Knowledge Management and hence
the definition, and instead formulating the questions more clearly and concretely.
One could for example make the questions more concrete by using examples.
Or one could start with a concrete question such as. If an employee wishes to leave,
what do you do in your organization?, What knowledge is it important to share in your
organization? and How do you do this? or if a worker is sitting on some invaluable
knowledge, how do you make sure it gets transferred?
An alternative would be to write an accompanying letter with a case study that sets out
the problem. The drawback with an accompanying letter is that it is likely not to be read,
so the introductory comments should be as brief as possible.
If the intention is to treat Knowledge Management as a part of ordinary management,
considertation should be given to omitting the skip option and asking all respondents to
fill in the whole questionnaire.
Further discussion of the target group could make the questionnaire more concrete. For
example, the kind of knowledge that is important differs from firm to firm.
It might be interesting to send the questionnaire out to different levels within each firm.
This would require several types of questionnaire.
If a definition is used in the questionnaire, one might consider using it on every page as
a running headline.
Proposal for an additional question:
Several members of the survey group wanted to include an additional question: Might
your firm be interested in participating in research or in experience groups in this field?
Page 35
15-04-2002
1.2 Leadership
1.5 Leadership
1.3 Incentives
1.6 Incentives
1.4 C Dedication of resources to obtaining and 1.1 C Dedication of time to obtaining knowledge
communicating knowledge
1.1 D Dedication of time to communicating knowledge obtained
1.1 E Dedication of budget to obtaining knowledge
1.1 F Dedicating of budget to communicating knowledge
1.4 D Encouraging participation in project
teams with external experts
1.6 Communications
1.3 Communications
1.3 E Use of IT
7 D The Board
7 F Advisory Board
7 G Trade Associations
7 E Competitors
7 I Competitors
7 F Suppliers
7 J Suppliers
7 I Consultants
7 M Consultants
7 J Regulatory agencies
7 N Regulatory agencies
7 K Customers or clients
7 O Customers or clients
7 L Others
7 P Others
11 Number of employees
11.b Turnover
12.a Trade
Page 36
15-04-2002
Page 37
15-04-2002
Design of
questionnaire
June
2001juni
Translation Interviews
and adaptation
juli
aug.
sept.
Reporting:
- Interim report to the former
Ministry of Business Affairs.
Analysis
Gathering of
17/12 2001
of data
data for pilot
from pilot - Report to OECD: January 2002
survey
- final report to former (Ministry of
survey
Business Affairs: 14 days after
fourth OECD meeting March
okt.
nov.
dec.
jan.
feb.
marts
2002
Third OECD
meeting *
First survey group
meeting
Fourth OECD
meeting
Second survey
group meeting
*The first OECD meeting was held in February 2001. The Centre for
Management has participated in the project since June 2001.
Page 38
Pilot reports
from
Canada,
Germany,
Denmark
circulated
15-04-2002