Academic Journal Guide 2021-Methodology
Academic Journal Guide 2021-Methodology
June 2021
charteredabs.org
UK business schools and international student recruitment: Trends, challenges and the case for change
Academic Journal Guide 2021 Page 1
Page 1
CONTENTS
page
Acknowledgements................................................................................................................................. 2
Introduction................................................................................................................................................... 6
The Aims of the 2021 AJG................................................................................................................... 8
The Process...................................................................................................................................................... 9
The Four Impact Factors Relating to Citation Information................................. 10
Rating Definitions.................................................................................................................................. 12
Outcomes....................................................................................................................................................... 14
Conclusion.................................................................................................................................................... 15
References..................................................................................................................................................... 17
Appendix 1................................................................................................................................................... 18
Appendix 2................................................................................................................................................... 19
UK business schools and international student recruitment: Trends, challenges and the case for change
Academic Journal Guide 2021 Page 2
Page 2
ACKNOWLEDGEMENTS
To produce the Academic Journal Guide requires great effort, care and attention from a
considerable number of people. We are hugely grateful to the Editors, Methodologists, Chair
of the Scientific Committee, members of the Scientific Committee and members of the
Management Committee. We are also thankful to Clarivate and Elsevier for the use of their
journal metrics. Finally, we thank Dr Grigory Pishchulov at Alliance Manchester Business School,
University of Manchester for his careful reviewing of the Guide.
Scientific Committee
Field Member
Accounting Prof. Marcia Annisette,
York University, Seymour Schulich School of Business, Canada
Prof. Mark Clatworthy,
University of Bristol, School of Economics, Finance and Management, UK
Prof. Christine Cooper,
Edinburgh University Business School, UK
Business and Economic Prof. Mark Casson,
History University of Reading, UK
Prof. Geoffrey G. Jones, Harvard Business School, USA
Economics, Econometrics Prof. Jerry Coakley,
and Statistics Essex Business School, UK
Prof. Robert Taylor,
Essex Business School, UK
Prof. Tim Worrall,
University of Edinburgh School of Economics, UK
Entrepreneurship and Small Prof. Susan Marlow,
Business Management Nottingham University Business School, UK
Prof. Becky Reuber,
University of Toronto, Rotman School of Management, Canada
Finance Prof. Marco Pagano,
University of Naples Federico II, Italy
Prof. Nick Taylor,
University of Bristol, School of Economics, Finance and Management, UK
Prof. John Wilson,
University of St. Andrews, School of Management, UK
Prof. Steve Foerster,
Ivey Business School, Western University, Canada
General Management, Prof. Peter Bamberger,
Ethics, Gender and Tel Aviv University, Coller School of Management, Israel
Social Responsibility
Prof. Caroline Gatrell,
University of Liverpool Management School, UK
Prof. Susanna Khavul,
San Jose State University/London School of Economics, USA/UK
Prof. Henk Volberda,
University of Amsterdam, Amsterdam Business School, Holland
UK business schools and international student recruitment: Trends, challenges and the case for change
Academic Journal Guide 2021 Page 4
Page 4
Field Member
Human Resource Prof. Pawan Budwar,
Management and Aston Business School, UK
Employment Studies
Prof. Fang Lee Cooke,
Monash Business School, Australia
Prof. Adrian Wilkinson,
Griffith Business School/University of Sheffield, Australia/UK
Information Systems Prof. Joe Nandhakumar,
Warwick Business School, UK
Prof. Cathy Urquhart,
Manchester Metropolitan University Business School, UK
Innovation Prof. Silvia Massini,
University of Manchester, Alliance Manchester Business School and
Manchester Institute of Innovation Research, UK
Prof. Nola Hewitt-Dundas,
Queen’s Management School, Queen’s University Belfast, UK
International Business Prof. Heinz Tüselmann,
and Area Studies Manchester Metropolitan University Business School, UK
Prof. Jedrzej George Frynas,
Open University, UK
Management Development Prof. David Collings,
and Education Dublin City University Business School, Ireland
Prof. Ken Starkey,
Nottingham University Business School, UK
Marketing Prof. Adam Lindgreen,
Copenhagen Business School, Denmark
Prof. Paurav Shukla,
Southampton Business School, UK
Operations and Technology Prof. Cipriano Forza,
Management University of Padua, Italy
Prof. Christine Harland,
Politecnico di Milano, Italy
Prof. Ian McCarthy,
Simon Fraser University, Beedie School of Business, Canada
Operations Research and Prof. David Lane,
Management Science Henley Business School, UK
Prof. Maria Paola Scaparra,
Kent Business School, UK
UK business schools and international student recruitment: Trends, challenges and the case for change
Academic Journal Guide 2021 Page 5
Page 5
Field Member
Organisational Studies Prof. Nic Beech,
Middlesex University, UK
Dr. Amanda Shantz,
Trinity College Dublin, Trinity Business School, Ireland
Psychology (General) Prof. Julie Aitken Schermer,
University of Western Ontario, Canada
Prof. Barbara Summers,
Leeds University Business School, UK
Psychology (Organisational) Dr. Julie Gore,
University of Bath, UK
Prof. David Guest,
King’s Business School, King’s College London, UK
Prof. Karoline Strauss,
ESSEC Business School Paris, France
Public Sector and Prof. Rhys Andrews,
Health Care Cardiff Business School, UK
Dr. Ian Elliot,
University of Northumbria, Newcastle Business School, UK
Regional Studies, Planning Prof. Gary Cook,
and Environment Leeds University Business School, UK
Prof. Phillip McCann,
Sheffield University Management School, UK
Sports, Leisure, Tourism Prof. Peter McKiernan,
and Sector Studies Strathclyde Business School, UK
Prof. Stephen Page,
Hertfordshire Business School, University of Hertfordshire, UK
Prof. Colin C. Williams,
Sheffield University Management School, UK
Social Sciences Prof. Robert Andersen,
University of Western Ontario, Canada
Strategy Dr. Sotirios Paroutis,
Warwick Business School, UK
Prof. Ram Mudambi,
Fox Business School, Temple University, USA
INTRODUCTION
The Purpose of the Academic Journal Guide
Welcome to the 2021 edition of the Chartered Association of Business Schools’ Academic Journal Guide (AJG).
The purpose of the AJG is to assist researchers to make informed judgements about the outlets they may
wish to publish in. It provides details on a wide range of journals, stretching across fields that are either
central or salient to business and management studies; in other words, it aims to encompass a broad set
of journals in which business and management academics may seek to publish their research.
It is also the case that some specialised areas have a relatively small number of outlets because a large
proportion of their output is published in general management journals.
Journal Impact Factors do not capture the nuances imparted by the often substantial differences in
the volume of articles within journals, acceptance rates, nor within any specific rating. They also do
not capture the nuances of the differences between short opinion pieces (which count towards the
numerator, but not the denominator of citation calculations), or citation behaviours within different fields.
On occasion, the ratings of some journals, if based purely on such metrics, may not correspond with how
scholars perceive them. Our purpose therefore was to produce a guide that took into consideration this
subjective input.
The AJG is not intended to be a fully comprehensive guide, given, inter alia, the problems of demarcating
what is Business and Management research and/or relevant to it, and what is not. Inclusion in the AJG
is wholly at the discretion of the Editors and the Scientific Committee, and no undertakings have been
made that all journals that may desire inclusion will have been included. Non-inclusion in the AJG should
not necessarily be taken as a judgment of journal quality, but may reflect a wide range of factors which
may include: a journal’s aims and scope; that most content of the journal lies outside the scope of, or
are not relevant to business and management studies; or that the Scientific Committee and those they
consulted with did not encounter sufficient evidence on which to formulate an opinion.
The AJG is intended to give both emerging and established scholars greater clarity as to which journals
to aim for, and where the best work in their field tends to be clustered. Emerging scholars will have
greater clarity as to the full range of possible outlets, and where the best work in their field may be
clustered. Business and Management is an amalgam of fields. The volume of research in Business and
Management has grown rapidly over time, as have the number and breadth of available outlets in which
scholars publish. By the same measure, publication in identified top journals gives scholars a recognised
currency to assist in situating their research that is not based upon idiosyncratic local preferences that
can be distorted by local networks. Should local networks deny the currency of scholars’ research in one
institution, there will consequently be others who will recognise and welcome it.
We appreciate DORA’s concerns as to any focus on outlet rather than content; however, by the same
measure, a journal guide gives scholars some outside affirmation that their work resides in the best
company, even if the worth of their research is denied by established patronage networks often
dominated by privileged groups. Again, we share DORA’s concern with citation metrics as an over-riding
measure, and hence our emphasis on peer opinion, encompassing a careful reading of typical work and
scientific merit that is encountered in particular journals. The Chartered ABS Guide simply seeks to give
an opinion that encompasses a composite view as to the relative concentration of work that may be
encountered in particular places, whilst recognising that this is a tendency, rather than a general rule. If
readers wish to appraise the worth of a particular piece of scholarly work, any choices they make are theirs
alone. It is also recognised that there is a great range in the standard of editorial experience and standing
between journals, and, indeed, in the quality of reviewers that journals can hope to attract, although it
does not automatically correspond to journal metrics, and, indeed, there are important methodological
differences within the latter. Of course, there are many other forms of research output than journal
articles, including books and a variety of creative endeavours informed by scholarly enquiry; the Guide
only focuses on journals, but other forms of scholarly endeavour are worthy of due consideration. Again,
relative readership of, and citation by, the peer scholarly community needs to be considered against
the wider impact on the economy and society of scholarly research. At the same time, we would reject
the view that only research that demonstrates immediate practical impact is worthwhile; we remain
convinced that scholarly reflection and endeavour can be a good in its own right, and the presence of an
intellectual class engaged in either pure or applied enquiry and debate on the state of the human and
natural condition is the mark of a civilized society.
UK business schools and international student recruitment: Trends, challenges and the case for change
Academic Journal Guide 2021 Page 8
Page 8
Good work may, of course, be found anywhere, but it is a generally held view that such work is more
likely to be concentrated in certain journals rather than others. The Editors recognise that any guide that
seeks to differentiate between journals will naturally be contentious. Some of this will reflect the natural
tensions in academia between shared scholarly identity, exchange and debate, and the individual pursuit
of very specialised knowledge that, whilst potentially worthwhile in its own right, when disseminated
is likely to be only accessible to a very small audience. It will also reflect the tensions between efforts to
commodify academic labour time, and the acclaim exceptional bodies of work receive across the scholarly
community. While recognising that exceptional scholarly work may be found in many places, we similarly
accept that such work tends to be clustered in particular locales and journals, in a process that may reflect
both the availability of resources and accumulated collective human capital. Better journals can be more
selective, find it easier to attract top reviewers, have the resources to manage papers efficiently, and,
because they are more widely read and cited, will attract some of the most ambitious authors. Identifying
such locales is a difficult and fraught process, but we remain convinced that it is better that this is
operationalised through the involvement of scholarly experts than without. We have made every effort to
learn from feedback we received on the 2018 edition of the AJG.
As outlined in the methodology section, the AJG builds on its previous iterations, and the Editors of this
Guide owe a debt of gratitude to the Editors and Scholarly Experts involved in these former editions.
THE PROCESS
The holistic methodology underpinning the AJG, consisting of evaluations of journals not based solely
on metrics but reflecting Subject Experts’ views, is a distinctive feature of the Guide. The approach
followed in 2015 and 2018 built on the previous iterations of the AJG, while we endeavoured to engage
more widely with expert peers than when producing earlier guides. The 2021 AJG continued to build
on the work of the 2018 AJG through an enlarged and more diverse Scientific Committee and enhanced
consultation process.
In detail, the four methodological components are as follows:
First, an open call was issued for applications for new journals to be added to the Guide alongside
those already included in the AJG. The Subject Experts formulated an opinion if journals should
be included or not.
Second, the Methodologists analysed the data collected from: (i) the Journal Citation Reports™ (JCR) from
Clarivate; (ii) the SCImago Journal Rank (SJR); (iii) the Source Normalised Impact per Paper (SNIP); and (iv)
the CiteScore.
Third, commencing from September 2020, evaluations were conducted by Subject Experts, based
on consultations with learned societies, professional associations and leading academics in their area
(see Appendix 2 for details of the consultation process). Following these consultations, Subject Experts
compiled these inputs, metric information and other information into cases for changes in journal ratings
where these were supported by robust evidence. The experts accorded particular attention to journals
where there had been a significant change in the metrics, where there had been a significant change
based on criteria of AJG journal grade definitions, as well as journals new to the Guide. Based on this,
reasoned recommendations were formulated.
Following this process, the Methodologists, the Chair of the Scientific Committee and the Editors met
with the Scientific Committee on 9th March 2021. All cases with completed Journal Review Forms and
supporting metric information were provided to the committee. This allowed the Committee as a whole
to review the proposed ratings of the journals under consideration in their entirety.
Fourth, the review and approval by Chartered Association of Business School’s Academic Journal Guide
Management Committee.
Please see Appendix 1 for more detail on the review process.
UK business schools and international student recruitment: Trends, challenges and the case for change
Academic Journal Guide 2021 Page 10
Page 10
1 Effectively, the SNIP’s subject areas are ‘tailor-made’ (Moed 2010: 274) which is an advantage when dealing with cross- and
multi-disciplinary journals.
2 Analogously, the 5-Year Impact Factor for 2018 divides the 2018 citations for a journal by the number of papers it published
during the five previous years, i.e. 2013-2017. Note that in June 2020, the CiteScore calculation was changed, in particular,
counting the number of citations for a journal over a four-year window. Work on the 2021 AJG began in 2019 and hence
employs the previous CiteScore calculation.
UK business schools and international student recruitment: Trends, challenges and the case for change
Academic Journal Guide 2021 Page 11
Page 11
Following the 2018 AJG, this iteration of the guide uses the mean 5-Year Impact Factor from Clarivate
based on the average of the five-year impact factors for the years 2014 to 2018. This average is
then standardised by subtracting the average for the subject area and dividing this difference
by the standard deviation:
We used standardised impact factors that are calculated for the SJR, the SNIP and the CiteScore. It should
be noted, however, that the standardised mean SJR, SNIP and CiteScore are based on the three-year
impact factors rather than the five-year impact factors as the latter are not available.
The reason why the AJG focuses on the 5-Year Impact Factor (and the three-year SJR and SNIP) rather than
a 2-year impact factor is that 2-year citation metrics can be highly volatile across years and because the
AJG takes a longer-run view of journal evaluation.
It should be noted that there can be considerable variability between and across journal metrics from
different sources and with different calculations. Hence, these should not be used mechanistically and
uniquely as a means of distribution. Crucially, this variability underlines the importance of adopting a
four-step methodology. The Subject Experts were also provided with the other metrics and data items,
such as the percentage of articles not cited and the percentage of reviews per journal, to help them rate
the journals in their subject area. The Subject Experts were asked to rate the journals from 4 to 1. A further
distinction (Journal of Distinction) was made for in respect of a small number of journals amongst those
with a rating of 4.
UK business schools and international student recruitment: Trends, challenges and the case for change
Academic Journal Guide 2021 Page 12
Page 12
RATING DEFINITIONS
In Table 1, the definitions of the journal ratings are set out. This draws on the previous iterations of the AJG.
4* Journals of Distinction. Within the business and management field including economics,
there are a small number of grade 4 journals that are recognised world-wide as exemplars
of excellence. As the world leading journals in the field, they would be ranked among the
highest in terms of impact factor. The initial paper selection and review process would be
rigorous and demanding. Accepted papers would typically not only bring to bear large
scale data and/or rigour in theory, but also be extremely finely crafted and provide major
advances to their field.
4 All journals rated 4 (whether included in the Journal of Distinction category or not) publish
the most original and best-executed research. As top journals in their field, these journals
typically have high submission and low acceptance rates. Papers are heavily refereed. These
top journals generally have among the highest citation impact factors within their field.
3 3 rated journals publish original and well executed research papers and are highly regarded.
These journals typically have good submission rates and are very selective in what they
publish. Papers are heavily refereed. These highly regarded journals generally have good to
excellent journal metrics relative to others in their field, although at present not all journals
in this category carry a citation impact factor.
2 Journals in this category publish original research of an acceptable standard. For these well
regarded journals in their field, papers are fully refereed according to accepted standards
and conventions. Citation impact factors are somewhat more modest in certain cases. Many
excellent practitioner-oriented articles are published in 2-rated journals.
1 These journals, in general, publish research of a recognised, but more modest standard in
their field. Papers are in many instances refereed relatively lightly according to accepted
conventions. Few journals in this category carry a citation impact factor.
CONCLUSION
We hope that the Academic Journal Guide (AJG) will stimulate further dialogue with the peer community
at large. No journal rating guide is ever definitive. It could be argued that the supposed objectivity and
superiority of purely metrics-based ratings is potentially misleading, as are crude count-based measures
(Aguinis et al., 2020). The AJG is based on the conviction that the expertise and experience of a committee
of successful researchers provides fertile grounds for including scholarly judgment in the rating of
academic journals.
We take the concerns of the peer community very seriously. Hence, the Editors and Management
Committee would again welcome informed input and feedback.
Our intention is to update the AJG every three years. We will continue to strive for ever greater rigour,
representation and inclusivity, taking account of the concerns across the community of business and
management scholarship, whilst retaining the principle of differentiation in research outputs and evading
a ‘tragedy of the commons’.
UK business schools and international student recruitment: Trends, challenges and the case for change
Academic Journal Guide 2021 Page 16
Page 16
REFERENCES
Aguinis, H., C. Cummings, R. S. Ramani and T. G. Cummings (2020). ‘“An A is an A”: The new bottom line for
valuing academic research’, Academy of Management Perspectives, 34, pp. 135-154.
Colledge, L., de Moya-Anegón, F., Guerrero-Bote, V., López-Illescas, C., El Aisati, M. H. and Moed, M. (2010),
‘SJR and SNIP: Two new journal metrics in Elsevier’s Scopus’, Serials: The Journal for the Serials Community
23, 215-221.
González-Pereira, B., Guerrero-Bote, V. P., Moya-Anegón, F. (2010), ‘A new approach to the metric of journals’
scientific prestige: The SJR indicator’, Journal of Informetrics 4, 379-391.
Harvey, C., Kelly, A., Morris, H. and M. Rowlinson (2010), Academic Journal Quality Guide, Version 4, London:
The Association of Business Schools.
Moed, H. F. (2010), ‘Measuring contextual citation impact of scientific journals’, Journal of Informetrics 4,
265-277.
Walker, J.T., E. Fenton, A. Salter and R. Salandra (2019a). ‘What influences business academics’ use of the
Association of Business Schools (ABS) list? Evidence from a survey of UK academics’, British Journal of
Management, 30, 730-747.
Walker, J.T., Fontinha, R., Salter, A. and Salandra, R. (2019b). ‘What determines how individual’s view ranks?
Evidence from a large-scale survey’, Research Evaluation, 28, 218-231.
Walker, J.T., Della Giusta, M., Fontinha, R. (2020), ‘Initial findings from the consultation on the impact of
research metrics on the work of academic economists 2020’.
UK business schools and international student recruitment: Trends, challenges and the case for change
Academic Journal Guide 2021 Page 18
Page 18
APPENDIX 1
Overview of the AJG 2021 Review Process
Grade 3 and Grade 4 journals, and Journals of Distinction (JoD), where methodologists Grade 1 and Grade 2 journals (except
identified significant upward or downward movement in the metrics-based Grade 2 journals that qualify for the full
rankings since AJG 2018. review and consultation process)
Grade 2 journals with significant upward movement in Journals new to AJG with proposed
metrics-based rankings. inception Grade of 1 or 2
Exceptional cases agreed with the Editors: In addition, subject area experts could in
exceptional cases, where a journal is not indicated under above definition, but where
there is robust evidence that a journal has shifted substantially based on criteria of the AJG
journal grades definition, and in consultation and agreement with the Editors, propose the
journal to be submitted to the consultation process.
Journals new to AJG with proposed inception grade ≥ 3
Based on metrics (if available), outcome of • Retention of existing journal grade For journals subject to consultation process,
consultation process (where applicable), • Change in journal grade the assessment of above review elements
other relevant information at disposal, and • Inception grade for journals new to AJG and a reasoned evidence-based report
subject area experts’ assessment, subject • Change in JoD status and/or additional with the recommendation was formally
area experts propose: JoD (in line with AJG definition of JoDs) recorded in the Journal Review Form
(see Appendix 3)
Review by Editors
Put forward to Scientific Committee with view of agreed recommended journal grades
• Scientific Committee members furnished with journal metrics • Presentation of proposed journal grades and grade changes by
spreadsheets and Journal Review Forms of all subject areas prior to subject experts and subsequent discussion in Scientific Committee,
meeting to allow the Committee as a whole to review proposed moderated by Editors and Chair of Scientific Committee
ratings and grade changes of the journals under consideration in
• Decisions taken in Scientific Committee
their entirety.
by consensus principle
Review by Editors
Review and Approval of journal grades and AJG 2021 in its entirety by AJG Management Committee
UK business schools and international student recruitment: Trends, challenges and the case for change
Academic Journal Guide 2021 Page 19
Page 19
APPENDIX 2
Consultation with Academic Community
Consultation Process
• Subject area experts were furnished with a bespoke spreadsheet for consultees to record their
assessment and to provide comments and narrative if they so wished, as well as with an official
Chartered ABS letter to accompany the consultation requests, setting out inter alia the purpose, remit
and importance of the consultation process, data protection, ethics, confidentiality undertakings.
• Subject experts provided to Editors and Chair of Scientific Committee on a confidential basis the list
of peers (anonymised) and learned societies consulted, which they reviewed to ensure sufficiency
and adequacy of consultation in the subject area and consistency across subject areas.
UK business schools and international student recruitment: Trends, challenges and the case for change
Academic Journal Guide 2021 Page 20
Page 20
charteredabs.org