Sustainability in Information Systems Auditing: Alifah Aida Binti Lope Abdul Rahman A.Al-Nemrat D.S. Preston
Sustainability in Information Systems Auditing: Alifah Aida Binti Lope Abdul Rahman A.Al-Nemrat D.S. Preston
Sustainability in Information Systems Auditing: Alifah Aida Binti Lope Abdul Rahman A.Al-Nemrat D.S. Preston
Abstract
Auditing is a systematic process of obtaining and evaluating evidence of activities,
events or transactions. Currently, audit practices have been revolutionized by the
development of information technology and basically information systems auditing focuses
on assessing proper implementation, operation and control of information systems resources
within organisation. Several frameworks have been formulated for information systems
auditing implementation to achieve improvement in auditing performance related to
compliance requirements, internal controls evaluation and information systems success.
However, sustainability dimensions in the information systems auditing practices and the
development of appropriate framework are not enough discussed in the literature although
sustainability is becoming significant in achieving certain organisation‘s objective. Therefore,
this study intends to analyse the relevant requirements by auditors and sustainability factors
and use them to formulate IS audit by integrating sustainability in the auditing process. Thus,
improve audit performance and enhanced accountability and integrity of auditors.
Introduction
The main purpose of IS auditing is to provide assurance that the information systems
are functioning in an efficient and effective manner to achieve organisation‘s objective. As IS
are inter related, Sayana (2002, p. 2) suggested that information systems assessment should
be carried out by implementing an integrated evaluation of all IS components. In general, the
major elements consist of physical and environmental, systems and administration,
application software, network security, business continuity and data integrity. Each element
may have different priority, therefore the most significant elements may be selected for
auditing.
Hall and Singleton (2005, cited in Abdolmohammadi & Boss, 2011, p. 141) indicated
that IS audits includes the assessment of controls, computer resources, operation and IS
implementation. In addition, a number of audit techniques are used for gathering evidence
such as reviewing documents, interviewing and data analysis by using automated programs
According to AICPA, 2007, AU319.30, IS audit must be performed when;
a) The client utilizes complex business systems and relies extensively on IT
controls
b) The client has replaced or made any significant changes to its IT systems
c) The client extensively shares data between systems internal organizational
systems
d) The client is involved in electronic commerce
e) The client uses emerging technology
458
European Scientific Journal September 2014 /SPECIAL/ edition Vol.3 ISSN: 1857 – 7881 (Print) e - ISSN 1857- 7431
459
European Scientific Journal September 2014 /SPECIAL/ edition Vol.3 ISSN: 1857 – 7881 (Print) e - ISSN 1857- 7431
effort for sustainability in order to maintain competitiveness (Smith and Scharicz, 2011 cited
in Smith, 2012, p.5 and Asif et al., 2008, p.423).
Previous literatures have also identified influences on the process associated with
sustainability to improve organisational performance while simultaneously preserving
environmental system and safeguarding social benefit. Smith & Sharicz (2011, p.81) denoted
that a systematic governance structure and effective leadership are the key components to
adopt TBL sustainability. Millar et al. (2012, p.493) enhanced the views of Smith & Sharicz
(2011) by investigating and analysing the organisational change for sustainability.
Sustainability involves transformation in business structures and therefore, an effective
communication and collaboration to every hierarchy is essential to implement new strategies.
Sustainability is also perceived as a strategy for continuous improvement. Under this
context, Prajog and Sohal (2004, cited in Jaca et al., 2012, p.143), indicated that
sustainability is the ability of organisations to meet changes requirement in the business
processes, applying contemporary best practice methods and remain competitive in market.
Concerning continuous improvement, Jaca et al., (2012) analysed and measures several
factors for achieving systematic management of improvement activities.
460
European Scientific Journal September 2014 /SPECIAL/ edition Vol.3 ISSN: 1857 – 7881 (Print) e - ISSN 1857- 7431
observed that most of sustainability research pertaining to this area have extensively
discussed environmental issues such as green information technology (green IT), green
information system (green IS) or green IT investment which focuses on reduction of energy
consumption or addresses issue on sustainability efforts on green supply (Erek et al., 2009;
Harmon et al., 2010)
Another consideration for sustainability literatures is sustainability for ICT
development and five (5) main dimensions have been identified, namely; financial, social,
institutional, technological and environmental. These five dimensions are crucial to be
considered in planning and implementing ICT projects. Proenza, (2001 cited in Ali and
Bailur, 2007) indicated that financial sustainability refers to the long term ability of ICT
projects to generate monetary benefit for maintaining the obligations of the organisation.
Technological sustainability is the ability for a technology to sustain and continuously
available for a long period of time, Misund and Hoiberg (2003 quoted in Ali and Bailur,
2007). Social sustainability refers to user satisfactions by considering cultural differences,
empowering marginalised groups, sharing and aligning goals with local people and adapting
to evolving community needs (Gόmez and Casadiego, 2002; Harris et al., 2003; Stoll and
Menou, 2003; Delgadillo, 2004 quoted in Ali and Bailur, 2007). Institutional sustainability
refers to the long term ability of process and structures of organisation to perform their
functions, Batchelor and Norrish (2003 cited in Ahmad Nawi et al., 2013, p. 696)
In addition to sustainability dimensions of environmental, social and economy, recent
literature has introduced sustainability from the hybrid systems perspective or systems of
systems. Hessami et al., (2009,p.84) applied Weighted Factor Analysis methodology (WeFA)
to examine the context, components, topology and the scope of sustainability from micro
systems to macro systems. Systems sustainability framework was formulated from WeFA
schema consisting of economy, environmental, social, technology, resource, uncertainty,
rapid change in the domain of deployment and complexity.
Sustainability measurement
Having defined sustainability and issues to be considered, it is important to explore
how to assess sustainability. Piotrowicz (2009, p.492) claimed that sustainability cannot be
assessed by traditional performance measurement. As sustainability is a holistic concept
which involves integration and interdependence among systems, the sustainability
measurement has to be connected to economy, environment and social aspects.
Sustainability can be measured by using a set of indicators or indexes. In addition to
business‘s Guidelines, Standards and Regulations to be complied, many organisations have
developed their own mechanism as a sustainability performance indicators or sustainability
metrics for assessing their sustainability performance. Previous studies have introduced
several initiatives to measure sustainability. Delai and Takahashi (2011, p.440) denoted that
sustainability measurement implementation needs to consider four (4) situations; 1) the
sustainability measurement criteria, 2) theme and sub themes to be applied, 3) selection of
groups in the measurement process and 4) sphere of the company impacts to be taken into
account.
It is reported by United Nation 2002, that sustainability refers to the effort of
minimising negative impact on economy, environmental and social activity. The current
practices of laws, policies and regulations may also have impact to the development of a good
sustainability performance.
According to Nicho and Cusack (2007), IT auditing is able to develop quality
assurance, benchmarking and measurement. Prior sustainability literatures in information
systems evaluation were mainly discussed the effective use of computing resources to meet
business demands and to achieve sustainability objectives. However, less number of research
461
European Scientific Journal September 2014 /SPECIAL/ edition Vol.3 ISSN: 1857 – 7881 (Print) e - ISSN 1857- 7431
has examined the importance of information systems in the area of sustainable information
systems auditing to collect audit evidence, analyse, execute audit work and report IS audit
findings. Therefore, there is a need to construct the dimension of sustainability from IS
auditing perspective.
In this study, the author proposed a continuous auditing methodology to be adapted to
measure sustainability in information systems. Identification of the important aspects of
sustainability in conducting information systems auditing will be determined by the current
literatures. The author engaged three phases to gain the objective of this study; includes 1)
current IS audit, 2) developing IS audit criteria and objective, 3) IS audit method (continuous
auditing).
462
European Scientific Journal September 2014 /SPECIAL/ edition Vol.3 ISSN: 1857 – 7881 (Print) e - ISSN 1857- 7431
financial statements prepared under the paperless, real-time accounting systems. They
introduced CA as a concurrent audit technique to be used in extracting evidence as the
application systems processing occurs. The emerging of technology has changed the audit
approach form traditional manual process to a paperless. Under this consideration, Rezaee et
al., (2002, p.160) defined CA as a comprehensive electronic audit process that enable
auditors to provide some degree of assurance on continuous information simultaneously with,
or shortly after, the disclosure of information. They proposed data warehouses and data marts
to be created for separating audit evidence on a real time basis. Data captured by using CA
application are held in data marts for testing and analysis. In relation to secured transmission,
Onion (2003, cited in Majdalawieh et al., 2012, p. 310) proposed keystroke level data
examination to monitor the integrity of the data by introducing the Extensible Continuous
Auditing Language.
According to ISACA (2011) continuous auditing is a methodology or framework that
enables auditors to provide written results on the subject matter. The ability to report on
events in a real time or near real time environment can provide significant benefits to the
users of audit reports. The main differences between traditional audits and continuous
auditing are the shortened time to release reports. Majority of literatures assumed that
continuous audits are conducted online, however, it is important to note that continuous
auditing may be performed either online or offline subjected to internal or external audit
requirements (El- Masry and L. Reck, 2008, p.782)
The most accepted CA definition given by CICA/AICPA research report)
CICA/AICPA, (1999 cited in Majdalawieh and Zaghloul, 2009, p. 360) defined that CA is a
methodology that enables auditors to provide written assurance on a subject matter using a
series of auditor‘s report issued simultaneously with or a short period of time after the
occurrence of events underlying the subject matter. In this context, CA may have to rely on
the current technology such as broad bandwidth, web application server technology, web
scripting solutions and ubiquitous database management systems with standard connectivity
(Sarva, 2006).
Many studies addressing the feasibility of CA to reduce firm risks and increase
investor‘s confidence (El-Masry and Reck, 2008), capability to receive results of the audit
procedures almost immediately after their occurrence (Rezaee et. al., (2001, p. 151), capable
to test key controls on recurring basis by applying embedded audit modules software e.g
ACL (Daigle et al., 2008). In terms of red flag detection, Debreceny et al., (2003 cited in
Davidson et al., 2013, p. 45) suggested that sufficient understanding of business processes
and controls risks are required to implement CA systems in order to ensure that appropriate
red flags are generated.
As processing systems becomes more complex due to the expansion of business and
networks, the security of the system and of the system‘s internal controls becomes more
critical. Therefore, it is crucial for a continuous assessment for accuracy and reliability of the
systems and CA allows auditors to examine internal controls structure in a whole, provides
capability to perform audit more frequently and offers the ability to expand the scope and
magnitude within critical areas of the organisation, ACL (2006, cited in Majdalawieh et al.,
2012, p. 307). In this context, Chen (2004, cited in Moorthy et al., 2011, p. 3528) has
explored the use of strategic systems approach in CA implementation as it offers continuous
monitoring in a real time environment and capable to detect material errors in financial
transactions.
CA is also perceived to enhance corporate governance effectiveness (Warren and
Parker, 2003 cited in Davidson et al., 2013, p. 45). With the implementation of the
Sarbanese-Oxley (SOX) Act2002, many companies are now concern about the adequacy of
internal controls over the systems that produced financial information. Vasarhelyi et
463
European Scientific Journal September 2014 /SPECIAL/ edition Vol.3 ISSN: 1857 – 7881 (Print) e - ISSN 1857- 7431
al.,(2004, cited in Brown et al., 2007,p. 3) claimed that CA and analytic monitoring
techniques are capable to support the implementation of SOX (section 404) and Harrison
(2005, cited in Brown et al., 2007,p. 3) believed that CA techniques are the only way to
achieve compliance requirements of Federal regulations. In regards to SOX implementation,
El-Masry and Reck, 2008 confirmed that CA has significant impact on investors‘ perception
of firm risk and the value of a firm. The result of their study confirms that CA has positive
impacts on investor‘s perceptions of firm risk and investor confidence in their investing
decisions. In addition to investors‘ concern, CA is also able to satisfy the external parties of
organisation such as suppliers and the customer with real time information (Hao and Zhang,
2010, p.445)
One of the greatest advantages of CA is continuous assessment and the ability to
provide frequents report to decision makers (Hunton, et al., 2002 cited in Brown et al., 2007,
p.1), timely detection of abnormalities, thus allowing the management to adapt the strategic
planning process in order to deal with risks ( Ramaswamy & Leavins, 2007 cited in Charlton
and Marx, 2009, p. 50) and improve audit quality as CA is able to examine financial and
non financial information (Hao and Zhang, 2010, p.445). In addition, utilising CA provides
auditors to use advanced network technology and therefore can test larger samples or even
complete samples more efficient and effective than traditional audit. Under this
consideration, Groomer (2006, cited in Davidson et al., 2013, p. 45) claimed that CA can
eliminate statistical inferences.
While, the automation of evidence gathering process enables the auditor to reduce the
amount of time and cost in conducting examinations of transactions thus provides sufficient
time for auditors to understanding business processes and evaluate internal control structures.
In this sense, CA contributes to reduce audit risks (Rezaee et al., 2002, p. 151, Hao and
Zhang, 2010,p. 445).Under CA, auditor needs to employ a control risk oriented audit plan
which focus on the effectiveness and the sufficiency of internal controls activities, assess
inherent and control risks and a detail set of audit tests to be performed (Rezaee et al., 2002,
p. 151).
464
European Scientific Journal September 2014 /SPECIAL/ edition Vol.3 ISSN: 1857 – 7881 (Print) e - ISSN 1857- 7431
which is most relevant to the Section 404 of the Sarbanese/Oxley Act that require the
participation of managers and auditors to ensure the effectiveness and the efficiency of
controls over the firm‘s financial reporting processes. In this sense, Kogan et al., (1999, cited
in Alles et al., 2006, p. 138) highlighted the problem of CA implementation, either it is a
control oriented or data oriented as there are instances that process controls are not automated
or their settings are not readily accessible. In such environment, CA is perceived to be data
oriented where it works on automated substantive procedures and analytical procedures, and
involve manual procedures for testing controls.
Shin et al., (2013, p. 621), studied the implementation of the CA in the ERP-based
environment which involve significant role of CM in enhancing the effectiveness and
efficiency of auditing. They argued that CA system implementation can be divided into two
stages; 1) extraction of CM scenario and 2) the implementation of risks monitoring systems.
465
European Scientific Journal September 2014 /SPECIAL/ edition Vol.3 ISSN: 1857 – 7881 (Print) e - ISSN 1857- 7431
IS AUDIT PLANNING
IS Auditing Methodology
Continuous auditing and continuous
monitoring
IS Auditing Implementation/ Audit Procedures
- Assessment on the IT/IS project,
- Evaluation of application systems
- Review on the IT Governance
- Selection of samples
- Risk assessment analysis
- Assessment on service level
IS Reporting/Follow-up
-Internal and external communication on
sustainability of the IS implementation
Figure 2: is audit execution and reporting phase
application systems, IT Governance,
466
The final stage of the sustainability integration into IS auditing process are follow up
activities. The purpose of follow up is to ensure the implementation of sustainability into IS
projects or application system development or IT Governance is satisfactory.
Figure 3: Use of the CA/CM concept in defining and generating IS audit questions based on the sustainability
objectives
(FOR COMPLIANCE AUDIT)
IS Procedures
Personnel activated the The application systems The application The application
application systems and process transactions/ systems reconcile systems generates
input data input
transactions/input output
Audit objective To ensure appropriate controls are in place for input, process and output.
Sustainability strategic objective To ensure the continuity of IS operations
CA objective Transactions are generated timely and accurately.
467
European Scientific Journal September 2014 /SPECIAL/ edition Vol.3 ISSN: 1857 – 7881 (Print) e - ISSN 1857- 7431
as reducing the potential of IS project failure, cost overrun and project delayed. The adoption
of CA and its techniques could enhance audit works by providing objective information to
public.
Conclusion
This study has attempted to explore the use of CA techniques to provide advantage for
IS auditing implementation. As sustainability is becoming important issue in many
organisations, the integration of sustainability to IS audit work is crucial to produce reliable
and objective report to public. The application of CA to achieve sustainability strategic
objective in IS auditing is perceived to have advantage to auditors and have great impacts
upon the process of IS auditing, implementing audit procedures and audit assurance as a
whole.
The current study has provided a brief views from the initial investigation. Further
studies are necessary to explore how important of sustainability dimension in information
systems evaluation and how views and perceptions expressed in applying CA as part of audit
methods in compliance and performance auditing.
References:
Abdolmohammadi, M.J. and Boss, S. R. (2011) ‗Factors associated with IT audits by the
internal function‘, International Journal of Accounting Information Systems, 11, pp. 140–151
Afgan, H. N., Andre, P. and Carralho, G.M. (2006) ‗Sustainability: the management system
property‘ PICMET Proceedings, Istanbul, Turkey, 9 to 13 July 2006.
Alles, M.G., Kogan, A. and Vasarhelyi, M.A. (2008) ‗Putting Continuous Auditing theory
into practice: lesson from two pilot implementations‘, Journal of Information Systems, 22 (2),
pp.195-214
Ali, M. and Bailur, S. (2007) ‗The challenge of sustainability In ICT4D –Is bricolage The
Answer?‘ Proceedings of the 9th International Conference on Social Implications of
Computers in Developing Countries, Sao Paulo, Brazil, May 2007
Amancei, C.and Surcel, T. (2010) ‗Increasing the efficiency of IT audit methodology
by using the organizations tolerance to IT systems availability‘, Informatica Ecomicá , 14(1),
pp.49-56
Bierstaker, J.L., Burnaby, P. and Thibodeau, J. (2001) ‗The impact of information technology
on the audit process: an assessment of the state of the art and implications for the future‘,
Managerial Auditing Journal, 16(3), pp. 159-164
Brown, C. E., Wong, J.A.andBaldwin, A.A. (2007) ‗Research streams in continuous audit: a
review and analysis of the existing literature‘, Journal of Emerging Technologies in
Accounting, pp. 1-28
Burrowes, A. and Persson, M. (2000) „The Swedish management audit: a precedent for
performance and value for money audits‘, Managerial Auditing Journal, 15(3), pp. 85-96
Carter, C. R. and Rogers, D. S. (2008) ‗A framework of sustainable supply chain
management: moving toward new theory‘, International Journal of Physical Distribution &
Logistics Management, 38( 5), pp. 360-387
Charlton, G. and Marx, B. (2009) ‗An investigation into the impact of continuous auditing on
the external auditors of the four largest banks in South Africa‘, South Africa Journal of
Accounting Research, 23(1), pp.45-65
Chen, D.Q., Mocker, M., Preston, D.S. and Teubner, A. (2010) ‗Information system strategy:
reconceptualization, measurement and implication‘, MIS Quarterly, 34 (2), pp. 233-259
468
European Scientific Journal September 2014 /SPECIAL/ edition Vol.3 ISSN: 1857 – 7881 (Print) e - ISSN 1857- 7431
469
European Scientific Journal September 2014 /SPECIAL/ edition Vol.3 ISSN: 1857 – 7881 (Print) e - ISSN 1857- 7431
Heine, M.L., Grover, and Malhotra, M.K. (2003) ‗The relationship between technology and
performance: a meta-analysis of technology models‘, The International Journal of
Management Science, 31(3), pp. 189-204.
ISACA Standards Board (2002), ‗Continuous Auditing: Is It Fantasy or Reality?,‘
Information Systems Control Journal, 5, pp.1-4
ISACA White Paper (2011) ‗ Sustainability‘, Information Systems Control Journal, pp.1-13
Jin‘e, Y. and Dunjia, L. (1997) „Performance audit in the service of internal audit‘,
Managerial Auditing Journal, (12) 4, pp. 192-195
Jaca, C., Viles, E., Mateo, R. and Santos, J. (2012) ‗Component of sustainable improvement
systems: theory and practice‘, The TQM Journal, 24 (2), pp.142-154
Kimaro, H.C. and Nhampossa, J.L. (2007) ‗The challenges of sustainability of Health
Information Systems in developing countries: comparative case studies of Mozambique and
Tanzania‘, Journal of Health Informatics in Developing Countries, 1(1), pp. 1-10
Kogan, A., Sudit, E. F. and Vasarhelyi, M.A. (1999) ‗Continuous online auditing: a program
of research‘, Journal of Information Systems, (13) 2, pp. 87–103
Korte, M., Lee, K. and Fung, C.C. (2012) ‗Sustainability in Information Systems:
requirements and emerging technologies‘, IEEE, 2012 International Conference on
Innovation, Management and Technology Research (ICIMTR2012), Malacca, Malaysia, 21
to 22 May 2012, pp. 481-485
Leidner, D.E, Lo, J. and Preston, D. (2011) ‗An empirical investigation of the relationship of
IS strategy with firm performance‘, Journal of Strategic Information Systems, 20 (9), pp.
419-437
Lagsten, J. and Goldkuhl, G. (2008) ‗Interpretative IS evaluation: results and uses‘, The
Electronic Journal Information Systems Evaluation, 11(2), pp. 97- 108
Mahzan, N. and Veerankutty, F. (2011) ‗IT auditing activities of public auditors in Malaysia‘.
African Journal of Business Management, 5(5), pp.1551-1563.
Marks, N. (2010) ‗Continuous auditing reexamined‘, ISACA Journal, 1, pp. 1-5
Majdalawieh, M. and Zaghloul, I. (2008) ‗Paradigm shift in information systems auditing‘,
Managerial Auditing Journal, 24(4), pp. 352-367.
Majdalawiedh, M., Sahraoui, S., Barkhi, R. (2012) ‗Intra/inter Process Continuous Auditing
(IIPCA), Integrating CA Within an Enterprise System Environment‘, Business Process
Management Journal, 18(2), pp. 304-327.
Mat Nayan, M., Badioze, Z.H. and Tengku Sembuk, T.M. (2010) ‗Defining information
system failure in Malaysia: results from Delphi technique, 7(10), IEEE, pp.1616-1621
Mc Manus, J. and Harper, T.W. (Autumn 2007) ‗Understanding the sources of information
systems project failure‘, Management Services, 51(3), pp. 38-43
Melville, N.P. and Ross, S.M. (2010) ‗Information system innovation for environmental
sustainability‟, MIS Quarterly, 34(1), pp. 1-21.
Millar, C., Hind, P. and Magala S. (2012) ‗Sustainability and need for change: organisational
change and transformational vision‘, Journal of Organizational Change Management‟,
25(4), pp. 489-500
Moorthy, M. K., Seetharaman, A ., Mohamed, Z., Gopalan, M. and San L.H. (2011) ‗The
impact of information technology on internal auditing‘, African Journal of Business
Management, 5(9), pp. 3523-3539
Nicho, M. and Cusack, B. (2007) ‗A metrics generation model for measuring the control
objectives of information systems audit‘ IEEEProceeding of the 40th Hawaii International
Conference on System Science, 2007
470
European Scientific Journal September 2014 /SPECIAL/ edition Vol.3 ISSN: 1857 – 7881 (Print) e - ISSN 1857- 7431
471
European Scientific Journal September 2014 /SPECIAL/ edition Vol.3 ISSN: 1857 – 7881 (Print) e - ISSN 1857- 7431
The International Standards of Supreme Audit Institutions \ (1997) ISSAI 3000: Standards
and Guidelines for performance audit based on INTOSAI‟s auditing standards and practical
experienceAvailable at: http/www.intosai.org (Accessed: 20 Jan 2013)
Todorov V. and Marinova D. (2010)‗Information Theory Perspective on Modelling
Sustainability‘, IEEE Proceedings of the 43rd Hawaii International Conference on System
Sciences, 2010, pp.1-10
Wanyama, I. (2011) ‗Stakeholder perception of information systems development success in
the public sector‘, Management Science and Engineering, 5(2), pp.31-41
Yang, D.C. and Guan, L. (2004) „The evolution of it auditing and internal control standards
in financial management audit‘, Managerial Auditing Journal, 19 (4), pp. 544-555
Zheng, H., Chanaron, J.J., You, J. and Chen, X. (2009) ‗Designing a key performance
indicator system for technological innovation audit at firm‘s level: a framework and an
empirical study‘, IEEE, 8(9), pp.1-5
472