The Impact of Information Systems On User Performance: An Exploratory Study
The Impact of Information Systems On User Performance: An Exploratory Study
The Impact of Information Systems On User Performance: An Exploratory Study
Introduction
Literature Review
examine in detail the impact of the quality of the performance of the user. For
example, Butler [13] stated that the response time of the system is very critical
for the performance user; the results show that the response time of the system
positively affects user performance and other factors on the quality of system
such as accuracy and reliability.
Researchers have attempted to control these factors more deeply
to identify their impact on user performance more accurately. For example,
Wierschem and Brodnax [69] identified the impact of improvements in the
treatment of personal computers processors speeds on user productivity.
A controlled laboratory experiment was conducted to measure the
impact of the speed of the processor on the output of the students. Based on
the results of the experiment, it was found that the productivity of the end
user, as measured by an increase in the volume of work is improved.
These studies have established very important conclusions on certain
factors and their interactions that affect the performance of the user, such as
the use of the system, system quality and reliability. In addition, they have
improved the previous models and have developed more comprehensive
models and conducted new empirical investigations on the impact of
information systems on user performance.
Some previous research on the performance of users relied on
dispositional factors such as attitudes and intention to use, to examine the
impact of information systems and predict user performance [41], which
leads to more conclusive debate and ambiguity. However, Sears and Jacko [58]
studied the effects of situational factors on the performance of the user. They
have established close links between the system, the task, satisfaction and
performance. In the same vein, Hossain et al. [37] relied on the psychological
traits of users in order to study the impact of information systems for clients
on user performance. The results show the significant impact of traits on the
relationship between information systems and performance users.
Empirically, the results show that TTF factors directly affect the
performance [42]. In other words, the capacity of the system can affect the
perceived usefulness in improving user interaction with the system. In this
sense the system’s ease of use, perceived usefulness and perceived ease of use
are linked together [60]. For example, a high quality system provides faster
response to users, leading to improvements in the perceived usefulness and
performance [46].
Finally, it is worth mentioning that the level of the relationship
between all the factors mentioned above differs from SI environment to
another, depending on the characteristics of the system and the user. However,
in developing the study design, the factors were chosen deliberately systems.
Overall, the factors were chosen with reference to a wide range of studies and
their use in information systems and user performance. From this we posit
that:
H1: The TTF affects user performance directly and indirectly through
perceived usefulness and ease of use in organizations.
H1a: The TTF directly affects user performance in organizations.
H1b: The TTF indirectly affects user performance in organizations
through perceived usefulness.
H1c: The TTF indirectly affects user performance in organizations
through the perceived ease of use.
Information Quality:
The literature on information quality reflects the existence of a number
of views on what constitutes the attributes of information. A large number of
empirical studies have been conducted to develop a framework for measuring
the quality of information [67- 39], from the many characteristics identified
by Bailey and Pearson (1983) such as accuracy, precision, currency, timeliness,
completeness, conciseness, format and relevance. Confirming the previous
frame, Watson and Shneider [68] identified five characteristics of information
quality are accuracy, timeliness, conciseness, convenience and relevance.
In this sense, Huang and Wang [39] have conducted a series of studies on
information quality and have used the accuracy, relevance and accessibility.
Miller [51] used usefulness, accuracy, timeliness and relevancy to measure
the information quality, while Alka [1] used the clarity, relevance, accuracy
and timeliness of research users. Similarly, Bovee (2004), used the relevance,
interpretability, accuracy and accessibility.
Issue 2,
The Impact of Information Systems on user Performance: An Exploratory Study
April, 2013
System Quality:
The measurement of the quality of information systems is a
multidimensional process focusing on different aspects, because a system has
many aspects such as system aspects, quality aspects and other aspects related
to technical issues. In general, the measure of system quality concentrates on
the specifications of a target system. However, some studies have examined the
benefits and use of the system and its efficiency. Some studies have used the
reliability, response time and ease of use as mentioned in various researches to
support ERP users to perform several tasks at the same time and for different
purposes [2].
Typical measures of the system quality in the traditional studies
include system stability, availability, response time and ease of use [71]. In
this context, it should be noted that researchers used different measures to
investigate the system quality depending on the nature of the research and its
objectives. Some studies have focused on the technical aspects of the system,
while others focus on system performance and its ability to provide quality
information. However, most studies have many similar measures. According
to DeLone and McLean [22] quality system is measured by the perceived
ease of use, reliability, functionality, flexibility, data quality, integration and
Issue 2, Scientific Papers (www.scientificpapers.org)
April, 2013 Journal of Knowledge Management, Economics and Information Technology
User performance:
There are different points of view on user performance. It can simply
be considered as the set of results achieved. On the individual level, it is the set
of a person’s realizations [61- 6- 9].
Measuring performance is normally achieved by aspects such as
speed, time, accuracy, efficiency and effectiveness [26]. Nevertheless, when it
comes to work-based software, it is important that systems are able to provide
people with information so they can work and make decisions [62]. This
success is measured in terms of speed and accuracy of obtaining the necessary
information to users from a system to accomplish their [26].
Some researchers have indicated that the performance can be
evaluated using two performance measures namely productivity and quality
Issue 2, Scientific Papers (www.scientificpapers.org)
April, 2013 Journal of Knowledge Management, Economics and Information Technology
Research Methodology
Analysis of results
Factorial analysis:
The exploratory analysis was conducted in SPSS 17. The dimensionality
of the scales was assessed by a principal component analysis (PCA) with
varimax rotation. Four items were eliminated Complet2, Resptime2, Effectiv5
and Efficien1. These are items whose contributions are shared between several
axes or those with low contributions factor [32]. Measurement instruments
have good psychometric qualities. All items selected are generally good factorial
contributions. Reliability and internal consistency of the items constituting a
single dimension were evaluated based on Cronbach’s alpha. All variables in
the model have good Cronbach’s alpha coefficients. Appendice 2 provides a
tabulated summary of the main results of the exploratory analysis.
In a second phase, a confirmatory factorial analysis was performed
in 18 Amos to test construct convergent and discriminant validities. At the
conclusion of this step, the analysis of construct validity yield acceptable
results. Table 1 summarizes the adjustment indices that can be considered
good, given the complexity of the model and the size of the relatively small
sample [56]. The first index (Chi-2/ddl) satisfies the threshold advocated 2 to
5. The RMSEA is less than the threshold limit of 0.08. CFI and TLI are above
the critical threshold of 0.9. The GFI and AGFI are satisfactory insofar as their
values are close to the recommended threshold of 0.9. These values may be due
to the sensitivity of these indicators to the number of parameters to estimate
and the sample size [32- 56]. The adjustment of the measurement model is
therefore considered satisfactory (GFI = 0.887, AGFI = 0.841, CFI = 0.938, TLI
= 0.925, RMSEA = 0.049 and RMR = 0.045).
At this level, the causality of this model allows the validation of all the
assumptions of our research work. Indeed, Table (2) shows that all causal links
are significant at the 5% level.
Table 3: Direct, indirect, and total effects at the level of causal model
Structural links Direct Indi- Total
effects rect effects
effects
TTF User performance 0,236 0,144 0,380
TTF Perceived usefulness 0,277 0,000 0,277
TTF Perceived ease of use 0,357 0,000 0,357
System Quality User performance 0,190 0,105 0,295
System Quality Perceived usefulness 0,221 0,000 0,221
System Quality Perceived ease of use 0,238 0,000 0,238
Information Quality User perfor- 0,307 0,179 0,486
mance
Information Quality Perceived use- 0,407 0,000 0,407
fulness
Information Quality Perceived ease 0,369 0,000 0,369
of use
Perceived usefulness User perfor- 0,246 0,000 0,246
mance
Issue 2, Scientific Papers (www.scientificpapers.org)
April, 2013 Journal of Knowledge Management, Economics and Information Technology
The indirect effect of the FTT, system quality and information quality
divided by the performance of users through perceived usefulness and perceived
Issue 2,
The Impact of Information Systems on user Performance: An Exploratory Study
April, 2013
ease of use is positive and significant. This result shows the mediating role of
perceived usefulness and perceived ease of use.
Discussion of results
Conclusions
important role in improving the performance quality and increase the volume
of users work. The results showed a satisfactory level of adjustment between IS
and users needs and task requirements, taking into account the characteristics
of IS.
Furthermore, perceived usefulness and perceived ease of use have
proven to be very important factors that affect the use of the system and
mitigate the impact on user performance. This is an opportunity for researchers
and practitioners in IS to maximize IS impacts by improving training and
organizational support in order to help users understand the benefits of using
IS and improving adaptability of these systems with user needs.
Careful consideration of user needs and requirements of working in
a particular industry will help designers and practitioners of IS design and
implement IS in the light of the diversity of suppliers, designers, functionality
of IS and industries [72].
In spite of insights provided by the results of this research and
managerial implications arising, some limitations should be noted. Some
measurement scales of variables could be improved, including scales
measuring perceived usefulness and perceived ease of use. Another limitation
is inherent in the non-consideration of the characteristics of users to measure
users’ performance based on sex, age, and experience.
In addition, most areas of research require further developments.
Studying the impact of user characteristics on individual performance seems
interesting.
References
and user performance”, Information & Management, 30, 1996, pp. 65-73.
[6] Armstrong, H., and Baron, A. “Performance Management”,2002,London: Institute
of Personnel and Development.
[7] Ballou, D., and Tayi, G. “Methodology for ailocating resources for data quality
enhancement”,Communications of the ACM, 32(3), 1989, p. 320.
[8] Barua, A., Kriebel, C, and T, M. “Information technologies and business value-an
analytic and empirical investigation”, Information Systems Research, 6(1), 1995, pp.
3-23.
[9] Bat, R., and Helton, E. “Computerized Performance”, Human Resource Management
Review, Winter, 1995, pp. 267-288.
[10] Bernroider, E. “IT governance for enterprise resource planning supported by the
DeLone-McLean model of information Systems success”, Information & Management,
45, 2008, pp. 257-269.
[11] Bhattacherjee, A. “Individual trust in online firms: scale development and initial
test”, Journal of Management and Information Systems, 9(1), 2002, pp. 211-241.
[12] Bovee, M. “Information Quality: A Conceptual framework and Empirical
Validation”,2004, Unpublished PhD Dissertation, University of Kansas, Kansas.
[13] Butler, T. “Computer Response Time and Use Performance”,1983, Paper presented at
the Proceedings of ACM SIGCHI ‘8, Conférence on Human Factors in Computer Systems,
CM SIGCHI 83.
[14] Chan, H., Siau, K., and Wei, K. “The Effect of Data Model, System and Task
Characteristics on User Query Performance -An Empirica! Study”,The DATA BASE
forAdvances in Information Systems 29 (1), 1998, pp. 31-49.
[15] Chang, H. “Task-technology fit and user acceptance of online auction”,International
Journal of Human-Computer Studies, 68(1-2), 2010, pp. 69-89.
[16] Churchill G.A. “A Paradigm for Developing Better Measures of Marketing
Constructs”, Journal of Marketing Research, 16, February, 1979, pp. 64-73.
[17] Cohen, S. “What makes teams work: Group Effectiveness?”, Journal of Management
and Information Systems, 23(3), 1997, pp. 230-290.
[18] Cykana, P., Paul, A., and Stern, M. “DoD guidellnes on data quality management”,Paper
presented at the Proceedings of the 1996 Conférence on Information Quality,
Cambridge.
[19] Davis, F. “Perceived usefulness, perceived ease of use, and user acceptance of
information technology”, Management Information System Quarterly 13(Sep), 1989,
pp. 318-340.
[20] Delone, W., and McLean, E. “Information Systems success: the quest for the
dépendent variable”, Information Systems research 3(1), 1992, pp. 60-95.
Issue 2,
The Impact of Information Systems on user Performance: An Exploratory Study
April, 2013
[21] Delone, W., and McLean, E. “Information Systems success: the quest for the
dépendent variable”, Information Systems research 3(1), 1992, pp. 60-95.
[22] DeLone, W., and McLean, E. “The DeLone McLean mode! of information system
success: a ten-year update”, Journal of Management Information Systems, 19(4), 2003,
pp. 3-9.
[23] Dishaw, T., Strong, D., and Bandy, B. “Extending the task technology fit model
with self efficacy constructs”,Paper presented at the Eighth Americas Conférence on
Information Systems, 2002.
[24] Esteves, J., and Coilado, P. “Towards the Unification of Crîtical Success Factors for
ERP Implementations”, Annual Business Information Technology Paper presented at
the 10 (BIT) 2000 Conférence, Manchester.
[25] Fiona, F., and Nah, G. “Enterprise Resource Planning Solutions and Management”,
2002, Hershey: Hershey IRM Press.
[26] Ford, G., and Gelderblom, H. “The Effects of Culture on the performance achieved
through the use of human computer interaction”, 2003, Paper presented at the
Proceeding of SAICSIT, SAICSIT.
[27] Goodhue, D., and Thompson, R. “Task-technology fit and individual
performance”,MIS Quarterly, 19(2), 1995, pp. 213-233.
[28] Goodhue, D., Klein, B, and March, S. “User évaluations of IS as surrogates for
objective performance”,Information & Management, 38, 2000, pp. 87-101.
[29] Grant, D., Hall, R., Wailes, N., and Wright, C. “The false promise of technological
determinism: the case of enterprise resource planning Systems”, New Technology, Work
and Employment, 21(1), 2006, pp. 2-15.
[30] Guimaraes, T, Staples, S., and McKeen, J. “Assessing the Impact From Information
Systems Quality”, The Quality Management Journal, 74(1), 2007, pp. 15-30.
[31] Gupta, M., and Kohli, A. “Enterprise resource planning Systems and its implications
for opérations function. Technovation, 26, 2006, pp. 687-696.
[32] Hair J.F., Black B., Babin B., Anderson R.E., Tatham R.L., “Multivariate data
analysis”, Prentice-Hall, 6ème ed, 2005, 928 Pages.
[33] Hamilton, S., and Chervany, N. “Evaluating Information System effectiveness”, Part
1, Comparing Evaluation Approaches, MIS Quarterly, 5(3), 1981, pp. 55-69.
[34] Hayes, D., Hunton, J., and Reck, J. “Market reactions to ERP implementation
announcements”,Journal of Information Systems,, 75(1), 2001, pp. 3-18.
[35] Hendricks, K., Singhal, V, and Stratman, J. “The impact of enterprise Systems on
corporate performance; A study of ERP, SCM, and CRM system implementations”,
Journal of Opération Management, 25, 2007, pp. 65-82.
[36] Hodgkinson, A. “Productivity measurement and enterprise bargaining - the local
Issue 2, Scientific Papers (www.scientificpapers.org)
April, 2013 Journal of Knowledge Management, Economics and Information Technology
[66] Venkatesh, V., and Davis, F. “A theoretical extension of the technology acceptance
model: Four longitudinal field studies”, Management Science, 46(2), 2000, pp. 186-205.
[67] Wang, R., and Strong, D. “Beyond accuracy: What data quality. means to data
consumers”, Journal on Management of Information Systems, 12(4), 1996, pp. 5-34.
[68] Watson, E., and Schneider, H. “Using ERP in éducation”, Communications of AIS,
1(9), 1999, pp. 12-24.
[69] Wierschem, D., C, and Brodnax, T., L “The Impact of Computer Processor Speed
on End-User Productivity”, Journal of End User Computing, 15(2), 2003, pp. 23-36.
[70] Wixom, B., & Watson, H. “An empirical investigation of the factors affecting data
warehousing success”, MIS Quarterly, 25(1), 2001, pp. 17-41.
[71] Wu, J., and Wang, W. “Measuring KMS success: A respecification of the DeLone
and McLean’s model”, Information & Management, 43(6), 2006, pp. 728-739.
[72] Yen, D. C, Wu, C.-S., Cheng, F.-F., and Huang, Y.-W. “Déterminants of users
intention to adopt wireless technology: An empirical study by integrating TTF with
TAM”, Computers in Human Behavior, In Press, 2010, Corrected Proof.
[73] Yusuf, A., Gunasekaran, and Abthorpe, M. “Enterprise information Systems
project implementation: A case study of ERP in Rolls-Royce”, International Journal of
Production Economies, 87, 2004, pp. 251-266.
[74] Zhang, Z., Lee, M., Huang, P., Zhang, L, and Huang, X. “A framework of ERP
Systems implementation success in China: An empirical study”, International Journal
of Production Economies 98, 2005, pp. 56-80.
Issue 2,
The Impact of Information Systems on user Performance: An Exploratory Study
April, 2013
Source Wixom and Todd, 2005; DeLone and McLean, 2003; Abugabah and
al., 2009 ; McGill and al., 2003
System Reli- Your IS is reliable Reliab1
quality ability Your IS provides consistent information. Reliab2
Cor- You find easier to correct your errors in your work with Correct1
rect- your IS.
ness Your IS helps you to reduce errors in your work. Correct2
Re- Your IS reacts and responds quickly when you entered Resptim1
sponse data.
time IS reacts and responds quickly to your questions. Resptim2
Inte- IS provides integration with other systems. Integr1
gration Your IS effectively combines data from different areas of Integr2
the business.
Your IS is designed for all levels of users. Integr3
Source Wixom and Todd, 2005; Abugabah and al., 2009 ; DeLone and
McLean, 2003; McGill and al., 2003
Per- The use of IS is useful for the performance of your work. Percuse1
ceived I can not do your job without IS. Percuse2
useful-
ness Your IS supports you in achieving the overall objectives Percuse3
of performance.
With your IS, it is easier to do your job Percuse4
Source Davis,1989; Ahn and al.,2007; Amoako-Gyampah, 2007 ; King and
He, 2006.
Per- Your IS is user friendly. Perceas1
ceived It is easy to learn to use your IS. Perceas2
ease of
use You find your IS easy to use. Perceas3
Source Davis, 1989; Kositanurit and al., 2006; Staples and Seddon, 2004 ;
Kositanurit and al., 2011 .
Issue 2,
The Impact of Information Systems on user Performance: An Exploratory Study
April, 2013