Three Approaches As Pillars For Interpretive Information Systems Research: Development Research, Action Research and Grounded Theory
Three Approaches As Pillars For Interpretive Information Systems Research: Development Research, Action Research and Grounded Theory
Three Approaches As Pillars For Interpretive Information Systems Research: Development Research, Action Research and Grounded Theory
1. INTRODUCTION
Research design, paradigms and methods are under the spotlight in the Computing discipline, particularly in the domain
of Information Systems (IS) [Baskerville, 1999; Baskerville & Wood-Harper, 1996; Cockton, 2004; du Plooy, 2004;
Glass, Ramesh & Vessey, 2004; Myers, 2004; Pather & Remenyi, 2004; Roode, 2003; 2004; Travis, 1999; Walsham
1995a; 1995b; Wood-Harper, 1985]. With the increase of ‘interpretivist’ research, a perspective emanating from the
social sciences, this paper addresses practical approaches and models to operationalise interpretive research in IS.
Three candidate approaches with methodological rigour, are proposed, namely: development research, action research,
and grounded theory.
________________________________________________________________________________________________
Author Addresses:
M.R. de Villiers, School of Computing, University of South Africa, P O Box 392, UNISA, 0003, South Africa; [email protected].
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that the copies are
not made or distributed for profit or commercial advantage, that the copies bear this notice and the full citation on the first page. Copyrights for
components of this work owned by others than SAICSIT or the ACM must be honoured. Abstracting with credit is permitted. To copy otherwise, to
republish, to post on servers, or to redistribute to lists, requires prior specific permission and/or a fee.
© 2005 SAICSIT
Quantitative
Mathematical modeling and
Qualitative
Surveys: Questionnaires
Controlled experiments
Quasi experiments
Field experiments
Theorem proving
Documents and
artefact studies
and interviews
Focus groups
Ethnography
Case studies
Observation
simulation
Testing
Positivist Interpretivist
Walsham [1995b] and O’Donovan and Roode [2002] attach importance to the editorial policy shift in the journal
MIS Quarterly, which has expanded its range of research by explicitly calling for papers based on interpretive or
integrated, as well as positivist, approaches.
This tendency of IS to take cognizance of human behaviour and to use evaluative approaches is notable. There is a
current gravitation, particularly in the HCI subdiscipline, towards user-centric systems, usability support for personal
computing, and the empowerment of domains beyond business and management information systems. Systems are
being developed to bridge the digital divide, to offer accessible computer technology, as well as emerging technology
and development software for the previously technologically-disenfranchised.
Much of the IS research done, is for postgraduate study. Du Plooy [2004] and Roode [2004] held a seminar relating
to non-positivist IS research methodologies, with particular reference to doctoral studies. Du Plooy [2004] notes
concerns, describing IS research as a ‘maturing science’ and a ‘fragmented adhocracy’ lacking theory and methods,
which does not fit neatly into the positivist paradigm, especially when qualitative methods are used. IS places a major
focus on the unique qualities of information itself, as occurs during enquiry into design, management decisions, and
social processes. Du Plooy suggests that academic IS research is often geared to the target audience of the dissertation
examiner, rather than the IS community, and that results seldom reach IS practitioners. His consequent axiology of
relevancy posits that interpretive research is typically weak in clear proposals on how to improve practice and that most
IS research shies away from value-laden research issues. PhD students should address practical problems, using sound
interpretive and evaluative approaches based on methods such as field studies, semi-structured and unstructured
interviews, and ethnographic data. Analysis should be conducted using, for example, grounded theory, hermeneutics, or
critical social theory, all of which contribute to the production and refinement of theoretical frameworks [du Plooy,
2004]. In line with his notable editorial [Roode, 2003:1] proposing ‘acceptance of interpretivist research on a semi-
equal footing with positivist research’, Roode [2004], referring to Hirschheim and Klein [2000], addresses the
intellectual state of IS research, with its internal and external views. The internal view of the IS research community
indicates fragmentation, particularly due to the paradigm war between interpretivists and positivists. The external view
relates to the gap between IS research and industry expectations, where current research is insufficiently relevant to
practice and links between academia and industry are inadequate. Research outputs produce a plethora of ad hoc
findings, yet lack generality and pluralism nor do they broaden theoretical constructs. Roode promotes a broadened
notion of relevancy. While the accepted scientific method – entailing hypethetico-deductive studies – is relevant, non-
positivist forms of scholarly research should not be excluded.
Regarding postgraduate research in general, Mouton [2001] points out the multidisciplinary and heterogeneous
nature of current knowledge. He further cites methodological difficulties as a major factor in the non-completion of
postgraduate studies.
In this milieu, the contribution of the present paper is to suggest three practical, methodologically- and theoretically
sound approaches for conducting interpretive research in IS. Each emanated from the social sciences and humanities,
yet is applicable to research in computing disciplines, where the design of human-computer interaction is highly
relevant in a society and economy increasingly geared to user-centric values. The approaches are applicable to
postgraduate studies, as well as to basic, ad hoc and contract forms of IS research.
With the acknowledgement that computing has human and sociological, as well as technological and computational
dimensions, particularly in Sub-Saharan Africa with its technologically-unempowered groups, research methods from
the interpretivist paradigm have a definititive role to play. Preece et al [2002] distinguish between the usability and user
experience of software systems. The latter, in particular, lends itself to interpretive and qualitative analysis.
This section of the paper describes, discusses and illustrates development research, action research, and grounded
theory, and their application in interpretive IS research. Each of the three has associated methods and techniques to
operationalise it. The proposals culminate in a diagrammatic ‘Pillars Proposal’ for IS Research.
4.1.3 Epistemology of DR
Development research has a pragmatic epistemology as it acknowledges collaborative shaping by researchers and
practitioners. Van den Akker [1999], describing the knowledge acquired from DR, distinguishes between:
─ Substantive design principles, relating to the generic characteristics of suitable interventions or products.
─ Methodological aspects, with a procedural emphasis, suggesting optimal development processes.
In formative research a great deal of such knowledge is inductively extracted from the experience of using and
evaluating the prototype developed for the study. This provides a link between the two branches of the dual
development focus, namely the developing solution to a specific problem and the evolution of generalisable design
principles. The experiential evidence obtained from studying the prototype in use in its various iterations, is enhanced
when integrated with theoretical arguments.
also been used for computer-based support materials, and is relevant to computer science and engineering as well for
generating hardware solutions and associated generic principles.
Figure 2 is a generic model of the DR process. Its iterative phases can be effectively used to structure an IS
research process, providing continuity and cohesiveness.
implementation
Solution
D evelopm ent
( im m ediate
D esign used as
outcom e )
solution , D evelop intervention
Problem
based on (prototype )
analysis
theoretical solution
fram ework Evaluate and General design
reflection
test principles ( distant
outcom es )
Figure 2 Development research model (synthesized by the author, influnced by Plomp [2002] and Reeves [2000])
Observe and
evaluate
Observe and
evaluate
Researcher
Plan
Plan response
Diagnose
case of qualitative, it is essential that it be systematically collected, analysed and coded. Defined sets of methods
should be applied so that a grounded theory emerges systematically and inductively through covariant ongoing
collection and analysis. Lincoln & Guba [1985] state that a GT is adjusted, expanded, and refined via this ongoing
process.
As with AR, there is a parallel from the social professions. The notion of emerging patterns has an analogy in
Christopher Alexander’s patterns within architecture and town planning, which form practical architectural languages,
as physical and social relationships articulate themselves [Alexander, Ishikawa & Silverstein, 1977]. Within a pattern
language, it is also possible to integrate overlapping patterns in a densifying process, which provides added meaning.
The four criteria for a well-constructed grounded theory within a substantive area are:
Fit: its categories and their properties should fit the realities being studied.
Work: in order to work, it should explain variations in behaviour.
Relevance: this is achieved when a grounded theory both fits and works.
Modifiability: the emerging theory is open to adaptation as new data and variations are integrated.
4.3.3 Epistemology of GT
The researcher’s bias and subjectivity may influence conceptualization and interpretations. However, grounded theory
has built-in mechanisms to prevent this, such as constant comparison, saturation and core relevance [Glaser, 1992].
Furthermore, data collection, analysis and presentation to peers should be linked at each step, adjusting one another to
the emergent theory and preventing forcing.
The Glaser model posits, contentiously, that so as not to force or make preconceptions, there is little initial need to
review literature. Once the emerging theory is sufficiently grounded in core variables, literature reviews in the
substantive field can commence and be related to the new work. Where new fields are opened the researcher, according
to Glaser, is a ‘pre-empting pioneer’, producing a new general theory to be integrated with other literature. Scholarship
starts and expands as the emerging grounded theory develops. Glaser claims that this approach also obviates the
problem of more and more to read and less time to do!
Systematic
Context: data in collection and
substantive area Discovery refinement Saturation
constant Emergent
Properties
inductive comparative testing theory
analysis coding for fit and
Hypothesis principles
Relationships
New data
mobility between
collection and
analysis
Pedim ent :
Interpretivist I S Research
5 CONCLUSION
Certain research issues are best suited to interpretive and context-dependent approaches. For situations where human
performance and social inquiry are relevant, this paper suggests three approaches, or models, as proposed pillars to
operationalise the interpretivist research paradigm. Development research, action research and grounded theory all
provide theoretical frameworks and methodologies to guide a research project, providing internal continuity and
consistency as the study progresses. When one of these approaches is used as a model, the activities, relationships, and
reasoning entailed in the research process should be explicitly linked to the selected approach, so that its framework
dictates the steps. Regular textual and diagrammatic reference to the model in the written document can enhance the
study, providing a unifying thread, both for the researcher and the readers.
I have used (or am in the process of using) each of the three – personally or with students – after literature
encounters had indicated its suitability for the study in hand. Enriched by reflection and experiential knowledge, I
undertook further in-depth literature surveys, which confirmed the utility of the approaches. The literature also
mentions other interpretive means such as case studies, critical theory, descriptive studies, document analysis,
ethnography, field studies, focus groups, hermeneutics, phenomenology, role play and semiotics [du Plooy, 2004;
Olivier, 2004; Travis, 1999; Walsham, 1995a; 1995b]. However, action research and grounded theory are consistently
advocated. One of the sources studied was Michael Myers’ detailed, hyperlinked overview of Qualitative Research in
Information Systems [Myers, 2004], which converges closely with the present independent suggestions. He
recommends the approaches of (i) action research, (ii) case studies, (iii) ethnography and (iv) grounded theory. The
first and the fourth confirm two of the present pillars, while the both the second (case studies) and the third
(ethnography), relating to field-based and contextual studies, can be used as methods within the pillars proposed here.
However, the development research pillar appears to be unique to this present study, and holds high utility for future
application in information systems research.
The advent of personal computing and the emergence of the HCI subdiscipline are changing the nature of
information systems and hence the forms of IS research. The findings of academic research and real-world best practice
should inform each other. The social inquiry research approaches outlined in this paper have the potential to impact on
performance in interactive computing systems. Findings should contribute to development theories and real-world
systems, should generate design principles and evaluation criteria, should encourage sound interaction practices, and
can help to support bridges over the digital divide.
Note: For some who may be unfamiliar with terminology, a few words are explained in a glossary after the references.
6 REFERENCES
ALEXANDER, C., ISHIKAWA, S. and SILVERSTEIN, M. 1977. A Pattern Language. New York: Oxford University Press.
BASKERVILLE, R.L. 1999. Investigating Information Systems with Action Research. Communications of the Association for Information Systems,
2 (Article 19) http://cais.isworld.org/articles/2-19/
BASKERVILLE, R.L. and WOOD-HARPER, A.T. 1996. A Critical Perspective on Action Research as a Method for Information Systems Research.
Journal of Information Technology 11:235-246.
CONRADIE, M.M. and DE VILLIERS, M.R. 2004. Electronic assessment of free text: a development research initiative. South African Journal of
Higher Education 18(2): 172-188.
COCKTON, G. 2004. A tutorial: Grounded Design and HCI. September 2004. Pretoria: University of South Africa.
COHEN, L., MANION, L. and MORRISON, K. 2000. Research Methods in Education. (5th ed.). London: RoutledgeFalmer.
DERNTL, M. and MOTSCHNIG-PITRIK, R. 2004. A Pattern Approach to Person-Centered e-Learning Based on Theory-Guided Action Research.
In Proceedings of the Networked Learning Conference 2004.
DICK, B., PASSFIELD, R. & WILDMAN, P. 1995. A beginner’s guide to action research. {Online].
http://www.scu.edu.au/school/sawd/arr/guide.html
DU PLOOY, N. 2004. Information Systems Research. Presentation at Doctoral Seminar: Research Methodologies in Informatics. January, 2004.
University of Pretoria.
DU POY, E. and GITLIN, L.N. 1998. Introduction to Research: Understanding and Applying Multiple Strategies (2nd ed.). St Louis: Mosby Inc.
GLASER, B.G. 1992. Basics of Grounded Theory Analysis. Mill Valley CA: Sociology Press.
GLASER, B.G. and STRAUSS, A.L. 1967. The Discovery of Grounded Theory. Chicago: Aldine.
GLASS, R.L., RAMESH, V. and VESSEY, I. 2004. An analysis of research in computing disciplines. Communications of the ACM 47(6): 89-94.
KOCK, N.F., McQUEEN, R.J. & SCOTT, J.L. 2000. Can Action Research be made more Rigorous in a Positivist Sense? The Contribution of an
Iterative Approach. Action Research E-Reports, 9. [Online] Available: http://www.fhs.usyd.edu.au/arow/arer/009.htm
HIRSCHHEIM, R. & KLEIN, H.K. 2000. Information Systems Research at the Crossroads: External versus Internal Views. In: R. Baskerville, J.
Stage and J De Gross (Eds.). Proceedings of the IFIP TC8 WG 8.2 International Working Conference on the Social and Organizational
Perspective on Research and Practice in Information Technology, Boston, Mass: Kluwer Academic Publishers.
LEEDY, P.D. and ORMROD, J.E. 2001. Practical Research: Planning and Design. Upper Saddle River, NJ: Merrill Prentice Hall.
LINCOLN, Y.S. and GUBA, E.G. 1985. Naturalistic Inquiry. Newbury Park: Sage Publications.
MERTENS, D.M. 1998. Research Methods in Education and Psychology: Integrating Diversity with Quantitative and Qualitative Approaches.
Thousand Oaks: Sage Publications.
MOUTON, J. 2001. How to succeed in your Master’s and Doctoral Studies: A South African Guide and Resource Book. Pretoria: Van Schaik
Publishers.
MYERS, M.D. 2004. Qualitative Research in Information Systems. Original version: MIS Quarterly 21(2) 1997:241,242. Updated in MISQ
Discovery modified Sept 08, 2004. [Online] Available: http://www.qual.aouckland.ac.nz/
O’DONOVAN, B. and ROODE, D. 2002. A framework for understanding the emerging discipline of informations sytems. Information Technology
& People, 15(1): 26-41.
OLIVIER, M.S. 2004. Information Technology Research: A Practical Guide for Computer Science and Informatics. (2nd ed.) Pretoria: Van Schaik
Publishers.
ORLIKOWSKI, W.J. 1993. CASE Tools as Organizational Change: Investigating Incremental and Radical Changes in Systems Development.
Management Information Systems Quarterly. 17(3).
PATHER, S. and REMENYI, D. 2004. Some of the Philosophical Issues Underpinning Realism in Information Systems: From Positivsim to Critical
Realism. In G. Marsden, Kotzé, P. & Adessina-Ojo, A. (Eds). Fulfilling the Promise of ICT - Proceedings of SAICSIT 2004. Pretoria.
PLOMP, T. 2002. Some reflections on development research (DR). Speaking notes for a breakfast meeting at the Faculty of Education, University of
Pretoria. August 2002.
PREECE, J., ROGERS, Y. and SHARP, H. 2002. Interaction Design: Beyond Human-Computer Interaction. John Wiley & Sons, Inc.
REEVES, T.C. 2000. Socially Responsible Educational Technology Research. Educational Technology, 40(6): 19-28.
ROODE, D. 2003. Information Systems Research: A Matter of Choice? South African Computer Journal, 30: 1-2.
ROODE, D. 2004. The role of Empirical versus Conceptual Approaches. Presentation at Doctoral Seminar: Research Methodologies in Informatics.
January, 2004. University of Pretoria.
SCHöN, D.A. 1987. Educating the Reflective Practitioner. San Francisco:Jossey-Bass Publishers.
STRAUSS, A.L. and CORBIN, J. 1990. Basics of Qualitative Research: Grounded Theory Procedures and Techniques. Newbury Park, CA: Sage.
TRAVIS, J. 1999. Exploring the Constructs of Evaluative Criteria for Interpretivist Research. In Proceedings of the 10th Australasian Conference
on Information Systems 1999: 1037-1049.
VAN DEN AKKER, J. 1999. Principles and Methods of Development Research. In: J. van den Akker, R.M. Branch, K.L. Gustafson, N. Nieveen &
T. Plomp (Eds). Design Approaches and Tools in Education and Training. Dordrecht: Kluwer Academic Publishers.
VAN DEN AKKER, J. 2002. The Added Value of Development Research for Educational Development in Developing Countries. In: K. Osaki, W.
Ottevanger C. Uiso & J. van den Akker (Eds). Science Education Research and Teacher Development in Tanzania. Amsterdam: Vrije
Universiteit, International Cooperation Center.
WALSHAM, G. 1995a. Interpretive case studies in IS research: nature and method. European Journal of Information Systems, 4(2): 74-81.
WALSHAM, G. 1995b. The emergence of interpretivism in IS research. Information Systems Research, 6(4): 376-394.
WOOD-HARPER, T. 1985. Research Methods in Information Systems: Using Action Research. In E. Mumford et al (eds). Research Methods in
Information Systems. North-Holland: Elsevier Science Publishers B.V.
ZUBER-SKERRIT, O. 1992. Action Research in Higher Education. London: Kogan Page.
GLOSSARY
Empirical: Based on the results of experiments and/or observations, not based on theory.
Epistemology: Theory of the grounds of knowledge, how knowledge is produced, basis of claims to knowledge.
Hermeneutics: The science of interpreting the intention of the original author or researcher.
Methodology: A set of methods used in a process of inquiry.
Ontology: The science of the essence of being; closely related to one’s view of reality.
Paradigm: The underlying philosophy and assumptions that form the foundation to one’s approach and methodology.
Substantive: Having a separate and independent existence, not merely inferential or implicit.