Logical Reasoning Ability in Engineering Students: A Case Study
Logical Reasoning Ability in Engineering Students: A Case Study
Logical Reasoning Ability in Engineering Students: A Case Study
Abstract—Mathematical logic is one of the scientific foundations instruction. Many students in these programs come from Asia,
of information technology and computer engineering. Therefore, Africa, and other countries. The performances of international
engineering students must be proficient in logical operations. First- and home students differ in certain aspects. In particular, in-
year engineering students answered four logical reasoning tasks
as part of a larger survey on scientific thinking, producing more ternational students have specific problems learning computer
incorrect responses than previous studies would have predicted, science, programming, electronics, and other professional
most notably in international student groups. This paper presents engineering subjects. They seem to have no problems in math-
and analyzes these results, and compares and discusses the dif- ematics or physics, a pattern similar to reports from many other
ferences between natural human reasoning and engineering logic. countries [7]–[9]. The author conducted research to understand
It seeks to explain failures in logical reasoning that occur despite
formal training and considers several possible cultural and psycho- better the problems faced by international students in their
logical explanations to this phenomenon. The conclusion highlights professional studies [10]. As a first step, a survey on scientific
the need for stronger emphasis in developing problem-solving and thinking patterns and learning styles was conducted among
metacognitive skills in engineering education. The importance of first-year students. The survey produced surprising results.
fluency in the language of study emerges as a significant factor in Logical reasoning tasks that were assumed to be straightfor-
learning technical subjects.
ward solicited more incorrect responses than previous studies
Index Terms—Cognitive practices, decision making, engineering among college students would have predicted [11].
education, information technology education, international stu-
This paper presents an analysis of student performance in
dents, scientific thinking.
logical reasoning and discusses several possible explanations
for their performance. It first provides a brief overview of the
I. INTRODUCTION theory of logic and reasoning studies in a cross-cultural con-
text. Next, survey methods and results are described. A discus-
sion of reasons and explanations follows. Finally, this paper con-
E NGINEERING is a field of applied sciences based on
mathematics, physics, and chemistry. A wide, functional
understanding of processes, in addition to a good command of
cludes with provisionary implications to engineering education
curricula.
technical skills, is a prerequisite for successful professional en- II. REASONING AND LOGIC
gineering work [1], [2]. For example, fluency in programming
requires deep understanding of abstract concepts, capability in A. Mathematical Logic and Human Judgment
algorithmic thinking, and logical reasoning [3], [4]. Moreover, George Boole wrote in his work on mathematical logic about
many studies indicate that ability in logical reasoning is not 150 years ago: “The design of the following treatise is to in-
separate from overall intellectual capacity and that students vestigate the fundamental laws of those operations of the mind
who master reasoning and problem-solving tend to perform by which reasoning is performed; to give expression to them in
better in any science subject [5], [6]. Computer engineering, in the symbolic language of a Calculus ” [12]. Boole believed
particular, depends on mathematical logic on all levels of com- that human reasoning follows formal logic. The study of log-
puter system design: processing circuits make use of Boolean ical reasoning goes as far back as Aristotle, who is the creator
operations; programming is based on algorithmic thinking; of modal logic and syllogisms with modalities. He introduced
database operations follow Boolean logic; and so forth. There- the qualification of necessary and possible premises [13]. Until
fore, computer engineers are expected to be fluent in logical recently, understanding of an effective decision-making process
thinking. When research data suggest otherwise, a problem that has relied on formal logic and statistics. Braverman’s textbook
requires reflection and invites explanation emerges. on management decision making from 1972 clearly announces:
The present study focuses on engineering students at the “A real decision situation, no matter how complicated, can, with
EVTEK University of Applied Sciences, an engineering col- patience, be broken down into its component parts to any level
lege in the Helsinki area of Finland that has four-year Bachelor of detail desired, a process of reduction; solutions then can be
of Engineering degree programs in information technology found for the individual components; and the overall solution
(IT) and media engineering with English as the language of can be achieved by a continued application of the logic process”
[12].
Moreover, the scientific assumption that people have inherent
Manuscript received January 30, 2007; revised July 17, 2007. logic as a basis for rational thought was strongly influenced by
The author is with EVTEK University of Applied Sciences, FIN-02650
Espoo, Finland (e-mail: [email protected]). the psychological writings of Jean Piaget [14]. However, many
Digital Object Identifier 10.1109/TE.2007.906600 subsequent studies have shown that reality is different. Logical
0018-9359/$25.00 © 2007 IEEE
368 IEEE TRANSACTIONS ON EDUCATION, VOL. 50, NO. 4, NOVEMBER 2007
fallacies are common, and why human reasoning is prone to Naturally, the empirical difficulty in reasoning problems de-
them is of long-standing interest [13], [15]. Typical findings of pends on factors other than reasoning mechanisms per se. If
reasoning experiments show that people often make logical er- subjects fail to understand the statement of the problem in the
rors and draw inferences that are not necessary, but merely plau- intended way, fail to understand the task they are supposed to
sible, based on beliefs. The classic work on human judgment perform, fail to formulate a correct natural-language response,
by Tversky and Kahneman in the 1970s supports the view that or fail to remember the key parts of the problem, their answers
human reasoning systematically violates the standards for statis- do not reflect the correct reasoning process. Several methodical
tical reasoning, ignoring, among other things, base rates, sample difficulties are present in isolating these disparate types of error
size, and correlations. Tversky and Kahneman took a Bayesian in the data when reasoning is studied [19].
account of probabilistic reasoning as a normative standard for To perform something unnatural, such as deductive rea-
an ideally rational agent. They found that humans systematically soning, is difficult because a person has to ignore most normal
fall short of the standard, concluding that “man is apparently not thinking and adhere to the constrained case. Scientists, such as
a conservative Bayesian: he is not a Bayesian at all” [16]. physics researchers, are better trained to think in a restricted,
Consequently, Richardson [15] states that formal decision- artificial system than others. Mortimer and Wertsch [22] explain
making studies need to be replaced by bounded rationality that that the language of science has different grammar, and their
takes the complexity of real world situations into account. Hu- research shows that students are reluctant to switch from the
mans have difficulty isolating a reasoning task from the sur- natural language code to the theoretical speech genre used by
roundings, and concentrating on the given premises only. Rea- science teachers. Moreover, a study among secondary school
soning is highly influenced by context and content. Evans [17] students in three European countries (United Kingdom, France,
claims that the default mode for reasoning is, in fact, pragmatic and Finland) shows that argumentation skills depend largely on
rather than deductive or analytic. People tend to select believ- training; educational systems seem to concentrate on different
able alternatives, choosing something that would be plausible aspects of analytical skills [23].
in the real world instead of automatically following reasoning
rules. Unfortunately, failures in human reasoning are common
C. Cultural or Background Differences in Reasoning
also in critical real-life situations, such as clinical reasoning in
medicine [18]. Are the differences in reasoning and logical thinking mainly
among individuals or among cultures? The answer has signif-
B. Reasoning Explained icant consequences for multicultural engineering education,
particularly computer science education. Some researchers,
Reasoning is a central component of cognition that depends such as Nuckolls [24], claim that inference is an aspect of
on theories of comprehension, memory, learning, visual percep- reasoning that differs cross-culturally. He recalls a classic study
tion, planning, problem solving, and decision making. Rips [19] by the Soviet neuropsychologist Luria that seemed to show
pointed out in 1998 that the mechanics of reasoning were not that East and Central Asian peasants were generally unable
known. How does one belief become another in the brain? Re- to provide answers to syllogisms that contained unfamiliar
cent advances in neuroscience raise expectations that the mech- information. They were asked to conclude what color the
anisms of reasoning processes could soon be explained by the bears in Novaya Zemlya are, given the premises that in the
functioning of the brain. Antonio Damasio [20] proposes that Far North, covered with snow, all bears are white, and that
the brain has two complementary paths for decision making: one Novaya Zemlya is in the Far North, always covered with snow.
for reasoning and the other for instant activation of prior emo- Luria’s informants refused to answer the question insisting that
tional experiences in comparable situations. The second path is they have no firsthand knowledge. Only individuals from the
a kind of “gut feeling” reaction; it activates an emotional signal same culture who had received schooling responded correctly,
that increases the efficiency of the reasoning process and makes demonstrating that the difference was not developmental, but
that process speedier. The “gut feeling” is not a substitute for related to exposure to Western education and styles of reasoning
true reasoning, which takes a longer route. When a situation re- [25]. Accordingly, a study of practical intelligence in Kenya
quires a response, the brain prompts images related to the situ- illustrated how Western schooling influenced test results of
ation, the options for action, and the anticipation of future out- school children. Children from traditionally oriented families
comes. Reasoning strategies then operate on that knowledge to scored high in practical intelligence and low in abstract-rea-
produce a decision. In any situation, both paths are employed. soning-based abilities; whereas, children with more formal
The left hemisphere of the brain is known to be dominant schooling showed a reverse pattern [26].
for language and conscious problem-solving processes, though However, most studies on cross-cultural differences in
not exclusively [21]. The writing ability has been located in the cognitive processes [27] reach the opposite conclusion from
right hemisphere, and some reasoning studies indicate that in- Nuckolls; D’Andrade specifically stresses that reasoning ca-
tuition and heuristic problem-solving rely on right hemisphere pacity seems to be the same across cultures [11]. He cites
functions as well. At present, the author has not been able to several cross-cultural psychological studies, which show no
locate any brain study which combines reasoning and foreign difference in reasoning between people from different cultures
language processing. Nevertheless, the examples found thus far when the given task fits some framework in their world-view.
seem to indicate that neuroscience will, in the near future, prove However, when a reasoning task is purely abstract, most people
valuable in understanding the problems presented in this study. tend to fail everywhere.
HOLVIKIVI: LOGICAL REASONING ABILITY IN ENGINEERING STUDENTS: A CASE STUDY 369
Crump [28] has compared mathematical and number systems a) It must be the case that it is raining.
in many different cultures. He concludes that symbolic counting b) Maybe it is raining and maybe it is not.
is a universal skill that develops gradually with age and that c) It must be the case that it is not raining.
is relatively unaffected by variations in the counting system
1C GIVEN: If Roger drank tea then Tom sat down.
employed, culture, cognitive development, and schooling. The
human brain has a certain capability for mathematic operations, SUPPOSE: Roger did not drink tea.
and the diversity of skills and intelligence is on the individual,
THEN:
not cultural, level. Crump argues that the structure of mathe-
a) It must be the case that Tom sat down.
matics is in some sense isomorphic with the structure of reality.
b) Maybe Tom sat down and maybe he did not.
Numbers as a purely formal system are independent of external
c) It must be the case that Tom did not sit down.
reality.
1D GIVEN: If this rock is a garnet then it is a semiprecious
III. RESEARCH METHOD AND RESULTS stone.
TABLE I
NUMBER OF SYLLOGISMS SOLVED CORRECTLY IN ALL GROUPS
TABLE II
NUMBER OF CORRECT AND “PLAUSIBLE” ANSWERS IN FINNISH STUDENT GROUPS, AND THE CORRECT ANSWERS RATES IN D’ANDRADE’S STUDY [11]
TABLE III
NUMBER OF CORRECT AND “PLAUSIBLE” ANSWERS BY FACULTY MEMBERS
TABLE IV
NUMBER OF CORRECT AND “PLAUSIBLE” ANSWERS
IN THE INTERNATIONAL STUDENT GROUP
Fig. 1. Correct answering rate comparison.
The study also implies that language affects ability in formal [14] J. Piaget and B. Inhelder, The Psychology of the Child. New York:
reasoning more than expected. People may apply different types Basic Books, 1969.
[15] R. C. Richardson, “Heuristics and satisficing,” in A Companion to Cog-
of thinking when using their native language and when using a nitive Science, W. Bechtel and G. Graham, Eds. Oxford, U.K.: Black-
second language. The findings of this study indicate that thor- well, 1998, pp. 566–575.
ough knowledge of language is needed for accurate performance [16] D. Kahneman, P. Slovic, and A. Tversky, Judgment Under Uncer-
tainty: Heuristics and Biases. Cambridge, U.K.: Cambridge Univ.
in reasoning tasks. Evidently, people should not be IQ tested in Press, 1982.
a language in which they are not fluent. The result suggests that [17] J. S. Evans, “Logic and human reasoning: An assessment of the deduc-
language as a medium of study has a stronger effect on learning tion paradigm,” Psych. Bul., vol. 128, pp. 978–996, Nov. 2002.
[18] J. I. Balla, “Logical thinking and the diagnostic process,” Methods Inf.
in science and engineering than is commonly believed. If this Med., vol. 19, pp. 88–92, 1980.
finding is confirmed by later studies, more attention should be [19] L. Rips, “Reasoning,” in A Companion to Cognitive Science, W.
paid to the modes of instruction in foreign language study pro- Bechtel and G. Graham, Eds. Oxford, U.K.: Blackwell, 1998, pp.
299–305.
grams in general. Nevertheless, further study is needed to con- [20] A. Damasio, Looking for Spinoza. Joy, Sorrow and the Feeling Brain.
firm and explain to what extent language influences learning. London, U.K.: Vintage/Random House, 2003.
[21] M. S. Gazzaniga, “The split brain revisited,” Sci. Amer., vol. 12, pp.
REFERENCES 27–31, Aug. 2002.
[22] E. Mortimer and J. Wertsch, “The architecture and dynamics of inter-
[1] J. Moss, K. Kotovsky, and J. Cagan, “The role of functionality in the
subjectivity in science classrooms,” Mind. Culture. Act., vol. 10, pp.
mental representations of engineering students: Some differences in the 230–244, 2003.
early stages of expertise,” Cogn. Sci., vol. 30, pp. 65–93, 2006. [23] M. Marttunen, L. Laurinen, L. Litosseliti, and K. Lund, “Compar-
[2] K. Hakkarainen, T. Palonen, S. Paavola, and E. Lehtinen, Communities ison of argumentation skills among secondary school students in
of Networked Expertise. Professional and Educational Perspectives. Finland, France and the United Kingdom,” in Proc. United Nations
Oxford, U.K.: Elsevier, 2004.
Educational, Scientific and Cultural Organization Conf. Intercultural
[3] R. Faux, “Impact of preprogramming course curriculum on learning in Education, Jyväskylä, Finland, 2003, CD-ROM.
the first programming course,” IEEE Trans. Educ., vol. 49, no. 1, pp.
[24] C. W. Nuckolls, “Cognitive anthropology,” in A Companion to Cogni-
11–16, Feb.. 2006. tive Science, W. Bechtel and G. Graham, Eds. Oxford, U.K.: Black-
[4] A. Eckerdal and A. Berglund, “What does it take to learn ‘Programming
well, 1998, pp. 140–145.
thinking’?,” in Proc. 1st Int. Computing Education Research Workshop, [25] J. V. Wertsch, Vygotsky and the Social Formation of Mind. Cam-
Seattle, WA, 2005, pp. 135–142. brigde, MA: Harvard Univ. Press, 1985.
[5] M. Johnson and A. Lawson, “What are the relative effects of reasoning
[26] R. J. Sternberg, “The theory of successful intelligence,” Revista Inter-
ability and prior knowledge on biology achievement in expository and americana de Psicología/Interamer. J. Psych., vol. 39, pp. 189–202,
inquiry classes?,” J Res. Sci. Teach., vol. 35, pp. 89–103, Jan. 1998.
2005.
[6] M. Capizzo, S. Nuzzo, and M. Zarcone, “The impact of the pre-in- [27] J.W. Berry, Y. H. Poortinga, M. H. Segall, and P. D. Dasden,
structional cognitive profile on learning gain and final exam of physics
Cross-Cultural Psychology. Research and Applications, 2nd
courses: A case study,” Eur. J. Eng. Educ., vol. 31, pp. 717–727, Dec. ed. Cambridge, U.K.: Cambridge Univ. Press, 2002.
2006.
[28] T. Crump, The Anthropology of Numbers. Cambridge, U.K.: Cam-
[7] M. L. Jacobson, R. A. Said, and H. Rehman, “Introducing design skills bridge Univ. Press, 1990.
at the freshman level: Structured design experience,” IEEE Trans. [29] J. Holvikivi, “Learning styles in engineering education: The quest to
Educ., vol. 49, no. 2, pp. 247–253, May 2006.
improve didactic practices,” Eur. J. Eng. Educ., vol. 32, pp. 401–408,
[8] S. Latu and A. Young, “Teaching ICT to Pacific Island background Aug. 2007.
students,” in Proc. 6th Australasian Computing Education Conf., R.
[30] K. Dunbar, “Problem solving,” in A Companion to Cognitive Science,
Lister and A. Young, Eds., Dunedin, New Zealand, 2004, vol. 30, pp. W. Bechtel and G. Graham, Eds. Oxford, U.K.: Blackwell, 1998, pp.
169–175.
289–298.
[9] D. Harnish, “An Arab-American project to improve technical educa- [31] C. Tenopir and D. W. King, Communication Patterns of Engineers.
tion: Sustaining intercultural educational collaboration during tense Piscataway, NJ: IEEE Press, 2004.
times,” in Proc. United Nations Educational, Scientific and Cultural
Organization Conf. Intercultural Education, Jyväskylä, Finland, 2003,
CD-ROM. Jaana Holvikivi received the M.S. degree in operations research and industrial
[10] J. Holvikivi, “Culture and cognition in information technology educa- engineering from Helsinki University of Technology (TKK), Espoo, Finland.
tion,” Eur. J. Eng. Educ., vol. 32, pp. 73–82, Mar. 2007. She is currently working toward the Ph.D. degree at TKK. She is a Senior
[11] R. D’Andrade, The Development of Cognitive Anthropology. Cam- Lecturer in computer science at EVTEK University of Applied Sciences, Espoo,
bridge, U.K.: Cambridge Univ. Press, 1995. Finland. She has worked for 15 years in systems analysis and research in public
[12] J. D. Braverman, Probability, Logic, and Management Decisions. administration in Finland, and as an Information Systems Consultant for the
New York: McGraw-Hill, 1972. United Nations Industrial Development Organization and the United Nations in
[13] J. Hintikka, “Inquiry as inquiry: A logic of scientific discovery,” many parts of the world before entering engineering education. Her interests
in Jaakko Hintikka Selected Papers. Dordrecht, The Netherlands: cover cultural anthropology and science of the mind. Her current research con-
Kluwer, 1996, vol. 5. centrates on improving multicultural information technology education.