Applying The Thinking Aloud Pair Problem
Applying The Thinking Aloud Pair Problem
Applying The Thinking Aloud Pair Problem
ABSTRACT
In ‘Thinking Aloud Pair Problem Solving’ (TAPPS), students work in pairs to solve
the mathematics problems. One student (the problem solver) is required to read the
problem and think aloud during the problem solving process. Another student (the
listener) attends to the problem solver’s thinking and reminds him/her to keep saying
aloud what he/she is thinking or doing, while also asking for clarifications and
pointing out errors being made. This study explored the effectiveness of applying
TAPPS on students’ mathematics performance in Brunei Darussalam. A Year 9 class
from one of the secondary schools participated in this research study. The students’
problem solving behaviour and mathematics achievement were investigated to see
any significant differences after learning using the TAPPS method. Data reported
were mainly collected through mathematics achievement tests, questionnaire surveys
and classroom observations. The study revealed that there was a significant
improvement in students’ problem solving behaviour especially in understanding the
problem. Although TAPPS did not help in improving students’ conceptual knowledge
in mathematics rather, it required the students to have a strong grasp of the
conceptual knowledge beforehand in order to be able to devise a plan to solve the
problems.
Keywords: Problem solving strategy, secondary, students’ mathematics
performance, Brunei Darussalam
INTRODUCTION
Learning mathematics is often linked to using one’s problem solving skill. While strong
conceptual understanding is important in learning mathematics, it is also essential for the
students to learn how to use their knowledge effectively in solving mathematics problems.
Different problem solving strategies have been described in literatures but some suggest that
students tend not to use strategies with too many stages (Jeon et al., 2005). In this study, we
mainly used a well-known example of problem solving strategy proposed by Polya (1945),
which consists of the following four stages: (i) understanding the problem, (ii) devising a
plan, (iii) carrying out the plan, and (iv) looking back over the process.
Thinking aloud pair problem solving, which was first developed by Arthur Whimbey, aims to
better understand thinking among the students (Whimbey & Lochhead, 1999) and to develop
students’ cognitive processes associated with problem solving (Kotsopoulus, 2010). Thinking
aloud pair problem solving is mainly based on thinking aloud and listening (Jeon et al.,
2005). As the name suggests, this involves students working in pairs. One student (the
problem solver) is required to read the problem aloud and think aloud during the problem
solving process, which includes verbalizing everything they are thinking and doing. Another
student (the listener) attends to the problem solver’s thinking and reminds him/ her to keep
ISSN: 2186-845X ISSN: 2186-8441 Print Leena and Luna International, Oyama, Japan. Copyright © 2015
www.ajmse. leena-luna.co.jp (株) リナアンドルナインターナショナル, 小山市、日本 P a g e | 20
Asian Journal of Management Sciences & Education Vol. 4(2) April 2015
__________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
saying aloud what he or she is thinking or doing, while also asking for clarifications and
pointing out errors being made. It is important to highlight that listeners are not allowed to
attempt to solve the problems or give correct answers. Instead of merely imitating worked
examples, this instructional method focuses on helping the students learn by being aware of
their thinking process in tackling mathematics problems. Students are not always able to
express their mathematical understanding in detail. Often, answers from the students were
given in the form of one word or sometimes, keywords. Thinking aloud during problem
solving may reveal much more about the students’ personally constructed understanding
compared to assessing them from their written works (Watson, 2002). However this may also
be restricted to how well the students are able to express their thinking process verbally.
In this study, we investigated the effects of conducting Thinking Aloud Pair Problem Solving
(hereafter, referred to as TAPPS) in a mathematics classroom on students’ mathematics
achievement in Brunei Darussalam. We also explored whether thinking aloud has any
significant effects on students’ problem solving performance.
LITERATURE REVIEW
Whimbey and Lochhead (1999) mentioned that thinking aloud during problem solving aims
to ensure that students “do not skip steps in their reasoning, nor miss facts in drawing
conclusions” (p. 23). This procedure may also help in identifying different kinds of students’
weaknesses, errors and strategies in problem solving (Montague et al., 2011). It is able to
provide more information inaccessible through examining students’ written work for
example, through students’ explanations.
Jeon et al. (2005) observed in their investigation on the effectiveness of TAPPS in improving
problem solving performance of high school chemistry students that students in both the
individual and TAPPS groups performed better in problem solving compared to the control
group. They found that students in the individual and TAPPS groups performed better in
recalling the related law and mathematics execution. The students in TAPPS group also
performed better than the others on conceptual knowledge. Jeon and colleagues (2005) also
stated that the verbal interactions between the solvers and listeners could help the students be
“more cognizant of both their own thinking and the thinking of other students” (p. 1564).
However, they discovered that listeners seemed to gain more benefits from TAPPS than the
problem solvers. They found that listeners’ ‘pointing out’ behaviour showed the greatest
correlation with their own problem solving performance; listeners’ ‘agreeing’ behaviour to
the solvers’ statements was also positively correlated to the listeners’ problem solving
performance. They also discovered that there was a negative correlation between the
listeners’ ‘pointing out’ and the solvers’ problem solving performance.
In addition, Kotsopoulus (2010) highlighted in her study on examining instances of talking
aloud during peer collaborations in mathematics that it is important to teach the students both
on how to express their thinking and their learning needs and how to attend to each other’s
thinking and learning needs in such settings. She mentioned TAPPS as a possible suggestion
to achieve this. Ericsson and Simon (1980) argued that thinking out loud does not affect the
cognitive processes or performance speed, but instead, it does help students to identify and
monitor their own thinking process.
in the classroom as stated in the new education reform system in Brunei known as Sistem
Pendidikan Negara Abad ke-21 or translated to English Language as the National Education
System for the 21st Century (and better known as SPN21) (Botty & Shahrill, 2014; Kani et
al., 2014; Mahadi & Shahrill, 2014; Ministry of Education, 2013; Matzin et al., 2013;
Mundia, 2010, 2012; Salam & Shahrill, 2014; Shahrill & Clarke, 2014; Yatab & Shahrill,
2014). Incorporating TAPPS in mathematics learning is expected to improve the
effectiveness of the classroom learning activity.
This study aimed to critically assess the effectiveness of having TAPPS in a mathematics
classroom in Brunei on students’ learning and problem solving skills. In order to actualise
this aim, we investigated the impact of TAPPS on students’ mathematics problem solving
behaviour as well as mathematics achievement. This study was guided by the following
research questions:
1. Are there any differences in students’ mathematics problem solving behaviour
before and after learning using TAPPS?
2. Are there any differences in students’ mathematics achievement before and after
learning using TAPPS?
METHODOLOGY
Participants
The participants for this study were the Year 9 students (mean age of 14 years old) in one of
the schools in the Brunei-Muara District. The students participating in this study were
amongst the students with intermediate ability doing Mathematics at the International
General Certificate for Secondary Education level (or IGCSE Mathematics). There were 21
students (12 boys and 9 girls) in this class. However, since there were some absentees during
the data collection period only data from 16 students were taken into account for the Problem
Solving Behaviour questionnaire.
Instruments
Recordings of the Lessons
There were three different focus groups chosen throughout the data collection period and
their interactions were audio recorded for follow-up analyses. In addition, field notes were
also written during each lesson where the first author entered her observations that may be
useful for further analyses.
Mathematics Achievement Tests
Scores from the pre-test and post-test were collected to assess the students’ mathematics
problem solving achievement. These tests required students to answer three items on problem
solving under the topic Rate, Ratio and Proportions for 15 minutes.
Questionnaire
A problem solving behaviour questionnaire was used in this study. This questionnaire was
given to the students before and after TAPPS was introduced. This questionnaire used a 5-
point Likert-type scale, ranging from 1 (never) to 5 (always), obtained and modified from
Desoete (2007). It consisted of 25 items that aimed to identify the students’ problem solving
strategy before and after the study. Each student would receive scores on each item in this
questionnaire, ranging from 1 to 5, and a total score from 25 to 125. Each item in this
questionnaire represents one of the stages in Polya’s problem solving strategy. The first stage,
ISSN: 2186-845X ISSN: 2186-8441 Print Leena and Luna International, Oyama, Japan. Copyright © 2015
www.ajmse. leena-luna.co.jp (株) リナアンドルナインターナショナル, 小山市、日本 P a g e | 22
Asian Journal of Management Sciences & Education Vol. 4(2) April 2015
__________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
which ‘understands the question’, was represented by 8 items; ‘devising a plan’ was
represented by 4 items, 6 items represented the ‘carrying out plan’ stage, and 6 items for the
‘reflecting’ stage.
Data Collection
The pre-test and problem solving behaviour pre-questionnaire were first administered to the
participants at the beginning of the lesson. Then, they were introduced to and practised with
the problem solving strategy and TAPPS strategy for the remainder of the lesson. They were
first assigned partners based on their pre-test mathematics performances and then trained with
their roles as the problem solver and the listener during TAPPS. The students were taught and
asked to practise on solving some problems using the four-step problem solving strategy,
which consisted of i) understanding the problem, ii) devising a plan, iii) carrying out the plan,
and iv) looking back over the process.
Once the students were ready, they were given two worksheets to be done for the rest of the
week. In each of the lessons, the first author had chosen different focus groups and recorded
their conversations as part of the research data. The worksheets were also submitted at the
end of every lesson to be assessed as part of the research data. The problem solving
behaviour post-questionnaire was administered to the participants immediately after the
students completed their worksheets. Finally, a delayed post-test was also given to the
students a week after the intervention lessons.
Data Analysis
In order to answer the first research question, the pre-questionnaire and post-questionnaires
were analysed quantitatively using the paired t-test and descriptive statistics to measure any
significant difference in their problem solving behaviour before and after TAPPS. For the
second research question, results from the pre-test and the post-test were analysed
quantitatively using the paired t-test and descriptive statistics to measure any significant
difference in students’ mathematics achievement before and after TAPPS.
Before After t
85.5 91.8
Problem Solving
4.06*
Behaviour
(14.9) (15.1)
Note. *p < 0.01. Standard deviations appear I parenthesis below the mean scores.
Mathematics Achievement
To investigate the differences in students’ mathematics achievement before and after learning
using TAPPS, the overall mean scores of the pre-test (2.125) and post-test (1.188) were
Copyright © 2015 Leena and Luna International, Oyama, Japan. ISSN: 2186-845X ISSN: 2186-8441 Print
23 | P a g e (株) リナアンドルナインターナショナル, 小山市、日本. www.ajmse. leena-luna.co.jp
Asian Journal of Management Sciences & Education Vol. 4(2) April 2015
__________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
compared and the difference was -0.937. A paired t-test was computed to find out whether
the difference of -0.937 is significant. Table 2 presents the mean scores, the standard
deviations of the pre- and post- tests and t-value. The result of the t-test showed that there
was no significant difference in the overall mean scores of the pre- and post-test (t = 1.70, p >
0.05).
Table 2. Mean scores and standard deviations of pre- and post-
achievement test and t-value (N = 16)
Pre-test Post-test t
Before After t
Note: a Understanding the problem stage was represented by items 1, 2, 3, 6, 7, 8, 9 and 10 in the
Problem solving behaviour questionnaire. b Planning stage was represented by items 4, 12, 13 and 16
in the questionnaire. c Carrying out plan stage was represented by items 5, 11, 14, 15, 17 and 18. d
Reflecting stage was represented by items 19, 20, 22, 23, 24 and 25.
* p < 0.01. Standard Deviations appear in parentheses below the mean scores.
ISSN: 2186-845X ISSN: 2186-8441 Print Leena and Luna International, Oyama, Japan. Copyright © 2015
www.ajmse. leena-luna.co.jp (株) リナアンドルナインターナショナル, 小山市、日本 P a g e | 24
Asian Journal of Management Sciences & Education Vol. 4(2) April 2015
__________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
Copyright © 2015 Leena and Luna International, Oyama, Japan. ISSN: 2186-845X ISSN: 2186-8441 Print
25 | P a g e (株) リナアンドルナインターナショナル, 小山市、日本. www.ajmse. leena-luna.co.jp
Asian Journal of Management Sciences & Education Vol. 4(2) April 2015
__________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
The results in this study contradicted the results found by Jeon et al. (2005). Since the number
of participants and time were limited during the data collection period, this study suggests
more research to be done in the future in investigating the effects of TAPPS on students’
mathematics achievement for a longer period of time or with a sample that is representative
of the Brunei secondary level students. In addition, without any extensive revision lessons
done on the Rate, Ratio and Proportions topic before the TAPPS lessons, students found it
hard to remember the concepts in order to solve the problems given. This has resulted in the
students not knowing which information from the questions that should be considered as
important or relevant. Therefore a suggestion for future research would be to carry out the
TAPPS lessons on a certain topic immediately after they have learnt it and to investigate the
improvement in their mathematics achievement and problem solving behaviour.
In this study, we investigated on how well students were able to use TAPPS in their
mathematics classroom by examining whether there were any significant differences both in
their problem solving behaviour and their mathematics achievement before and after TAPPS.
Future research on other disciplines in the Brunei context should also be done, as it may be a
better learning method in other subjects that involve problem solving besides mathematics.
Jeon et al. (2005) did their study on the effectiveness of TAPPS method in the context of
chemistry lessons and have found that TAPPS “improved students’ conceptual knowledge
and increased success rates on solving problems” (p. 1564). The students in their study were
better at recalling related laws and executing meaningful mathematical expressions with the
help of TAPPS. This could also be the case for other subjects, especially in science. It is also
important for any teacher or researcher to gradually introduce TAPPS to their students. The
teacher or researcher may begin by firstly providing an environment that the students are
comfortable with. After a familiarisation period, a more challenging task may then be given
to the students.
ISSN: 2186-845X ISSN: 2186-8441 Print Leena and Luna International, Oyama, Japan. Copyright © 2015
www.ajmse. leena-luna.co.jp (株) リナアンドルナインターナショナル, 小山市、日本 P a g e | 26
Asian Journal of Management Sciences & Education Vol. 4(2) April 2015
__________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
REFERENCES
[1] Botty, H. M. R. H., & Shahrill, M. (2014). The Impact of Gagné, Vygotsky and
Skinner Theories in Pedagogical Practices of Mathematics Teachers in Brunei
Darussalam. Review of European Studies, 6(4), 100-109.
[2] Desoete, A. (2007). Evaluating and improving the mathematics teaching-learning
process through metacognition. Electronic Journal of Research in Educational
Psychology, 5(3), 705-730.
[3] Ericsson, K. A., & Simon, H. (1980). Verbal reports as data. Psychological Review,
87, 215-250.
[4] Fan, L., & Yeo, S. M. (2006). Integrating oral presentation into mathematics teaching
and learning: An exploratory study with Singapore secondary students. Paper
presented at the American Educational Research Association (AERA) Annual
Meeting, San Francisco, California, USA, April 7-11, 2006.
[5] Gan, S. L., & Hong, K. S. (2010). The effectiveness of peer tutoring in the teaching of
mathematics. Malaysian Journal of Learning and Instruction, 7, 113-132.
[6] Henjes, L. M. (2007). The use of think-aloud strategies to solve word problems.
Unpublished master’s dissertation, University of Nebraska-Lincoln.
[7] Jeon, K., Huffman, D., & Noh, T. (2005). The effects of thinking aloud pair problem
solving of high school students’ chemistry problem-solving performance and verbal
interactions. Journal of Chemical Education, 82(10), 1558-1564.
[8] Kani, N. H. A., Nor, H. N. H. M., Shahrill, M., & Halim, R. H. A. (2014).
Investigating the leadership practices among mathematics teachers: The immersion
programme. International Journal of Contemporary Educational Research, 1(2), 113-
121.
[9] Kotsopoulos, D. (2010). An analysis of talking aloud during peer collaborations in
mathematics. International Journal of Science and Mathematics Education, 8, 1049-
1070.
[10] Mahadi, M. A. H., & Shahrill, M. (2014). In pursuit of teachers’ views on the use of
textbooks in their classroom practice. International Journal of Education, 6(2), 149-
158.
[11] Matzin, R., Shahrill, M., Mahalle, S., Hamid, M. H. S., & Mundia, L. (2013). A
comparison of learning styles and study strategies scores of Brunei secondary school
students by test anxiety, success attributions, and failure attributions: Implications for
teaching at-risk and vulnerable students. Review of European Studies, 5(5), 119-127.
[12] Ministry of Education. (2013). The National Education System for the 21st Century:
SPN21 (Revised ed.). Ministry of Education, Brunei Darussalam.
[13] Montague, M., Krawec, J., & Rosenzweig, C. (2011). Metacognitive strategy use of
eight-grade students with and without learning disabilities during mathematical
problem solving: A think-aloud analysis. Journal of Learning Disabilities, 44(6), 508-
520.
[14] Mundia, L. (2010). Implementation of SPN21 curriculum in Brunei Darussalam: A
review of selected implications on school assessment reforms. International
Education Studies, 3(2), 119-129.
Copyright © 2015 Leena and Luna International, Oyama, Japan. ISSN: 2186-845X ISSN: 2186-8441 Print
27 | P a g e (株) リナアンドルナインターナショナル, 小山市、日本. www.ajmse. leena-luna.co.jp
Asian Journal of Management Sciences & Education Vol. 4(2) April 2015
__________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
[15] Mundia, L. (2012). Policy changes in Brunei teacher education: Implications for the
selection of trainee teachers. The Education Forum, 76(3), 326-342.
[16] Polya, G. (1945). How to solve it? Garden City, NY: Doubleday.
[17] Salam, N. H. A., & Shahrill, M. (2014). Examining classroom interactions in
secondary mathematics classrooms in Brunei Darussalam. Asian Social Science,
10(11), 92-103.
[18] Shahrill, M., & Clarke, D. J. (2014). Brunei Teachers’ Perspectives on Questioning:
Investigating the Opportunities to ‘Talk’ in Mathematics Lessons. International
Education Studies, 7(7), 1-18.
[19] Watson, A. (2002). What does it mean to understand something and how do we know
when it has happened? In L. Haggarty (Ed.), Teaching mathematics in secondary
schools (pp. 161-175). London: Routledge Falmer.
[20] Whimbey, A., & Lochhead, J. (1999). Problem solving and comprehension. Mahwah,
NJ: Lawrence Erlbaum Associates.
[21] Yatab, R. S., & Shahrill, M. (2014). The differing views in using the common
assessment tasks in secondary school science. International Journal of Science and
Research, 3(7), 685-693.
ISSN: 2186-845X ISSN: 2186-8441 Print Leena and Luna International, Oyama, Japan. Copyright © 2015
www.ajmse. leena-luna.co.jp (株) リナアンドルナインターナショナル, 小山市、日本 P a g e | 28