Chapter 4 Assesment
Chapter 4 Assesment
Chapter 4 Assesment
triangle (note that this proposition is only partially correct because all the
angles of an acute-angled triangle must be acute). The propositions form the
basic units of meaning in concept maps (RuizPrimo, 2004), although simpler
concept maps may not have linking
ADA TABEL
phrases (e.g., Orton, 2004), resulting in loss of information about the nature of
the links.
Why is concept map useful in assessing conceptual understanding?
Research suggests that the degree of a students understanding is determined
by the number, accuracy, and strength of connections (Hiebert and Carpenter,
1992; Resnick and Ford, 1981). Thus, a concept is well understood if it has
sufficient number of accurate and strong links with other related concepts. From
this perspective, a concept map can provide a visual representation of the
interconnected properties of the concepts held by the student.
Concept map was first developed by Joseph Novak and his team in the
1970s as a tool to document changes in understanding of a wide range of
scientific concepts held by students as they moved from first grade to twelfth
grade (Novak and Musonda, 1991). It is based on Ausubels (1963) assimilation
theory that states that learning takes place by assimilating new concepts and
propositions into existing knowledge framework or cognitive schema of the
learner (Novak and Caas, 2006). This psychological foundation justifies the use
of concept map as a tool to trace students conceptual changes over time. Over
the past three
decades, its use as an assessment technique has been
extensively investigated, especially in science education (Caas, et al., 2003). In
mathematics education, researchers and educators have also reported positive
findings concerning the use of concept map as an assessment technique at
different educational levels (see chapters in AfamasagaFuataI, 2009). The
following sections will discuss four aspects of this use.
First, several types of concept mapping tasks are explained to show that
different tasks may address different aspects of students conceptual
understanding. Second, training techniques for the mapping tasks are illustrated
with examples to help teachers plan such training when concept mapping is new
to their students. Third, four different classroom applications of concept maps
are discussed with examples, viz. to detect students prior knowledge, to
measure learning outcomes, to track learning progress, and to serve as a
learning strategy. Finally, several methods to evaluate student-constructed
concept maps are given so that the teachers can use the assessment information
to plan meaningful learning; this will align with the perspective of assessment for
learning.
2 Types of Concept Mapping Tasks
Concept mapping tasks can be categorized along a continuum of low to high
degree of directedness according to whether the four components, namely,
concepts, links, linking phrases, and map structure, are fully, partially, or not
provided (Ruiz-Primo, Schultz, Li and Shavelson, 2001). In high-directed concept
mapping tasks, most of these components are provided; thus, the tasks are
relatively easy for students to complete, but they are limited in measuring the
interconnected properties of students understanding. In contrast, in low-directed
concept mapping tasks, students have greater freedom to express their
understating of a topic using components that they construct on their own. In
this case, the openness of the tasks is more challenging to the students.
Some examples of commonly used concept mapping tasks from highdirected to low-directed ones are provided below.
2.1 High-directed concept mapping tasks: Fill-in-the-map
Fill-in-the-map tasks provide students with several concepts and require them to
fill in a skeleton map with these concepts. Figure 2 shows two different examples
of fill-in-the-map tasks: Fill-in-the-nodes and Fill-inthe-lines. Distracters may be
3
included to encourage students to think carefully about which items are relevant
to the map. The Fill-in-thenodes task in Figure 2 is an incomplete concept map
with two blank nodes. Four concepts are provided, two of which are distracters.
On the other hand, the Fill-in-the-lines task has two unlabelled links. Two linking
phrases are provided, with no distracter. The teacher has to decide whether or
not to include distracters, depending on the stage of learning and the students
ability. In either case, students fill in the blanks with what they think are the
correct items based on their understanding.
To design this type of mapping task, teachers either construct a concept
map themselves or use an expert-constructed map (for example, through
working with other teachers or mathematicians). Then remove some of the
concepts or linking phrases from the map and add distracters, if desired. This
type of concept mapping task is easy to administer and to grade, for example, by
counting the number of correctly filled items.
ADA TABEL
2.2 Semi-directed concept mapping tasks
When one or two of the above mentioned four components of a complete
concept map is missing and the other remaining components are fully or partially
provided, the concept mapping task is considered to be semidirected. Compared
with the high-directed concept mapping tasks, the semi-directed mapping tasks
require more efforts to complete.
In the semi-directed concept mapping task shown in Figure 3, only
concepts and linking phrases are provided. Students need to construct a concept
map including all the given concepts but only the relevant linking phrases. An
example of a possible concept map is also shown.
ADA TABEL
A variation of a semi-directed concept mapping task, illustrated in
Mansfield and Happs (1991), is to provide students with a partial list of concepts
of a particular topic, say, quadrilaterals. The most inclusive concept, in this case,
quadrilateral, is placed at the top of the map, with the other less inclusive
concepts, such as rectangle and rhombus, at lower levels, thereby requiring
students to consider hierarchy among the
2.3 Low-directed concept mapping tasks: Free-style mapping
Low-directed concept mapping tasks, also called free-style mapping, require
students to fully construct the maps based on the mapping topic or a list of given
concepts. They are free to express ideas in their own ways covering the four
components of a concept map. When only a mapping topic is given, students
need to first identify some concepts relevant to the topic and then construct the
map accordingly. For most school students, a concept list is usually given
because they may have difficulty in selecting the appropriate concepts. Some of
them may provide concepts that are somewhat related but not relevant or
essential to the topic (Jin, 2007). For example, they may include the concept
mathematics within the topic of functions: functions are very important for the
learning of mathematics. This kind of propositions does not directly address
students understanding about functions, and irrelevant concepts may even
distract students from constructing meaningful maps. A given concept list will
help them focus on a certain knowledge domain; at the same time, the task can
4
allow students to include additional concepts that they think are relevant to the
given ones.
The concept map in Figure 4 by a Singapore Secondary 3 student is an
example of a low-directed concept mapping task with a given list of concepts
about quadrilaterals. The student had used all the concepts provided without
adding new ones. The map was well constructed, with the most general concept
polygon located at the top, followed by less inclusive concepts quadrilateral,
parallelogram, and similar shapes at the middle levels, and the least inclusive
concept diagonals at the bottom.
ADA TABEL
Teachers may begin with high-directed mapping tasks and then move to
low-directed ones. This is because the high-directed mapping tasks are relatively
easy for students to complete. Furthermore, starting with easier tasks allows
time for both teachers and students to become familiar with the purposes and
construction of concept maps before they tackle the more challenging lowdirected tasks.
3 Training on Concept Mapping
Where concept map has not been extensively used in mathematics lessons, it is
necessary to train students on the techniques of constructing informative
concept maps. High-directed and semi-directed mapping tasks are, however,
quite straightforward and do not require extensive
Concept training. Thus, this section will focus on training in free-style mapping
tasks where a list of concepts is given. This is also most commonly used by
researchers and widely reported in the literature.
The following procedures have been developed based on the literature and
pilot studies conducted in Singapore and China (Jin and Wong, 2010).
1. Introduction: Teachers first provide students with a preliminary idea of
what a concept map is, what it is used for, and what its attributes are, i.e.,
nodes, arrowed links, and linking phrases.
2. Demonstrate with examples: Teachers begin with an example with four
or five concepts that students have already learned. First, read aloud the
concepts and help students to recall their meanings. Second, write the
concepts onto separate cards so that they can be easily moved around to
explore various connections that make sense. Concepts that are most
closely related are arranged near to one another. Third, once the intended
connections have been decided upon, identify the relations between each
pair of concepts and draw directed lines between them. Fourth, write on
each line the relationships identified so that propositions can be formed.
Finally, go back and check to see if any concept or relationship has been
left out; redraw the map if necessary.
3. Student practice: Provide students with a different set of concepts for
practice and remind them to pay attention to the following: a. All the
given concepts should be included in the map. b. In arranging the
concepts, make sure enough space is left for adding linking phrases. c.
The lines should be directed (with arrow) so that the relationships are
clear. d. All the lines should be labeled with linking phrases. e. The entire
map should be clear and legible.
4. Consolidation: After some practice, students should have mastered the
basic skills of concept mapping. Teachers should further encourage
students to include additional relevant concepts into their concept maps,
to construct as many relationships as they can between the concepts, and
to describe the relationships using informative, detailed linking phrases.
As the concept map is used as a graphical representation of students
conceptual understanding, they should show as much of their knowledge
as possible in their map so that it is rich enough to capture the essential
attributes of their conceptual understanding. With this the teachers can
obtain a better idea about what the students have already grasped and
which contents they are still weak in.
boxes, spaces are provided for students to add linking lines and labels in their
own words.
ADA TABEL
With the given concepts, either in the boxes or in the list, and the fixed
hierarchical positions of the concepts, this task focuses students attention on a
particular domain. Thus, teachers have more control over what they are testing.
This task can be converted to the low-directed type, for example, by providing
only the mapping topic numbers or offering a list of concepts related to numbers.
As mentioned in the earlier section, this new task is more challenging for
students to complete and teachers to grade; yet, its openness allows students to
have greater freedom to express their understanding, thus, giving more valuable
information to the teachers.
4.3 Using concept map to track students progress in learning
Concept map has been used to track the changes in a students cognitive
structure and its increasing complexity as he or she integrates new knowledge
into existing cognitive structure. For example, Mansfield and Happs (1991)
reported their use of concept map as an expedient evaluation tool in a study of
parallel lines among a group of 12-year old students. In their study, the same
concept list consisting of eleven concepts was provided in the pre- and postconcept mapping tests before and after instruction of parallel lines. They cited
the concept maps drawn by the student, Bruce: he used only five concepts in the
pre-concept map but seven, adding one new concept, in the post-concept map.
Furthermore, the propositions in the post-concept map were more informative,
for example, revealing a misconception not found in the preconcept map.
Although the two maps were well-constructed, the omission of some given
concepts suggests that further teaching of these concepts is required for that
student. Thus, comparing concept maps constructed before and after instruction
can help teachers determine how much progress their students have made and
how effective the instruction has been. With the information drawn from the
comparison, teachers can then adjust their plans for future lessons.
4.4 Constructing concept maps as a learning strategy
Concept mapping has been widely promoted as a learning strategy to help
students elaborate on their learning and thereby to develop deep conceptual
understanding (Afamasaga-FuataI, 2006; Jegede, Alaiyemola and Okebukola,
1990). This popular application extends concept mapping beyond its use as a
formative or summative assessment tool.
Concept map can serve as a scaffold for students to organize their own
knowledge. At the end of a unit of instruction, a high-directed concept mapping
task can help students clarify the nature and number of connections among
newly learned concepts. A low-directed concept mapping task will encourage
them to reflect on the possible relationships among the concepts and represent
these relationships in a pictorial way. They may even see links that they are not
initially aware of (De Simone, 2007), thereby developing deeper understanding
about the concepts. They can modify these maps as learning progresses. This
constructive activity can be more effective when students work together in
groups to discuss their ideas and combine their knowledge in order to learn and
construct new knowledge (Gao, Shen, Losh and Turner, 2007). This group activity
will also provide opportunity for groups to compare their conceptual structure
with other groups and this will inspire further learning. In recent years, with the
support of concept mapping software such as CmapTools (Novak, 1998) and
SmartDraw (http://www.smartdraw.com), students can now build and discuss
their concept maps at distant locations (Novak and Caas, 2006) and flexible
times.
9
10
11
12
13
The third measure of the relationship between each pair of concepts is the
quality of the proposition indicated by the linking phrase between them. A
simplified scoring scheme is as follows (see McClure, Sonak and Suen, 1999;
Novak and Gowin, 1984):
(1) when a proposition has no linking phrase or indicates misconception,
score 0;
(2) when a proposition indicates a relationship between the
connected concepts but with partially correct or incomplete linking
phrases, score 1;
(3) when a proposition indicates a correct and meaningful relationship
between the
connected concepts, score 2.
This scheme is illustrated in Figure 7 below. Proposition (a) indicates a
misconception of the relationship between square and parallelogram; thus, it is
scored 0. Proposition (b) correctly indicates the relationship that square is a
parallelogram; however, the linking phrase is very brief and gives no further
information about how or why a square is a parallelogram. Compared to
proposition (b), the proposition (c) is more detailed as it gives a complete
description of a square in relation to parallelogram. To apply the scoring scheme,
teachers should decide how much their students are expected to master the
relationship between two concepts at their stage of learning. If the students
propositions have met the expectation, then score 2; if the expectation is only
partially met, score 1. With this in mind, a teacher may score proposition (b) 1 or
2 according to his/her expectation. For formative assessment, pay attention to
the actual propositions, in addition to the scores, in order to identify students
good understanding as well as misconceptions.
ADA TABEL
The usefulness of the distance, connectedness, and quality of proposition
scores becomes apparent for more complex concept maps. These scores allow
more objective comparison between studentconstructed concept maps.
14
16