10 - Chapter 3
10 - Chapter 3
THE EXPERIMENT
3.0 Introduction
This chapter is divided into three major sections: 3.1 Research Design and
Methodology, 3.2 The New Materials, and 3.3 The Field Trial. Section 3.1
variables and describes the participants (sample). Section 3.2 gives details
of the new materials. It gives details of the language skills covered and the
sample unit from the multimedia package. Finally, the 3.2 presents the
details of the research tools used for the study, measures taken for data
Section 3.3 gives an account of the piloting and the field trial of the
materials.
As stated earlier, the purpose of the study was to establish the effect of the
UG level in Digital Language Laboratory. The study was guided by the null
hypothesis given in the section 1.7 of the thesis. The testing of hypothesis
94
and Shohamy (1989) the “Experimental research is carefully constructed so
linguistics, the feasibility of carrying out a true experiment which fulfils the
criteria of all the three basic characteristics may not always be viable. “The
Farhady, 1982). So, to meet the requirements, the present study uses one
and Sohamy (1989), the one-group pre-test post-test design “attempts to use
the subjects as their own controls and to eliminate the need for a control
variable.” Seliger and Sohamy (1989) further state that “the design is
95
efficient because it controls a number of extraneous variables which can
affect the homogeneity of subjects when more than one group is involved”.
X1 – T – X2
where, X1 is the pre-test, T is the treatment, that is, the tryout of the
Thus, the present study has adopted the one group pre-test post-test design
3.1.1 Variables
variable”. It can also be defined as the major variable that the researcher
The dependent variables therefore in this study are the pre-test and post-test
students.
3.1.2 Participants
have already been assigned on the basis of some principle like test scores,
class called an intact group. An intact group allows the researcher to give
The purpose of the present study is to establish the effect of the multimedia
group of First Year Arts and Commerce students of Sardar Patel University
97
that had qualified itself at 12th Examination of Gujarat State Higher
female and twelve were male; ten students had passed the 12th board
examination in the Commerce stream and ten in the Arts stream. The
mother tongue of all participants was Gujarati. They had studied English as
schools. Ten of them had scored above 50 marks in English at 12th standard
level. Nine participants’ the annual family income was above one lakh and
eleven participants’ family income was below 1 lakh per year. Thus, the
sample, that is, the participants for the present study were controlled in the
sense that they belonged to an intact group and had similar linguistic and
educational background.
three basic components of the experiment: the sample, the treatment, and
the measurement of the treatment (Seligar and Shohamy, 1989). The current
study therefore involves the control of the three components namely, the
98
the multimedia materials, and the measurement of the treatment, that is the
below.
the year 2010-11 after piloting of a sample unit. The multimedia materials
consisted of five units of three hours each. Each unit of the package
speaking and reading skills were covered in the multimedia package. Each
learning activities were generally group and pair works as preparation and
with and without computer activities. The units also had instructions for the
focus and positive impact where interactiveness and meaning focus make
99
them different from exercises with structural grammar focus in the sense
that they involve the learners in expressing and interpreting meaning. This
2001). Following van Lier (1996), Chapelle (2001) further suggests that
gives details of the unit titles, the language functions and the grammar
topics that were developed in the five units. Moreover, the units were
materials production.
The pre-test administered at the beginning of the experiment and the post-
true/false, choose the correct option and fill in the blanks exercises. In
addition to this, a speaking test was given to assess speaking ability of the
participants. A list of five questions on real life language use was prepared
for each language function included the package. The participants were
asked five questions from the list and were given a time limit to respond.
100
The participants were assessed qualitatively using the rubrics given in the
table 3.2 below. The rubrics were adopted and adapted from BULATS and
Level Descriptors
B2 • Achieves the task adequately; most responses are appropriate but a few may
be inappropriate or ambiguous (possibly due to incomprehension of input). •
Able to express simple ideas and makes some attempt to express complex
ideas; mostly coherent, with some extended discourse. • There is an adequate
range of grammar and vocabulary which is sufficiently accurate to deal with
the tasks. • Pronunciation can generally be understood. • May be some
hesitation while searching for language generally makes adequate use of the
allowed response time.
101
B1 • Achieves most of the task, in a limited way; some responses may be
inappropriate, ambiguous or not attempted (possibly due to incomprehension
of input). • Able to express simple ideas; little extended discourse; some
incoherence. • The range of grammar and vocabulary used is sufficient to
complete tasks in a limited way. Some language in simple utterances is
accurate but basic inaccuracies may impede communication of ideas and
achievement of the tasks. • Pronunciation can generally be understood but L1
features may cause strain• Hesitation may demand patience of the listener;
use of the allowed response time may not always be adequate.
A2 • Achieves only simplest part of the task (i.e. responding to simple prompts)
in a very limited way; many responses may be inappropriate, ambiguous or
not attempted (possibly due to incomprehension of input). • No extended
discourse • The range of language is sufficient to respond to simple prompts
but not to complete complex tasks. Some utterances (single words or short
phrases) may be accurate but inaccuracies in grammar and vocabulary limit
achievement of the tasks and restrict coherence and communication of ideas.
• Pronunciation of single words may be intelligible but L1 features may make
understanding difficult. • Hesitation is excessive; use of the allowed response
time is adequate on only a few occasions.
A1 • May achieve a few of the simplest parts of the task (i.e. responding to simple
prompts) in a very limited way; most responses may be inappropriate, ambiguous or
not attempted (possibly due to incomprehension of input). • Utterances may be
limited to single words. • The range of language is limited and inadequate to
complete the tasks. Some accurate language but frequent inaccuracies may mean the
message is not communicated. • Pronunciation of single words may be intelligible
but L1 features may cause excessive strain to a listener. • Hesitation is excessive;
use of the allowed response time is generally inadequate.
102
A post-test of comparable difficulty level was administered at the end of the
experiment.
reflect on 20 “Can Do” statements through responses such as Yes; No; and
speak slowly’, ‘I can ask and answer simple questions about home, country
and work place’, etc in the beginning and at the end of the experiment.
mention that:
103
“questionnaires have a number of advantages: a) They are self-administered
and can be given to large groups of subjects at the same time. They are
questionnaire is given to all subjects, the data are more uniform and
standard. d) Since they are usually given to all subjects of the research at
exactly the same time, the data are more accurate” (p.172).
attitudes that are not easily observed. For the current research, the
efficient than open ones. Thus, the subjects were made to check agreements
five point scale with responses such as: strongly agree; agree; not sure;
the researcher already had descriptive data of the subjects through the form
104
the real life language use, time, interactivity, attitude towards technology
items.
Accessibility area had items like, ‘It is easy to understand the instructions’,
‘The navigation between the slides is easy’. The relevance of the content
was assessed through items like, ‘The situations used for practice are real
life like’, ‘The language functions, grammar and vocabulary practiced are
useful in day to day life”, etc. For assessing appropriateness of the duration
of the units and time given to accomplish task, the subjects were asked to
respond to, ‘I could finish the tasks in the given time-frame’ and ‘I got
technology and overall enjoyment were assessed using items like ‘I got
and pair works helped me improve the language’; ‘I enjoyed learning the
and ‘I enjoyed working on and off the computers’, ‘I found the materials
difficult to say that there is any data collection procedures that do not affect
105
the data (Seliger and Shohamy, 1999). In other words, all data collection
more important that the researcher is aware of these effects in explaining the
techniques to assure the quality of the research and the quality of data
measure. Seliger and Shohamy (1989) note that “the internal validity of a
research study concerns with being able to state that relation between the
extraneous variables” (p. 105). Thus the internal validity refers to the results
that are because of the factors that have been selected by the researcher,
rather than other factors that the researcher hasn’t controlled. Factors that
could influence the internal validity of a research study are usually related to
the participants and the instrumentation. The current research has ensured
106
a. The participants
the influence if events that take place at different points in time on the
possible negative effects of the extended duration of the study. In such cases
language input other than those measured by the dependent variable. Any
this if care is not taken (Perry, 2005). The current study was conducted over
a period of three weeks which included the 15-hour program and therefore
Another factor that may have an effect on the internal validity is attrition. In
procedures, the subjects may lose interest and drop out or may remain
by history, but deals with natural changes taking place over time in the
107
participants such as emotional states, physical coordination and strength, or
factor with younger subjects than with older ones (Seliger and Shohamy,
1989). Studies that take place over longer periods of time are potentially
researcher does not randomly select the samples when forming different
groups for comparisons (Perry, 2005). Since the current study used
randomly selected subjects from an intact group, the issue about pre-
The multimedia package used for the treatment was designed and developed
comments made by the experts were incorporated into the design. Thus,
experts’ comments also helped validate the design and the content of the
in establishing the validity of the design as well as the treatment used in the
current study.
108
c. The tests
both the pre-test as well as the post-test by having them reviewed by the
experts. To avoid the threat of the test effect, the post-test in the current
study had different test items of comparable difficulty level. However, the
d. The Questionnaire
procedure, the researcher can obtain information on whether the items are
well phrased and easily understood by the respondents. For the current
study, an item analysis was conducted and the items were modified and
revised thus ensuring that the questions provided varied and meaningful
information through its items. In addition to the item analysis, a pilot run of
the questionnaire was carried out for determining the quality of the
109
3.2 The New Materials
The new materials were divided into five units. The units were a
different media. Often they are available on a CD-Rom which makes use of
print, graphics, video and sound. Usually such materials are interactive and
which they produce” (p. xi). Therefore, the units were digitized and were
on the internet that can make the content presentation interactive and
package.
Bangs, Frisby and Walton (2005) assert that “authoring tools enable the
content elements such as texts, pictures, and audio and video recordings,
110
programmes. Online encyclopaedia Wikipedia defines an authoring tool as
have a range of uses, they are commonly used to create e-learning modules.
(Chappelle, 2001). CourseLab 2.4 is a free authoring tool that fulfils many
SCORM 2004, SCORM 1.2, and AICC. In addition to this, it can stand
alone i.e., it does not require LMS and can be distributed of a CD. Working
Internet Explorer 6.0 or higher and 50MB hard drive space. Minimum
111
Windows® 98, XP, 2003, Internet Explorer 5.0, Mozilla FireFox 1.0 or
higher, JavaScript enabled and XML support enabled. The key features of
112
• Access to additional functionality of the Course Player for advanced”
(CourseLab 2.4, p.7).
3 Do you know him? Asking about and Questions like: What… look
describing people’s like, how old, what color,
appearance; Identifying how long/tall; Modifiers and
people prepositions
4 Did you buy this? Talking about prices; Questions with How
Talking about preferences; much/many, Which,
Making comparisons Demonstratives;
Comparison with adjectives
113
3.2.2 Sample Unit
Pre-learning activities
Activity 1
Divide the class into two groups and make them play a quiz on Gujarat. Ask
6 questions to each group and give 10 points for each correct answer. If a
team fails to answer a question, it will pass to the other team. On giving
correct answer of the question, the team will get 05 bonus points. Compare
You may ask general knowledge based questions on Gujarat such as:
b. Where would you go to see Aina Mahal and Prag Mahal in Gujarat?
e. What are the names of the two Indus Valley Civilization towns found
in Gujarat?
114
Activity 2
Divide the class into groups of 10 students each. Ask them to list ten places
in Gujarat worth visiting. Get the answers from each group and write them
on the board. Ask the learners to study each other’s list and make changes
Ask the learners to imagine that they have guests from a foreign country
and they are supposed to take them on a tour of Gujarat. But following the
time constraint, they have to select any five places for the visit. Which
Now, ask the learners to log on to the computers and take the Unit.
Conversation 1
Kate : I’m fine, Jeet. Thank you. And how are you?, I’m going to India
next December for a month.
115
Kate : Jeet, You are from India, aren’t you?
Kate : I hear India is a big country and there are many states worth
visiting!
Kate : So, how do I plan my visit? Could you help me, please?
Jeet : Well, you may restrict your visit to any one or two states this time.
And being a Gujarati, I’d suggest you to visit Gujarat first.
Jeet : Gujarat is famous for its rich historical and cultural heritage. It has
archeological sites, beaches, hills, places of pilgrimage and diverse
people.
By the way, let’s visit Gujarat Tourism website. You will be able
to see some of the attractions there.
116
Video Clip 2
Transcript
Tucked away on the western coast of India, Gujarat is a state famous for its
Mahatma Gandhi and Sardar, Gujarat is ……… …….. its rich cultural and
historical heritage that dates back several centuries down to the times of
prosperous and industrialized states and is well connected by air, road and
international airport at Ahmedabad, you can fly into Gujarat from any
corner of the world. Wherever you …….. come from and whatever may be
your interest, you will find Gujarat interesting, vibrant and welcoming. You
can traverse across the entire state within hours owing to …….. superb
internal infrastructure and spend months without the feeling of being left
out. It is here that you ……. visit all those archaeological sites and relive
moments of history. It is here that you can stroll on sun presst beaches on
one day and retire back to the hills the next. It is …….. that you can unwind
your body and mind in an Ayurvedic spa or cleanse your soul at many
pilgrimage centers. It is here that you will meet diverse people and discover
117
their undying passion for life and its celebrations. So, it doesn’t matter
………….. you are young or old, hiker or a sea lover, spiritually inclined or
Gujarat for you just like there is something in Gujarat for ……………. .
Everyone
Vocabulary Exercise 1:
Watch the video again to guess the correct meanings of the words
1. Tuck away
2. globetrotting
3. date back
4. recently commissioned
planned
118
5. traverse across
6. Unwind
Now, watch the video clip, listen to the commentary carefully. Check
Conversations 2
Kate : Well Jeet, it sounds interesting. I think I should start from Gujarat.
Kate : I think I‘ll land in Ahmedabad, that’s the only international airport
in the state, isn’t it?
Jeet : It’s a fairly big city, but it’s not too big like New Delhi and
Mumbai.
Kate : Is it expensive?
119
Jeet : No, it’s not too bad. Not as much as a city in the US or the UK.
Jeet : Yes, it is. It has many attractions like Sabarmati Ashram, Sidi-
saiyad Mosque, Adalaj vav and Calico Museum. It has rich cultural
heritage as well as flare of a modern India.
Kate : Excellent! Well Jeet, I also read somewhere that there are many
ancient temples in Gujarat.
Jeet : It’s true. Gujarat is a land of religious minded people and some of
the world’s most famous temples are in Gujarat. Let me show you a
video from the website.
Video Clip 3
Watch the video and listen carefully to say whether the following
Transcript:
Gujarat is a land of religious minded people who have an intense faith in the
God almighty. Little wonder that Gujarat is also a land of temples. Somnath,
120
the temple of Lord Shiva and Dwarka, the holy abode of Lord Krishna
continues to draw millions of devotees and tourists. And while hill top
shrines like Ambaji, Palitana, Girnar and Pavagadh offer a rich spiritual fair
history will leave you spellbound and with feelings of reverence to the sun
God.
Conversation 3
Kate : This is exciting, Jeet. I would love to visit these temples. Can you
Jeet : Well, one can experience three different seasons in a year in Gujarat
as in other parts of India. Summers are very hot. Monsoon hot and
Jeet : You are going at the right time. December to February is winter.
Let me show you some more clips from the website and then you
121
Video Clip 4
Video Clip 5
Activity 1
Divide the class in groups and make each one answer some of the following
questions about his or her hometown. Make them ask follow-up questions to
122
Questions:
Activity 2
Ask the learners to find out students from the group who have visited some
state or city recently. Ask the others to find out more about that state or city
the board or give them on a handout. The students may ask questions like
A: Yes, I did.
C: …………………… ?
123
Sample Questions:
What’s the best time of year to visit? What’s the shopping like?
What’s the weather like then? What things should people buy?
What should tourists see and do What else can visitors do there?
there?
Which place did you like the most?
Activity 3
Read the following passage and answer the questions given below it.
SOMNATH
Daksha,who was a son of Brahma. However, Som loved only one of them,
Daksha cursed his son-in-law, causing him to lose his brilliance. In despair,
Som turned to Shiva and served him with such zealous devotion that Shiva
124
gave him respite from the curse - he would wax for half the month and wane
for the rest. In gratitude, the Moon God built a Shiva temple at Somnath.
Situated on the coast with a commanding view of the Arabian Sea, the
Somnath Temple is one of the twelve most sacred Shiva shrines in India.
off with camel-loads of gold and precious gems, leaving the edifice in ruins.
The cycle of pillage and reconstruction at Somnath continued over the next
seven centuries. The present temple, made of stone, was built in 1950. It is
situated 79 Kms. from Junagadh and 450 Kms from Ahmedabad. According
to the legend, Somnath is as old as creation itself. East of the temple, at the
confluence of three rivers, is Triveni Tirth. The ghats going down to the sea
at this spot are said to mark the place where Lord Krishna’s funeral rites
were performed, after a hunter mistook him for a deer and killed him.
125
2. Working with your partners, put the following in the order in which
they happened:
The field trial was conducted by the researcher as a teacher. The field trial
commenced with the pre-test. The participants were made to take the
reading, listening and speaking tests. Following the test, the participants
package. It was ensured that the participants could access the computer
the teaching of the units that constituted the multimedia package. At the end
126
of the treatment, the post-test was administered. The trial ended with
3.4 Conclusion
the research design adopted to address the research hypotheses posed in the
current study. The first section gives justification for the selection and use
of the research design. The second section gives a detailed account of the
new materials, the tests and data validity and reliability measures taken.
127