Research Methodology
Research Methodology
Research Methodology
net/publication/369479003
Research Methodology
CITATIONS READS
0 19
2 authors:
All content following this page was uploaded by A. Sivakumar on 24 March 2023.
Dr. G. Singaravelu
and
Dr. A. Sivakumar
iii
iv Research Methodology
♦
and measurement, Introduction to Statistics, Computer Application
and Report preparation.
The present book is dedicated to our parents. We extend our thanks
to all the members of faculty of Education, Educational Technology and
Department of Education (SDE) ,Bharathiar University, Coimbatore.
ix
x Research Methodology
♦
of Education, Educational Psychology, Problems of Education,
Research Methodology , Web Based Learning etc. He is guiding 8
Ph.D scholars in Bharathiar University. He has produced 64 M.Phil in
Education. He has produced 4 Ph.D in Educational Technology and 16
Ph.D in Education. He has completed a Major project entitled e-TLM Chapter-1
Package. He participated and presented papers in conferences held in
University of Cologne, Germany and visited Dubai as well as Sharja. RESEARCH METHODS
He participated and presented papers in conferences held in University
of Pennsylvania, Philadelphia, USA, University of Malaya, Malaysia,
Infrastructure University, Kualalumper and Nanyang University,
Singapore. He is a visiting Team member of NCTE , selection committee
member of Principals and Faculties and Inspection committee member 1.1. MEANING OF RESEARCH
of TNTEU. He has been acting members in INFITT, ISFTE, Research Research comprises “creative work undertaken on a systematic
Advisory Board and Board of study members in various universities basis in order to increase the stock of knowledge, including knowledge
of humans, culture and society, and the use of this stock of knowledge
Dr. A. Sivakumar holds the Degrees of M.Sc,,M.Ed,M.Phil(education), to devise new applications.” It is used to establish or to confirm facts, to
Ph.D(education). He has been serving as Guest Lecturer, Department reaffirm the results of previous work, to solve new or existing problems,
of Educational Technology, Bharathiar University, Coimbatore, Tamil to support theorems, or to develop new theories. A research project may
Nadu. He is specialized in Computer Education and SPSS Package. also be an expansion on past work in the field. To test the validity of
He published 10 papers and participated10 conferences in Tamil Nadu. instruments, procedures, or experiments, research may replicate elements
He published 2 books in the field of education. of prior projects, or the project as a whole. The primary purposes of
basic research (as opposed to applied research) are documentation,
discovery, interpretation, or the research (R&D) of methods and systems
for the advancement of human knowledge. Approaches to research
depend on epistemologies which vary considerably both within and
between humanities and sciences.
Educational research refers to a variety of methods, in which
individuals evaluate different aspects of education including: “student
learning, teaching methods, teacher training, and classroom dynamics”.
Educational researchers have come to the consensus that educational
research must be conducted in a rigorous and systematic way, although
what this implies is often debated. There are a variety of disciplines
which are in educational research. These include psychology, sociology,
anthropology and philosophy. The overlap in disciplines creates a broad
range from which methodology can be drawn. The findings of educational
research also need to be interpreted within the context in which they
are discovered as they may not be applicable in every time or place.
1
2 Research Methodology Research Methods 3
♦ ♦
Gary Anderson outlined ten aspects of educational research: Basic Research
• Educational research attempts to solve a problem. The research is done for knowledge enhancement, the research
• Research involves gathering new data from primary or first-hand which does not have immediate commercial potential. The research is
sources or using existing data for a new purpose. done for human welfare, animal welfare and plant kingdom welfare. It
is called basic, pure, fundamental research. The main motivation is to
• Research is based upon observable experience or empirical evidence.
expand man’s knowledge, not to create or invent something. According
• Research demands accurate observation and description. to Travers, “Basic Research is designed to add to an organized body
• Research generally employs carefully designed procedures and of scientific knowledge and does not necessarily produce results of
rigorous analysis. immediate practical value.” Such a research is time and cost intensive.
• Research emphasizes the development of generalizations, principles
Applied Research
or theories that will help in understanding, prediction and/or control.
Applied research is designed to solve practical problem of the
• Research requires expertise—familiarity with the field; competence
modern world, rather than to acquire knowledge for knowledge’s
in methodology; technical skill in collecting and analyzing the data.
sake. The goal of applied research is to improve the human condition.
• Research attempts to find an objective, unbiased solution to the It focus on analysis and solving social and real life problems. This
problem and takes great pains to validate the procedures employed. research is generally conducted on large scale basis, it is expensive.
• Research is a deliberate and unhurried activity which is directional As such, it often conducted with the support of some financing agency
but often refines the problem or questions as the research progresses. like government, public corporation, world bank, UNICEF, UGC,
• Research is carefully recorded and reported to other persons Etc,. According to hunt, “applied research is an investigation for
interested in the problem. ways of using scientific knowledge to solve practical problems”
for example:- improve agriculture crop production, treat or cure a
1.2. NATURE OF RESEARCH specific disease, improve the energy efficiency homes, offices, how
• Research strives to be objective and logical. can communication among workers in large companies be improved?
Applied research can be further classified as problem oriented and
• Research is based on observable experience and empirical evidence.
problem solving research.
• Research is characterized by patient and unhurried activity.
• Research demands accurate observation, reservation and description. Problem oriented research
• Research is directed towards the solution of the problem. Research is done by industry apex body for sorting out problems
faced by all the companies. Eg:- WTO does problem oriented research
• Research is carefully recorded and reported.
for developing countries, in India agriculture and processed food export
• Research acquires expertise. development authority (APEDA) conduct regular research for the benefit
• Research involves gathering new data from primary data or first- of agri-industry.
hand sources or using existing data for new purpose.
Problem solving
1.3. TYPES OF RESEARCH This type of research is done by an individual company for the
Research can be classified in many different ways on the basis of problem faced by it. Marketing research and market research are the
the methodology of research, the knowledge it creates, the user group, applied research. For eg:-video conference, international conducts
the research problem it investigates etc, research to study customer satisfaction level, it will be problem solving
4 Research Methodology Research Methods 5
♦ ♦
research. In short, the main aim of applied research is to discover some • Ethnography: - This type of research focuses on describing the
solution for some pressing practical problem. culture of a group of people. A culture is the shared attributes,
values, norms, practices, language, and material things of a group
Quantitative Research of people.
This research is based on numeric figures or numbers. Quantitative • Case study:-It is a form of qualitative research that is focused on
research aims to measure the quantity or amount and compares it providing a detailed account of one or more cases.
with past records and tries to project for future period. In social
• Grounded theory:- It is an inductive type of research, based or
sciences, “quantitative research refers to the systematic empirical
grounded in the observations of data from which it is developed. It
investigation of quantitative properties and phenomena and their
uses a variety of data sources, including quantitative data, review
relationships”. The objective of quantitative research is to develop
of records, interviews, observation and surveys
and to employ mathematical models, theories or hypothesis pertaining
to phenomena. • Historical research:-It allows one to discuss the past and the
The process of measurement is central to quantitative research present events in the context of the present condition and allows
because it provides fundamental connection between empirical one to reflect and to provide possible answers to current issues
observation and mathematical expression of quantitative relationships. and problems.
Statistics is the most widely used branch of mathematics in quantitative In addition to the above, the researcher also have the descriptive
research. Statistical methods are used extensively with in fields such research. Fundamental research, of which this is based on establishing
as economics and commerce. various theories, also the research is classified in to
Quantitative research involving the use of structured questions, • Descriptive research
where the response options have been pre-determined and large number
• Analytical research
of respondents is involved. Eg:-total sales of soap industry in terms of
rupees cores and quantity in terms of lakhs tones for particular year. • Fundamental research
• Conceptual research
Qualitative Research
• Empirical research
Qualitative research presents non-quantitative type of analysis.
• One time research or longitudinal research
Qualitative research is collecting, analyzing and interpreting data
by observing what people do and say. Qualitative research refers to • Field-setting research or laboratory research or simulation research
the meanings, definitions, characteristics, symbols, metaphors and • Clinical or diagnostic research
description of things. Qualitative research is much more subjective • Exploratory research
and uses very different methods of collecting information, mainly
• Historical research
individual, in-depth interviews and focus groups.
The nature of this type of research is exploratory and open ended. • Conclusion oriented research
Small numbers of people are interviewed in depth and or a relatively • Case study research
small number of focus groups are conducted. Qualitative research can • Short term research
be further classified in the following type.
• Phenomenology:-A form of research in which the researcher 1.4. SCOPE OF RESEARCH
attempts to understand how one or more individuals experience All research is goal oriented. The goal of research is three fold in
a phenomenon. nature, discovery of new knowledge, refinement of existing knowledge
6 Research Methodology Research Methods 7
♦ ♦
and finding the solution to problem. A piece of research may have one or better grasp core subjects. This type of instruction moves away from
more of these goals. Research gives birth to new knowledge or develops, the traditional lecture model of teaching and offers students a way to
elaborates and refines the existing knowledge. The new knowledge may learn at their own pace. Slower learners can take the time they need
help to improve the prevailing conditions and also correct errors and to develop a solid understanding of material while more advanced
misconceptions. In the words of J. Francis Rummel, “Research is an students don’t have to wait to move on to the next concept. This better
endeavor to discover, develop and verify knowledge. It is an intellectual addresses individual learning styles and allows teachers to utilize diverse
process that has developed over hundreds of years, every changing in platforms to provide instruction.
purpose and form and always searching for truth”. According to George
J. Mouly, “Research is a most important tool for advancing knowledge, Mixed-Age Teaching
for promoting progress and enabling man to relate more effectively to his The potential benefits of putting kids of different ages together
environment, to accomplish his purposes and to resolve his conflicts”. in the same classroom are still being researched, but many schools
Research clarifies certain problems that exist and also assist to find the have been using this teaching method for years with good results.
solution to them. To quote Mouly, “Actually research is simply the process In a mixed-age classroom, the young students learn how to interact
of arriving at dependable solution to problems through the planned and with older ones and benefit from observing their academic abilities.
systematic collection, analysis and interpretation of data”. Collaboration between age groups facilitates further development.
Achieving advanced competencies at the young age increases confidence.
1.5. TRENDS IN EDUCATIONAL RESEARCH Teachers also benefit from mixed-age classrooms in that they’re able
Looking at current trends in educational research provides an eye- to track their students through more than one grade to get a clearer
opening view of the modern classroom. If the researcher are looking picture of academic growth.
into a career in education, keeping up with changing instructional styles
prepares the researcher to enter the field with the tools the researcher Brain-Based Teaching
need to best serve today’s students. Based on neuroscience research that shows consistent practice of a
concept creates strong pathways between neurons, brain-based teaching
Team Teaching takes advantage of the power of the developing mind to create the
Putting two instructors in one classroom is known as team teaching. greatest amount of positive changes during the short period that kids
It can otherwise be called collaborative team teaching or co-teaching. are in school. Kids work in groups, participate in games that address
This model provides benefits and presents challenges to both teachers specific concepts and engage in lessons built around central themes, all
and students. Kids in co-teaching classrooms observe teamwork in with the goal of improving their understanding of important academic
action and learn to see concepts from more than one perspective. They skills and ideas. Physical education is included to facilitate the growth
have the chance to learn from teachers with diverse backgrounds and and development of new neuronal pathways.
can delve deeper into subjects thanks to the opportunity for more
one-on-one instruction time. However, conflicting personalities and Critical Thinking Skills
the tendency of students to favor one teach over the other can threaten Although memorization of fundamental facts is critical to building
the stability of this model. a foundation of knowledge in the early grades, kids also need to be
taught how to apply those facts in a multitude of situations. Research
Individualized Instruction into critical thinking skills is driving new ways of teaching that include
A great deal of research is being done on how diversification of encouraging students to ask questions, develop problem-solving skills by
instruction to cater to the unique needs of students may help them to working in groups and discuss the outcomes of their experiments. These
8 Research Methodology Research Methods 9
♦ ♦
methods of discovery give kids a more active role in their education 1.6.1. Historical Methods
and teach them how to make decisions by applying the facts they’ve Historical method comprises of the techniques and guidelines by
learned to the problem at hand. which historians use primary sources and other evidence, including the
evidence of archaeology, to research and then to write histories in the
1.6. QUALITATIVE RESEARCH TECHNIQUES
form of accounts of the past. The question of the nature, and even the
Qualitative research is a type of social science research that collects possibility, of a sound historical method is raised in the philosophy of
and works with non-numerical data and that seeks to interpret meaning history as a question of epistemology. The study of historical method
from these data that help us understand social life through the study and of different ways of writing history is known as historiography.
of targeted populations or places. People often frame it in opposition The task of the historian is to locate and interrogate appropriate
to quantitative research, which uses numerical data to identify large- sources for the reconstruction of an era. Therefore, it is important to
scale trends and employs statistical operations to determine causal and recognize the different sources used by historians and the value which
correlative relationships between variables. Within sociology, qualitative can be placed upon them. But, before discussing particular types of
research is typically focused on the micro-level of social interaction that source material it must be 0very clearly recognized that all sources
composes everyday life, whereas quantitative research typically focuses are biased. Therefore, the historian must recognize the outlook of the
on macro-level trends and phenomena. Methods of qualitative research source and take it into account when using it as evidence. The major
include observation and immersion, interviews, open-ended surveys, focus types of sources recognized by historians can be classified as follows: -
groups, content analysis of visual and textual materials, and oral history.
Primary sources
The Purpose of Qualitative Research These are the earliest available accounts of an event which are used by
Qualitative research has a long history in sociology and has been later writers to interpret that event. They are the raw material used by other
used within it for as long as the field itself has existed. This type writers to provide them with information and data. In using primary sources
of research has long appealed to social scientists because it allows it is important to recognize the value judgments made by the people who
the research to investigate the meanings that people attribute to their wrote them and the intent of the author in writing the original document.
behavior, actions, and interactions with others. While quantitative
Types of primary sources
research is useful for identifying relationships between variables,
like, for example, the connection between poverty and racial hate, it 1. Original handwritten documents, early copies of original documents,
is qualitative research that can illuminate why this connection exists letters, diaries and book manuscripts;
by going directly to the source -- the people themselves. Qualitative 2. Printed documents and published books;
research is designed to reveal the meaning that informs the action or
3. Personal documents, private documents, government documents
outcomes that are typically measured by quantitative research. So,
and public documents;
qualitative researchers investigate meanings, interpretations, symbols,
and the processes and relations of social life. What this type of research 4. Pictures, photographs and film;
produces is descriptive data that the researcher must then interpret 5. Archaeological evidence and statistical data derived from documents;
using rigorous and systematic methods of transcribing, coding, and 6. Oral evidence.
analysis of trends and themes. Because its focus is everyday life and
people’s experiences, qualitative research lends itself well to creating Secondary sources
new theories using the inductive method, which can then be tested Secondary source discuss a subject either from a great distance or after
with further research. the event on the basis of second-hand or even more remote information.
10 Research Methodology Research Methods 11
♦ ♦
Secondary sources provide interpretations and make judgments about • Data collection or literature review.
primary sources. When using secondary sources it is important to realize • Evaluation of materials.
that the account they give, even when it involves lengthy quotations from
• Data synthesis.
primary sources, may not be accurate. Secondary sources can be used to
understand primary sources but must not be confused with them. Several • Report preparation or preparation of the narrative exposition.
cautions need to be observed when working with secondary sources. Each of these steps is discussed briefly below.
Historical research is the process of systematically examining past Identification of the Research Topic and Formulation of the Research
events to give an account of what has happened in the past. Problem or Question
• It is not a mere accumulation of facts and dates or even a description This is the first step in any type of educational research including
of past events. historical research.
Ideas for historical research topics can come from many different
• It is a flowing, dynamic account of the past events which involves
sources such as current issues in education, the accomplishments
an interpretation of the these events in an attempt to recapture the
of an individual, an educational policy, or the relationship between
nuances, personalities, and ideas that influenced these events.
events.
• One of the goals of historical research is to communicate an
understanding of past events. Data Collection or Literature Review
Significance of Historical Research This step involves identifying, locating, and collecting information
pertaining to the research topic.
The following gives five important reasons for conducting historical The information sources are often contained in documents such
research (based on Berg, 1998): as diaries or newspapers, records, photographs, relics, and interviews
• To uncover the unknown (i.e., some historical events are not recorded). with individuals who have had experience with or have knowledge
• To answer questions (i.e., there are many questions about our past that of the research topic.
the researcher not only want to know but can profit from knowing). • Interviews with individuals who have knowledge of the research
• To identify the relationship that the past has to the present (i.e., topic are called oral histories.
knowing about the past can frequently give a better perspective • The documents, records, oral histories, and other information
of current events). sources can be primary or secondary sources.
• To record and evaluate the accomplishments of individuals, agencies, • A primary source is a source that has a direct involvement with
or institutions. the event being investigated like a diary, an original map, or an
• To assist in understanding the culture in which the researcher live interview with a person that experienced the event.
(e.g., education is a part of our history and our culture). • A secondary source is a source that was created from a primary
source such as books written about the event. Secondary sources
Historical Research Methodology are considered less useful than primary sources.
There is no one approach that is used in conducting historical
research although there is a general set of steps that are typically Evaluation of Materials
followed. It includes the following steps. Every information source must be evaluated for its authenticity
• Identification of the research topic and formulation of the research and accuracy because any source can be affected by a variety of factors
problem or question. such as prejudice, economic conditions, and political climate.
12 Research Methodology Research Methods 13
♦ ♦
There are two types of evaluations as follow.s Data Synthesis and Report Preparation
1. External Criticism–involves the process of determining the validity, It refers to synthesizing, or putting the material collected into a
trustworthiness, or authenticity of the source. Sometimes this is narrative account of the topic selected.
difficult to do but other times it can easily be done by handwriting • Synthesis refers to selecting, organizing, and analyzing the materials
analysis or determining the age of the paper on which something collected into topical themes and central ideas or concepts. These
was written. themes are contiguous and meaningful.
2. Internal Criticism–involves the process of determining the • It is prerequisite to watch out for these four problems that might be
reliability or accuracy of the information contained in the sources encountered when the researcher attempt to synthesize the material
collected. This is done by positive and negative criticism. collected and prepare the narrative account.
• Positive criticism refers to assuring that the statements made • Trying to infer causation from correlated events is the first problem.
or the meaning conveyed in the sources is understood. This Just because two events occurred together does not necessarily
is frequently difficult because of the problems of vagueness mean that one event was the cause of the other.
and presentism.
• The second problem is defining and interpreting key words so as to
• Vagueness refers to uncertainty in the meaning of the words avoid ambiguity and to insure that they have the correct connotation.
and phrases used in the source.
• The third problem is differentiating between evidence indicating
• Presentism refers to the assumption that the present-day how people should behave and how they in fact did behave.
connotations of terms also existed in the past.
• The fourth problem is maintaining a distinction between intent
• Negative criticism refers to establishing the reliability or and consequences. In other words, educational historians must
authenticity and accuracy of the content of the sources used. make sure that the consequences that were observed from some
This is the more difficult part because it requires a judgment activity or policy were the intended consequences.
about the accuracy and authenticity of what is contained in
the source. 1.6.2. Ethnographic Study
• Firsthand accounts by witnesses to an event are typically • Ethnographic study Involves investigation of very few cases, maybe
assumed to be reliable and accurate. just one case, in detail.
• Historians often use three heuristics in handling evidence. • Often it involves working with primarily unconstructed data. This
These are corroboration, sourcing, and contextualization. data had not been coded at the point of data collection in terms of
• Corroboration, or comparing documents to each other to a closed set of analytic categories.
determine if they provide the same information, is often used • It mphasizes on exploring social phenomena rather than testing
to obtain accurate and authentic information. hypotheses.
• Sourcing, or identifying the author, date of creation of a • Data analysis involves interpretation of the functions and meanings
document, and the place it was created is another technique that of human actions. The product of this is mainly verbal explanations,
is used to establish the authenticity or accuracy of information. where statistical analysis and quantification play a subordinate role.
• Contextualization, or identifying when and where an event • Methodological discussions focus more on questions about how
took place, is another technique used to establish authenticity to report findings in the field than on methods of data collection
and accuracy of information. and interpretation.
14 Research Methodology Research Methods 15
♦ ♦
• It focuses on describing the culture of a group in very detailed and • Collect information in the context or setting where the group works
complex manner. The ethnography can be of the entire group or or lives. This is called fieldwork. Types of information typically
a subpart of it. needed in ethnography are collected by going to the research site,
• It involves engaging in extensive field work where data collection respecting the daily lives of individuals at the site and collecting
is mainly by interviews, symbols, artifacts, observations, and many a wide variety of materials. Field issues of respect, reciprocity,
other sources of data. deciding who owns the data and others are central to ethnography
(Qualitative Inquiry and Research Design, 95)
• The researcher in ethnography type of research looks for patterns of
the groups mental activities, that is their ideas and beliefs expressed • From the many sources collected, the ethnographer analyzes the
through language or other activities, and how they behave in their data for a description of the culture-sharing group, themes that
groups as expressed through their actions that the researcher observed. emerge from the group and an overall interpretation (Wolcott,
1994b). The researcher begins to compile a detailed description
Procedures For Conducting Ethnography of the culture-sharing group, by focusing on a single event, on
several activities, or on the group over a prolonged period of
• Determining if ethnography is the most appropriate design for using time.
to study the research problem. Ethnography is suitable if the needs
• Forge a working set of rules or generalizations as to how the
are to describe how a cultural group works and to explore their
culture sharing group works as the final product of this analysis.
beliefs, language, behaviours and also issues faced by the group,
The final product is a holistic cultural portrait of the group that
such as power, resistance and dominance. (Qualitative Inquiry
incorporates the views of the participants (emic) as well as the
and Research Design, 94)
views of the researcher (etic). It might also advocate for the needs
• Then identify and locate a culture sharing group to study. This of the group or suggest changes in society. (Qualitative Inquiry
group is one whose members have been together for an extended and Research Design, 96)
period of time, so their shared language, patterns of behaviour and
The ethnographic method is different from other ways of conducting
attitudes have merged into discernible patterns. This group can
social science approach due to the following reasons:
also be a group that has been marginalized by society. (Qualitative
Inquiry and Research Design, 94) • It is field-based. It is conducted in the settings in which real people
actually live, rather than in laboratories where the researcher controls
• Select cultural themes, issues or theories to study about the
the elements of the behaviours to be observed or measured.
group. These themes, issues and theories provide an orienting
framework for the study of the culture-sharing group. As discussed • It is personalized. It is conducted by researchers who are in day-to
by Hammersley and Atkinson (2007), Wolcott (1987, 1994b, 2008- day, face-to-face contact with the people they are studying and who
1), and Fetterman (2009). The ethnographer begins the study by are both participants in and observers of the lives under study.
examining people in interaction in ordinary settings and discerns • It is multifactorial. It is conducted through the use of two or more
pervasive patterns such as life cycles, events and cultural themes. data collection techniques - which may be qualitative or quantitative
(Qualitative Inquiry and Research Design, 94-95) in nature - in order to get a conclusion.
• For studying cultural concepts, determine which type of ethnography • It requires a long term commitment i.e. it is conducted by researcher
to use. Perhaps how the group works need to be described, or a critical who intends to interact with people they are studying for an extended
ethnography can expose issues such as power, hegemony and advocacy period of time. The exact time frame can vary from several weeks
for certain groups (Qualitative Inquiry and Research Design, 95) to a year or more.
16 Research Methodology Research Methods 17
♦ ♦
• It is inductive. It is conducted in such a way to use an accumulation • Duration and cost: Research can involve prolonged time in the
of descriptive detail to build toward general patterns or explanatory field, particularly because building trust with participants is usually
theories rather than structured to test hypotheses derived from necessary for obtaining rich data.
existing theories or models. • Bias: Ethnographers bring their own experience to bear in pursuing
• It is dialogic and conducted by a researcher whose interpretations questions to ask and reviewing data, which can lead to biases in
and findings may be expounded on by the study’s participants directions of inquiry and analysis.
while conclusions are still in the process of formulation. • Descriptive approach: Ethnography relies heavily on storytelling and
• It is holistic and conducted so as to yield the fullest possible portrait the presentation of critical incidents, which is inevitably selective
of the group under study. and viewed as a weakness by those used to the scientific approaches
Ethnography, which is a method dedicated entirely to field work, of hypothesis testing, quantification and replication.
is aimed at gaining a deeper insight of a certain people’s knowledge
1.7. QUANTITATIVE RESEARCH TECHNIQUES
and social culture.
Quantitative Research
Advantages of Ethnography are
Quantitative methods emphasize objective measurements and the
• It can open up certain experiences during group research that other statistical, mathematical, or numerical analysis of data collected through
research methods fail to cover. polls, questionnaires, and surveys, or by manipulating pre-existing
• Notions that are taken for granted can be highlighted and confronted. statistical data using computational techniques. Quantitative research
• It can tap into intuitive and deep human understanding of and focuses on gathering numerical data and generalizing it across groups
interpretations of (by the ethnographer) the accounts of informants of people or to explain a particular phenomenon.
(those who are being studied), which goes far beyond what Characteristics of Quantitative Research
quantitative research can do in terms of extracting meanings.
Researchers goal in conducting quantitative research study is to
• Ethnography allows people outside of a culture (whether of a determine the relationship between one thing [an independent variable]
primitive tribe or of a corporation’s employees) to learn about its and another [a dependent or outcome variable] within a population.
members’ practices, motives, understandings and values. Quantitative research designs are either descriptive [subjects usually
However, there are certain challenges or limitations for the measured once] or experimental [subjects measured before and after
ethnographic method: a treatment]. A descriptive study establishes only associations between
• Deep expertise is required: Ethnographers must accumulate variables; an experimental study establishes causality. Quantitative
knowledge about the methods and domains of interest, which research deals in numbers, logic, and an objective stance. Quantitative
can take considerable training and time. research focuses on numeric and unchanging data and detailed, convergent
reasoning rather than divergent reasoning [i.e., the generation of a variety
• Sensitivity: The ethnographer is an outsider and must exercise
of ideas about a research problem in a spontaneous, free-flowing manner].
discretion and caution to avoid offending, alienating or harming
those being observed. Its main characteristics are
• Access: Negotiating access to field sites and participants can be
• The data is usually gathered using structured research instruments.
time-consuming and difficult. Secretive or guarded organizations
may require different approaches in order for researchers to • The results are based on larger sample sizes that are representative
succeed. of the population.
18 Research Methodology Research Methods 19
♦ ♦
• The research study can usually be replicated or repeated, given 8. Use tables to provide exact values; use figures to convey global
its high reliability. effects. Keep figures small in size; include graphic representations
• Researcher has a clearly defined research question to which objective of confidence intervals whenever possible.
answers are sought. 9. Always tell the reader what to look for in tables and figures.
• All aspects of the study are carefully designed before data is collected.
1.7.1. Survey
• Data are in the form of numbers and statistics, often arranged in
tables, charts, figures, or other non-textual forms. In research of human subjects, a survey is a list of questions aimed
at extracting specific data from a particular group of people. Surveys
• Project can be used to generalize concepts more widely, predict
may be conducted by phone, mail, via the internet, and sometimes
future results, or investigate causal relationships.
face-to-face on busy street corners or in malls. Surveys are used to
• Researcher uses tools, such as questionnaires or computer software, increase knowledge in fields such as social research and demography.
to collect numerical data. Survey research is often used to assess thoughts, opinions and
The overarching aim of a quantitative research study is to classify feelings. Surveys can be specific and limited, or they can have more
features, count them, and construct statistical models in an attempt to global, widespread goals. Psychologists and sociologists often use
explain what is observed. surveys to analyze behaviour, while it is also used to meet the more
Things to keep in mind when reporting the results of a study pragmatic needs of media, such as, in evaluating political candidates,
using quantitative methods public health officials, professional organizations, and advertising and
1. Explain the data collected and their statistical treatment as well marketing directors. A survey consists of a predetermined set of questions
as all relevant results in relation to the research problem you are that is given to a sample.[1] With a representative sample, that is, one that
investigating. Interpretation of results is not appropriate in this section. is representative of the larger population of interest, one can describe
the attitudes of the population from which the sample was drawn.
2. Report unanticipated events that occurred during your data
Further, one can compare the attitudes of different populations as well
collection. Explain how the actual analysis differs from the planned
as look for changes in attitudes over time. A good sample selection is
analysis. Explain your handling of missing data and why any
key as it allows one to generalize the findings from the sample to the
missing data does not undermine the validity of your analysis.
population, which is the whole purpose of survey research.
3. Explain the techniques you used to «clean» your data set.
4. Choose a minimally sufficient statistical procedure; provide a Types
rationale for its use and a reference for it. Specify any computer
Census
programs used.
A census is the procedure of systematically acquiring and recording
5. Describe the assumptions for each procedure and the steps you
information about the members of a given population. It is a regularly
took to ensure that they were not violated.
occurring and official count of a particular population.The term is
6. When using inferential statistics, provide the descriptive statistics, used mostly in connection with national population and housing
confidence intervals, and sample sizes for each variable as well as censuses; other common censuses include agriculture, business, and
the value of the test statistic, its direction, the degrees of freedom, traffic censuses. The United Nations defines the essential features of
and the significance level [report the actual p value]. population and housing censuses as “individual enumeration, universality
7. Avoid inferring causality, particularly in nonrandomized designs within a defined territory, simultaneity and defined periodicity”, and
or without further experimentation. recommends that population censuses be taken at least every 10 years.
20 Research Methodology Research Methods 21
♦ ♦
Other household surveys Opinion poll
Other surveys than the census may explore characteristics in An opinion poll is a survey of public opinion from a particular
households, such as fertility, family structure, and demographics. sample. Opinion polls are usually designed to represent the opinions of
Major household surveys include: a population by conducting a series of questions and then extrapolating
• General Household Survey, conducted in private households in Great generalities in ratio or within confidence intervals.
Britain. It is a repeated cross-sectional study, conducted annually,
Methodology
which uses a sample of 9,731 households in the 2006 survey.
A single survey is made of at least a sample (or full population in
• Generations and Gender Survey, conducted in several countries in
the case of a census), a method of data collection (e.g., a questionnaire)
Europe as well as Australia and Japan.Theprogramme has collected
and individual questions or items that become data that can be analyzed
least one wave of surveys in 19 countries, with an average of 9,000
statistically. A single survey may focus on different types of topics such
respondents per country.
as preferences (e.g., for a presidential candidate), opinions (e.g., should
• Household, Income and Labour Dynamics in Australia Survey, abortion be legal?), behaviour (smoking and alcohol use), or factual
where the wave 1 panel consisted of 7,682 households and 19,914 information (e.g., income), depending on its purpose. Since survey
individuals research is almost always based on a sample of the population, the success
• Integrated Household Survey, a survey made up of multiple of the research is dependent on the representativeness of the sample with
other surveys in the UK. It includes about 340,000 respondents, respect to a target population of interest to the researcher. That target
making it the largest collection of social data in the UK after the population can range from the general population of a given country to
census. specific groups of people within that country, to a membership list of a
• National Survey of Family Growth, conducted in the United professional organization, or list of students enrolled in a school system.
States by the National Center for Health Statistics division of
1.7.2. Experimental Research
the Centers for Disease Control and Prevention to understand
trends related to fertility, family structure, and demographics Experimental Research is commonly used in sciences such as
in the United States. The 2006-2010 NSFG surveyed 22,682 sociology, psychology, physics, chemistry, biology and medicine etc.
interviews. It is a collection of research designs which use manipulation and
controlled testing to understand causal processes. Generally, one or more
• Panel Study of Income Dynamics in the United States, wherein data
variables are manipulated to determine their effect on a dependent variable.
have been collected from the same families and their descendants
The experimental method is a systematic and scientific approach
since 1968. The study involved more than 9,000 individuals as of
to research in which the researcher manipulates one or more variables,
2009.
and controls and measures any change in other variables.
• Socio-Economic Panel, a longitudinal panel dataset of the Experimental Research is often used where:
population in Germany. It is a household based study which started
1. There is time priority in a causal relationship (cause precedes effect)
in 1984 and which reinterviews adult household members annually.
In 2007, the study involved about 12,000 households, with more 2. There is consistency in a causal relationship (a cause will always
than 20,000 adult persons sampled. lead to the same effect)
• UK households: a longitudinal study, now known as Understanding 3. The magnitude of the correlation is great.
Society.Its sample size is 40,000 households from the United The word experimental research has a range of definitions. In the
Kingdom or approx. 100,000 individuals. strict sense, experimental research is what the researcher call a true
22 Research Methodology Research Methods 23
♦ ♦
experiment. This is an experiment where the researcher manipulates Sampling Groups to Study
one variable, and control/randomizes the rest of the variables. It has Sampling groups correctly is especially important when researchers
a control group, the subjects have been randomly assigned between have more than one condition in the experiment. One sample group
the groups, and the researcher only tests one effect at a time. It is also often serves as a control group, whilst others are tested under the
important to know what variable(s) want to test and measure. experimental conditions.
A very wide definition of experimental research, or a quasi Deciding the sample groups can be done in using many different
experiment, is research where the scientist actively influences something sampling techniques. Population sampling may be chosen by a number
to observe the consequences. Most experiments tend to fall in between the of methods, such as randomization, “quasi-randomization” and pairing.
strict and the wide definition. A rule of thumb is that physical sciences, Reducing sampling errors is vital for getting valid results from
such as physics, chemistry and geology tend to define experiments experiments. Researchers often adjust the sample size to minimize
more narrowly than social sciences, such as sociology and psychology, chances of random errors.
which conduct experiments closer to the wider definition. Here are some common sampling techniques:
Aims of Experimental Research • probability sampling
Experiments are conducted to be able to predict phenomenons. • non-probability sampling
Typically, an experiment is constructed to be able to explain some kind • simple random sampling
of causation. Experimental research is important to society - it helps • convenience sampling
us to improve our everyday lives.
• stratified sampling
Identifying the Research Problem • systematic sampling
After deciding the topic of interest, the researcher tries to define the • cluster sampling
research problem. This helps the researcher to focus on a more narrow
• sequential sampling
research area to be able to study it appropriately. Defining the research
problem helps the researcher to formulate a research hypothesis, which • disproportional sampling
is tested against the null hypothesis. • judgmental sampling
The research problem is often operationalization, to define how • snowball sampling
to measure the research problem. The results will depend on the exact
• quota sampling
measurements that the researcher chooses and may be operationalized
differently in another study to test the main conclusions of the study. Creating the Design
An ad hoc analysis is a hypothesis invented after testing is done, to The research design is chosen based on a range of factors. Important
try to explain why the contrary evidence. A poor ad hoc analysis may factors when choosing the design are feasibility, time, cost, ethics,
be seen as the researcher’s inability to accept that his/her hypothesis measurement problems and what researcher would like to test. The
is wrong, while a great ad hoc analysis may lead to more testing and design of the experiment is critical for the validity of the results.
possibly a significant discovery.
Typical Designs and Features in Experimental Design
Constructing the Experiment
There are various aspects to remember when constructing an • Pretest-Posttest Design –It is different before the manipulation starts
experiment. Planning ahead ensures that the experiment is carried out and the effect of the manipulation. Pretests sometimes influence
properly and that the results reflect the real world, in the best possible way. the effect.
24 Research Methodology Research Methods 25
♦ ♦
• Control Group: Control groups are designed to measure research If the experiments involve human, a common strategy is to first
bias and measurement effects, such as the Hawthorne Effect or the have a pilot study with someone involved in the research, but not too
Placebo Effect. A control group is a group not receiving the same closely, and then arrange a pilot with a person who resembles the
manipulation as the experimental group. Experiments frequently have subject(s). Those two different pilots are likely to give the researcher
2 conditions, but rarely more than 3 conditions at the same time. good information about any problems in the experiment.
• Randomized Controlled Trials: Randomized Sampling, comparison
Conducting the Experiment
between an Experimental Group and a Control Group and strict
control/randomization of all other variables An experiment is typically carried out by manipulating a variable,
• Solomon Four-Group Design: With two control groups and two called the independent variable, affecting the experimental group. The
experimental groups. Half the groups have a pretest and half do effect that the researcher is interested in, the dependent variable(s),
not have a pretest. This to test both the effect itself and the effect is measured.
of the pretest. Identifying and controlling non-experimental factors which
the researcher does not want to influence the effects, is crucial
• Between Subjects Design: Grouping Participants to Different to drawing a valid conclusion. This is often done by controlling
Conditions variables, if possible, or randomizing variables to minimize effects
• Within Subject Design: Participants Take Part in the Different that can be traced back to third variables. Researchers only want to
Conditions - See also: Repeated Measures Design measure the effect of the independent variable(s) when conducting
• Counter balanced Measures Design: Testing the effect of the an experiment, allowing them to conclude that this was the reason
order of treatments when no control group is available/ethical for the effect.
• Matched Subjects Design: Matching Participants to Create Similar
Analysis and Conclusions
Experimental- and Control-Groups
• Double-Blind Experiment: Neither the researcher, nor the In quantitative research, the amount of data measured can be
participants, know which is the control group. The results can be enormous. Data not prepared to be analyzed is called “raw data”. The
affected if the researcher or participants know this. raw data is often summarized as something called “output data”, which
typically consists of one line per subject (or item). A cell of the output
• Bayesian Probability: Using Bayesian probability to “interact” data is, for example, an average of an effect in many trials for a subject.
with participants is a more “advanced” experimental design. It The output data is used for statistical analysis, e.g. significance tests,
can be used for settings were there are many variables which are to see if there really is an effect.
hard to isolate. The researcher starts with a set of initial beliefs, The aim of an analysis is to draw a conclusion, together with
and tries to adjust them to how participants have responded other observations. The researcher might generalize the results to a
Pilot Study wider phenomenon, if there is no indication of confounding variables
It may be wise to first conduct a pilot-study or do before the “polluting” the results.
researcher do the real experiment. This ensures that the experiment If the researcher suspects that the effect stems from a different
measures what it should, and that everything is set up right. Minor variable than the independent variable, further investigation is needed
errors, which could potentially destroy the experiment, are often found to gauge the validity of the results. An experiment is often conducted
during this process. With a pilot study, the researcher can get information because the scientist wants to know if the independent variable is
about errors and problems, and improve the design, before putting a having any effect upon the dependent variable. Variables correlating
lot of effort into the real experiment. are not proof that there is causation.
26 Research Methodology Research Methods 27
♦ ♦
Experiments are more often of quantitative nature than qualitative sociometric assessment often focuses on a child’s relationships with
nature, although it happens. regard to social popularity, peer acceptance, peer rejection, and
reputation. Some sociometric assessment methods derive information
Sociometry on social relationships by assessing children’s positive and negative
Sociometry is a quantitative method for measuring social relationships. social perceptions of one another, whereas other methods involve adult
It was developed by psychotherapist Jacob L. Moreno in his studies of (teacher, parent) and self- perceptions of children’s social competencies
the relationship between social structures and psychological well-being. or standing. Sociometric assessment methods were introduced in the
Sociometry, measurement techniques are used in social psychology, 1930s and advanced in the journal Sociometry. In the 1950s, several
in sociology, and sometimes in social anthropology and psychiatry based books were published on the topic and sociometric measurements
on the assessment of social choice and interpersonal attractiveness. often were part of research and school-based assessments of social
The term is closely associated with the work of the Austrian-born relationships. The use of classic sociometric procedures declined in
psychiatrist J.L. Moreno, who developed the method as a research and the following decades, due to the advancement of social behaviour
therapeutic technique. Sociometry has come to have several meanings; rating scales and ethical concerns regarding the use of peer nomination
it is most commonly applied to the quantitative treatment of preferential methods with children.
interpersonal relations, but it is also used to mean the quantitative
treatment of all kinds of interpersonal relations. The emphasis may 1.7.3. Action Research
be psychological or sociological. A succinct definition of action research appears in the workshop
A sociometric measure assesses the attractions (or repulsions) within materials the researcher use at the Institute for the Study of Inquiry in
a given group. The basic technique involves asking all group members Education. That definition states that action researchis a disciplined
to identify specific persons within the group they would prefer (or would process of inquiry conducted by and for those taking the action. The
not prefer) to have as partners in a given activity. Many variations on primary reason for engaging in action research is to assist the “actor”
this technique exist for studying different aspects of social preference. in improving and/or refining his or her actions.
For example, a group’s networking structure can be exposed through Practitioners who engage in action research inevitably find it to be
the sociometric technique of recording all interactions between group an empowering experience. Action research has this positive effect for
members. The technique can also be applied on larger scale to reveal many reasons. Obviously, the most important is that action research is
inter-organizational networks by treating organizations as individual units. always relevant to the participants. Relevance is guaranteed because
Much work has focused on the concept of sociometric status. the focus of each research project is determined by the researchers,
This includes studies of leadership; of social adjustment, ranging from who are also the primary consumers of the findings.
the social isolate (or unchosen individual) to the sociometric star (or Perhaps even more important is the fact that action research helps
highly chosen); of the relationship between sociometric status and educators be more effective at what they care most about—their teaching
other personality variables, demographic variables, and intelligence; and the development of their students. Seeing students grow is probably
and of minority-group prejudice the greatest joy educators can experience. When teachers have convincing
evidence that their work has made a real difference in their students’ lives,
Implications of socio-metric assessment for educational research the countless hours and endless efforts of teaching seem worthwhile.
Sociometric assessment can be defined as the measurement of
interpersonal relationships in a social group. Sociometric measurement The Action Research Process
or assessment methods provide information about an individual’s Educational action research can be engaged in by a single teacher or
social competence and standing within a peer group. School-based by a group of colleagues who share an interest in a common problem, or
28 Research Methodology Research Methods 29
♦ ♦
by the entire faculty of a school. Whatever the scenario, action research Collecting Data
always involves the same seven-step process. These seven steps which Professional educators always want their instructional decisions to
become an endless cycle for the inquiring teacher are the following: be based on the best possible data. Action researchers can accomplish
• Selecting a focus this by making sure that the data used to justify their actions are valid
• Clarifying theories (meaning the information represents what the researchers say it does)
and reliable (meaning the researchers are confident about the accuracy
• Identifying research questions
of their data). Lastly, before data are used to make teaching decisions,
• Collecting data teachers must be confident that the lessons drawn from the data align
• Analyzing data with any unique characteristics of their classroom or school.
• Reporting results To ensure reasonable validity and reliability, action researchers
• Taking informed action should avoid relying on any single source of data. Most teacher
researchers use a process called triangulation to enhance the validity and
Selecting a Focus reliability of their findings. Basically, triangulation means using multiple
independent sources of data to answer one’s questions. Triangulation
The action research process begins with serious reflection directed
is like studying an object located inside a box by viewing it through
toward identifying a topic or topics worthy of a busy teacher’s time.
various windows cut into the sides of the box. Observing a phenomenon
Considering the incredible demands on today’s classroom teachers, no
through multiple “windows” can help a single researcher compare and
activity is worth doing unless it promises to make the central part of a
contrast what is being seen through a variety of lenses.
teacher’s work more successful and satisfying. Thus, selecting a focus,
When planning instruction, teachers want the techniques to choose
the first step in the process, is vitally important. Selecting a focus begins
the suitable for the unique qualities of the students. All teachers have
with the teacher researcher or the team of action researchers asking:
the experience of implementing a “research-proven” strategy only
What element(s) of our practice or what aspect of student learning
to have it fail with their students. The desire of teachers is to use
do the researcher wish to investigate?
approaches that “fit” their particular students is not dissimilar to a
Clarifying Theories doctor’s concern that the specific medicine being prescribed be the
correct one for the individual patient. The ability of the action research
The second step involves identifying the values, beliefs, and process is to satisfy an educator’s need for “fit” which may be its most
theoretical perspectives the researchers hold relating to their focus. powerful attribute. Because the data being collected come from the
For example, if teachers are concerned about increasing responsible students and teachers who are engaged with the treatment, the relevance
classroom behaviour, it will be helpful for them to begin by clarifying of the findings is assured.
which approach—using punishments and rewards, allowing students For the harried and overworked teacher, “data collection” may
to experience the natural consequences of their behaviours, or some appear to be the most intimidating aspect of the entire seven-step action
other strategy—they feel will work best in helping students acquire research process. The question I am repeatedly asked, “Where will I
responsible classroom behaviour habits. find the time and expertise to develop valid and reliable instruments
for data collection?”, gives voice to a realistic fear regarding time
Identifying Research Questions
management. Fortunately, classrooms and schools are, by their nature,
Once a focus area has been selected and the researcher’s perspectives data-rich environments. Each day a child is in class, the researcher
and beliefs about that focus have been clarified, the next step is to generate is producing or not producing work, is interacting productively with
a set of personally meaningful research questions to guide the inquiry. classmates or experiencing difficulties in social situations, and is
30 Research Methodology Research Methods 31
♦ ♦
completing assignments proficiently or poorly. Teachers not only see Regardless of which venue or technique educators select for reporting
these events transpiring before their eyes, they generally record these on research, the simple knowledge that they are making a contribution to
events in their grade books. The key to managing triangulated data a collective knowledge base regarding teaching and learning frequently
collection is, first, to be effective and efficient in collecting the material proves to be among the most rewarding aspects of this work.
that is already swirling around the classroom, and, second, to identify
other sources of data that might be effectively surfaced with tests, Taking Informed Action
classroom discussions, or questionnaires. Taking informed action, or “action planning,” the last step in
the action research process, is very familiar to most teachers. When
Analyzing Data teachers write lesson plans or develop academic programs, they are
Although data analysis often brings to mind the use of complex engaged in the action planning process. What makes action planning
statistical calculations, this is rarely the case for the action researcher. particularly satisfying for the teacher researcher is that with each piece
A number of relatively user-friendly procedures can help a practitioner of data uncovered (about teaching or student learning) the educator will
identify the trends and patterns in action research data. During this feel greater confidence in the wisdom of the next steps. Although all
portion of the seven-step process, teacher researchers will methodically teaching can be classified as trial and error, action researchers find that
sort, sift, rank, and examine their data to answer two generic questions: the research process liberates them from continuously repeating their
What is the story told by these data? past mistakes. More important, with each refinement of practice, action
Why did the story play itself out this way? researchers gain valid and reliable data on their developing virtuosity.
By answering these two questions, the teacher researcher can acquire
a better understanding of the phenomenon under investigation and as 1.7.4. Observation
a result can end up producing grounded theory regarding what might Observation would seem to be an obvious method of carrying
be done to improve the situation. out research in psychology. However, there are different types of
observational methods and distinctions need to be made between:
Reporting Results
1. Controlled Observations
It is often said that teaching is a lonely endeavor. It is doubly sad
2. Natural Observations
that so many teachers are left alone in their classrooms to reinvent the
wheel on a daily basis. The loneliness of teaching is unfortunate not 3. Participant Observations
only because of its inefficiency, but also because when dealing with In addition to the above categories observations can also be either
complex problems the wisdom of several minds is inevitably better overt/disclosed (the participants know they are being studied) or covert/
than one. undisclosed (the research keeps their real identity a secret from the
The sad history of teacher isolation may explain why the very act research subjects, acting as a genuine member of the group).
of reporting on their action research has proven so powerful for both the Observations are relatively cheap to carry out and few resources are
researchers and their colleagues. The reporting of action research most needed by the researcher. However, it can often be very time consuming
often occurs in informal settings that are far less intimidating than the and longitudinal.
venues where scholarly research has traditionally been shared. Faculty
meetings, brown bag lunch seminars, and teacher conferences are among Controlled Observation
the most common venues for sharing action research with peers. However, Controlled observations are likely to be carried out in a psychology
each year more and more teacher researchers are writing up their work laboratory. The researcher decides where the observation will take
for publication or to help fulfill requirements in graduate programs. place, at what time, with which participants, in what circumstances
32 Research Methodology Research Methods 33
♦ ♦
and uses a standardized procedure. Participants are randomly allocated Sometimes the behaviour of participants is observed through a
to each independent variable group. two-way mirror or they are secretly filmed. This method was used
Rather than writing a detailed description of all behaviour observed, by Albert Bandura to study aggression in children (the Bobo doll
it is often easier to code behaviour according to a previously agreed scale studies).
using a behaviour schedule (i.e. conducting a structured observation). A lot of research has been carried out in sleep laboratories as
The researcher systematically classifies the behaviour and observe well. Here electrodes are attached to the scalp of participants and what
the distinct categories. Coding might involve numbers or letters to observed are the changes in electrical activity in the brain during sleep
describe a characteristics, or use of a scale to measure behaviour intensity. (the machine is called an electroencephalogram – an EEG).
The categories on the schedule are coded so that the data collected can Controlled observations are usually overt as the researcher explains
be easily counted and turned into statistics. the research aim to the group, so the participants know they are being
For example, Mary Ainsworth used a behaviour schedule to study observed. Controlled observations are also usually non-participant as
how infants respond to brief periods of separation from their mothers. the researcher avoids any direct contact with the group, keeping a
During the Strange Situation procedure infant’s interaction behaviours distance (e.g. observing behind a two-way mirror).
directed toward the mother were measured, e.g.
Strengths
1. Proximity and contacting seeking
2. Contact maintaining 1. Controlled observations can be easily replicated by other researchers
3. Avoidance of proximity and contact by using the same observation schedule. This means it is easy to
3. to
4. Resistance Avoidance
contact andofcomforting
proximity and contact test for reliability.
4. Resistance to contact and comforting 2. The data obtained from structured observations is easier and quicker
The observer
Thenoted downnoted
observer the behaviour displayed during
down the behaviour 15 second
displayed intervals
during 15 secondand scored the to analyze as it is quantitative (i.e. numerical) - making this a less
intervalsonand
behaviour for intensity scored
a scale of 1 the
to 7.behaviour for intensity on a scale of 1 to 7. time consuming method compared to naturalistic observations.
3. Controlled observations are fairly quick to conduct which means
that many observations can take place within a short amount of
time. This means a large sample can be obtained resulting in the
findings being representative and having the ability to be generalized
to a large population..
Limitations
1. Controlled observations can lack validity due to the Hawthorne
effect/demand characteristics. When participants know they are
being watched they may act differently.
Naturalistic Observation
Naturalistic observation (i.e. unstructured observation) involves
studying the spontaneous behaviour of participants in natural
surroundings. The researcher simply records what they see in whatever
way they can.
Sometimes the behaviour of participants is observed through a two-way mirror or they are secretly filmed.
This method was used by Albert Bandura to study aggression in children (the Bobo doll studies).
34 Research Methodology Research Methods 35
♦ ♦
Compared with controlled/structured methods it is like the difference This approach was used by Leon Festinger in a famous study
between studying wild animals in a zoo and studying them in their into a religious cult who believed that the end of the world was about
natural habitat. to occur. He joined the cult and studied how they reacted when the
With regard to human subjects Margaret Mead used this method prophecy did not come true.
to research the way of life of different tribes living on islands in the Participant observations can be either cover or overt. Covert is
South Pacific. Kathy Sylva used it to study children at play by observing where the study is carried out ‘under cover’. The researcher’s real
their behaviour in a playgroup in Oxfordshire. identity and purpose are kept concealed from the group being studied.
The researcher takes a false identity and role, usually posing as a
Strengths genuine member of the group. On the other hand, overt is where the
1 By being able to observe the flow of behaviour in its own setting researcher reveals his or her true identity and purpose to the group and
studies have greater ecological validity. asks permission to observe.
2. Like case studies naturalistic observation is often used to generate
Limitations
new ideas. Because it gives the researcher the opportunity to study
the total situation it often suggests avenues of enquiry not thought 1. It can be difficult to get time / privacy for recording. For example,
of before. with covert observations researchers can’t take notes openly as
this would blow their cover. This means they have to wait until
Limitations they are alone and reply on their memory. This is a problem
1. These observations are often conducted on a micro (small) scale as they may forget details and are unlikely to remember direct
and may lack a representative sample (biased in relation to age, quotations.
gender, social class or ethnicity). This may result in the findings 2. If the researcher becomes too involved, he may lose objectivity
lacking the ability to be generalized to wider society. and become bias. Thus reducing the validity of their data.
2. Natural observations are less reliable as other variables cannot be
Recording of Data
controlled. This makes it difficult for another researcher to repeat
the study in exactly the same way. With all observation studies an important decision the researcher
has to make is how to classify and record the data. Usually this will
3. A further disadvantage is that the researcher needs to be trained to
involve a method of sampling. The three main sampling methods are:
be able to recognise aspects of a situation that are psychologically
significant and worth further attention. 1. Event sampling. The observer decides in advance what types of
behaviour (events) she/he is interested in and records all occurrences.
4. With observations the researcher do not have manipulations of
All other types of behaviour are ignored.
variables (or control over extraneous variables) which means cause
and effect relationships cannot be established. 2. Time sampling. The observer decides in advance that observation
will take place only during specified time periods (e.g. 10 minutes
Participant Observation every hour, 1 hour per day) and records the occurrence of the
Participant observation is a variant of the above (natural observations) specified behaviour during that period only.
but here the researcher joins in and becomes part of the group they are 3. Instantaneous (target time) sampling. The observer decides in
studying to get a deeper insight into their lives. If it were research on advance the pre-selected moments when observation will take
animals the researcher would now not only be studying them in their place and records what is happening at that instant. Everything
natural habitat but be living alongside them as well! happening before or after is ignored.
36 Research Methodology Research Methods 37
♦ ♦
1.7.5. Interview 3. Phone interview—With this type of interview, interviewee speak
Interviewing is a valuable primary research method, and choosing directly to the interviewer over the phone but are not in the same
from the different interviewing techniques is the first step in the process physical location. There are still benefits of hearing the tone of
of undertaking this type of research. Interviews allow to learn more someone’s voice, adapting questions based on responses and recording
detailed information. Whether one is interviewing by an expert or the interview. This is a good choice if the researcher prefer speaking
gathering information from a small group of individuals, the researcher directly with an interview subject but constraints prevent the researcher
must decide how to conduct the interview. from meeting face-to-face or if the interviewee does not want a face-
The five most common interview techniques include the following to-face interview or one requiring the use of the internet.
interview types: 4. Email interviews—With this type of interview, one does not have any
1. Face-to-face interviews face-to-face or direct interaction with the interviewee. Interviewer
2. Webcam interviews can email the interview questions, and receive the responses via
3. Telephonic interviews email. The benefit of this type of interview is that a transcript in
digital form is already made once the responses are returned to
4. Email interviews
the interviewer. However, one cannot watch for social cues or ask
5. Instant message/chat interviews additional questions based off responses in real time. Sometimes
With each interviewing technique, there are advantages and these results in receiving less information than the researcher could
disadvantages, so choosing the right one for primary research method is via a telephone, webcam or face-to-face interview.
done by considering the value of each type, time or location constraints 5. Chat/instant message interviews—With this type of interview,
and the personal preferences of researcher.. the researcher conduct the researcher interview over an instant
Interviewing techniques messaging service, such as Yahoo! Messenger, Google Talk or
There are five main interviewing techniques the researcher can MSN Messenger. Since this type of interviewing technique is
use as a primary research method. done in real time, the researcher have the benefit of adapting the
researcher questions or asking additional questions based on the
1. Face-to-face interview—With this type of interview, Interviewer
responses the researcher receive. The length of responses might
and interviewee are in the same location and are speaking directly to
be shorter with this type of interview, but one can save a copy of
one another. Benefits of this type of interviewing technique include
the chat session for an already-made digital copy of the interview.
being able to see and hear social cues, to adapt the researcher
questions based on how the person the researcher are interviewing Interviewing technique tips
responds and to record a copy of the interview that the researcher
When interviewing technique is used as a primary research method,
can later be transcribed to use as a reference. This is often the best
there are certain steps during the preparation and interviewing processes
option if it meets the needs and availability of both the researcher
that facilitate a more effective interview.
and the researcher interview subjects.
2. Webcam interviews—With this type of interview, Interviewer and Preparation tips
interviewee are face-to-face via webcam technology. It offers the same
1. The interviewer shall learn interviewee prior to the interview in
benefits as a traditional face-to-face interview, and recording either the
order to form questions that are specific to the person.
audio or the video output is a good idea in order to transcribe it and
refer back to the transcript as a reference. This type of interviewing 2. Plan ahead, and set aside an adequate amount of time that suits
technique is also useful when distance prohibits a face-to-face interview. the interviewing technique.
38 Research Methodology Research Methods 39
♦ ♦
3. Check the recording equipment in advance to make sure everything Advantages of the close form
is working correctly, and have a backup recorder ready to go in
1. It is easy to fill out.
case of technical difficulties.
2. It takes little time by respondents
4. Prepare the researcher questions carefully for any type of interview
technique by spending the time to write good interview questions. 3. It is relatively objective
4. Easy to tabulate and analyze
Interviewing tips
5. Answers are standardized.
1. Start the interview stating the interview subject at ease.
2. Respect the interviewee by following their wishes if the researcher Limitations of the close form
subject chooses to not answer a specific question. It fails to reveal the respondents’ motives and does not always get
3. Stay ready to adapt the questions if an answer to one of the questions information of sufficient scope and in depth and may not discriminate
triggers another question that pertains to the research. between the finer shades of meaning.
4. Keep the interview focused by redirecting the conversation with The open form
additional questions when the person the researcher are interviewing
The open form or unstructured type of questionnaire calls for a
strays too far from the focus of the researcher interview questions.
free response in respondents own words.
Interviews are a powerful primary research method, and the
information the researcher learn by completing any of the interviewing Advantages of the open form questionnaire
techniques adds value to the research.
1. Open end questions are flexible.
1.7.6. Questionnaire 2. They can be used when all possible answer categories are not known.
Questionnaire is a self- report data collection instrument that each 3. They are preferable to complex issues that cannot be condensed.
research participant fills out as part of a research study. Researchers 4. They allow more opportunity for creativity, thinking and
use questionnaire to obtain information about the thoughts, feelings, self-expression.
attitudes beliefs, values, perceptions, personality and behavioural
intentions of research participants. Limitation
According to John W. Best (1992) a questionnaire is used when
1. There is possibility of collection of worthless or irrelevant
factual information is desired, when opinion rather than facts are desired,
information.
an opinionnaire or Attitude scale is used.
2. Data collected through open end questionnaire are not often
Forms/Kinds Of Questionnaire standardized from person to person.
The researcher can construct questions in the form of a closed, 3. Coding is difficult and subjective.
open pictorial and scale items.
Pictorial form
1. Close Form Some questionnaires present respondents with drawings and
Questionnaire that calls for short check responses as the, restricted photographs rather than written statement from which to choose answers.
or close form type. They provide for marking a Yes or No a short This form of questionnaire is particularly suitable tool for collecting
response or checking an item from a list of suggested responses. data from children and adults who had not developed reading ability.
40 Research Methodology Research Methods 41
♦ ♦
Pictures often capture the attention of respondents more readily than • The sponsor
printed words, lessen subjects’ resistance and stimulate the interest in • The purpose
questions. “To get better answers, ask better questions”
• Return address and date
Characteristics of a Good Questionnaire • Confidentiality
• Questionnaire should deal with important or significant topic to • Voluntary responses and
create interest among respondents. • Thanks
• It should seek only that data which cannot be obtained from other Instructions to the Respondent
sources.
It is very important that respondents are instructed to go presented
• It should be as short as possible but should be comprehensive. at the start of the questionnaire which indicates what is expected from
• It should be attractive. the respondents. Specific instructions should be given for each question
• Directions should be clear and complete. where the style of questions varies throughout the questionnaire. For
• It should be represented in good Psychological order proceeding Example – Put a tick mark in the appropriate box and circle the relevant
from general to more specific responses. number etc.
71
76 Research Methodology Sampling Techniques and Measurement 77
♦ ♦
to determine statistical significance. Each of these distributions is a
family of distributions where the degrees of freedom define the shape.
Hypothesis tests use these distributions to calculate p-values. So, the
DF are directly linked to p-values through these distributions
Related post: A Graphical Look at Significance Levels (Alpha)
and P values
Degrees of Freedom for t-Tests and the t-Distribution
t-tests are hypothesis tests for the mean and use the t-distribution
to determine statistical significance.
A 1-sample t-test determines whether the difference between the
sample mean and the null hypothesis value is statistically significant.
Let’s go back to our example of the mean above. the researcher know
that when the researcher have a sample and estimate the mean, the
researcher have n – 1 degrees of freedom, where n is the sample size.
Consequently, for a 1-sample t-test, the degrees of freedom is n – 1.
The mean is 6.9, and it is based on 10 values. So, the researcher
The mean is 6.9, and it is based on 10 values. So, the researcher know that the values must sum to The DF define the shape of the t-distribution that the researcher t-test
know that the values must sum to 69 based on the equation for the mean.
69 based on the equation for the mean. uses to calculate the p-value. The graph below shows the t-distribution
Using simple algebra (64 + X = 69), the researcher know that X
for several different degrees of freedom. Because the degrees of freedom
must equal 5.
Using simple algebra (64 + X = 69), the researcher know that X must equal 5. are so closely related to sample size, the researcher can see the effect of
sample size. As the degrees of freedom decreases, the t-distribution has
Estimating Parameters Imposes Constraints on the Data
thicker tails. This property allows for the greater uncertainty associated
Estimating Parameters
As theImposes Constraints
researcher can see,onthat
thelast
Datanumber has no freedom to vary.
with small sample sizes.
It is not an independent piece of information because it cannot be any
As theother value.
researcher canEstimating
see, that lastthe parameter,
number the mean
has no freedom in this
to vary. It iscase,
not animposes
independent piece of
a constraint
information because onbethe
it cannot anyfreedom to Estimating
other value. vary. The the
lastparameter,
value andthethe mean
mean in thisare
case, imposes
entirely dependent on each other. Consequently, after estimating the
a constraint on the freedom to vary. The last value and the mean are entirely dependent on each other.
mean, the researcher have only 9 independent pieces of information
Consequently, after estimating the mean, the researcher have only 9 independent pieces of information
even though our sample size is 10.
even though our sampleThat’ssizethe
is 10.
basic idea for degrees of freedom in statistics. In a
general sense, DF are the number of observations in a sample that are
That‘sfree to vary
the basic ideawhile estimating
for degrees statistical
of freedom parameters.
in statistics. The researcher
In a general sense, DF arecan
the number of
also think of it as the amount of independent data that the researcher
observations in a sample that are free to vary while estimating statistical parameters. The researcher can
also think of itcan useamount
as the to estimate a parameter.
of independent data that the researcher can use to estimate a parameter.
To dig into t-tests, read my post about How t-Tests Work.one canshow how the different t-tests
calculate t-values and use t-distributions to calculate p-values.
78 Research Methodology Sampling Techniques and Measurement 79
♦ ♦
To dig into t-tests, read my post about How t-Tests Work.one Chi-Square 3 X 2 Table
canshow how the different t-tests calculate t-values and use t-distributions Now, let’s try a 3 X 2 table. The table below illustrates the example
to calculate p-values. that one use in my post about the chi-square test of independence. In that
The F-test in ANOVA also tests group means. It uses the post, one determine whether there is a statistically significant relationship
F-distribution, which is defined by the degrees of freedom. However, between uniform color and deaths on the original Star Trek TV series.
the researchers calculate the DF for an F-distribution differently. For
more information, read my post about how F-tests Work in ANOVA.
Degrees of Freedom for the Chi-Square Test of Independence
The chi-square test of independence determines whether there is a
statistically significant relationship between categorical variables. Just
like other hypothesis tests, this test incorporates degrees of freedom.
For a table with r rows and c columns, the general rule for calculating
degrees of freedom for a chi-square test is (r-1) (c-1).
However, the researcher can create tables to understand it more
intuitively. The degrees of freedom for a chi-square test of independence
are the number of cells in the table that can vary before the researcher
can calculate all the other cells. In a chi-square table, the cells represent In table,
In the the table, one categorical
one categorical variable
variable is shirt is shirt
color, which can becolor, which
blue, gold, canThebeother
or red.
the observed frequency for each combination of categorical variables. blue,variable
categorical gold,isorstatus,
red.which
Thecan
other categorical
be dead or alive. Aftervariable
one enteredis
thestatus, which
two bolded values,can
one can
The
Chi-Square 2 Xconstraints
2 Table are the totals in the margins. be dead
calculate or alive.
all the remaining After
cells. one entered
Consequently, this table the
has 2 two
DF. bolded values, one can
Chi-Square 2 X 2 Table calculate all the remaining cells. Consequently, this table has 2 DF.
For example, in a 2 X 2 table, after the researcher enter one value in the table, the researcher can calculate Like the t-distribution, the chi-square distribution is a family of distributions where the degrees of
For example, in a 2 X 2 table, after the researcher enter one value Like the t-distribution, the chi-square distribution is a family of
freedom define the shape. Chi-square tests use this distribution to calculate p-values. The graph below
the remaining cells.
in the table, the researcher can calculate the remaining cells. distributions where the degrees of freedom define the shape. Chi-
displays several chi-square distributions.
square tests use this distribution to calculate p-values. The graph below
displays several chi-square distributions.
In the table above, one entered the bold 15, and then one can calculate
thetable
In the remaining three
above, one values
entered in parentheses.
the bold Therefore,
15, and then one thisthe
can calculate table has 1 DF.
remaining three values in 77
parentheses. Therefore, this table has 1 DF.
Degrees of Freedom in Regression Analysis
Chi-Square 3 X 2 Table Degrees of freedom in regression are a bit more complicated, and it can keep it on the simple side.
80 Research Methodology Sampling Techniques and Measurement 81
♦ ♦
egrees of Freedom in Regression Analysis
Degrees of Freedom in Regression Analysis enough information for what the researcher want to do, the researcher
Degrees of freedom in regression are a bit more complicated, and will have imprecise estimates and low statistical power.
Degreesitofcan
freedom
keep itinon
regression are side.
the simple a bit In
more complicated,
a regression and iteach
model, can keep
termitison
anthe simple side. 2.7. HYPOTHESIS
a regressionestimated parameter
model, each term isthat
an uses one degree
estimated of freedom.
parameter that usesInone
thedegree
regression
of freedom. In the
A hypothesis (plural hypotheses) is a proposed explanation for
output
gression output below,
below, the researcher
the researcher can see can
howsee
eachhow
termeach terma requires
requires DF. Therea are
DF.28 observations
a phenomenon. For a hypothesis to be a scientific hypothesis, the
There are 28 observations and the two independent variables use a
d the two independent variables use a total of two degrees of freedom. The remaining 26 degrees of scientific method requires that one can test it. Scientists generally base
total of two degrees of freedom. The remaining 26 degrees of freedom
eedom are displayed in Error.in Error. scientific hypotheses on previous observations that cannot satisfactorily
are displayed
be explained with the available scientific theories. Even though the words
“hypothesis” and “theory” are often used synonymously, a scientific
hypothesis is not the same as a scientific theory. A working hypothesis
is a provisionally accepted hypothesis proposed for further research.
A different meaning of the term hypothesis is used in formal logic, to
denote the antecedent of a proposition; thus in the proposition “If P, then
Q”, P denotes the hypothesis (or antecedent); Q can be called a consequent.
P is the assumption in a (possibly counterfactual) What If question.
The adjective hypothetical, meaning “having the nature of a
hypothesis”, or “being assumed to exist as an immediate consequence of a
hypothesis”, can refer to any of these meanings of the term “hypothesis”.
The error
The error degrees degreesareofthefreedom
of freedom are the
independent independent
pieces pieces
of information that of
are available for Meaning and Importance of Hypothesis
information that are available for estimating the researcher coefficient
timating the researcher coefficient estimates. For precisecoefficient estimates and powerful hypothesis “Hypo” means below and “thesis” means idea or general opinion
estimates. For precisecoefficient estimates and powerful hypothesis
tests in regression, the researcher78must have many error degrees of to be defendedby a person and thus hypothesis means an idea form
freedom. This equates to having many observations for each model term. beforehand which has less value than thegenerally formed view. If
As the researcher add terms to the model, the error degrees of the researcher have to proceed towards some destination for which
freedom decreases. The researcher has fewer pieces of information the researcher do not knowthe way, the researcher try to form an idea
available to estimate the parameters. This situation reduces the precision about the direction to proceed and by trial and error, the researcher
of the parameters and the power of the tests. When the researcher has reach that goal. The primary idea is called a hypothesis.
too few remaining degrees of freedom, the researcher can’t trust the Characteristics of Good Hypothesis
regression results. If the researchers use all the researcher degrees of
Specific: The hypothesis should not be too vague or general.
freedom, the p-values can’t be calculated.
Conceptually clear: The hypothesis should be properly expressed.
For more information about the problems that occur when the researcher
It leads to discovery of additions to knowledge by helping to confirm
use too many degrees of freedom and how many observations the researcher
or disconfirm particular theories or propositions.
need, read my blog post about over fitting the researcher model.
Even though they might seem murky, degrees of freedom are Related to be available technique
essential to any statistical analysis! In a nutshell, DF define the amount The hypothesis should be capable of being verified. Itmust be
of information the researcher have relative to the number of properties simple and capable to empirical test. It provides the framework for
that the researcher want to estimate. If the researcher doesn’t have drawing theconclusion of a research endeavor. In fact, conclusions are
82 Research Methodology Sampling Techniques and Measurement 83
♦ ♦
direct response to the hypothesisformulated for the study as confirmed relation to theories in the field. Hypothesis testing isoften referred to as
or discontinued by data analysis. significance testing. A test of significance is conducted by comparing
thevalues of a statistics computed from a sample with values predicted
Types of Hypothesis by the samplingdistribution under the assumption that the null hypothesis
Hypotheses are mostly commonly classified according to the is true.
way they are stated in the research process. Based on this method of
classification, there are two types of hypothesis: Types of Errors
1. Null hypothesis: The null hypothesis may be crude or refined. There are few errors in the nature of problems and hypothesis
When a null hypothesis stated negatively, it is called a null. A 1. Scientific problem is not moral and ethical questions.
crude null hypothesis which is at the low levelof abstraction and 2. Value statements that indicate cultural or personal judgments or
it does not lead to higher theoretical research. The null hypothesis preferences should be avoided.
is aproposition that stipulates that there would be no relationship 3. Another common defect of problem statements often occurs in
or difference between thevariables being studied and that any such doctoral thesis: listing the methodological points or problems as
relationship or difference if found to exist does soaccidentally or as sub problems.
a result of chance it is more or less the negation of the directional
or alternative hypothesis. 2.8. ONE TAILED TEST AND TWO TAILED TESTS
2. Uniform: Uniform Hypothesis relate to the existence of empirical Conduct a test of statistical significance, whether it is from a
uniformities. correlation, an ANOVA, a regression or some other kind of test, the
Complex:The complex types are concerned with complex idea researcher are given a p-value somewhere in the output. If the researcher
type. They existence of logically desired relationship between empirical test statistic is symmetrically distributed, the researcher can select one
uniformities. of three alternative hypotheses. Two of these correspond to one-tailed
tests and one corresponds to a two-tailed test. However, the p-value
Analytic presented is (almost always) for a two-tailed test.
They are aimed at finding out the relationship between changes
in one property leading to change in another. And so many types are 2.9. TWO TAILED TEST
there which are relating to hypothesis. Using a significance level of 0.05, a two-tailed test allots half of the
i.e. Uni
variablbe and multi variable, universal and statistical, researcher’s alpha to testing the statistical significance in one direction
temporal and cross sectional, descriptive, relational, explanatory and half of the researcher alpha to testing statistical significance in the
etc. The problem and hypothesis direct investigation helps to deduce other direction. This means that. 025 is in each tail of the distribution of
specific empirical manifestation implied by them.It advances scientific the researcher test statistic. When using a two-tailed test, regardless of
knowledge by helping the investigator to confirm or reject theory and the direction of the relationship the researcher hypothesize, the researcher
hypothesis incorporates the theory or part of it, in testable or near are testing for the possibility of the relationship in both directions. For
testable form. example, the researcher may wish to compare the mean of a sample to
a given value x using a t-test. Our null hypothesis is that the mean is
Hypothesis Testing and Levels of Significance equal to x. A two-tailed test will test both if the mean is significantly
In qualitative studies, the main purpose of the analysis is to test greater than x and if the mean significantly less than x. The mean is
hypothesis, which form thebasis of the study and to discuss these in considered significantly different from x if the test statistic is in the
probability distribution or bottom 5% of its probability distribution, resulting in a p-value less th
en using a two-tailed test, regardless of the direction of the relationship the researcher hypothesize, the
0.05. The one-tailed test provides more power to detect an effect in one direction by not testing the eff
earcher are testing for the possibility of the relationship in both directions. For example, the researcher
in the other direction.
y wish to compare the mean of a sample to a given value x using a t-test. Our null hypothesis is that the
x. AResearch
an is equal to84 Methodology
two-tailed test will test both if the mean is significantly greater than x and if the mean Sampling Techniques and Measurement 85
♦ ♦
nificantly lesstop
than x. The
2.5% mean is 2.5%
or bottom considered
of its significantly x if the test
different fromresulting
probability distribution, in astatistic is in the
p-value
2.5% or bottom 2.5%less
of itsthan 0.05. distribution, resulting in a p-value less than 0.05.
probability
The range for our example is 2.2, the distance from the lowest score, 1.8, to the highe
Interquartile range.
106 Research Methodology Introduction to Statistics 107
♦ ♦ A slightly more sophisticated measure is the interquartile range. If the resea
median is actually a better measure of centrality than the mean if The interquartile range for example
into quartiles, is.one9,fourth
meaning that because the quartiles
of the measurements are in quartile 1, one fou
3, and one fourth in 4, the researcher will get a number that divides 1 and 2 and a num
the researcher data are skewed, meaning lopsided. If, for example, divide roughly at 2.45 and 3.35. The reason for the odd dividing lines
4. The researcher then measure the distance between those two numbers, which the
the researcher have a dozen ordinary folks and one millionaire, the is because there are 15 pieces of data, which, of course, cannot be
the data. Notice that the number between quartile 2 and 3 is the median!
distribution of their wealth would be lopsided towards the ordinary neatly divided into quartiles!
people, and the millionaire would be an outlier, or highly deviant The interquartile range for example is .9, because the quartiles divide roughly at 2.45
The standard deviation
member of the group. The millionaire would influence the mean a for the odd dividing lines is because there are 15 pieces of data, which, of course, ca
great deal, making it seem like all the members of the group are doing The standard deviation is the “average” degree to which scores
into quartiles!
quite well. The median would actually be closer to the mean of all the deviate from the mean. More precisely,
The standard the researcher measure how far
deviation.
people other than the millionaire. all the researcher measurements are from the mean, square each one,
The standard deviation is the "average" degree to which scores deviate f
The median for our example is 3.0. Half the people scored lower, and add them all up. The result is called the variance. Take the square
precisely, the researcher measure how far all the researcher measurements are from
and half higher (and one exactly). root of the variance, and the researcher has the standard deviation. Like
one, and add them all up. The result is called the variance. Take the square root o
the mean, it is the “expected value” of far the scores deviate from the
researcher has the standard deviation. Like the mean, it is the "expected value"
The mode mean. Here is what the formula
deviate fromlooks like:
the mean. Here is what the formula looks like:
The mode is the measurement that has the greatest frequency, the
one the researcher found the most of. Although it isn’t used that much,
it is useful when differences are rare or when the differences are non-
numerical. The prototypical example of something is usually the mode. The normal curve
The normal curve
The example for the mode is 3.2. It is the grade with the most
people (3). At its simplest, the central At its simplest, the central tendency and the measure of dispersion describ
tendency and the measure of dispersion
summary of the set of data. On a more sophisticated level, these measures describ
describe a rectangle that is a summary of the set of data. On a more
normal curve, that contains the data most efficiently.
Statistical dispersion sophisticated level, these measures describe a curve, such as the normal
105
Dispersion refers to the idea that there is a second number which tells curve, that contains the data most efficiently.
us how “spread out” all the measurements are from that central number. This curve, also called the bell-shaped curve, represents a distribution
that reflects certain probabilistic events when extended to an infinite
The range number of measurements. It is an idealized version of what happens
The range is the measure from the smallest measurement to the largest in many large sets of measurements: Most measurements fall in the
one. This is the simplest measure of statistical dispersion or “spread.” middle, and fewer fall at points farther away from the middle. A simple
The range for our example is 2.2, the distance from the lowest example is height: Very few people are below 3 feet tall; very few
score, 1.8, to the highest, 4.0. are over 8 feet tall; most of us are somewhere between 5 and 6. The
same applies to weight, IQs, and SATs! In the normal curve, the mean,
Interquartile range median, and mode are all the same.
A slightly more sophisticated measure is the interquartile range. If
the researchers divide the data into quartiles, meaning that one fourth 3.9. INFERENTIAL STATISTICS
of the measurements are in quartile 1, one fourth in 2, one fourth in 3, With inferential statistics, the researcher is trying to reach
and one fourth in 4, the researcher will get a number that divides 1 and conclusions that extend beyond the immediate data alone. For instance,
2 and a number that divides 3 and 4. The researcher then measure the the researcher use inferential statistics to try to infer from the sample
distance between those two numbers, which therefore contains half of data what the population might think. Or, the researcher use inferential
the data. Notice that the number between quartile 2 and 3 is the median! statistics to make judgments of the probability that an observed difference
108 Research Methodology Introduction to Statistics 109
♦ ♦
between groups is a dependable one or one that might have happened • The researcher have two separate data sets that are provided by
by chance in this study. Thus, the researcher use inferential statistics the same people, just at different times (e.g. pre/post)
to make inferences from our data to more general conditions; the
researcher use descriptive statistics simply to describe what’s going ANOVA (Analysis of Variance)
on in our data. An ANOVA is a statistical test that is also used to compare means.
The difference between a t-test and an ANOVA is that a t-test can only
t-tests compare two means at a time, whereas with an ANOVA, the researcher
A t-test is a statistical test that can be used to compare means. can compare multiple means at the same time. ANOVAs also allow
There are three basic types of t-tests: one-sample t-test, independent- the researcher to compare the effects of different factors on the same
samples t-test, and dependent-samples (or paired-samples) t-test. measure. ANOVAs can become very complicated, and the analysis
For all t-tests, the researcher are simply looking at the difference should only be done by someone who has been trained in statistics.
between the means and dividing that difference by some measure There are several types of ANOVAs, including: one-way ANOVA,
of variation. within-groups (or repeated-measures) ANOVA, and factorial ANOVA.
3.10. PARAMETRIC AND NON PARAMETRIC STATISTICS 3.12. TYPES OF THE VARIABLES
In the literal meaning of the terms, a parametric statistical test is There are different ways variables can be described according to the
one that makes assumptions about the parameters (defining properties) ways they can be studied, measured, and presented. Numeric variables have
112 Research Methodology Introduction to Statistics 113
♦ ♦
values that describe a measurable quantity as a number, like ‘how many’ • Confounding variable: extra variables that have a hidden effect
or ‘how much’. Therefore numeric variables are quantitative variables. on the researcher experimental results.
Numeric variables may be further described as either continuous or discrete: • Control variable: a factor in an experiment which must be held
A continuous variable is a numeric variable. Observations can take constant. For example, in an experiment to determine whether light
any value between a certain set of real numbers. The value given to makes plants grow faster, the researcher would have to control for
an observation for a continuous variable can include values as small soil quality and water.
as the instrument of measurement allows. Examples of continuous
• Dependent variable: the outcome of an experiment. As the
variables include height, time, age, and temperature.
researcher change the independent variable, the researcher watch
A discrete variable is a numeric variable. Observations can take a
what happens to the dependent variable.
value based on a count from a set of distinct whole values. A discrete
variable cannot take the value of a fraction between one value and the • Independent variable: a variable that is not affected by anything
next closest value. Examples of discrete variables include the number that the researcher, the researcher, does. Usually plotted on the x-axis.
of registered cars, number of business locations, and number of children • A measurement variable has a number associated with it. It’s an
in a family, all of of which measured as whole units (i.e. 1, 2, 3 cars). “amount” of something, or a “number” of something.
The data collected for a numeric variable are quantitative data. • Qualitative variable: a broad category for any variable that can’t
Categorical variables have values that describe a ‘quality’ or be counted (i.e. has no numerical value). Nominal and ordinal
‘characteristic’ of a data unit, like ‘what type’ or ‘which category’. variables fall under this umbrella term.
Categorical variables fall into mutually exclusive (in one category or • Quantitative variable: A broad category that includes any variable
in another) and exhaustive (include all possible options) categories. that can be counted, or has a numerical value associated with it.
Therefore, categorical variables are qualitative variables and tend to Examples of variables that fall into this category include discrete
be represented by a non-numeric value. variables and ratio variables.
Categorical variables may be further described as ordinal or nominal
An ordinal variable is a categorical variable. Observations can take a • Random variables are associated with random processes and
value that can be logically ordered or ranked. The categories associated give numbers to outcomes of random events.
with ordinal variables can be ranked higher or lower than another, but • A ranked variable is an ordinal variable; a variable where every
do not necessarily establish a numeric difference between each category. data point can be put in order (1st, 2nd, 3rd, etc.).
Examples of ordinal categorical variables include academic grades • Ratio variables: similar to interval variables, but has a meaningful
(i.e. A, B, C), clothing size (i.e. small, medium, large, extra-large) zero.
and attitudes (i.e. strongly agree, agree, disagree, strongly disagree).
A nominal variable is a categorical variable. Observations can take a Less Common Types of Variables
value that is not able to be organized in a logical sequence. Examples of
• Active Variable: a variable that is manipulated by the researcher.
nominal categorical variables include sex, business type, eye color, religion
and brand. The data collected for a categorical variable are qualitative data. • Attribute variable: another name for a categorical variable (in
statistical software) or a variable that isn’t manipulated (in design
Common Types of Variables of experiments).
• Categorical variable: variables than can be put into categories. • Binary variable: a variable that can only take on two values,
For example, the category “Toothpaste Brands” might contain the usually 0/1. Could also be yes/no, tall/short or some other two-
variables Colgate and Aqua fresh. variable combination.
114 Research Methodology Introduction to Statistics 115
♦ ♦
• Collider Variable: a variable represented by a node on a causal • Manifest variable: a variable that can be directly observed or
graph that has paths pointing in as well as out. measured.
• Covariate variable: similar to an independent variable, it has an • Manipulated variable: another name for independent variable.
effect on the dependent variable but is usually not the variable of • Mediating variable: variables that explain how the relationship
interest. between variables happens. For example, it could explain the
• Criterion variable: another name for a dependent variable, when difference between the predictor and criterion.
the variable is used in non-experimental situations. • Moderating variable: changes the strength of an effect between
• Dichotomous variable: Another name for a binary variable. independent and dependent variables. For example, psychotherapy
• Dummy Variables: used in regression analysis when the researcher may reduce stress levels for women more than men, so sex moderates
want to assign relationships to unconnected categorical variables. the effect between psychotherapy and stress levels.
For example, if the researcher had the categories “has dogs” and • Nuisance Variable: an extraneous variable that increases variability
“owns a car” the researcher might assign a 1 to mean “has dogs” overall.
and 0 to mean “owns a car.” • Observed Variable: a measured variable (usually used in SEM).
• Endogenous variable: similar to dependent variables, they are • Outcome variable: similar in meaning to a dependent variable,
affected by other variables in the system. Used almost exclusively but used in a non-experimental study.
in econometrics.
• Polychotomous variables: variables that can have more than two
• Exogenous variable: variables that affect others in the system. values.
• Explanatory Variable: a type of independent variable. When • Predictor variable: similar in meaning to the independent variable,
a variable is independent, it is not affected at all by any other but used in regression and in non-experimental studies.
variables. When a variable isn’t independent for certain, it’s an
• Responding variable: an informal term for dependent variable,
explanatory variable.
usually used in science fairs.
• Extraneous variables are any variables that the researcher are
• Scale Variable: basically, another name for a measurement variable.
not intentionally studying in the researcher experiment or test.
• Test Variable: another name for the Dependent Variable.
• A grouping variable (also called a coding variable, group variable
or by variable) sorts data within data files into categories or groups. • Treatment variable: another name for independent variable.
• Identifier Variables: variables used to uniquely identify situations.
Classification of Data
• Indicator variable: another name for a dummy variable.
The process of arranging data into homogenous groups or classes
• Interval variable: a meaningful measurement between two according to some common characteristics present in the data is called
variables. Also sometimes used as another name for a continuous classification.
variable.
• Intervening variable: a variable that is used to explain the Bases of Classification
relationship between variables. There are four important bases of classification:
• Latent Variable: a hidden variable that can’t be measured or (1) Qualitative Base (2) Quantitative Base (3) Geographical Base
observed directly. (4) Chronological or Temporal Base
116 Research Methodology Introduction to Statistics 117
♦ ♦
(1) Qualitative Base Construction of a Statistical Table
When the data are classified according to a quality or attribute A statistical table has at least four major parts and some other
such as sex, religion, literacy, intelligence, etc. minor parts.
(2) Quantitative Base
1. The Title
When the data are classified by quantitative characteristics like
height, weight, age, income, etc. 2. The Box Head (column captions)
(3) Geographical Base 3. The Stub (row captions)
When the data are classified by geographical regions or location, 4. The Body
like states, provinces, cities, countries, etc. 5. Prefatory Notes
(4) Chronological or Temporal Base
When the data are classified or arranged by their time of occurrence, 6. Foot Notes
such as years, months, weeks, days, etc. 7. Source Notes