Research Methodology

Dr. Md. Hasanuzzaman

Senior Lecturer
Higher Institution Centre of Excellence (HICoE)
UM Power Energy Dedicated Advanced Centre (UMPEDAC)
Level 18, Room 16, Wisma R&D, University of Malaya
59990 Kuala Lumpur, Malaysia
Tel:+603-22463463(Direct);+603-22463246(General Office)
Email: [email protected];[email protected]

Outline

Introduction
Research Types
Research Approach
Research Design
Data Collection
Data Analysis
Results and Discussion
Conclusions & Recommendations
2

Introduction
The methodology shows how your research
questions will be answered.
It must be appropriate for research topic.
Describe in detail what methodology and
materials that researchers will use to carry out
the research.

Research Process in Engineering

Prior
knowledge

An idea

Independent verification:
literature, experiment,
numerical model,
analytical model, etc.

Submit
Report,
Thesis,
Journal
or
Conference
Paper

Discovery

The Outcome is Recognised

as a Major contribution
to the field

Independent verification:
literature, experiment,
numerical model,
analytical model, etc.

Assessors
5

Research Types

Research
Types

Exploratory

Descriptive

Analytical

Predictive

Research Types
Exploratory Research
Used when few or no previous studies exist.
Looking for patterns, hypotheses or ideas that can
be tested and will form the basic for further
research.

Descriptive Research
Used to identify and classify the elements or
characteristics of a research topic.
Quantitative techniques are most often used to
collect, analyze and summaries data.
7

Research Types
Analytical Research
Extends the descriptive approach to suggest or
explain why and how something is happening.
An important feature of this type of research is in
locating and identifying the different factors
(variables) involved.

Predictive Research
The aim of predictive research is to speculate
intelligently on future possibilities, based on close
analysis of available evidence of cause and effect.
8

Research Methods

Research Methods

Qualitative
Method

Anthropological
research

Quantitative
Method

Historical
Research

Descriptive
research

Correlational
research

Experimental
research

causalcomparative
research

Qualitative Method
Narrative data is collected in order to study the topic of
interest.
Anthropological research
Culture investigation
The data analysis includes coding and production of verbal
synthesis.
No statistical procedures or other means of quantification is
involved.

Historical Research
allows one to discuss past and present events. The method
investigates the why and how of decision making.
Example: X and Y (2013) examined trends in achievement levels
of African American versus White children.

10

Quantitative Method
Data (both numerical and non-numerical) is
collected in order to describe, predict and/or
control phenomena of interest.
The data analysis is mainly statistical.
Quantitative research can be used to verify
such hypotheses formulated through
qualitative research.

11

Quantitative Method
Descriptive Research
Survey research
collect data in order to answer questions about the current
status of the topic of study
use formal instruments to study preferences, attitudes,
practices, concerns, or interests of a sample
statistical approach to summarise the results of many
studies that have investigated basically the same problem
Example: Hasanuzzaman et al. (2012) surveyed and
investigated energy consumption, energy sources, energy
savings, emission reduction and cost benefit of energy
savings in a cement industry.
12

Qualitative Method
Correlational Research
collecting data in order to determine whether, and
to what degree, a relationship exist between two
or more variables
To make predictions of how one variable might
predict another

13

Quantitative Method
Experimental Research
to investigate cause and effect relationship through the direct
manipulation of an independent variable X to measure the effect on
dependent variables Y
Used for testing
X and Y are correlated
X causes Y

comparison of two different approaches

comparison of an existing approach to a new approach
comparison of differing amounts of a single approach

causal-comparative research
sometimes treated as a type of descriptive research since it describes
conditions that already exist.
attempt to determine reasons, or causes, for the existing condition.
14

Research Design
Research design (depends on research types):
Conceptual and/or Theoretical Framework
Models and/or Theorems Formulation
Research/Experimental Design
Sampling Method
Measurement Instruments
Materials and Experiments
Data Collection Method
Data Analysis
15

Validity and Reliability

Validity is an important consideration in the choice of an
instrument to be used in a research investigation
It should measure what it is supposed to measure

Reliability is another important consideration, since

researchers want consistent results from instrumentation
Consistency gives researchers confidence that the results actually
represent the achievement of the individuals involved

16

What are Data?

Data refers to the information that researchers obtain
on the subjects of their research.
Demographic information or scores from a test are
examples of data collected.
The researchers has to determine what kind of data
they need to collect.

17

Key Questions
Questions arise regarding the procedures and conditions under
which the instruments will be administered:
Where will the data be collected?
When will the data be collected?
How often are the data to be collected?
Who is to collect the data?

18

Data Collection
Source

Method

Unit of data collection

Model, Sample

Environment of Data Collection

Lab, Field, research desk

Interaction with unit of data collection

Treatment, subject involvement, intrusive

measurement

Measurement instrument

Observation, Recorders, Interviews,

Surveys, Questionnaires, Primary
documents, Ethnography, Literature
survey, data logger

19

What is a Survey?

Researchers are often interested in the opinions of a

large group of people about a particular topic or issue.
There are three major characteristics that most surveys
possess:

1)

2)

3)

Information is collected from a group of people in

order to describe some aspect of the population
Information is collected by asking questions of the
members of the selected group
Information is collected from a sample rather than
from every member of the population

20

Why Are Surveys Conducted?

The purpose of surveys is to describe the characteristics of a
topic.

Researchers find out how the parameters/ variables of a

topic distribute themselves.
A selected sample is surveyed and analyzed what is found
out from the sample.
In descriptive surveys, researchers are not as concerned
about why the observed distribution exists as with what the
distribution is.
21

Item Formats
Questions used in a subject-completed instrument can take
many forms but are classified as either selection or supply
items.
Examples of selection items are:
True-false items
Matching items
Multiple choice items

Examples of supply items are:

Short answer items
Essay questions
22

Steps in Survey Research

The following steps are used in conjunction with
performing proper surveys in research:
Selecting the sample
Preparing the instrument (questionnaire)
Closed-ended questions
Open-ended questions
Pre-testing the questionnaire
Format
Cover letter
Training interviewers

23

Anonymous Responses
Arguments for yes Anonymous
Sample population might be less influenced by who is
asking the questions
Respondents might be less concerned about others
learning of their opinions

Arguments for no Non-anonymous

Who will you send the results to?
Who will you send the reward to?
How do you know who to follow up about returning the
survey?
24

Confidentiality
Need to ensure that confidentiality is assured
before the survey is sent out.
Consider using an independent third party to
administer the survey.

25

Feedback
It is assumed that your sample population
(and the full population) will want access to
the results.
You must explain how will this be done at the
beginning of the survey.

26

Sample Time lines

Week 1: Pre-survey letter of introduction
(Wider research context and brief research
plan)
Week 2: Survey send out
Week 3: Mid-survey reminder letter
Week 4: Last minute final reminder
Week 6: Post-survey analysis report
completed
27

Content of items
Avoiding response set
Components of attitudes
Common types of faulty items
leading questions
double barreled questions
vague and ambiguous terminology
hidden assumptions

28

Leading questions and context

effects
Would you agree that the governments policies on health
are unfair?
Item wordings should not contain value judgments
How many packs of cigarettes did you smoke last night?
Think how the context of the study would affect the
response, say in a
survey of young peoples life styles
survey of health behavior and heart disease

29

Double barreled questions

Do you believe the training programme was a
good one and effective in teaching you new
skills?
avoid questions that involve multiple premises

30

Vague and ambiguous terminology

How often do you clean your teeth?

Frequently
often
infrequently
never

what does frequently mean?

Give quantifiers to ensure all respondents
understand the same thing by the response
categories
31

Hidden assumptions
May lead to a positive response as otherwise
something negative about the respondent is
being conveyed

32

Data Analysis in Survey Research

After researchers receive the completed questionnaires, the
task of summarizing the results remains.
The total size of the sample and total percentage of returns
should be reported.
The percentage of the total sample responding for each item
should be reported.
The percentage of respondents who chose each alternative
for each question should be given.

33

Types of Surveys

There are two types of surveys:

1)

Cross-sectional survey
Collect information from a sample that has been drawn from a
predetermined sample
Information is collected at just one point in time, even though it
could take days to gather all the data

2)

Longitudinal survey
Information is collected at different points in time in order to study
changes over time

34

Steps in Survey Research

The following steps are used to perform proper
surveys in research:
Defining the problem
Identifying the target sample (unit of analysis)
Choosing the mode of data collection

Direct administration
Mail surveys
Telephone surveys
Personal interviews

35

Methods for obtaining data

Survey research (all require a structured questionnaire,
where each observation unit is posed with the exact
same questions)
postal questionnaire survey
e-mail questionnaire survey (Internet polls)
face-to-face interviews
telephone interviews
Systematic observation
Text analysis
Statistical data (secondary analysis)
Register data
36

Ethical principles in obtaining data

no harm may be done to the participants

informed consent
anonymity
confidence

37

Questionnaire design
Relevant to requirements gathering for, and
evaluation of, projects
Self study pack covers:
Planning and logistics of questionnaire design
Layout issues
Forms of questions
Contents of questions

38

Planning and logistics of

questionnaire design

Quantitative or qualitative?
Legal requirements: the Data Protection Act
Confidentiality and anonymity
Sample size
Volunteer respondents
Identifying subject areas
Determining appropriate length
Typical time scale
Main components of questionnaires
39

Designing a Survey
Role of the researcher
Develop the research plan
Design the survey instrument
Select the sample
Issue/distribute the survey
Prompt the sample for responses
Analyse the data
Generate conclusions

Rating system 5 point scale

Strongly disagree
Disagree
Neutral
Agree
Strongly agree

1
2
3
4
5

Rating system 4 point scale

Strongly disagree
Disagree
Agree
Strongly agree

1
2
3
4

This forces respondents to show positive or

negative attitudes.

Hints for writing questions

Keep in very simple avoid jargon (no synonym)
Use one concept per question avoid multiple concepts
Keep wording positive avoid negative words and phrases,
double negatives
The first question should be the over-all question Never
place a controversial question at the beginning.
Keep related questions together Difficult for the respondent
to remain coherent
Use three questions per topic Do not over question, dont
waste peoples time.

Reporting
Calculate averages and statistics for each theme.
Construct a Histogram and report the value
Report selective quotes on open questions.

Missing Data
Did the respondent simply forget one
question?
May be the question was not relevant to that
person?
Was the question too personal?
Was the question confusing? Could it have
been scored as a 1 for one interpretation and
a 5 using another interpretation.

Research Design
Application

Applied research
Fundamental research

Descriptive research
Exploratory research
Predictive research
Objectives
Analytical research

Methods

Qualitative research
Quantitative research

Approach

Experimental research
Modeling/Simulation research
Mixed

46

Research Design
Gives direction and systematic process to the research.
Critical process that transforms an idea, interest, or question into a
meaningful and purposeful investigation.
The central emphasis of research design is the process itself.
Does not refer to the end product, the results, a new theory or a specific
methodology.
Research design framework:
1.
2.
3.
4.
5.
6.
7.
8.
9.

Identify the problem area.

Literature survey.
Define actual problem and objectives for investigation in clear, specific terms.
Development of models, theories and hypotheses.
Development of instruments and methods to collect data.
Experimental control and manipulation of variables.
Collection of empirical data.
Modeling and analysis of data.
Evaluation of results.
47

Research Design
Experimental design
Title: Motor efficiency
Independent variable: Load
Dependent variable: efficiency
The effect of efficiency depends on the load.

Steps when conducting an experiment:

a.
b.
c.
d.

Choose independent variable.

Select dependent variables to be measured
Data collection: motor samples
Analyse data: measurement of efficiency using various
methods, loss measurements due to varying load
conditions.
48

Research Design (cont.)

Discussion on experimental research:
i. Involves doing something new: motor efficiency
tests
ii. Compare with something standard: standards of
measurement methods

49

Research Design
Characteristic of Good Experiment:
Research is based on an open system thought
Researchers examine data critically
Data valid and verifiable
Researchers specify limits on their generalization
Conclusion based on research findings are correct
and can be verified by others.

50

Assignment Research Design

Read journal papers and identify the items below:
What is the object?
What are the variables?
What are the names of the variables?
What research method is used?
What is the independent variable?
What is the dependent variable?
State the novelty of the proposed topic.

51

Types of Researcher-completed
Instruments

Rating scales
Interview schedules
Tally sheets
Flowcharts

Performance checklists
Observation forms

52

Basic Outline

Introduction

Problem to be investigated
Purpose & Justification
Research Objectives

Literature Review

Find out research gap

Theory and definitions

Research Methodology
Experimental design

Experiment, correlational, etc.

Instrumentation

How you will measure each parameters.

Reliability & Validity

Procedural Detail

What will happen and when it will happen.

Data collection
Mathematical formulation
Data analysis

Results and Discussion

Conclusion and Recommendations

53

54