Unit 1 Introduction To Inferential Statistics: 1.0 Objectives
Unit 1 Introduction To Inferential Statistics: 1.0 Objectives
Structure
1.0 Objectives
1.1 Introduction
1.2 Concept and Meaning of Inferential Statistics
1.3 Inferential Procedures
1.3.1 Estimation
1.3.2 Hypothesis Testing
1.3.2.1 Types of Hypothesis
1.3.2.2 Level of Significance
1.3.2.3 One-tailed and Two- tailed Tests
1.3.2.4 Errors in Hypothesis Testing
1.3.2.5 Power of a Test
1.4 Procedure for Testing Hypothesis
1.5 Let Us Sum Up
1.6 References
1.7 Key Word
1.8 Answers to Check Your Progress
1.9 Unit End Questions
1.0 OBJECTIVES
After reading this unit, you will be able to:
1.1 INTRODUCTION
To refresh your memory with regard to what you learned in BPCC104:
Statistical Methods for Psychological Research- I and to set a background for
further discussion and explanation for the present course, that is, BPCC108:
Statistical Methods for Psychological Research- II, let us focus on the
following points.
Statistics can be described as a branch or sub-field of mathematics that
mainly deals with the organisation as well as analysis and interpretation of a
group of numbers (Aron, Aron and Coups, 2009).
*
Prof. Suhas Shetgovekar, Faculty, Discipline of Psychology, SOSS, IGNOU, Delhi
15
Inferential
Statistics: An 1. Statistics as a subject area has a vast scope and application. It finds its
Introduction application in fields like policy planning, management, education,
marketing, agriculture, medicine and so on, though, one of its major
application is in research.
Refer to Box 1.1, that gives a brief description about descriptive statistics.
These techniques are relevant mainly in univariate analysis of data, that is,
when there is one variable. But when we want to carry out bivariate analysis
(where there are two variables) or when we have multiple independent
variables and dependent variables, where we want to study cause and effect
relationship and so on, we could use inferential statistics.
16
In BPCC104: Statistics for Psychological Research- I, we briefly explained Introduction to
Inferential
inferential statistics. Let us once again discuss the same in this unit as this Statistics
unit forms the foundation to the units that we will subsequently discuss in
this course.
For the above examples, different statistical techniques, that necessarily fall
under Inferential statistics can be used. For instance, with regard to the first
example, the researcher could use Independent t test, as there are two groups
and significant difference between the two groups with regard to
organisational citizenship behaviour needs to be studied. Though if the
assumptions of parametric tests are not fulfilled then Mann- Whitney U test
can also be used.
With regard to the example 2, the paired t test can be used if the assumptions
of parametric statistics are met. This is so because the significant difference
between a same group, pretest and posttest, is studied.
With regard to the last example (that is, example 3), to carry out data analysis
One Way Analysis of Variance (this is a parametric test) or Kruskal- Wallis
One Way ANOVA (this is nonparametric test) can be used.
Above we mentioned about parametric and non parametric tests. the same
will be discussed in details by us in unit 4 of this course.
17
Inferential
Statistics: An Let us now focus on what is inferential statistics.
Introduction
In inferential statistics, inferences are drawn about the population based on a
representative sample. After the data is collected, it is organised and
summarised and once this is done, inferential statistics can be carried out in
order to analyse the data and draw conclusions and make inferences. Thus,
with the help of inferential statistics, inferences can be drawn about the
population of the study based on the characteristics of the sample on whom
the study was carried out (Salkind, 2014).
As stated by Aron, Aron and Coups (2013, page 2), inferential statistics is
employed by psychologists in order to make inferences and draw conclusions
based on certain data. Further, inferential statistics though computed based on
descriptive statistics of a given sample, it goes beyond the sample and it helps
in generalisation of inferences to the whole population (Mohanty and Mishra,
2016, page 8). King and Minium (2008, page, 4) described that “the purpose
of inferential statistics is to draw conclusions about the conditions that exist
in a population from study of a sample”. The process of inferential statistics
can be explained with the help of the following flowchart (refer to figure
1.1).
Data collection
Data analysis
1.3.1 Estimation
Estimating probability of a phenomenon is referred to as estimation
(Veeraraghavan and Shetgovekar, 2016). As we know from the explanation
of inferential statistics, that inferences are drawn from sample that is
representative of a population and these inferences can then be generalised to
the whole population. In these inferences, the researcher will make an
estimation that needs to be close to the actual or true population value.
There are two types of estimation: point estimation and interval estimation.
Point estimation: This is a type of estimation in which the value is a single
point. or example the estimation for sample mean is made as . that is
expe ted to e equal to the population mean. Point estimate omprises of
sample mean and sample proportion. he population mean is „ ‟ the sample
mean will e „x‟. In similar manner, if the population proportion is „P’ then
sample proportion will be „p’.
Interval estimation: An interval estimate is an interval or two numbers
within which the population parameter could lie. Thus, for population mean
„ ‟ the interval estimate will be a<x< b. The interval estimate is greater than
„a‟ but lesser than „ ‟. For example, an interval estimate could be 45- 47
within which it is expected that the population mean will lie. As the
researcher has an interval, he/ she is thus able to trust that the estimate is
close to the population value with 95% or 99% level of confidence. Interval
estimate comprises of confidence interval for mean and confidence interval
for proportions.
While estimations are made there could be fluctuations and these could be
due to varied reasons including chance factors and sampling error.
19
Inferential
Statistics: An The inferences drawn by the researcher needs to be free of any chance
Introduction factors. For example, a researcher is studying if there exists significant
difference in job satisfaction of government and private bank employees.
After carrying out data collection and data analysis, he/she obtains results
that such a difference does exist, then such results should not be an outcome
of chance factors. If the difference falls within the range ± 1.96, then the
significant difference can be said to be real and not due to chance factors.
Fluctuations can also be as a result of sampling error that occur when the
sample selected by the researcher is not representative of the population
being studied. A sample that is not representative of the population will not
possess the same characteristics as the population and thus the results
obtained from such a sample cannot be used to draw inferences for the
population. Sampling errors can be avoided by being careful while selecting a
sample and also by having a larger sample.
1) Further, the alternative hypothesis refers to the sample and the null
hypothesis refers to the population.
For instance
The alternative hypothesis is H1 x1 x2
The null hypothesis is HO: 1 = 2
Further, any hypothesis can also be one tailed or two tailed. It is termed as
one- tailed when certain direction is given to the hypothesis or the hypothesis
is directional. For example, if the researcher is study if gender difference
exists with regard to emotional intelligence, a one-tailed hypothesis would be
“ emales have higher emotional intelligence than males” or “Males have
higher emotional intelligence than females”. Refer to figure no. 1.2 that
provides the figure for both 0.05 and 0.01 levels of significance. In one-tailed
test, in order to reject a null hypothesis, the score needs to fall in the upper
tail, that is in the top 5% of the distribution. A one-tailed test can be tested in
either of the direction.
22
Introduction to
Inferential
a) 0.05 level of significance Statistics
1.64 1.96
-3 -2 -1 0 1 2
3
2.33 2.58
0.005 (0.5 two- tailed)
-3 -2 -1 0 1 2
3
The z scores for one tailed test would be -1.64 or 1.64 at 0.01 level and -2.33
or 2.33 at 0.05 level. The z scores for two tailed test would be -1.96 or 1.96
at 0.01 level and -2.58 or 2.58 at 0.01 level (as you can see in figure 1.2).
23
Inferential
Statistics: An Type I and Type II errors in hypothesis testing. Refer to the table 1.1 for
Introduction clarity in this regard.
Let us now discuss the correct decisions as well as the types of errors.
In a way, whether the Type I error is committed or not will depend on the
level of significance that is taken by the researcher, which can be specified
before the research process starts. Therefore, the likelihood of making type I
error would be lower if a stringent alpha level is used. Though, when, the
alpha level is stringent, the likelihood of making Type II error could increase
(Mohanty and Misra, 2016). Thus, it can be said that the relationship between
making type I and type II error is inverse in nature. Though, if we want to
ensure that both the errors are avoided, then the sample size can be increased.
24
1.3.2.4 Power of a Test Introduction to
Inferential
Statistics
Let us now come to the next significant term, that is power of the test. Power
of a test can be related with type II error. Power of a test can be explained as
a measure of how sensitive the experiment or research is in detecting the real
effect that the independent variable has on the dependent variable (Mohanty
and Misra, 2016). Thus, it mainly involves rejecting the null hypothesis, as
when null hypothesis is rejected it can be said that the independent variable is
having an effect on the dependent variable. Thus, the Power of a test can also
be described in terms of probability related to rejection of null hypothesis
when it is false. Thus,
Power = 1- β or β = 1- Power
The values of probability ranges from 0.00 to 1.00 (Mohanty and Misra,
2016). The more is this value the more the experiment or research will be
sensitive in detecting the real effect and the less is the value, the less is the
experiment or research will be sensitive in detecting the real effect. Further,
as we increase the sample size, the Power of a test will also increase.
In the earlier sub section, we discussed about the null hypothesis (es) and
alternative hypotheses. In the very first step of hypothesis testing procedure,
25
Inferential
Statistics: An null hypothesis(es)/ alternative hypothesis(es) are specified. This will mainly
Introduction depend on the objective,(s) and nature of the study as well as the existing
review of literature.
A sample is taken by the researcher and data is collected. Statistic that is thus
obtained from the sample (representative) is then used in order to make an
estimation about the population parameters.
In this regard, based on the P value or probability level selected under step 2,
decision is taken by the researcher whether to accept or reject the null
hypothesis.
1.6 REFERENCES
Aaron, A., Aaron, E. N., & Coups, E. J. (2013). Statistics for psychology.
New Delhi: Dorling Kindersley (India) Pvt. Ltd.
Best, J. W and Kahn, J. V. (1999). Research in Education. New Delhi:
Prentice Hall of India Pvt. Ltd. for information on research designs.
Kerlinger, Fred, N. (1995). Foundations of Behavioural Research. Bangalore:
Prism Books Pvt. Ltd. for information on research, research designs, types of
research and methods of data collection.
King, M; Minium, W. (2008). Statistical Reasoning in the Behavioural
Sciences. Delhi: John Wiley and Sons, Ltd.
Mangal, S. K. (2002). Statistics in psychology and Education. new Delhi: Phi
Learning Private Limited.
Minium, E. W., King, B. M., & Bear, G. (2001). Statistical reasoning in
psychology and education. Singapore: John-Wiley.
Mohanty, B and Misra, S. (2016). Statistics for Behavioural and Social
Sciences. Delhi: Sage.
Salkind, N. J. (2014). Statistics for People who (think that) hate statistics.
New Delhi: SAGE.
Veeraraghavan, V and Shetgovekar, S. (2016). Textbook of Parametric and
Non-parametric Statistics. Delhi: Sage.
27
Inferential
Statistics: An Point estimation: This is a type of estimation in which the value is a single
Introduction point.
28