04-Accuracy and Precision
04-Accuracy and Precision
04-Accuracy and Precision
There are certain basic concepts in analytical chemistry that are helpful to
the analyst when treating analytical data. This section will address
accuracy, precision, mean as related to chemical measurements in the
general field of analytical chemistry.
Accuracy
In analytical chemistry, the term 'accuracy' defines as "closeness of the
agreement between the result of a measurement and a true value." In
theory, a true value is that value that would be obtained by a perfect
measurement. Since there is no perfect measurement in analytical
chemistry, we can never know the true value.
For example, lets call a measurement we make XI and give the symbol µ
for the true value. We can then define the error in relation to the true
value and the measured value according to the following equation:
error = XI - µ (1)
We often speak of accuracy in qualitative terms such a "good," "expected,"
"poor," and so on. However, we have the ability to make quantitative
measurements. We therefore have the ability to make quantitative
estimates of the error of a given measurement. Since we can estimate the
error, we can also estimate the accuracy of a measurement.
Random errors are unavoidable. They are unavoidable due to the fact that
every physical measurement has limitation, i.e., some uncertainty.
Using the utmost of care, the analyst can only obtain a weight to the
uncertainty of the balance or deliver a volume to the uncertainty of the
glass pipette.
For example, most four-place analytical balances are accurate to ± 0.0001
grams. Therefore, with care, an analyst can measure a 1.0000 gram weight
(true value) to an accuracy of ± 0.0001 grams where a value of 1.0001 to
0.999 grams would be within the random error of measurement.
If the analyst touches the weight with their finger and obtains a weight of
1.0005 grams, the total error = 1.0005 -1.0000 = 0.0005 grams and the
random and systematic errors could be estimated to be 0.0001 and 0.0004
grams respectively.
Note that the systematic error could be as great as 0.0006 grams, taking
into account the uncertainty of the measurement.
A truly random error is just as likely to be positive as negative, making the
average of several measurements more reliable than any single
measurement. Hence, taking several measurements of the 1.0000gram
weight with the added weight of the fingerprint, the analyst would eventually
report the weight of the finger print as 0.0005 grams where the random
error is still 0.0001 grams and the systematic error is 0.0005 grams.
However, random errors set a limit upon accuracy no matter how many
replicates are made.
Precision
The term precision is used in describing the agreement of a set of results
among themselves. Precision is usually expressed in terms of the deviation
of a set of results from the arithmetic mean of the set (mean and standard
deviation). Good precision does not mean good accuracy.
Why doesn't good precision mean we have good accuracy?
We also know that the total error is the sum of the systematic error and
random error. Since truly random error is just as likely to be negative as
positive, we can reason that a measurement that has only random error is
accurate to within the precision of measurement and the more precise the
measurement, the better idea we have of the true value, there is no bias in
the data. In the case of random error only, good precision indicates good
accuracy.
The top left image shows the target hit at high precision and
accuracy. The top right image shows the target hit at a high accuracy
but low precision. The bottom left image shows the target hit at a high
precision but low accuracy. The bottom right image shows the target
hit at low accuracy and low precision.
We know that systematic error will produce a bias in the data from the true
value. This bias will be negative or positive depending upon the type and
there may be several systematic errors at work. Many systematic errors
can be repeated to a high degree of precision. Therefore, it follows that
systematic errors prevent us from making the conclusion that good
precision means good accuracy. When we go about the task of determining
the accuracy of a method, we are focusing upon the identification and
elimination of systematic errors. Don't be misled by the statement that
'good precision is an indication of good accuracy.' Too many systematic
errors can be repeated to a high degree of precision for this statement to
be true.
Repeatability (of results of measurements) - the closeness of the
agreement between the results of successive measurements of the
same measurand carried out under the same conditions of
measurement.
Additional Notes:
1. These conditions are called repeatability conditions.
2. Repeatability conditions include the same measurement procedure, the
same observer, the same measuring instrument, used under the same
conditions, the same location, and repetition over a short period of time.
Reproducibility (of results of measurement) - the closeness of the
agreement between the results of measurements of the same
measurand carried out under changed conditions of measurement.
Additional Notes:
1. A valid statement of reproducibility requires specification of the
conditions changed.
2. The changed conditions may include principle of measurement, method
of measurement, observer, measuring instrument, reference standard,
location, conditions of use, and time.
When discussing the precision of measurement data, it is helpful for the
analyst to define how the data are collected and to use the term
'repeatability' when applicable. It is equally important to specify the
conditions used for the collection of 'reproducibility' data.
Mean
The definition of mean is, "an average of n numbers computed by adding
some function of the numbers and dividing by some function of n." The
central tendency of a set of measurement results is typically found by
calculating the arithmetic mean (x̄) and less commonly the median or
geometric mean.
The mean is an estimate of the true value as long as there is no systematic
error. In the absence of systematic error, the mean approaches the true
value (µ) as the number of measurements (n) increases.
The frequency distribution of the measurements approximates a bell-
shaped curve that is symmetrical around the mean. The arithmetic mean is
calculated using the following equation:
x̄ = (X1 + X2 + ···Xn) / n (2)
Typically, insufficient data are collected to determine if the data are evenly
distributed. Most analysts rely upon quality control data obtained along with
the sample data to indicate the accuracy of the procedural execution, i.e.,
the absence of systematic error(s). The analysis of at least one QC sample
with the unknown sample(s) is strongly recommended. Even when the QC
sample is in control it is still important to inspect the data for outliers.
Q test.
The Q test is commonly conducted at the 90% confidence level but the
following table (3) includes the 96% and 99% levels as well for your
convenience. At the 90% confidence level, the analyst can reject a result
with 90% confidence that an outlier is significantly different from the other
results in the data set. The Q test involves dividing the difference between
the outlier and it's nearest value in the set by the range, which gives a
quotient - Q.
Example: This example will test four results in a data set--1004, 1005,
1001, and 981.
The range is calculated: 1005 - 981 = 24.
The difference between the questionable result (981) and its nearest
neighbor is calculated: 1001 - 981 = 20.
The quotient is calculated: 20/24 = 0.83.
The calculated quotient is compared to the Q 0.90 value of 0.76 for n=4
(from table 14.3 above) and found to be greater.
The questionable result (981) is rejected.