Evaluation of A Questionnaire To Assess Nutritional Knowledge, Attitudes and Practices in A Thai Population
Evaluation of A Questionnaire To Assess Nutritional Knowledge, Attitudes and Practices in A Thai Population
Evaluation of A Questionnaire To Assess Nutritional Knowledge, Attitudes and Practices in A Thai Population
Abstract
Background: The rapid increase in non-communicable chronic diseases in people of working age has had a major
effect on health care utilization, productivity and economy. Lifestyle and diet are recognized as being major risk
determinants involved. Disease prevention strategies need to be based on people’s understanding of nutritional
knowledge, attitudes and practice. This study evaluates the validity of a new nutritional knowledge and practice
questionnaire specifically developed for assessing individuals of working age in a Thai population.
Methods: The questionnaire was constructed and based on previous relevant literature and its content validity
was scrutinized by an expert panel. An exploratory factor analysis (EFA) was performed to reduce the number of
questions included. Subsequently, data from a cross-sectional study of 1,032 participants were used to evaluate the
reliability and validity of this questionnaire. The validity of the questionnaire constructed for assessing knowledge and
attitude was evaluated using Confirmatory Factor Analysis (CFA). For the practice component, set criteria were applied
to determine the final variables used.
Results: CFA of the nutritional knowledge component suggested that all the variables in the model fitted with the
data (χ2 = 80.17, df = 66, p > 0.05, CFI = 0.99, RMSEA = 0.01, SRMR = 0.02). The CFA final model for the nutritional
knowledge included three factors (food recommendation, nutrients related to diseases, and healthy diet) with
a total of 14 questions. For nutrition attitude, CFA also revealed a good fit (χ2 = 178.14, df = 93, p < 0.001, CFI =
0.99, RMSEA = 0.03, SRMR = 0.03). The final CFA model for nutritional attitude included three factors (food choice,
healthy diet and food recommendation) with a total of 16 questions. For practice items, the number of questions
was reduced from 76 to 60.
Conclusions: Questionnaire development should use a logical, systematic and structured approach. Results from our
evaluation process demonstrates the construction validity of the nutritional knowledge and practice questionnaire
developed. This questionnaire can be further modified for use in other countries within the region.
Keywords: Chronic disease, Nutritional knowledge, Nutritional attitude, Nutritional practice, Working age
* Correspondence: [email protected]
1
Department of Nutrition, Faculty of Public Health, Mahidol University, 420/1
Ratchawithi RD., Ratchathewi District, Bangkok 10400, Thailand
Full list of author information is available at the end of the article
© The Author(s). 2019 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0
International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and
reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to
the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver
(http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
Pongkiatchai et al. Nutrition Journal (2019) 18:35 Page 2 of 10
the factors they were designed to measure [10]. Further- Table 1 General characteristics of participants
more, these factors should be correlated. Finally, errors Characteristics Cross-sectional (n = 1032) %
across variables should be uncorrelated. It is noted that Sex
smaller factor loadings result in larger error variances, Male 397 38.5
however this can be improved by re-specification of the
Female 635 61.5
model. To estimate the parameters of the model, the
model itself must be properly defined. “Goodness-of-fit” Age (years)
measures underlying the analysis of the CFA [11], in- 18–32 310 30
cluded chi-square (X2) which shows the difference be- 33–47 526 51
tween observed and expected covariance matrices; 48–62 196 19
values closer to zero indicate a better fit. Researchers BMI (kg/m2)
may fail to reject an inappropriate model where sample
Standard (< 23.0) 551 53.4
sizes are small and reject an appropriate model where
sample sizes are large. Consequently, other measures of Overweight (23.0–24.9) 222 21.5
‘goodness of fit’ have been developed. Comparative fit Class I obesity (25.0–29.9) 230 22.3
index (CFI) analyzes the model fit by examining the dis- Class II obesity (≥30.0) 29 2.8
crepancy between the data and the hypothesized model, Marital status
while adjusting for the issues of sample size inherent in Single 339 32.8
the chi-squared test of model fit, and the normed fit
Married 614 59.5
index. The standardized root-mean-square residual
(SRMR) is the square root of the discrepancy between Divorce/separated 79 7.7
the sample covariance matrix and the model covariance Education
matrix. The root mean square error of approximation High school and lower 289 28
(RMSEA) avoids issues due to sample size by analyzing Diploma / Vocational school 215 20.8
the discrepancy between the hypothesized model, with Bachelor degree and higher 528 51.2
optimally chosen parameter estimates, and the popula-
Occupation
tion covariance matrix. The accepted approach for asses-
sing goodness of fit requires that the chi-square (X2) Employee 301 29.2
analysis should have a non-significant p-value and a X2/ Private company staff 207 20.1
df value that is at 3 or below. It is important to consider Government staff 276 26.7
that the modified X2 from re-specification is usually up- Self employed 108 10.5
wardly biased with sample size [12, 13]. The calculated Agricultures 140 13.6
value for CFI should lie between 0 and 1, with a value over a
Salary (THB)
0.90 indicating a good fit. A value for SRMR should be at
0.08 or below. RMSEA values of approximately 0.06 or < 15,000 282 27.3
below indicates an acceptable fit, with values 0.05 or less, 15,000-25,000 547 53
indicating good fit [14]. If the analysis indicated a possible 25,001- 35,000 142 13.8
data-model misfit, model modification was applied. This 35,001-45,000 42 4.1
modification involved further re-specification by (i) adding 45,001-60,000 19 1.9
a parameter in the model with a large modification index a
(1 USD = 35.2 THB)
(MI) and (ii) deleting a parameter from the model with a
non-significant path. completed the nutritional knowledge and practice ques-
For the “practice component”, the items included were tionnaire, (response rate 95.6%). Most of participants
based on a food frequency questionnaire (FFQ) [15]. The were female (62%), married (59.5%) and had attained an
criteria used to exclude food items included: (i) food items undergraduate university degree or higher (51.2%). The
deemed as being seasonal food, (ii) any food item that was participants’ age ranged from 18 to 62 years with a mean
consumed in less than 60% of our subjects, (iii) food items age of 38 years. For BMI, 21.5% of subjects were classi-
that had never been consumed by study subjects. This fied as overweight, 22.3% were class I obese and 2.8%
process was used to reduce and refine of items included. were class II obese.
Fig. 1 Standardized estimated factor items loading, error variances for nutritional knowledge 3 factors, 31 items Legend: A = basic nutritional
knowledge, B = food based dietary guidelines, C = diet related disease knowledge
Pongkiatchai et al. Nutrition Journal (2019) 18:35 Page 5 of 10
(χ2)3178.83, df = 434, p-value = 0.000, CFI = 0.59, RMSEA = model for “nutritional knowledge” was composed of three
0.08 and SRMR =0.14 with χ2/df = 7.32, (Fig. 1). The modi- factors (food recommendation, nutrient related to diseases
fication indices (MIs) showed the expected parameter and healthy diet) with a total of 14 items. Parameter estima-
change statistics for each item. The model was re-specified tion results after model modification revealed a good fit for
and eventually 9 items with a low factor item loading from the model as indicated by a reduced chi-square value (from
three factors were excluded. To ensure the model fitted 465.5 to 80.2 with 66 degrees of freedom, p-value> 0.05).
well, covariance values were also added. The final CFA The value of CFI, RMSEA and SRMR were 0.99, 0.01 and
Fig. 2 Standardized estimated factor items loading, error-variances and covariance for nutritional knowledge 3 factors, 14 items. Legend: A = basic
nutritional knowledge, B = food based dietary guidelines, C = diet related disease knowledge
Pongkiatchai et al. Nutrition Journal (2019) 18:35 Page 6 of 10
Fig. 3 Standardized estimated factor items loading, error variances for nutritional attitude 3 factors, 40 items. Legend: AT = food based dietary
guideline attitude, BT = balance diet and their variety attitude, CT = food choice attitude
Pongkiatchai et al. Nutrition Journal (2019) 18:35 Page 7 of 10
Fig. 4 Standardized estimated factor items loading, error-variances and covariance for nutritional attitude 3 factors, 16 items. Legend: AT = food
based dietary guideline attitude, BT = balance diet and their variety attitude, CT = food choice attitude
Pongkiatchai et al. Nutrition Journal (2019) 18:35 Page 8 of 10
0.02 respectively, indicating a large improvement in the local inventory questionnaires [17, 18]. These studies have
model fit. The parameter estimates of the CFA are shown focused mainly on either the nutritional knowledge,
in Fig. 2. attitudes and practices of undergraduate students or of
elderly populations. In Thailand, previous studies have de-
CFA results for nutritional attitude veloped nutritional knowledge attitude and practice ques-
The first hypothesized model consisted of 3 factors (food tionnaires for specific age groups such as children and the
choice, healthy diet and food recommendation with a elderly [19, 20] however none has reported instrument
total of 40 items), revealed a χ2 value of 5503.0, df = 740, validation process.
p-value = 0.000, CFI = 0.75, RMSEA = 0.08 and SRMR = This study has developed and evaluated the construct
0.11 with χ2/df = 7.4 (Fig. 3). The initial model did not validity of the Thai adult nutritional knowledge, attitude
fit the sample data. Fifteen items were excluded due to and practice questionnaire for just such purposes. Meas-
low factor item loading. Any non-significant paths from uring nutritional knowledge, attitude and practice in
the three factors were also deleted. Covariance values adults is challenging as an appropriate questionnaire has
were added. This procedure significantly improved the not been available. Other research instruments that exist
model. The final CFA model for the nutritional atti- are well established but are unlikely to be appropriate
tude was composed of three factors (food choice, for Thais [21–23]. The nutritional knowledge attitude
healthy diet and food recommendation with a total of and practice questionnaire has social and cultural fea-
16 items). The Chi-square value was reduced from tures that should be considered in a number of dimen-
801.1 to 178.1 with 93 degrees of freedom. The three sions. To obtain information on nutritional behavior in
factor model failed to achieve an exact fit (χ2/df = 1.9, any population, the instrument should include questions
p < 0.05). An acceptable fit was indicated by CFI, related to knowledge and attitudes related to food con-
RMSEA and SRMR values (0.99, 0.03 and 0.03, re- sumption and practice [24].
spectively) [16]. All of the standardized factor load- Confirmatory factor analysis can be used to verify the
ings were greater than 0.4. The parameter estimates structure of a set of observed variables in order to deter-
of the CFA are shown in Fig. 4. mine whether the extracted items show acceptable fit for
the data collected. Cut-off points of model fit criteria
The results of nutritional practice (FFQ) can be set and used to determine acceptable values for
The process of model refinement reduced the food items the model of nutritional knowledge [25–27]. CFA is
(practice) from the original 76 to 60 items, including 6 often used to confirm hypotheses and uses pathway ana-
items on milk and dairy products, 7 items on rice, 10 lysis diagrams to represent variables and factors [28]. In
items on meat and products, 4 items on vegetables, 4 this study, the CFA results helped evaluate the nutri-
items on fruits, 5 items on cereal, 2 items on dessert, 6 tional attitude structure of the questionnaire. The model
items on beverages, 3 items on fats, 13 items on miscel- showed an acceptable fit with indices close to the nom-
laneous (Table 2). inal value. The CFA results for attitude, however, initially
failed to fit the collected data as demonstrated by the
Discussion highly significant Chi-square test for goodness of fit. It
Previous studies both in Europe and China have assessed has been suggested that this test is overly sensitive to
nutritional knowledge, attitude and eating behavior using sample size [13, 25, 26]. The highly significant goodness
of fit test may have been affected by the external factors Authors’ contributions
such as sample size, the number of parameters and the RP and RC conceived the study concept and design. RP and PP conducted
the survey and supervised data collection. RP and AL performed analysis and
degrees of freedom to sample size ratio [13, 29]. Never- interpretation of data. Manuscript was prepared by RP, AL, WO and RC.
theless, the other indices suggested an acceptable fit. It Manuscript revision was done by RP,AL, NH, and WO. All authors read
was concluded that the nutritional knowledge and atti- and approved the final manuscript.
and females may potentially display different knowledge Consent for publication
and attitudes to nutrition. Future studies should investi- Not applicable.
gate this in Thai adults using the nutritional knowledge
Competing interests
and practice questionnaire. Furthermore the age range
The authors declare that they have no competing interests.
for the adult working population is relatively broad and
within this range some variation on attitude and know- Author details
1
Department of Nutrition, Faculty of Public Health, Mahidol University, 420/1
ledge relating to nutrition may also exist.
Ratchawithi RD., Ratchathewi District, Bangkok 10400, Thailand. 2Departments
of Epidemiology, Faculty of Public Health, Mahidol University, 420/1
Ratchawithi RD., Ratchathewi District, Bangkok, Thailand. 3Division of
Conclusion Population Health, Health Services Research & Primary Care, School of Health
This study demonstrates that final version of the ques- Sciences, Faculty of Biology, Medicine and Health, The University of
tionnaire has acceptable levels of constructed validity Manchester, Manchester, UK.
and can be used to assess nutritional knowledge, attitude Received: 23 March 2019 Accepted: 4 July 2019
and practice in a general adult working population of
Thais. This questionnaire can be further modified for
use in neighboring countries in the region that share a References
1. Ministry of Public Health. Thailand Health Profile Report 2008-2010. 2008.
similar culture. http://wops.moph.go.th/ops/thp/images/stories/Report_pics/CD_ROM53/
This questionnaire can also be used to identify gaps in Eng/Chapter4.8.pdf. Accessed 11 May 2019.
the public’s nutritional knowledge and to evaluate the 2. Ministry of Public Health. Thailand Health Profile Report 2008-2010. 2008.
http://wops.moph.go.th/ops/thp/images/stories/Report_pics/CD_ROM53/
success of public health education campaigns and nutri- Eng/Chapter4.1.pdf Accessed 11 May 2019.
tional interventions. It can also identify nutritional 3. Aekplakorn W. Thai National Health Examination Survey, NHES V.
knowledge and practice determinants associated with Nonthaburi:. The Graphico system co.Ltd.; 2014.
4. Health Information System Development Office. Thailand Health Profile
diseases risk. 2008-2010. 2010. https://www.hiso.or.th/hiso5/report/report9.php. Accessed
10 July 2017.
5. Murakami K, Okubo H, Sasaki S. Effect of dietary factors on incidence of type
Additional files 2 diabetes: a systematic review of cohort studies. J Nutr Sci Vitaminol
(Tokyo). 2005;51(4):292–310.
Additional file 1: Figure S1. Flow chart describing the development 6. Kosulwat V. The nutrition and health transition in Thailand. Public Health
and validation of the NKAP 1 questionnaire. (PDF 13 kb) Nutr. 2002;5(1A):183–9.
7. Azizi M, Aghaee N, Ebrahimi M, Ranjbar K. Nutrition knowledge, the attitude
Additional file 2: Table S1. Results of the EFA of the nutritional and practices of college students. Facta Universitatis. 2011;9(3):349–57.
knowledge component in validation study (n = 103)*.Tables S2. Results 8. Expert Consultation WHO. Appropriate body-mass index for Asian
of EFA of the nutritional attitude component in validation study (n = 103). populations and its implications for policy and intervention strategies.
(PDF 53 kb) Lancet. 2004;363(9403):157–63.
9. Jitnarin N, Kosulwat V, Rojroongwasinkul N, Boonpraderm A, Haddock CK,
Poston WS. Prevalence of overweight and obesity in Thai population: results
Abbreviations of the National Thai Food Consumption Survey. Eat Weight Disord. 2011;
CFA: Confirmatory Factor Analysis; CFI: Comparative Fit Index; df: Degree of 16(4):e242–9.
freedom; EFA: Exploratory Factor Analysis; FFQ: Food Frequency questionnaire; 10. Mueller RO, Hancock GR. Factor analysis and latent structure, confirmatory.
RMSEA: Root Mean Square Error of Approximation; SRMR: Standardized Root- In: Smelser NJ, Baltes PB, editors. International encyclopedia of the Social &
Mean-square Residual Behavioral Sciences. Oxford: Pergamon; 2001. p. 5239–44.
11. Brown TA. In: Kenny DA, editor. Confirmatory factor analysis for applied
Acknowledgments research. New York: The Guilford Press; 2006.
We extend our appreciation to all study participants. The Faculty of Public 12. Hooper D, Coughlan J, Mullen MR. Structural equation modelling: guidelines
Health, Mahidol University financially supported the publication of the study. for determining model fit. Electron Bus Res Methods. 2008;6(1):53–9.
Pongkiatchai et al. Nutrition Journal (2019) 18:35 Page 10 of 10
13. McCoach DB, Gable RK, Madura JP. Instrument development in the affective
domain. 3rd ed. New York: Springer; 2013.
14. Fonseca M. Principles and practice of structural equation modeling, third
edition by rex B. Kline. Int Stat Rev. 2013;81(1):172–3.
15. Pongkiatchai R. A study of nutrient intake of high school students in
Bangkok using semiquantitative food frequency questionnaire Bangkok.
Bangkok: Mahidol University; 1999.
16. Chen X, Hu Y, Zhu D, Li J, Zhou L. Chinese version of the aging perceptions
questionnaire (C-APQ): assessment of reliability and validity. Aging Ment
Health. 2016;20(6):567–74.
17. Parmenter K, Wardle J. Development of a general nutrition knowledge
questionnaire for adults. Eur J Clin Nutr. 1999;53(4):298–308.
18. Marietta AB, Welshimer KJ, Anderson SL. Knowledge, attitudes, and
behaviors of college students regarding the 1990 nutrition labeling
education act food labels. J Am Diet Assoc. 1999;99(4):445–9.
19. Polsiri A. Knowledge, attitudes and behaviors about food consumption of
Ramkhamhaeng University undergraduate students. Ramkhamhaeng J.
2008;11(1):49–60.
20. Piaseu N, Tatsanachantatanee D, Kittipoom S, Putwatana P. Nutritional
knowledge, attitude toward food, food behavior, and nutritional status
among nursing students. Rama Nurs J. 2009;15:48–59.
21. Feren A, Torheim LE, Lillegaard IT. Development of a nutrition knowledge
questionnaire for obese adults. Food Nutr Res. 2011;55. https://doi.org/10.34
02/fnr.v55i0.7271.
22. Hendrie GA, Cox DN, Coveney J. Validation of the general nutrition
knowledge questionnaire in an Australian community sample. Nutr Diet.
2008;65(1):72–7.
23. Medeiros LC, Hillers VN, Chen G, Bergmann V, Kendall P, Schroeder M.
Design and development of food safety knowledge and attitude scales for
consumer food safety education. J Am Diet Assoc. 2004;104(11):1671–7.
24. Green EC. Can qualitative research produce reliable quantitative findings?
Field Methods. 2001;13(1):3–19.
25. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis: a global
perspective. 7th ed. New Jersey: Pearson Education; 2010.
26. Kline RB. Principles and practice of structural equation modeling. 3rd ed.
New York: Guilford Press; 2015.
27. Lim T-P, Chye FY, Sulaiman MR, Suki NM, Lee J-S. A structural modeling on
food safety knowledge, attitude, and behaviour among Bum Bum Island
community of Semporna, Sabah. Food Control. 2016;60:241–6.
28. Yong AG, Pearce S. A Beginner’s guide to factor analysis: focusing on
exploratory factor analysis. Tutor Quant Methods Psychol. 2013;9(2):79–94.
29. Marsh HW, Balla J. Goodness of fit in confirmatory factor analysis: the effects
of sample size and model parsimony. Qual Quant. 1994;28(2):185–217.
30. Bureau of Nutrition. Food-based dietary guidelines for Thai: Bangkok
Ministry of Public Health; 2001. http://www.fao.org/3/a-as887e.pdf.
Accessed 28 June 2016.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in
published maps and institutional affiliations.