A Model of Vocational Competency Assessment of Industrial Engineering Students of Vocational High Schools
A Model of Vocational Competency Assessment of Industrial Engineering Students of Vocational High Schools
Muhammad Akhyar
UNS HP. 081804516951; 0271 7650572
1. Introduction
Table 1 shows that through the instrument validation the names of the
three learning style indicators are modified but the number remains the same.
Table 2 shows that, besides the modification of the names of the personality
indicators, the number becomes smaller, from 11 indicators to 8 indicators.
In line with the theoretical review, conceptual framework, and validation
result, research hypotheses are formulated as follows:
1. The work principle knowledge (Y12), work procedure knowledge (Y13),
lathe practice skill (Y14), milling practice skill (Y15), work accuracy (Y16),
and work consistency (Y17) are valid indicators of vocational competency
(η3).
2. The creativity development (Y1), innovative experience (Y2), and skill
development (Y3) are valid indicators of learning style (η1).
3. The achievement motivation (Y4), responsiveness (Y5), adaptiveness (Y6),
progressiveness (Y7), work spirit (Y8), enthusiasm (Y9), self-confidence
(Y10), and work commitment (Y11) are valid indicators of personality
(η2).
4. There is a positive and significant relationship between students’ learning
style (η1) and vocational competency (η3).
5. There is a positive and significant relationship between students’
personality (η2) and vocational competency (η3).
6. There is a positive and significant reciprocal relationship between
students’ learning style (η1) and personality (η2).
2. Research Method
This study was a research and development study aiming to find out a
model of vocational competency assessment. The problem under investigation
was a model of developing students’ competency and a model of assessing
students’ vocational competency. This study focused on lathe and milling practice
competencies. The assessment model was developed in accordance with the
empirical findings on the competency development model consisting of a model
of assessing the competency construct, a model of measuring the construct
determining the competency, and a structural model.
The research population consisted of two subpopulations, namely (1)
engineering and vocational education experts, machinery practice instructors, and
industry practitioners, and (2) students of Industrial Engineering Vocational High
Schools in Surakarta. The sample from subpopulation (1) was selected using the
purposive sampling technique; it consisted of nine vocational education experts,
six machinery practice instructors, and two industry practitioners who were
involved in the research instrument validation. The sample from subpopulation (2)
was selected using the proportional random sampling technique; it consisted of
607 students from vocational high schools accredited A and B. The data collection
aimed to (1) validate the instruments, and (2) test the model of competency
development. The data collection for instrument validation employed
questionnaires administered in two periods, and the model testing employed a
questionnaire, a paper-and-pencil test, and a performance test. The data on the
former were analyzed using the descriptive technique, while the data on the latter
were analyzed using the LISREL model analysis.
a. Research Findings
The study shows the following findings. First, the construct model consists
of the learning style construct, the personality construct, and the competency
construct. The learning style construct consists of indicators of creativity
development with a factor loading (λ) of 0.603, innovative experience with a
factor loading (λ) of 0.577, and skill development with a factor loading (λ) of
0.02; the personality construct consists of indicators of achievement motivation
with a factor loading (λ) of 0.780, responsiveness with a factor loading (λ) of
0.335, adaptiveness with a factor loading (λ) of 0.190, progressiveness with a
factor loading (λ) of 0.375, work spirit with a factor loading (λ) of 0.08,
enthusiasm with a factor loading (λ) of 0.452, self-confidence with a factor
loading (λ) of 0.307, and work commitment with a factor loading (λ) of -0.05; and
the vocational competency construct consists of indicators of work principle
knowledge with a factor loading (λ) of 0.631, work procedure knowledge with a
factor loading (λ) of 0.540, lathe skill with a factor loading (λ) of 0.221, milling
skill with a factor loading (λ) of 0.316, work accuracy with a factor loading (λ) of
0.178, and work consistency with a factor loading (λ) of 0.222. Second, there is a
positive and significant relationship between students’ personality and learning
style with a relation coefficient (β) of 0.564; there is a positive and significant
relationship between students’ learning style and vocational competency with a
relation coefficient (β) of 0.905; and there is a negative and significant
relationship between students’ personality and vocational competency with a
relation coefficient (β) of -0.840. The model of vocational competency
development fits the empirical data, indicated by x2/df as big as 3.15; the
deviation of parameter values (RMSEA) is 0.062; the indices of the GFI and
AGFI model fits are 0.929 and 0.907 respectively. Third, the model of vocational
competency assessment consists of three components, namely personality,
learning style, and competency. This model is called the PLC model and
presented in Figure 2.
CRITERIA
b. Discussion
In relation to the measurement model, the research findings show that all
the six indicators of the vocational competency are valid. Concerning the learning
style construct, there is one invalid indicator, namely the skill development with a
factor loading (λ) of 0.02, while concerning the personality construct, there two
invalid indicators, namely the work spirit with a factor loading (λ) of 0.08 and the
work commitment with a factor loading (λ) of -0.05. Those indicators are not
valid because their t-values are less than 1.96.
In relation to the structural model, the research findings show that there is
a positive and significant relationship between learning style and vocational
competency, personality and learning style, and learning style and vocational
competency. However, the relationship between personality and vocational
competency is negative and significant with a β coefficient of 0.840 (t = -9.132; p
= 0.05). The empirical fact does not fit the hypothesis stating that there is a
positive and significant relationship between personality and competency. This
study then analyzed the data from the research sample and found out that in
vocational high schools accredited A there is a positive and significant
relationship between personality and competency, while in schools accredited B
there is a negative and insignificant relationship between personality and
competency. In relation to this finding, in practice it is necessary for teachers and
instructors to design a learning process that provides students with opportunities
to develop personality and competency in the form of complex and challenging
tasks. The factor of the measurement generalization can be a cause for the
negative relationship between personality and competency, especially in the
measurement of the practice skill aspect. According to Brennan (1983), the
measurement generalization measurement depends on the qualities of the
instruments, raters, and learning/practice environments. These factors
simultaneously determine the data accuracy. To measure students’ practice
performance, this study employed rating scales. The good quality of the
performance test instrument does not guarantee the accuracy of the obtained data.
The rater factor plays an important role when the raters assess students’ practice
performance. The data accuracy is better when the observations are made by the
same rater on the same observed object. However, this does not guarantee the data
quality, because, according to Brennan, the room lighting factor and the condition
of the room for learning and practice can influence the accuracy in the observation
of students’ practice performance. In this study, the observations on the students
were made by the teachers or instructors in their respective schools, comprising 8
vocational high schools. Therefore, the negative and significant relationship
between personality and competency may result from such factors as the school
status, the rater, and the condition of the learning setting.
The research findings also show that there is a positive and significant
between learning style and competency with a β coefficient of 0.905 (t > 1.96; p =
0.05), and there is a positive and significant between learning style and
personality with a β coefficient of 0.602 (t > 1.96; p = 0.05). This indicates that
the learning style plays a strategic role in preparing the students, because on the
one hand it can develop their competency and on the other it can develop their
personality. Therefore, the more complex and interesting the tasks designed by the
teachers are, the more opportunities the students can get to develop their
competency and personality.
In relation to the assessment model, the research findings show that the
model of vocational competency assessment consists of three components, namely
competency, personality, and learning style. An effective assessment of the
students’ vocational competency should focus on the indicators of competency,
namely knowledge of work principle and work procedure, lathe and milling
practice skills, and work accuracy and consistency. The assessment of the
students’ competency should be conducted not only on the competency as a
learning outcome but also on the factors determining the competency, namely
learning style and personality. The focus of the assessment of the students’
learning quality is on the indicators of creativity development, while that of the
students’ personality is on the indicators of achievement motivation,
responsiveness, adaptiveness, progressiveness, enthusiasm, and self-confidence.
The Ministry of National Education (2007:1) sets the criteria for the
assessment of the students’ competency; a score of 7 is in the good category, a
score of 8 is in the very good category, and a score of 9 is in the excellent
category. The assessment of students’ learning style and personality is norm-
referenced, on the basis of SBi and Mi, namely SBi = 1/6 (highest score – lowest
score) and Mi = ½ (highest score – lowest score). If a student obtains a score > Mi
+ 1.5 SBi, his score is very high; a score between Mi and Mi + 1.5 SBi is high; a
score between Mi and Mi –1.5 SBi is low; and a score < Mi – 1.5 SBi is very low.
4. Conclusions
Based on the research findings and discussion, the following conclusions
can be drawn.
1. The vocational competency construct consists of six indicators, namely
work principle knowledge, work procedure knowledge, lathe practice skill,
milling practice skill, work accuracy, and work consistency.
2. The learning style construct consists of two indicators, namely creativity
development and innovative experience.
3. The personality construct consists of six indicators, namely achievement
motivation, responsiveness, adaptiveness, progressiveness, enthusiasm,
and self-confidence.
4. There a positive and significant reciprocal relationship between students’
learning style and their personality; there a positive and significant
relationship between students’ learning style and their vocational
competency; there a negative and significant relationship between
students’ personality and their vocational competency.
5. The model of vocational competency assessment as the main research
finding is called the PLC model consisting of 3 components, namely
personality (P), learning style (L), and competency (C). The personality
consists of six factors, namely achievement motivation, responsiveness,
adaptiveness, progressiveness, enthusiasm, and self-confidence. The
learning style is an implementation of a learning model oriented to practice
(work-based learning), namely lathe and milling practices. The learning
style consists of two indicators, namely skill development and innovative
experience. The competency consists of six indicators, namely work
principle knowledge, work procedure knowledge, lathe practice skill,
milling practice skill, work accuracy, and work consistency.
References