Designing and Evaluating Training Systems
Designing and Evaluating Training Systems
Designing and Evaluating Training Systems
AAMODT CHAPTER 8
DESIGNING AND
EVALUATING TRAINING
SYSTEMS
SARA GILLEN & HANS MACATANGAY
LEARNING
OBJECTIVES AAMODT- ORGANIZATIONAL LAEARNING
TRAINING
"systematic acquisition of skills, rules, concepts, or attitudes
that result in improved performance" (Goldstein & Ford, 2002).
Planned effort by the organization to facilitate the learning of
job-related behavior on the part of its employees
WHY IS IT ESSENTIAL?
Ensures that employees have the knowledge and skills to
perform the job
Compensates for the inability to select desired applicants
To keep up with the changes in jobs, technology, and laws
Used to teach knowledge and skills that are not currently needed
but will be used in the future
LO1: KNOW HOW TO CONDUCT A TRAINING NEEDS ANALYSIS
NEEDS ANALYSIS
The Training Needs Assessment Process:
First step in developing an employee training system
Process of determining the training needs of an
organization
WHY IS IT IMPORTANT?
By a meta analysis: increased training effectiveness
courtesy of a needs assessment conducted prior to the
creation of the training program
EFFECTIVE TRAINING
supportive climate for training, effective programs,
employees want to learn, goals of the program are
consistent with those of the organization
LO1: KNOW HOW TO CONDUCT A TRAINING NEEDS ANALYSIS
TASK ANALYSIS
Second step of needs analysis process
Identify the tasks performed by each employee, the conditions under which these tasks are performed,
and the competencies (KSA) needed to perform the tasks under the identified conditions
Interviews, observations, task inventories
Determine how employees learn to perform each task or obtain each competency
LO1: KNOW HOW TO CONDUCT A TRAINING NEEDS ANALYSIS
PERSON ANALYSIS
Final step of needs analysis process
Process of identifying the employees who need training and determining the areas in which individual
employee needs to be trained
Should include an evaluation of employee's readiness for the training
Ex. Trainers at Jollibee Chains test management trained on essential on-the-job tasks
demonstrate proficiency = end of training
PROFICIENCY
LO1: KNOW HOW TO CONDUCT A TRAINING NEEDS ANALYSIS
PERSON ANALYSIS
METHODS IN DETERMINING TRAINING NEEDS
Performance appraisal scores
Surveys
Interviews
Skill and Knowledge Tests
Critical Incidents
LO1: KNOW HOW TO CONDUCT A TRAINING NEEDS ANALYSIS
METHODS IN DETERMINING TRAINING NEEDS
Performance appraisal scores
Easiest method
Rating representing some aspect of an
employee's work performance
3 PROBLEMS
Rating errors can reduce the accuracy of
performance appraisal scores (Leniency
and Strictness errors)
Rarely are there situations in which all
employees score either high or low on a
dimension
Performance appraisal system may not
provide the type of information needed to
conduct a training needs analysis
LO1: KNOW HOW TO CONDUCT A TRAINING NEEDS ANALYSIS
METHODS IN DETERMINING TRAINING NEEDS
Surveys
Common approach
design and administer a survey that asks employees
what knowledge or skills for training
Advantages
eliminate performance rating errors
strengths and weaknesses
even w/o organization effort to design effective
performance appraisal system or job description
Disadvantages
Employee dishonesty
Organization may not afford suggestions
LO1: KNOW HOW TO CONDUCT A TRAINING NEEDS ANALYSIS
METHODS IN DETERMINING TRAINING NEEDS
Surveys
Questionnaire
Asks employees to list the areas for training
Provide a list
Better method
employees rate job-related tasks and components
of knowledge
Results are given to supervisors for validation
Used to determine whether supervisors agree with
employee perception and assess training needs
LO1: KNOW HOW TO CONDUCT A TRAINING NEEDS ANALYSIS
METHODS IN DETERMINING TRAINING NEEDS
Interviews
Done with a selected number of employees
Yields in-depth answers about training needs
Advantage
feelings and attitudes are clearly expressed
Disadvantage
data is more difficult to quantify and analyze
LO1: KNOW HOW TO CONDUCT A TRAINING NEEDS ANALYSIS
METHODS IN DETERMINING TRAINING NEEDS
Skill and Knowledge tests
Skill test: measures employee's level of job-related
skill
Knowledge test: measures employee's knowledge
about job-related topic
Ex. knowledge of lending laws for loan officers,
company policy, free-throw shooting for basketball
players
Disadvantage
Relatively few tests are available for this purpose
LO1: KNOW HOW TO CONDUCT A TRAINING NEEDS ANALYSIS
METHODS IN DETERMINING TRAINING NEEDS
Critical Incidents
Relatively easy to use
Sorted into dimensions and separated into examples of
good and poor performance
ESTABLISHING GOALS AND OBJECTIVES
Next step in developing a training program
Must be specific
Includes an action word, an item, a condition, and a standard
LECTURES
Good training source if the goal is for employees to obtain
knowledge
More effective when paired with simulations and role-
plays for teaching skills
Time-consuming process to produce a lecture-based
training program
Important part: handouts to the audience
provide material to trainees
either paper or digital handouts
LO2: BE AWARE OF THE VARIOUS TRAINING METHODS
CASE STUDIES
Employees are in a group and presented with real or
hypothetical workplace problem and are asked to propose
the best solution
Good source for developing analysis, synthesis, and
evaluation skills
Most successful: actual situations
Living case: based on a real situation rather than a
hypothetical one
Should be realistic and interesting
HELPED TO USE
REINFORCE THE
THOSE
TAUGHT THE
PRINCIPLES
PRINCIPLES IN
DISCUSSING THE
SIMULATION
An exercise designed to place an applicant in a situation
that is similar to the one that will be encountered on the
job
offer actual working conditions with pressure and
consequences of making mistakes
Effective: physically and psychologically simulates actual
job conditions
Meta-analysis by Sitzmann (2011): employees trained with
simulations learned and retained more than employees
taught through lecture or reading
LO2: BE AWARE OF THE VARIOUS TRAINING METHODS
ROLE-PLAY
A training technique in which employees perform
necessary interpersonal skills by acting out simulated
roles
Used in many types of training situations
Ex. Practicing performance appraisal reviews to sales
clerks taking customer orders
"Real Play"
employees practice their skills on actual customers
LO2: BE AWARE OF THE VARIOUS TRAINING METHODS
BEHAVIOR MODELING
A training technique in which employees observe correct behavior, practice that behavior, and receive
feedback about their performance
Difference: trainees role-play ideal behavior
Learning points: behaviors necessary to correct problems in the job
Positive transfer of learning
Traineess mentally
Role-play rehearse the solution to
the problem
MOTIVATE EMPLOYEES TO ATTEND THE TRAINING
Once the training program has been developed, organizations must motivate employees to
attend training
Relate the training to an employee's immediate job
Make the training interesting
Increase employee buy-in
Provide incentives
Provide food
Reduce the stress associated with attending
LO3: KNOW HOW TO CONDUCT A TRAINING PROGRAM
CLASSROOM
Who will conduct the training?
In-house trainers: employees of the organization
used when training program will be presented
frequently
training topic is specific to the organization
Outside/external trainers: contract with the organization,
videos, local universities
trainers in organization lack expertise
cost of internally developing a training program exceeds
the cost of contracting with an external trainer
Videos: Economic advantage
Local colleges and universities: used for technical and
leadership training
Advantage: lower costs, access to training facilities,
faculty, employees receive college credit
LO3: KNOW HOW TO CONDUCT A TRAINING PROGRAM
CLASSROOM
Where will the training be held?
on site
Advantage: less expensive
off-site location (hotel, university, or conference center)
Advantage: concentrate on their training
How long should the training be?
Cost efficiency perspective: weeklong training session
Highest level of learning: training material should be
presented in distributed learning rather than mass learning
Adjusting for the audience
Trainer must consider the size, demographics, and abilit of
the audience
Preferably present material at a moderate pace
LO3: KNOW HOW TO CONDUCT A TRAINING PROGRAM
CLASSROOM
Delivering the training program
Introduction by the trainer, objectives of the training seminar, training schedule, seminar rules
Choice of activities depends on the task or skill to be taught
LO3: KNOW HOW TO CONDUCT A TRAINING PROGRAM
TRAINING THROUGH DISTANCE LEARNING
Disadvantage of traditional classroom: taught at same pace
and location
Asynchronous or synchronous
ASYNCHRONOUS
Complete training program at their own pace and time
Printed materials, videos, DVDs, web-based programs
Increase effectiveness = interactive
Interactive videos: presents a videotaped situation and
employees choose their response
Training programs offered over the internet
learning organizations contract with a learning portal
containing e-courses
LO3: KNOW HOW TO CONDUCT A TRAINING PROGRAM
ASYNCHRONOUS
Programmed instruction: training method in
which employees learn information at their
own pace
Self-paced
Actively involved
Information in small units
Meta-analysis by Allen and colleagues
(2004): scores from distance learning classes
were no different with students from
traditional course
LO3: KNOW HOW TO CONDUCT A TRAINING PROGRAM
SYNCHRONOUS
Conducted live over the phone, internet
or by satellite
Sources: teleconferences, webinars,
webcasts
Interactive sources, blogs, wikis, listerv
As effective as classroom training,
increased effectivity wen learners can
control pace of learning and when
given feedback
LO3: KNOW HOW TO CONDUCT A TRAINING PROGRAM
ON-THE-JOB TRAINING
Informal training by experienced peers and supervisors that occurs on the job and during job tasks
Teaching skills that require supervision to learn, requires repetition, and benefit role modeling
Modeling
Job Rotation
Apprentice Training
Coaching and Mentoring
LO3: KNOW HOW TO CONDUCT A TRAINING PROGRAM
ON-THE-JOB TRAINING
Modeling
also called social learning
learning through watching and imitating the
behaviors of others
Effective under certain conditions:
we tend to model behavior of people similar to
us
3 Conditions
employee must pay attention to the behavior
of other employees
employee must be able to retain information
employee must have the ability or skill to
reproduce the behavior that is seen
LO3: KNOW HOW TO CONDUCT A TRAINING PROGRAM
ON-THE-JOB TRAINING
Job Rotation
employees are given the opportunity to
perform several different jobs in an
organization
popular for managerial training
Commonly used to train nonmanagerial
employees
allows lateral transfers and flexibility
Cross-training'
Advantage: improve job satisfaction
LO3: KNOW HOW TO CONDUCT A TRAINING PROGRAM
ON-THE-JOB TRAINING
Apprentice Training
usually found in craft and building trades in
which employees combine formal coursework
with formal on-the-job training
144 hours of formal class and works with an
expert
Criticized for two major reasons:
emphasis is on the production of work
than teaching new skills to the apprentice
restrict entry into trades which results in
inflated wages
LO3: KNOW HOW TO CONDUCT A TRAINING PROGRAM
ON-THE-JOB TRAINING
Coaching
Experienced employees working with new
employees
Issue 1: good workers are not necessarily
good trainers and vice versa
Issue 2: diminishes expert's productivity
Professional coaches
hired to coach a particular employee
help employees identify strengths,
weaknesses, set goals, solve problems
LO3: KNOW HOW TO CONDUCT A TRAINING PROGRAM
ON-THE-JOB TRAINING
Mentoring
Veteran in the organization who
advises and looks out for a new
employee
At least one position above the
employee being mentored
MOTIVATING EMPLOYEES TO LEARN DURING TRAINING
Providing incentive
money, job security, self-
improvement, advancement,
fun, opportunity to enter a
new career
Training program is interesting
Provide feedback
balance of positive and
negative feedback
ENSURING TRANSFER OF TRAINING
Transfer of training: extent to which behavior learned in training will be performed on the job
use realistic training programs
Practice desired behavior as much as possible
Overlearning
practice in as many different situations as possible
Employees must be given the opportunity and encouraged to apply what they have learned
Atmosphere set by the management
Have employees set goals
LO4: UNDERSTAND THE PSYCHOLOGICAL THEORY BEHIND SUCCESSFUL TRAINING
SUCCESSFUL TRAINING
Employees must have the skills and abilities
Minimal outside factors that can distract
Must be motivated to learn
self-efficacy and reward
Training method is a good match to the
employee
Training program must allow for goal setting,
positive feedback, practice, overlearning,
transfer of training
Opportunity and encouragement to use newly
acquired knowledge at work
LO5: BE ABLE TO EVALUATE THE EFFECTIVENESS OF A TRAINING PROGRAM
Training Posttest
Group 1
Posttest
Group 3 Pretest
Posttest
Group 4
LO5: BE ABLE TO EVALUATE THE EFFECTIVENESS OF A TRAINING PROGRAM
EVALUATION CRITERIA
Content validity: comparing training content with the knowledge,
skills, abilities required to perform a job
Employee reactions: employees are asked their opinion of a training
program
ratings are influenced by trainer's style, degree of interaction,
motivation of the trainee, organizational support
Employee learning: measuring how much employees learned from
training programs
administered before the test and after; must be reliable and valid
Application of training: extent ot which employees actually can use
the learned material
Business impact: evaluating whether the goals for training were met
Return on Investment (ROI): amount of money an organization makes
after subtracting the cost of training and other interventions
1
MUCHINSKY CHAPTER 6
ORGANIZATIONAL
LEARNING
LEARNING
MUCHINSKY-ORGANIZATIONAL LAEARNING OBJECTIVES
10
LEARNING OBJECTIVE 1
Limitations
Organizations have little control
Employees might learn inappropriate
actions and methods from other
employees
Some information is best conveyed
formally 9
10
LEARNING OBJECTIVE 1
Onboarding
practices, policies, programs the organization has which
helps in welcoming newcomers
helps new employees now the policies and culture of the
organization
helps new employees to adjust
Typically starts at the first day of employment
Orientation Programs
provides relevant information, resources, and materials
help in emotional support by showing appreciation to the
newcomers that they have joined the organization
guides newcomers by providing direct assistance in
9
navigating the new organization
10
LEARNING OBJECTIVE 2
Learning and Task Performance
Learning - change of knowledge and skills is acquired
through education or experience
Psychomotor Ability
final phase of skill acquisition
help in determining the final level of task
performance in the procedural knowledge phase
10
LEARNING OBJECTIVE 2
Complex Relationship Between Abilities and Phases
of Task Performance
"Experts" do not only have knowledge, but know how and when
to apply knowledge"
10
LEARNING OBJECTIVE 3
10
LEARNING OBJECTIVE 3
Reasons
Sometimes training requirements are obvious leading to
shortened or foregone needs assessments
There is a legal certification or requirement that needs
to be met
The changing nature of work into becoming more rapid
10
LEARNING OBJECTIVE 4
Wrong
10
LEARNING OBJECTIVE 4
10
LEARNING OBJECTIVE 6
Diversity Training
A training method directed at interpersonal
sensitivity and awareness among employees
Diversity characteristics
Surface-level
can be seen with the naked eye
Deep-level
personality and values
Goals of Diversity Training
increase knowledge about diversity
improve attitude towards diversity
develop skills regarding diversity
10
LEARNING OBJECTIVE 6
Diversity Training
Diversity Training focuses on
diversity awareness
skill building
A combination of diversity awareness and
skill building
According to Bez.rukova ct al. (2016), diversity
training was more successful in organizations if
they went beyond diversity awareness
10
LEARNING OBJECTIVE 6
Diversity Training
Goals of Diversity Awareness
increase knowledge about issues
providing the organization's view on diversity
dispelling myths about different groups
provide facts about changing demographics
make trainees think about how they categorize people,
and find common ground between themselves and
others
"in group" vs "out group"
focus on individual identities rather than group
characteristics
The "Who am I exercise"
Challenge individual's views on themselves
10
LEARNING OBJECTIVE 6
Diversity Training
According to Bezrukova et al (2016), diversity
programs are largely successful for participants
However
participant attitudes may change over time
changes in attitude from programs are not
uniform
generally successful in changing attitudes
towards diversity, but not towards specific
groups of people
not all diversity programs result with positive
outcomes
LEARNING OBJECTIVE 6 10
Expatriate Training
Expatriate - a person from one country, working and living in
another
A key aspect of expatriate training if focusing on cross-
cultural issues
Educate individuals in business norms, etiquette, and
language barriers
help expatriates overcome the fear of the unknown
help expatriates be more comfortable with their
environment
When and who is involved is important
expatriates perform better when their diversity training
was done after their arrival to the country
sending the family with the expatriate is advisable
It is important to consider the full life cycle of international
assignment
there have established emotional, cognitive, and
behavioral problems associated with returning to one's
host country
10
LEARNING OBJECTIVE 6
Sexual Harassment Training
Sexual harassment - Unwelcome sexual advances. requests for sexual favors. and other
verbal or physical conduct of a sexual nature that creates an intimidating, hostile, or
offensive work environment
Two kinds of sexual harassment
Quid Pro Quo
organizational rewards are given for sexual favors
Hostile-environment harassment
individuals regard workplace conditions as offensive (unwanted touching, off
color jokes)
Sexual behavior at work is largely unaccepted
However
Some jokes can be seen as harmless
Flirtation can lead to love and romance
10
LEARNING OBJECTIVE 6
Sexual Harassment Training
Sexual harassment training consists of teaching sensitivity to other people's values and
preferences
It should not be assumed that people are preferred to be touched
cultural preferences vary on the degree on which people should be touched
Most Sexual Harassment Training are designed to be educational in nature
participants are taught the manifestations of harassment
how individuals can find certain things as offensive
Sexual Harassment can occur in the organizational context where it occurred
employees in service jobs can be targeted by customer and clients
the boundaries of the non-workplace and workplace have blurred as employees
develop romance with one another, and as well as the advent of technology
Sexual harassment cases have become more and more complex for organizations
10
LEARNING OBJECTIVE 7
Management Development Issues
Management Development - the process by which individuals in
management or leadership roles enhance their talents to better
perform the job
it's learning objectives are typically knowledge, skills, and
competencies for future positions in the organization
Without sufficient development, people in management roles
will fail
there will be high costs for the organization if people in
management roles fail, due to the cost of replacing
managers and missed business objectives
Managers can cause a great deal of stress to their employees
many employees regard their bosses as their main source of
stress
"bad bosses" contribute health hazards to the employees
due to the amount of stress they cause
10
LEARNING OBJECTIVE 7
Four categories of behaviors related to managerial
effectiveness
1. Intrapersonal skills
a. self awareness
b. self control
c. emotional maturity
d. integrity
2. Interpersonal skills
a. social skills
b. empathy
c. relationship development
3. Business Skills
a. planning
b. organization
c. monitoring skills
4. Leadership Skills
a. leading others
b. maintaining a team
10
LEARNING OBJECTIVE 7
Mentoring
Mentor - an experienced or senior person who helps to
professionally develop less experienced person (protege)
Disadvantages
proteges being paired with mentors who are bad mentors
mismatched values, personalities and work styles
breaches of trust
TRAINING AND
DEVELOPING
EMPLOYEES
LEARNING
DESSLER - TRAINING AND DEVELOPING
OBJECTIVES EMPLOYEES
Employee Orientation/Onboarding
provides new employees with the
background information they need to
perform their jobs
makes the new people feel welcome and
part of the team
Help new employees understand the
organization in a broad sense (its past,
present, culture, and strategies and vision
of the future)
Starts socializing the employees into the
organization's culture and way of doing
things
LO2: EXAMPLES OF DESIGN ONBOARDING AND EMPLOYEE ENGAGEMENT
Orientation/Onboarding Process
Starts during the first day, and the employee is
given the necessary resources and references
Make sure the employee socializes with the other
employees throughout the following days
Length of the orientation will depend on what will
be covered
The Orientation should at least have
information on employee benefits
information on personnel policies
safety measures
facilities tour
The Employee handbook
Orientation technology
organizations use technology to aid their
orientations
LO3: LIST AND BRIEFLY EXPLAIN EACH OF THE STEPS IN THE TRAINING PROCESS
Training Process
Directly after orientation, training should begin
Training is the process in which new or current
employees are given the skills they need to perform
their jobs
Training might involve
the current jobholder teaching the process to the
new employee
Multiweek classroom or internet classes
Inadequate training can hold the employer responsible
for negligent training
5 TRAINING TECHNIQUES:
On-the-job training: having a person learn a job by
actually doing it
Apprenticeship training: people become skilled workers
usually through a combination of formal learning and on-
the-job training
Informal learning: 70% job learning occurs informally on
or off job, 20% social interactions, 10% actual formal
traning
Audiovisual-based training: DVDs, films, PowerPOint,
audiotapes
Vestibule training: trainees learn on actual or simulated
equipment but are trained off the kob
LO5: DISCUSS MANAGEMENT DEVELOPMENT METHODS
MANAGEMENT DEVELOPMENT
Attempt to improve managerial performance by imparting
knowledge, changing attitudes or increasing skills
Importance: promotion within is a major source of
management talent
On-The-Job METHODS
Job rotation: moving managers form department to
department to broaden their understanding of the
business and test their abilities
helps avoid stagnation and improve cooperation
Coaching/Understudy Approach: trainee works with
senior manager
Action Learning: Management trainees are allowed to
work full-time analyzing and solving problems in other
departments
LO5: DISCUSS MANAGEMENT DEVELOPMENT METHODS
On-The-Job METHODS
Stretch Assignments: places employees in different jobs
that are more demanding that those to which they are
accustomed to
Off-the-Job METHODS
Case Study Method: trainees solve realistic problems
after studying written or video case descriptions
Management games: trainees learn by making realistic
decisions in simulated situations
Outside seminars: web-based and traditional classroom
management development
University-related programs: executive education,
leadership
LO5: DISCUSS MANAGEMENT DEVELOPMENT METHODS
Off-the-Job METHODS
Case Study Method: trainees solve realistic problems after
studying written or video case descriptions
Management games: trainees learn by making realistic
decisions in simulated situations
Outside seminars: web-based and traditional classroom
management development
University-related programs: executive education, leadership
Corporate universities: company-based method for exposing
prospective managers to realistic exercises to develop
improved management skills
Executive coaches: Outside consultant that questions
associates in order to identify strengths and weaknesses, and
counsels the executive so the individual can capitalize on those
strengths and overcome weaknesses
LO6: IMPORTANCE OF THE STEPS IN LEADING ORGANIZATIONAL CHANGE
Aamodt, M. G. (2016). Industrial and organizational psychology (8th ed.). Stamford, CT: Cengage
Learning.
Dessler, G. (2020). Human resource management (16th ed.). New Jersey: Pearson Education, Inc.
Muchinsky, P. (2019) Psychology applied to work. (12th ed.). USA: Thomson Wadsworth. (Main
Reference)