Assessor Learner Guide
Assessor Learner Guide
Assessor Learner Guide
Conduct outcomes-
based assessment
SAQA ID 115753:
Module 1
Understanding outcomes-based assessment
After completing this module, the learner will be able to demonstrate understanding
of outcomes-based assessment, by successfully completing the following:
In this first Module, you will gain an understanding of the importance of outcomes-
based learning and assessment and how it compares with other forms of learning
and assessment.
You’ll also investigate the opportunities offered by Recognition of Prior Learning
(RPL), the key principles of assessment and how to give feedback on assessment
results in this Module.
Example
Common standards in general use are:
Standards for weight: gram, kilogram, etc.
Standards for time: seconds, minutes, hours, etc.
Standards for value: rands, dollars, yen, etc.
Concepts of learning
According to Gerda Magnus and Herman de Vries from Assessment College 1,
outcomes based learning can be either:
Strategic - It means learning one or more skills as enabling outcomes so that
a higher-order skill may be acquired
Scaffolded - It is the degree of support, guidance and direction given to
students when they set out to complete a task, whether it is formative
assessment, experiential learning, or summative assessment
Deep - Deep learning involves the critical analysis of new ideas, linking them
to already known concepts; leads to the understanding and long-term
retention of concepts; results of such learning is best for problem solving in
unfamiliar contexts
Shallow - The intention of surface learning is to cope with course
requirements such as memorising them as isolated and unrelated facts;
leads to superficial retention of material without reflecting on purpose
Outcomes based education holds the following key beliefs about learning and
success:
What and whether learners learn successfully is more important than exactly
when, how and from whom they learn it.
All learners can learn and succeed, but not on the same day in the same way.
Successful learning promotes more successful learning, just as poor learning
fosters more poor learning.
1
Fasset: Assessor and Moderator Networking event 2008
To encourage employers:
o to use the workplace as an active learning environment;
o to provide employees with the opportunities to acquire new skills; and
o to provide opportunities for new entrants to the labour market.
To employ persons who find it difficult to be employed.
To encourage workers to participate in learnerships and other training
programmes.
To improve the employment prospects of persons previously disadvantaged
by unfair discrimination and to redress those disadvantages through
education and training.
SETAs are responsible for the achievement of these purposes, and this also involves
the ETQA sections, which can make a significant impact on the improvement of
access and redress by encouraging their accredited providers to implement
increasingly transformative assessment policies.
Both the South African Qualifications Authority Act, 1995, and the Skills Development
Act, 1998, require that education and training programmes and practices are based
on Unit Standards registered on the NQF, and where appropriate (e.g. in the case of
learnerships) result in national qualifications on the NQF2.
Both Acts also require that education and training practices have internal and
external assessment practices built into a quality assurance system. The purpose of
quality assurance is to ensure that the highest levels of competence and excellence
will be achieved for every Rand collected in the form of the skills development levy
and for every Rand of this income that is invested in all the practices relating to
education and training.
Assessment that leads to the achievement of credits or qualifications on the NQF
must be conducted by a registered assessor.
Credits: A “credit” is a numeric value assigned to a unit standard. One credit equals 10
hours of notional learning time required to master the capability described in a unit
standard.
Definitio The total number of credits determines the type and level of qualification. The following
n criteria apply:
Qualification A minimum of...
National Certificate 120 credits
National Diploma 240 credits
National degree 360 credits
Assessment is basically a case of learners demonstrating that they can perform the
outcomes, which have been decided on for the particular competence they are being
trained in. That is why setting accurate standards is so important. The Standards will
determine what the assessment must test for. Learners would show competence as:
Practical competence - demonstrated ability to perform a set of tasks and
actions in authentic contexts
Foundational competence - demonstrated understanding of what we are
doing and why we are doing it
2
Adapted from an article written by Marietta van Rooyen, MD of The Assessment College,
www.workinfo.com/free/downloads/30.htm
One of the SAQA requirements for registration as an assessor is that the assessor
must have achieved the assessor standard ‘Conduct Outcomes Based Assessment’.
Another important requirement is that assessors are only registered to assess in their
area of expertise, and that they must be qualified at the level of the candidate they
are assessing or at a higher level in the same field, or be able to demonstrate
equivalent competence
Assessors are appointed and trained to undertake the assessment process. An
assessor can be internal to the organisation that does the training, or external. If they
are internally appointed, they must be qualified at, or above the level of training that
they will be assessing, and they must be registered with their ETQA as an Assessor.
Subject matter experts (SME’s) make ideal assessors as they either know the job
being assessed well, or have been involved in the design of these jobs.
Where practical, one could contact retired employees who know the job and the
company well and invite them to become part-time assessors for both skill, and
learnership programmes.
The following is a list of the critical functions / tasks of an assessor:
1. Get to know the standard being measured as defined by the Standards
Generating Body (SGB) for your industry, and understand how these link to
the various levels of the National Qualifications Framework (NQF).
2. Plan and design assessment for the various standards in conjunction with
training providers, who may be the company’s internal training and
development function, or external vendors.
3. Collect reliable evidence about the learner's performance, and evaluate and
judge that evidence to decide whether the learner is competent, or not yet
competent.
4. Regularly review the assessment process and make changes to it when
necessary.
5. Comply with all moderation requirements that the ETQA function in the
relevant SETA for your industry may decide on from time to time. We strongly
recommend that assessors make an appointment to meet the ETQA Manager
at your local SETA to gain support for the assessment process in your
company. Remember that these officials are paid from the levies collected to
be of help to you!
6. Complete all documentation required by the ETQA function of the relevant
SETA, and forward it to them.
3
Adapted from: http://www.skillsatwork.co.za
Terminology Definition
Assessment criteria Assessment criteria are statements that describe the standard to
which learners must perform the actions, roles, knowledge,
understanding, skills, values and attitudes stated in the outcomes.
They are a clear and transparent expression of requirements against
which successful (or unsuccessful) performance is assessed
The assessment criteria should specify:
The knowledge, understanding, action(s), roles, skills, values
and attitudes that a learner has to display in order to provide
evidence that outcomes and competence have been achieved
The level of complexity and quality of these
The context of and conditions under which demonstrations
should occur
Unit standards Unit standards are the parts which qualifications are made of. A
qualification in SAQA terms are made up of a cluster of unit standards,
including standards for fundamental learning, core learning and
elective learning – this is to ensure that learners are not only
competent in a particular field, but that they are developed holistically,
with competence in communication and numeracy, etc.
Critical cross-field Assessment in OBET is not only focused on what learners can do, but
outcomes intends to develop learners holistically. In other words, learners are
also required to demonstrate certain life skills, which will not only
enhance their learning, but will also ensure that these skills are
transferable to their private lives.
These skills are referred to as ‘generic abilities’ and are expressed as
‘critical cross-field outcomes’ in the qualifications. The following critical
cross-field outcomes must be included and assessed in each
qualification:
Identify and solve problems in which responses display that
responsible decisions, using critical thinking, have been
made.
Work effectively with others as a member of a team, group,
organization or community.
Organize and manage oneself and one’s activities responsibly
and effectively.
Collect, analyse, organize and critically evaluate information.
Communicate effectively using visual, mathematical, and/or
language skills in the modes of written and/or oral
presentation.
Use science and technology effectively and critically show
responsibility towards the
environment and the health of others.
Demonstrate an understanding of the world as a set of related
systems by recognizing that problem-solving contexts do not
exist in isolation.
Contribute to the full personal development of each learner
and the social and economic development of the society at
large, by making it the underlying intention of any programme
of learning to make an individual aware of the importance of:
o reflecting on and exploring a variety of strategies to
learn more effectively;
o participating as responsible citizens in the life of local,
national and global communities;
o being culturally and aesthetically sensitive across a
range of social contexts
Terminology Definition
Formative Formative assessment refers to assessment that takes place during
assessment the process of learning and teaching.
Designed to support the teaching and
learning process
Assists in the planning future learning
Diagnoses the learner’s strength and
weaknesses
Provides feedback to the learner on his/her
progress
Helps to make decisions on the readiness of learners to do a
summative assessment
Is developmental in nature
Credits/certificates are not awarded
Summative Summative assessment is assessment for making a judgement about
assessment achievement. This is carried out when a learner is ready to be
assessed at the end of a programme of learning.
At the end of a learning programme (qualification, unit
standard, or part (qualification).
To determine whether the learner is competent or not yet
competent.
In knowledge and inputs-based systems, this usually occurs
after a specified period of study, e.g. one year.
In OBET, learner-readiness determines when assessments
will take place.
Is carried out when the assessor and the learner agree that
the learner is ready for assessment
Criterion-referenced OBET assessment is associated with criterion-referenced
Assessment assessment, particularly in terms of the assessment of the individual
and his/her achievement.
Makes judgements about learners by measuring learners’
work against set criteria.
An individual is assessed.
The criteria are pre-determined and are part of the standard.
The criteria are objective and attempt to be as clear as
possible in terms of the nature of the assessment.
Where grading is used, learners are graded against the
criteria for assessment.
Thus in OBET, assessment is done to the standard that is stated in
terms of the specified outcomes and the accompanying assessment
criteria laid down. The achievement (or non-achievement) of other
learners undergoing the same assessment is not the major issue.
A learner is deemed competent or not competent on the basis of their
assessment against the standard set.
Terminology Definition
Norm-referenced Makes judgements about learners by measuring them against one
Assessment another.
A group of learners is assessed.
Assessments are curriculum-based.
Associated with grading and ranking of learners.
Associated with averaging of scores or grading of learners.
Associated with adjustment of scores to fit the profile of the
learner group.
Still used:
To assess large numbers of learners in a cost-effective way.
To test content knowledge.
To draw statistics, i.e. compare one year’s performance with
that of the previous year to evaluate standards.
To determine the quality of teaching.
To determine the quality of the learning programme.
To make comments about the national curriculum and trends.
To analyse strengths and weaknesses to assist in program
planning and evaluation.
Purpose of RPL
The OBE system makes provision for what is now known as “recognition of prior
learning” (or RPL), which basically entails testing a person's ability to do a specific
job and awarding this person either a qualification or credits towards a qualification,
based on his current knowledge and ability to perform the required task.
This means that if a person has been working as a plumber for the last 12 years, this
person may request a training institution to perform an RPL (Recognition of Prior
Learning) exam, to assess his capability and award him with a qualification based on
his experience. It is therefore possible for him to receive a plumbing qualification
based on his experience, without having served a recognised apprenticeship or
learnership.
Recognition of prior learning (RPL) refers to a process for the giving of credit to what
learners already know and can do regardless of whether this learning was achieved
formally, informally or non-formally. RPL is the use of the assessment process to
recognise job competence that has been gained by experience through assessing
the individual employee’s quality of integration of education, training, coaching,
mentoring and lifeskills
The purpose of RPL is to:
Identify what the candidate knows and can do
Match the candidate’s skills, knowledge and experience to specific unit
standards and exit level outcomes of qualifications
Assess the candidate against those standards
Credit the candidate for skills, knowledge and experience built up through
formal, informal and non-formal learning that occurred in the past
RPL can be applied to:
Personal development
Certification
Access to further learning
Promotion
Career change
Process of RPL
The RPL process4 can be seen as:
Benefits of RPL
Recognition of prior learning has been identified as a powerful tool for bringing
people into the learning system—it reassures them that they don’t have to start from
scratch and that the skills they already have are valuable. The growing body of
research on the subject has revealed evidence that RPL has many benefits.
4
Source: INSETA_RPL_Portfolio_Example_2010
Challenges of RPL
The challenges facing the implementation of RPL in South Africa include:
ensuring that equity, redress and an holistic approach are developed and
practised;
ensuring that new forms of exclusion and discrimination of adult learners do
not become the norm at our education institutions;
ensuring that education providers become more “adult learner friendly” as
they deal with increasingly diverse learner populations;
juggling institutional autonomy versus consistency within and between
institutions in the various sectors; and
ensuring the participation and collaboration of all stakeholders in the
particular sector
Evidence should be authentic (i.e. it is real, and it can be linked to the candidate
who puts it forward), current (i.e. it is sufficiently up to date in terms of current
competence in the standards) and sufficient (i.e. there is enough evidence to show
competence).
There are different types of evidence, depending on what is generated by a specific
assessment or learning activity or job-related activity: e.g. a written document, a
performance, a made product etc. The three main sources of evidence are:
Direct Evidence- Direct evidence is produced during assessment of
learning by a registered assessor. This type of evidence can be collected
using a variety of methods, for example direct observation, direct oral
questioning, work-related projects or assignments, simulations, finished
products, written test, etc.
Indirect Evidence -Indirect evidence is evidence produced about the
candidate’s achievements from another source. Such evidence is often
referred to as third party evidence. This might include reports from
managers, performance appraisals, written or oral testimonials, records
from a workplace, current written or oral testimonials, training records, non-
work related projects or assignments.
Historical Evidence- Historical evidence is evidence about the learners’
past work or past performance. Forms of historical evidence might include,
for example, certificates or qualifications, photographs and videos, logbook
or performance record, documented evidence of competence,
portfolios/examples of completed work or projects, products exemplifying
the skills acquired through previous work and life experience, and/or past
written testimonials.
Portfolio of evidence: a carefully organised and complete collection of evidence
compiled by candidates/learners to prove competence in relation to defined
outcomes
Assessment methods
Assessment methods refer to the activities that an assessor engages in as s/he
assesses a learner and the learner’s work.
An assessment method refers to how you assess an outcome, for example, orally,
through a written activity, a demonstration or a project.
Normally these activities are:
Observation – observing the learner while s/he is carrying out tasks, real or
simulated, as defined in an outcome or outcome statement.
Evaluation of a product – evaluating something the learner has produced
after the task has been completed.
Below you will find some examples of assessment tools or instruments, methods,
evidence types, and recording approaches, and how they might relate to each other.
Please remember that these could take a number of different forms depending on
purpose of assessment and nature of learning area. For example, a portfolio method
could be used to gather together to illustrate many different kinds of evidence which
have been generated by different assessment instruments or tools.
Assessment Tools or Assessment
Assessment Method Evidence Type
Instruments Records
[Instructions to learners and [Ways of recording the
[What do you ask the
criteria against which they [What learners produce level or performance for
candidate to do, and how
are being assessed; OR as evidence] a candidate or group of
do you assess this]
instructions to assessors] learners]
Written Assessments:
Exams
Written task instruction Products:
Tests
and parameters with e.g.
Assignments
criteria for learners written report
Projects Recording forms
Marking memo or survey
assessment grid with Questionnaires
visual products
‘model answers’ and Portfolios of
(graphs, diagrams,
criteria for assessors evidence
posters etc.)
Written scenarios
and case studies
The methods of assessment should cover situations for gathering evidence of:
Problem solving ability,
Knowledge and understanding,
Practical and technical skills, and
Attitudinal skills and values
Note that the eight learning outcomes listed above would be broadly expected of any
learner embarking on any educational program.
When choosing assessment methods and assessment instruments it is important to
offer variety to learners in the way they demonstrate their learning, and to help them
to develop a well-rounded set of abilities by the time they graduate.
Assessment instruments
Let’s look at some of the assessment instruments in more detail now. (Remember,
assessment instruments refer to the nature of the assessment task given to the
learner to do).
Instrument Method
Comment
1. Workplace The assessor watches the This method is an authentic,
observation learner as he or she works in the integral and natural part of
usual workplace situation. The workplace supervision. It allows
situation may be video-taped. for continuous assessment,
The learner works at the usual disruption is minimal and it is
speed in the usual way. The cost-effective. It may, however,
learner must be performing an be insufficient. Some
appropriate task to demonstrate competencies cannot be easily
competencies. observed or demonstrated.
Assessment criteria must be
clearly spelt out and assessors
must be aware of complicating
factors. Good communication is
essential.
2. Simulation The tasks being assessed are A deficiency of simulation as an
recreated in a training room. The assessment instrument is that it
situation should be as close to does not show real pressures or
the real situation as possible. workplace situations. People
Simulation need not be may be self-conscious and it
disruptive. It can be very similar requires substantial effort to
to actual work conditions and is prepare. Reliability may be
useful when direct observation is suspect.
not possible.
Instrument Method
Comment
6. Product evaluation The final products of a learner’s
activities are assessed. What the It allows the final product to be
learner actually makes is assessed as proof of
assessed. competence. It is authentic and
most useful together with a
supplementary form of
evidence. Authenticity may be
in doubt if the assessor was not
present when the object was
made.
7. Projects/ A project or assignment may be
assignments/ tasks done alone or in groups. It Projects, assignments and
(individually or in usually involves a clear set of tasks allow for a range of
groups) tasks incorporating a range of competencies to be dealt with
competencies. It usually includes simultaneously. they can be
research, collecting and used with individuals and
analysing data, reporting on and groups. They allow candidates
applying information. It may a great deal of autonomy and
result in a final product such as a are especially useful where
report, a presentation or an innovation and being
object. enterprising is being assessed.
They may, however, require
massive inputs of energy and
resources from both learner and
assessor. Authenticity may be
difficult to establish. The topic
must be carefully developed in
order for evidence of
assessment criteria to emerge.
8. Documents linked to These are documents kept in the
activities normal course of the work being Work-related documentation is
assessed. The documents could authentic, easily accessible,
include minutes, memos, time familiar to the learner and can
pages, schedules, log books, easily be verified.
etc.
9. Discussion/ A structured discussion or
interview interview between the learner Answers (and therefore
and the assessor, or between evidence) are only as good as
the learner and a panel. the questions asked. It may not
address real workplace issues
and favours those who are
more confident and articulate.
Written skills are not needed
and it allows for immediate
feedback. Oral discussion or
interview is usually only suitable
as supplementary evidence.
Real workplace issues may be
missed.
Instrument Method
Comment
10. Written questions/ The learner may respond to Written questions and essays
essays questions in a written form. are useful to gather proof of
Questions come in a variety of factual knowledge and memory
forms and may be multiple skills. They can be administered
choice type questions, open- quickly and to large numbers of
ended questions, matching, people at the same time. They
complete-the-gaps and so on. standardise the assessment
Essays are continuous prose, in process, are cost effective and
response to a question, usually not very time consuming.
to a defined length. Essays can be very useful for
assessing abstract thinking.
Questions have a limited
usefulness for skills such as
analysis, synthesis and
evaluation. There can be a big
margin of error in results and
criteria for assessing essays
may be unclear.
11. Witness testimony/ Witness testimonies are reports Witness testimony and peer
peer evaluation or endorsements by observers of reports can be useful for
the learner’s activities or verification purposes. They are
knowledge. Peer assessment suitable for generic
involves colleagues at the same competencies such as “working
level as the learner giving their in a team”, and “communication
opinion of learners’ skills”. They are simple to use.
competencies. However, they may be biased
or inaccurate. The learner may
find them threatening and it can
be a problem for peers to
assess a learner who is not yet
competent.
12. Evidence of prior Evidence of prior achievements
achievements may include awards, certificates These achievements must,
or actual products. however, be recent and
relevant to the skills being
assessed.
13. Photographs or Photographs or videos may be
videos taken at work or in a simulated Photographs or videos are
environment. useful for illustrating processes
and providing proof of
performance by the learner.
14. Case studies and In a case study a learner
role plays responds to a detailed A role play is suitable for
description of a scenario or a set assessing problem-solving and
of conditions, usually to solve a strategic skills. Learners may
problem within that scenario. be self-conscious and react
Role plays are less passive and differently from the real
involve the learner acting out situation. The case study can
appropriate responses to specific be difficult to write, and requires
situations. The assessor may a very good understanding of
participate in one of the roles. the situation itself. Case studies
need credibility to be effective.
Instrument Method
Comment
15. Journals/ logbooks These are kept by learners who
report on processes as they Journals and logbooks are
happen. Journals are diaries useful for assessing progress
which learners keep during the and monitoring change. Thy
process of tasks, activities or provide opportunities for
jobs. Logbooks are more guidance and growth and are
structured and record or “log” therefore very suitable for
when specific tasks or actions formative assessment. They are
happen. also useful for programme
evaluation. Clear guidelines are
necessary before starting.
Keeping the journal/ log book
up to date requires self-
motivation. Reliability may be
an issue, since it is difficult to
ensure that the record is
accurate and current.
16. Tests/ Tests or examinations are Tests and examinations are
examinations written responses to questions useful for large group
within tightly defined conditions assessment. They match most
and time frames. While most people’s ideas of what
examinations are without access assessment is and can provide
to support material, take-home evidence of understanding and
or open-book examinations are knowledge. Real competencies
possible. may, however, be masked by
poor examination skills. They
favour those with good writing
skills. They assess theoretical
knowledge rather than actual
performance.
17. Portfolio of One of the most useful ways of This is equally appropriate for
Evidence (PoE) presenting evidence of applied learners engaged in learning
competence is by gathering and programmes and for RPL
arranging evidence in a portfolio candidates and is particularly
of evidence. appropriate for programmes
A portfolio of evidence is a which are assessed largely in
collection of evidence gathered the workplace.
for various purposes. In a learning
programme, it may mean that the
candidate selects and keeps
his/her own assessment products
over the period of the course (e.g.
any tasks, assignments, projects
completed or artifacts made). A
portfolio could include assessor
records, such as comments made
on the basis of observation. Some
learning programmes set out
specific guidelines for putting
together a portfolio. For RPL, a
portfolio includes a collection of
specified evidence (e.g. letters of
reference; proof of work
experience, or articles produced
in the workplace) collected and
presented for assessment.
Example:
A learner is assessed on research skills. However, a learner’s ability to write may not
necessarily provide evidence that the learner has the ability to do research. The
assessment must assess the learner’s ability to perform. In this case, the learner
should be assessed on the various activities of the stages of research, namely –
Formulation of the research question
Literature review
Development of research instruments
Collection of data
Analysis of data and writing a report
Therefore, the assessment should stay within the parameters of what is required –
not less than the unit standard or qualification, nor more than the unit standard or
qualification.
A reliable assessment is one that is in line with other assessments made by the
same and other assessors in relation to the same unit standard or qualification.
Reliability in assessment is about consistency. Consistency means that comparable
judgments are made in the same (or similar) contexts each time a particular
assessment is conducted. Assessment judgments should also be comparable
between different assessors. Assessment results should not be perceived to have
been influenced by variables such as:
assessor bias;
different assessors interpreting the standards or qualifications differently;
assessor stress and fatigue; or
assessor assumptions about the candidate, based on previous performance.
The principles of fairness, validity and reliability imply that some form of moderation
practices (both internal and external) need to be applied to assessments. In other
words, moderation is a key element of a reliable assessment system.
A practicable assessment is effective without placing unreasonable demands on the
relevant role-players. Assessment should be designed to be as effective as possible
in the context of what is feasible and efficient in a particular learning programme or
RPL process. It should try to avoid unreasonable demands in relation to:
the time commitments required for the generation, collection, presentation
and assessment of evidence involving:
o the candidate;
o the assessor;
o third party witnesses (mentors, line-managers, coaches…); and
evidence facilitators, RPL advisors and others involved in
advice and support.
financial implications for the employer or provider in relation to
(for example) releasing personnel listed above for lengthy
periods; and
financial implications for the employer or provider in relation to
suspending or slowing the effectiveness of the normal use of
machinery, tools, other equipment, facilities and human
resources.
SAQA summarises the importance of the principles of good assessment with the
following equation:
FAIRNESS + VALIDITY + RELIABILITY + PRACTICABILITY = CREDIBILITY
The critical overriding principle of assessment is that of ethics: because the results of
assessment can lead to an increase in pay, improved career prospects and the like,
the principles of assessment should be applied ethically and responsibly.
‘Criteria and Guidelines for the Assessment of NQF Registered Unit standards and Qualifications’ (SAQA, 2000)
Assessing competence
The NQF defines the competence which learners are expected to demonstrate in its
standards as applied competence.
SAQA’s ‘Criteria and Guidelines for the Assessment of NQF Registered Unit
standards and Qualifications’ defines this as ‘the union of practical competence,
foundational competence and reflexive competence:’
Foundational
Practical competence Reflexive competence
competence
The demonstrated ability to The demonstrated The demonstrated ability to
perform a set of tasks in an understanding of what the integrate performance with
authentic context. candidate is doing and understanding, so as to show
A range of actions or why. that the candidate is able to
possibilities is considered, This underpins the adapt to changed
and decisions are made practical competence and circumstances appropriately
about which actions to therefore the actions taken. and responsibly, and to explain
follow. the reason behind an action.
Applied competence implies that a candidate has the theoretical knowledge that
enables an understanding of what is being done and why it is done, together with the
skills to perform a particular task or to think in a certain way. Furthermore learners
can reflect on their own performance and understanding. As a result they can learn
from actions, adapt to changes and solve problems.
Assessing applied competence requires a variety of assessment instruments, the use
of multi-dimensioned projects or problem-solving tasks in real-life contexts providing
opportunities to combine theory, practice and thoughtfulness.
The candidate must show competence at the level of the unit standard and,
ultimately the level of the qualification or learning programme.Applied competence
cannot be demonstrated solely through performance in simulated conditions in the
training programme. For example, if a candidate wishes to achieve a standard on
mentoring, or moderation, there must be evidence that they have demonstrated their
applied competence in the context of mentoring a real candidate or moderating a real
set of assessments.
This is one of the factors taken into consideration when agreeing on the credit value
of a unit standard. The credit value is calculated by working out how long an average
candidate who started a learning programme with the ‘learning assumed to be in
place’ as specified in the standard would take to achieve applied competence in
relation to the unit standard.
The number of ‘notional hours’ is calculated by adding to the face-to-face or
distance training time the time that the candidate will need to spend applying his or
her learning in context in order to generate evidence of the right nature, quality and
type to meet the requirements of validity, authenticity, currency and sufficiency. Ten
‘notional hours’ is considered equivalent to one credit. Notional hours are not
prescriptive to providers, but do provide guidance to providers about the time
implications for an ‘average’ candidate.
It is clear, then, that a three or four day learning programme (i.e. 2-3 credits in terms
of face-to-face learning) with no significant element of application in context is
unlikely to support learners to achieve a unit standard of 12-15 credits. The
programme evaluator will be unlikely to approve such a programme in the first place,
so such problems may be addressed at the accreditation stage. If not, the assessor,
moderator and/or verifier should address this situation by insisting that the evidence
offered is sufficient to demonstrate applied competence.
If a candidate or group of learners have been placed on an accelerated programme
because of high levels of relevant experiential learning, or if they are under-going an
RPL process, or if they have already undergone RPL and are now participating in
top-up training, the process or programme offered is not a standard programme. The
assessment plan will spell out which outcomes/standards have already been
achieved, and which are now being covered. So, as in all assessment processes, the
focus of the assessor, moderator and verifier should be the evidence of applied
competence, as ‘notional hours’ apply to ‘average’ learners who begin at a specified
level, and not ‘experienced’ learners who begin above that level.
Simulation is, however, a perfectly acceptable as a way of generating evidence of
competence for certain outcomes or unit standards, particularly those involving
health and safety risks. Here there is a good reason for using simulation rather than
an uncontrolled workplace situation: naturally candidates must demonstrate
competence before being allowed to operate expensive and potentially dangerous
machinery or handle hazardous substances or put other people and themselves at
risk. However, it would never suffice for a whole qualification. For example, the pilot,
having demonstrated competence in relation to many of the unit standards in
simulated flying conditions, must still demonstrate the ability to fly the real plane
under supervision before achieving the full qualification.
Module 2
Prepare for assessments
After completing this module, the learner will be able to prepare for assessments, by
successfully completing the following:
Before the assessment can take place, the assessor has to plan, design and prepare
assessments. This includes making decisions about the method of assessment,
the instruments to be used, the activities to be structured and the extent to
which more than one learning outcome can be assessed simultaneously.
Logistics
Organising schedules. Obviously one of the first things that you would draw
up would be a schedule according to which the assessment should be
planned. The schedule, which can include the following, should also linked to
time and dates when the different activities should be completed:
o Designing the assessment instruments, including the guidelines for
assessment, the assessment plan, an assessment briefing agenda, a
Documentation
Assessment instruments. Assessment instruments are designed in
advance, preferably as part of the course design and development processes.
It is important that assessment instruments be kept secure until such time
when the assessment is to take place.
Documentation of assessment. Assessment results and all other activities
that go with assessment should be professionally documented for two
reasons. Firstly, evidence of assessment must still be moderated and verified
and, secondly, assessment documentation may be needed for feedback
purposes, especially where the candidate lodges an appeal against the
results of the assessment.
Ensuring that procedures are in place where learners provide feedback on the
assessment process and can challenge the assessment if necessary.
Establishing procedures for re-assessment if required.
Establishing the relationship between learner scores and learner
characteristics after completion of assessment.
Checking to ensure parties involved in the assessment are ready and available
We will explore the following parties:
Assessor
Moderator
Learner / candidate
Verifier/ external moderator
SETA / ETQAs
The assessor
Assessors include all practitioners who will be responsible for the assessment of the
Assessors are registered by the relevant Education and Training Quality Assurance
Body and can be de-registered if they do not comply with the relevant ETQA
requirements or if they are found to be unsuitable. (SAQA Guidelines, 1999: 25.)
The moderator
The assessor is moderated by an (internal) moderator from the same enterprise as
the assessor and/or an external moderator (verifier) from a SETA/ETQA. Drawn from
the same enterprise or assessment agency as the assessor, this person checks that
the assessment meets the principles for good assessment, ensures that the
assessment is carried out according to agreed guidelines and ensures the quality of
the assessment method.
SETA/ ETQAs
In terms of monitoring, ETQAs will be required to demonstrate continuing evaluation
of moderation and assessment. They must demonstrate a developmental approach
to improving the quality of learning provision and the review of learning provision.
This monitoring by the ETQA will be conducted through a variety of mechanisms
appropriate to the sector and sphere of operations of the ETQA. Such mechanisms
could include multi-sectoral, national and even international review workshops or
meetings, board or panel reviews, as well as reviews and surveys with constituent
providers to ensure that improvements are continually sought and implemented.
The ETQA Regulations (RSA, 1998a) require all ETQAs and providers to have in
place a quality management system which includes policies, procedures, and review
mechanisms for quality assurance. Included among these are policies, procedures,
and mechanisms for the management of assessment – both internal and external.
ETQAs are required to evaluate the assessment policies and procedures of
constituent providers and ensure the management and monitoring thereof. The
universal assessment principles of fairness, validity and reliability form the foundation
for assessment policy and evaluation for accreditation processes and procedures.
Moderation requirements
The principles of fairness, validity and reliability imply that some form of moderation
practices (both internal and external) need to be applied to assessments. In other
words, moderation is a key element of a reliable assessment system. Moderation
procedures must form part of an assessment system in order to assure quality.
Moderation is a process that ensures that the assessment conducted by the
registered assessor meets the specified outcomes as described in the NQF
registered standards and qualifications, and are fair, valid and reliable. Moderators
who wish to carry out the moderation function in the ETQA primary focus must be
registered with the ETQA. Moderators should first be practising registered assessors
and then train as moderators.
ETQA constituent Providers are to ensure that a sample of all assessments
conducted is moderated, with the aim of enhancing the quality of assessments in the
sector. As a guide to the size of the sample, it is recommended that an average of
not less than 10% should be moderated. The rationale for the selection of the sample
will vary, but there should be an attempt to target as well as use random samples.
ETQA’s have certain specific requirements in terms of the provider’s moderation
process. There must be an overall moderation system, which should be briefly
described in writing and should guide each moderator. This should include the
following elements:
A moderation policy. This policy should include the criteria for the selection
of assessments for moderation. It should also state the frequency of
moderation in different contexts, and include procedures to be followed and
forms to be completed.
A procedure for the quality manager for assessment to follow when
requesting moderation.
A pro-forma to be followed by moderators in drawing up a moderation plan.
Pre-assessment moderation
Assessment may not be conducted before Pre-Assessment Moderation has not been
not completed, Pre- assessment Moderation will ensure that:
the assessment design is of the expected quality
the assessor is able to execute the assessment according to the standard
a suitable assessment plan has been compiled
the assessment instruments that will be used will yield valid results,
all the information needed for assessment is laid out in an assessment guide;
and
all aspects indicated in the moderation plan have been executed
It is the Moderator’s responsibility to ensure that these aspects in terms of quality
assuring assessment are in place. Assessors must support this as Moderators
ultimately will report to the ETQA Verifiers if Moderation did not comply with SAQA
Guidelines and Criteria, the ETQA Policy and the Provider Policy and instructions.
responsibilities, and
appeals procedures related to the assessment at hand
5
Source: THE IMPACT OF THE CRITICAL OUTCOMES ON CURRICULUM, PEDAGOGY AND ASSESSMENT IN ABET
The mechanisms for the development and implementation of the NQF would include:
standards setting,
qualification design,
assessment,
moderation,
credit accumulation,
accreditation of providers,
registration of assessors,
recognition of achievements
In the past, learning done at institutions such as technikons, technical colleges and
universities was viewed as “education”, and learning within companies was viewed
as “training”. Often there was no formal recognition for training. According to the
SAQA Act both education and training are recognised forms of learning, and
individuals should be able to move freely between these two types of learning.
The NQF is a framework on which qualifications, courses, and learning programmes
are registered. Achievements obtained by learners are recorded and recognised
nationally. It is therefore an integrated approach towards education and training.
NQF Framework
QUALIFICATIONS AND
INSTITUTIONS
CERTIFICATES
10 Doctorates
Tertiary / Research / Professional Instructions
9 Masters Degrees
Post graduate diplomas
8 and Professional
Higher Qualifications
Education Bachelor Degrees and
& Training 7
Advanced Diplomas Universities / Technikons / Colleges / Private /
(HET) Professional Institutions / Workplace / etc.
Diplomas and Advanced
6
certificates
Higher Certificates and
5 Advanced National
(vocational) Certificates.
Std 10 / Grade 12, N3 /
NCS
4 National Senior Certificate
and National (vocational) Technical /
Further Formal high
Certificates. Community / Industry
Education schools /
Std 9 / Grade 11, N2 / NIC Police / Training Boards
& Training Private /
Nursing / / Unions /
3 National (vocational) State
(FET) Private Workplace, etc
Certificates. schools
colleges
Std 8 / Grade 10
2 Further Education and
Training Certificates.
Senior Phase, ABET
Std 7 / Grade 9 Level 4 Occupation / NGOs /
Formal
General Intermediate ABET Work-based churches /
schools
Education Phase Level 3 training / Night schools/
(Urban /
& Training 1 Upliftment ABET / Private
Foundation ABET Rural /
programmes / providers/
(GET) Phase Level 2 Farm /
Community Unions/
Special)
ABET programmes Workplace
Pre-School
Level 1
The NQF is like a single, but wide, ladder that covers many possible learning and
career paths, which include all forms of education and training. The ladder is
designed to make it easy for people to move sideways and upwards (articulate) as
they move from one type of learning to another or from one career to another. Like a
ladder, the NQF has different rungs or levels that make it clear how far a person is
from the bottom or from the top, and what the next step is. All types of career paths
have the same steps or levels.
The NQF ladder currently has ten steps, whereby all education and training is
classified according to 10 levels. The levels measure the complexity of learning for
different levels, rather than focusing on how long a person has studied. The levels
allow for comparison between different courses, as well as comparison between
education and training received in different places and in different ways. Comparison
can also be made internationally, in order to compare South African qualifications to
those from other countries.
Qualifications are registered on the different levels based on the exit level of that
qualification i.e. what the person will know and be able to do once they have
completed their qualification.
Pre-assessment Meeting
The learner is invited to the pre-assessment meeting where the following is
discussed and minutes of the meeting compiled.
Purpose of the assessment
Unit standard (s) to be assessed
Specific outcomes to be assessed.
Assessment criteria including any relevant integrated assessment
Method of assessing each specific outcome
Evidence required for each assessment criteria
Assessment date and the type of venue and resources required.
Note:
Selection and placement processes combined with flexible delivery including
bridging, slower and accelerated options should be available. Providers and clients,
such as employers who are supporting their employees through training, should be
aware whether or not learners have the ‘learning assumed to be in place’ before
entering a learning programme.
If they do not, it is likely that additional support or a bridging programme may be
needed, and it is best to find this out sooner rather than later. Additional funding may
be required, or more release time from work, so it is important not to raise hopes by
accepting people onto learning programmes when they are really being set up for
failure.
CANDIDATE : _________________________________
DATE : _____ / _____ / _____
Have I notified anyone else who needs to know? (e.g. security, reception, a witness)
Have I got together any other evidence which supports unit standard which I am
being assessed against?
Have I checked that nothing will get in the way of being able to perform this activity?
_________________________________
CANDIDATE’S SIGNATURE
I declare that the above items were explained to me clearly and I have understood them.
ASSESSOR
LEARNER
WITNESS
Module 3
Conduct assessments
After completing this module, the learner will be able to conduct assessments, by
successfully completing the following:
Use assessment practices that promote effective, manageable, fair and safe
assessment. Ensure that assessment practices are in line with quality assurance
requirements, recognised codes of practice and learning-site or work-site
standard operating procedures where applicable
Carry out the assessment according to the assessment design and in line with
the assessment plan. Justify adjustments by the situation, and unforeseen events
and special needs of candidates are addressed without compromising the validity
or fairness of the assessment
Use questioning techniques that are appropriate and have the potential to
successfully elicit appropriate responses. Ensure that communication with
candidates is non-leading, and is appropriate to the assessment at hand and the
language ability of the candidate
Gather sufficient evidence, including evidence generated over time, to enable
valid, consistent, reliable and fair assessment judgements to be made
Ensure that assessment judgements are consistent with judgements made on
similar evidence and are justified by the authenticity, validity, sufficiency and
currency of the evidence
Ensure that records of the assessment are in line with the requirements of the
organisation's quality assurance system. Ensure that records meet requirements
for making assessment judgements, giving meaningful feedback, supporting
internal and external moderation, and addressing possible appeals
Conduct assessments
The ability to make assessment judgements using diverse sources of evidence must
be demonstrated. Assessments to include cases where candidates have special
needs and where evidence arises through RPL situations. Should it not be feasible to
gather evidence for assessments of special need candidates or in RPL situations,
evidence may be produced through scenarios.
Candidate-assessors must show they can make judgements in situations where:
Candidates meet all criteria for a particular outcome,
Candidates clearly do not meet the criteria for a particular outcome,
Candidates meet some, but not all criteria, and
More evidence is required in order to make a judgement of competence
At this stage the learner and the assessor should be ready to conduct the
assessment:
Assessment practices
Here we will discuss the practices that should be associated with assessment to
ensure that what we do is in line with quality assurance requirements, recognised
codes of practice and learning-site or work-site standard operating procedures.
The assessment The assessment measures what it says it is measuring.
practices are valid Assessment activities and instruments test skills that match the
outcomes to be assessed.
Types of assessment instruments used (interview, written
test etc.) are appropriate.
The subject matter assessed relates to the relevant unit
standards.
Skills assessed relate to the relevant unit standards.
These uses of assessment in support of access also address certain redress issues,
as often learners from formerly disadvantaged backgrounds have little or no formal
recognition of their achievements, and also have lower achievement levels through
no fault of their own. In other words, they could be capable and hard-working, but
through having received poor quality teaching backed by few resources they have
not realised their potential.
This leads naturally to another key principle, that of flexibility. Providers can
promote access and redress by adopting the principle of flexibility, which might be
implemented in many ways, including:
Offering programmes in a modular form and making provision for learners to
be exempted from certain modules through an RPL process, and operating a
cost formula which allows exemption from the costs of the identified modules;
Offering different versions of the same learning programmes, some
accelerated, some slower and containing enrichment and bridging materials,
addressing the needs of certain groups of learners;
Relaxing any entry requirements and rather assessing potential learners in
relation to placement, bridging and gap-fill options to make the programme
more accessible;
Carrying out needs analyses with relevant communities and stakeholders,
and offering programmes in response to identified needs, areas of growth,
and in line with the Sector Skill Plan
Seeking funding from interested parties to subsidise learners and RPL
candidates from previously disadvantaged communities.
Quality assurance
Quality assurance of assessment is governed by four main activities (documents),
namely:
The Feedback report
Providing an appeals application to candidates who wish to appeal
Assessment review
Moderation report
Time given for gathering and presentation of evidence (whether in one sitting
or over time) must be sufficient to allow an average learner to demonstrate
competence.
There must be a relationship between course methodology and content and
the assessment (not applicable to RPL systems).
Grading design (assessment criteria, issues of weighting, format for
judgements, etc.) must be done concurrently with instrument design, and
must be compatible with the instrument. (“Grading refers to the act of making
a final judgement in an assessment event.)
Assessment design must include the development of an assessment guide
laying out details and instructions for the assessment activity. Explicit grading
instructions must be developed (for marking, recording on observation sheets,
or evaluating a product such as a lesson plan or training event, etc).
The design must make provision for special needs without compromising the
validity of the assessment.
The assessment must be implementable within any reasonable site costs and
time requirements.
The assessment process begins with getting to know the unit standard or
qualification. The assessor needs to consider what is contained in the different
components of a unit standard or qualification. On the basis of this knowledge and
understanding, the assessor then decides whether to design a task/tasks that require
observation, written tests and/or questioning. The situations or contexts for
performance would also be prepared for at this stage. Appropriate instruments such
as checklists indicating the complexity and quality of the performance (i.e. criteria)
should be designed.
Where the outcome describes practical competence then it is likely that observation
and/or evaluation of a product may be appropriate. This could be combined with
questioning to ascertain elements such as underpinning knowledge and
understanding and the ability to adapt to change and unforeseen circumstances, and
reasons for such adaptation. The appropriate instruments could be a practical
exercise, and/or submission of a product and a written or oral test to cover the range
statement which could include underpinning knowledge and understanding, other
contexts not covered by the practical exercise, integration of other abilities that
should be in place, etc.
Having decided on the methods and instruments, the assessor would then develop
the appropriate assessment materials. If the method chosen were written
assessment, then the material would be the question paper and checklist. Likewise, if
the chosen method were a practical exercise and questioning then the material would
be a practical task and questioning.
The assessor needs to make sure that all the relevant documents are ready such as:
Assessment tool
Assessment checklist
Questions and memorandum
The assessment tool should be in line with the principles of assessment which are:
Assesses what it claims to assess in terms of method, evidence
Validity
collected (authentic and current)
Is in line with other assessments conducted by the same and other
Reliability assessors in relation to the same unit standard /qualification. (It is about
consistency)
Assessment is effective and feasible without causing unreasonable
Practicality
demand to all role-players
Fair Assessment does not in any way hinder or advantage a candidate
Authenticity Assessment should make judgment against the individual's own work
Credibility This is the end result of fairness, validity, reliability and practicability
Assessment methods: This refers to how one assesses the outcome such as orally,
written activity, or demonstration. Assessment methods go hand in hand with the
assessment instruments and the type of evidence required as shown below:
Assessment
Assessment tool Evidence type Assessment record
method
Instructions to What the candidate What candidates Ways of recording
learners /assessors is asked to do and produce as evidence the level of
how the same will be performance for a
assessed candidate
e.g.: written task e.g. written e.g. written report e.g. recording forms
instruction assessments such as
test
used for diagnostic and remedial purposes, and can be used to build up and document
a candidate profile over time in order to feed into summative results linked to the award
of credit.
The main purpose of formative assessment is to support learning, and it can be
described as developmental. Good practice in formative assessment is guided by
the principles of good assessment.
Here is a summary of some key characteristics of good formative assessment:
Assessment must be clearly linked to critical and specific outcomes.
Assessment must be designed to reflect the importance of critical
outcomes and of demonstrating applied competence.
Learners are clearly informed about how, when, where and by whom they
will be assessed in an assessment plan explained to, and signed by each
candidate at the beginning of the programme.
Assessment should not be an ‘add-on’ to teaching and learning, but
should be integrated into learning activities and used to identify learning
needs and give feedback and support to learners.
A variety of assessment methods and techniques should be used.
Assessment should be contextualised where possible.
Learners should take an active role in assessment, helping formulate
task-specific criteria and engaging in self and peer assessment.
Assessment should be sensitive to gender, race, language and cultural
issues.
Provision should be made for learners with special needs.
Moderation procedures must form part of an assessment system in order
to assure quality.
The assessment
The assessment must now be carried out according to the assessment plan in
accordance with the assessment guide. The assessment guide could be in the form
of a Learner Workbook – where the learner and assessor are guided through the
process of assessment.
The assessor has met the learner at the pre-assessment meeting and the learner is
fully aware of what is to be assessed.
It must be noted that the assessor must be familiar with the course material and this
should also be available at the assessment meeting.
The Unit Standard which is to be assessed must be available for referral.
In the assessment plan it must be noted what questions will be asked – what
methods are to be used in assessment and what principles to follow during the
assessment meeting.
Questioning techniques
You need to use questioning techniques that are appropriate and have the potential
to successfully elicit appropriate responses.
A critical role of the assessor is to ask questions that provide evidence of the
learner's competence. The way questions are phrased and the tone of voice in which
they are asked can significantly affect the response and the degree of comfort the
learner has in answering them. Questions need to be clear and specifically relate to
the assessment topic. Carefully phrased questions encourage discussion. Questions
not so carefully phrased may intimidate the learner.
The principles of assessment should be kept in mind when deciding to use a
particular instrument, i.e. the assessment instrument should ensure fairness, should
be reliable, valid and practical.
There are two important types of questions:
1. Closed questions require a "yes" or "no" response, or a short answer:
"Are you able to operate the scanner?"
"Can you tell me the name of the payroll supervisor?"
"Do you know how to use the POS system?"
Learners need to feel comfortable with questioning. Often it can have a positive effect
when the learner has the opportunity to discuss what s/he knows. It is important that
questions are clear, so the learner is not confused about what answer is required.
The following list shows some of the different types of questions that can be used:
Assertion/reason questions
Consist of an assertion and supporting explanation.
The learner has to decide whether the assertion and explanation are true, and
if true, whether the explanation is a valid reason for the assertion. Sometimes
the learner is asked to select his/her answer from a list of possibilities, e.g.
True; True + Valid; True + Invalid.
Possible uses: Ability to weigh up options and to discriminate
Aural/oral tests
These are mainly used to generate evidence on learners’ ability to listen,
interpret, communicate ideas and sustain a conversation in the language of
assessment.
Possible uses: Interpretation of ideas.
Expression of ideas
Examinations/tests
These usually consist of a range of questions. Learners are required to
respond to questions within a specified time.
Possible uses: Recall of information
Cognitive skills such as problem solving or analyses
answers (as in short answer questions, etc.) and the assessor has to exercise
his/her professional judgment when interpreting learner’s responses.
Possible uses: Allows for self-expression when questions are oral
Supports observation of tasks where underpinning
knowledge and understanding are tested
Personal interviews
A personal interview is probably the oldest and best-known means of eliciting
information directly from learners. It combines two assessment methods,
namely observation and questioning. An interview is a dialogue between the
assessor and the learner, creating opportunities for learner questions.
Possible uses: A range of applications using different forms of
questions, particularly open-ended questions
Guidance and support to the learner
Questionnaires
A questionnaire is a structured written interview consisting of a set of
questions relating to particular areas of performance. Unlike a personal
interview, it is administered and judged under standard conditions.
Possible uses: Assessment of outcomes particularly concerned with
attitudes, feelings, interests and experiences
Structured questions
A structured question consists of a stem (which describes a situation),
followed by a series of related questions. The stem can be text, a diagram, a
picture, a video, etc.
Possible uses: Recall of information
Application of knowledge and understanding
Analyses
Debates
Arguments
Note:
Try not to ask questions one after the other, as it can sound like an interrogation.
Pace your questions and ask them at appropriate times.
Listening
The other side of questioning and speaking is listening, another important skill for an
assessor. Active listening is the key to showing that you are genuinely interested in
what the learner is saying. Your response to a comment or question from a learner
can have immediate positive or negative effects on that person. For example, raising
your eyebrows or sighing loudly at an inappropriate time can distract or even distress
the learner and impact negatively on their assessment.
Always give the learner the opportunity to elaborate on points they have made. Be
prepared to rephrase questions and provide examples if necessary to help them
understand. Finish the assessment with an open-ended question like:
"I'd like to give you the opportunity to tell me if I've overlooked anything?"
Rules of evidence
When assessing the learner’s evidence, the assessor needs to ensure that the
evidence is: (VACCS/VARCS)
Valid – meet the specific outcomes and its related assessment criteria i.e. fit
for purpose
Authentic – created by the learner
Consistent/Reliable – the evidence will give the same results about the
learner’s competence either by different Assessors or over a period of time
Current - the evidence applies to the latest version of the standard or reflect
current practises
Sufficient – evidence covers all the specific outcomes and criteria and the
learner can demonstrate competency at an acceptable level
Types of evidence
The best type of evidence is that which can be observed directly by the Assessor.
This means that evidence must be collected from activities that are as similar as
possible to actual conditions. However, there are other types of evidence that are
also valid if checked and verified. There are three main types of evidence:
Direct evidence
Direct evidence is actual evidence produced by the learner. This is the most
valid type of evidence. Direct evidence also easily establishes authenticity.
This should be the Assessor’s primary source of evidence.
Sources of direct evidence include:
o Direct observation of tasks, activities, etc
o Questioning i.e. written / oral
o Product and output evaluation
It may be necessary to verify evidence, for example, a written assignment or
product to ensure that it is the learner’s own work
Indirect evidence
Indirect evidence is evidence produced about the learner from another
source. This usually in the form of reports of third party sources i.e. sources
other than that of the Assessor. Indirect evidence can be used to verify the
authenticity of other forms of evidence. In addition it may be necessary to
corroborate these forms of evidence
Sources of indirect evidence include:
o Team outputs
o Work completed at an earlier stage
o Performance appraisal
o Training records
o Testimonials
o Reviews and commendations
o Certificates and qualifications
o Medals, prices and trophies
o Customer / client ratings
Historical Evidence
This type of evidence tells the Assessor what the learner was capable of doing in
the past. It is the least valid form of evidence because it does not necessarily
prove current competence. Historical evidence usually needs to be checked for
authenticity. The Assessor should guard against discrepancies regarding this kind
of evidence, but it is still a useful supplement to the assessment process, more
especially for Recognition of Prior Learning.
Some examples of historical evidence are:
o Projects and Portfolios
o Video/audio taped performance/ photographs
o Document competed by the learner
o Performance appraisal
o Training records
o Testimonials
o Review and commendations
o Certificates and qualification
o Medals, prices and trophies
o Customer or client ratings
Example of evidence
Product Process
Tests can be short or long answers. They can be ticking a response, matching, multiple
choice or essay type responses. They relate to what the key focus of the test is to be:
the ability to write a response; or
the actual knowledge itself, whether comprehension; or
recall; or
problem solving
Oral tests of Q&As are used to identify listening, interpreting, analytical and communication
skills.
Observation is used to identify the learner's ability to perform under a specific set of
circumstances, which usually relates to a workplace situation. A valid way of assessing
performance using this method is to use checklists or logs as a validation.
Role-plays There are some occasions when it is inappropriate for direct observation or
direct contact to be used. In this case a useful alternative is a role-play or simulation of the
workplace scenario. This needs to closely mirror the real world circumstance as far as
possible. Another version of this is the use of case studies where the learner is asked to
respond to a particular workplace situation presented usually in a written form.
Reports are useful as assessment tools because they can be used in either on or off job
circumstances and are not dissimilar to the situations in the workplace. They require the
application of knowledge in a specific context and are usually required to show some
analysis or application of theory.
Portfolios are useful for gathering material relating to performance criteria over an
extended period of time and may include different types of evidence:
direct
indirect; and
supplementary
For each of these methods, the assessor has responsibility to ensure that the learner
understands exactly what is required, both in terms of the actual format or
presentation and in terms of how much is required.
The following general guidelines should help you decide if the evidence is sufficient:
1. The candidate must show competence in executing the specific outcomes and
critical cross-field outcomes of the unit standard and the unit standards of a
qualification.
2. The candidate must meet the requirements of the assessment criteria linked to
each specific outcome. This can be rather subjective, so that the assessor might
need to motivate his or her judgement of “meeting the requirements” or not. That
is why it is important to keep evidence of assessment for a reasonable period of
time, at least until after verification and until the candidate had reasonable time to
appeal against the results of the assessment, should he or she wish to appeal.
3. The candidate must show an understanding of the essential embedded
knowledge that forms part of the unit standard. Rote learning is seldom
necessary, but the candidate must demonstrate the ability to find and use
theoretical knowledge. This can often be achieved by means of an open-book
theoretical examination.
Functional: The assessment must be easy to administer and mark. Here are
a few guidelines in this regard:
Arrange assessment from easy to difficult
Make sure the layout of the assessment is used consistently
throughout the assessment.
Group all the items of the same type.
Provide clear concise directions to learners and the people who must
administer it.
Judgment of Evidence
Evidence is judged by you, the assessor, on the basis of evidence provided by the
candidate as being Valid, Authentic, Sufficient and Current.
Let us now look at how to process the evidence provided by candidates to enable,
valid, consistent, reliable and fair assessment practises.
Sufficiency
There is quite some disagreement between providers of learning and assessment
about exactly how much evidence is required to justify finding a candidate
competent. To some extent this will depend on the assessment method used.
However, the following general guidelines should help you decide if the evidence is
sufficient:
The candidate must show competence in executing the specific outcomes
and critical cross-field outcomes of the unit standard and the unit standards of
a qualification.
The candidate must meet the requirements of the assessment criteria linked
to each specific outcome. This can be rather subjective, so that the assessor
might need to motivate his or her judgement of “meeting the requirements” or
not. That is why it is important to keep evidence of assessment for a
reasonable period of time, at least until after verification and until the
candidate had reasonable time to appeal against the results of the
assessment, should s/he wish to appeal.
The candidate must show an understanding of the essential embedded
knowledge that forms part of the unit standard. Rote learning is seldom
necessary, but the candidate must demonstrate the ability to find and use
theoretical knowledge. This can often be achieved by means of an open-book
theoretical examination.
At least two different assessment instruments should be used, so that a
measure of corroboration can be achieved. The principle of triangulation is,
however, always a safe one – three assessment instruments are used.
The candidate must demonstrate added value in a workplace setting that is
relevant to his or her newly-acquired skills. A workplace setting can, of
course, also be simulated.
The candidate must show competence at the level of the unit standard and,
ultimately the level of the qualification or learning programme.
The usual way of reporting the results of assessment in the context of industry/work
has been: Competent/Not yet Competent. This makes sense because so many of
the requirements are absolute. No-one wants a surgeon who understands and
applies 60% of the requirements for operating on a patient. Minimum requirements
are spelt out and each one must be met. The significance of recording ‘Not yet
Competent’ rather than ‘Not Competent’ is to indicate that the need for lifelong
learning is recognised, and learners may have opportunities to work at improving
performance until they are ready to be re-assessed and hopefully found competent at
a later stage.
The assessment result is quite correctly either competent or not yet competent, and
might be reported something like this:
Evidence meets
Did the learner demonstrate VARCCS
Reference Assessor Comments requirements
Yes/No
the following: C NYC
UNIT STANDARD SPECIFIC OUTCOMES AND ASSESSMENT CRITERIA
Unit Standard Range
The typical scope of this unit standard is
The effect of HIV/AIDS on the individual, the workplace and society.
The effect of the HIV/AIDS pandemic on the economy, a sub-sector, and organisation and a specific workplace.
Specific Outcome 1
Know and understand HIV/AIDS and its effects on the human immune system
1. Learner Workbook Assessor writes relevant Y
Class Activity 1 comments here
The terms HIV and AIDS are Learner PoE Guide
known and explained at a basic Practical Activity 1
level of understanding Summative Project
2. Learner Workbook Assessor writes relevant Y
Class Activity 1 comments here
The way in which the immune Learner PoE Guide
system works is explained with Practical Activity 1
reference to the role of Summative Project
antibodies in the immune system
Moderation
The assessor should submit the following documents to the moderator:
All the marked scripts of a particular course.
A copy of the original questions.
His/her report on the outcome, if available.
A list of all the outcomes (e.g. specific outcomes, learning outcomes, critical
cross-field outcomes) covered by the examination (e.g. in the form of a
curriculum or unit standard).
A detailed memorandum (model answer) that indicates the solution/correct
answer to each question, an indication of the marks allotted to each question
and a clear explanation of the way the scripts were marked and scored.
Reporting procedures
Learning and/or assessment providers should have specific rules on how, when and
by whom assessment results may be communicated and who may receive such
information. The following are some options of how one can communicate
assessment results:
Candidates can normally obtain official results from the learning or
assessment provider’s administration office.
A specific person should be appointed and authorised to inform learners of
official results.
Results can also be communicated to learners via the Internet, provided that
each learner has exclusive access to his or her results, e.g. by means of a
personal identification number.
A cut-off period should be specified when results will be available, e.g. not
later than one week after the assessment.
Special certificate and diploma awarding ceremonies may be arranged for the
awarding of full qualifications and verifier-endorsed unit standard-based
courses.
Rubrics and grades are often used in the education sector, and they are perfectly
acceptable in an OBET system.
In fact, in some contexts the level of achievement can best be described in relation to
rubrics. A rubric is used when it is important to distinguish different levels of
performance, but relate these to clear assessment criteria rather than by giving a
mark or a percentage. A percentage or mark is usually reached by using assessment
criteria, but, unfortunately, different assessors can award different marks or
percentages to the same piece of work.
Source: faeriekeeper.net
reasoning behind the assessment judgement are available for scrutiny by the
moderator and verifier. It expects providers to have in place an assessment
management system that ensures moderation is properly conducted and that
verifiers have access to evidence of candidate achievement and moderation reports.
3.6 Ensure that records of the assessment are in line with the quality
assurance system.
You need to ensure that records of the assessment are in line with the requirements
of the organisation's quality assurance system.
Your assessment records need to meet requirements for:
making assessment judgements,
giving meaningful feedback,
supporting internal and external moderation, and
addressing possible appeals
Recording and reporting in an effective way is the key to good assessment, and to the
smooth implementation of skills programmes, learnerships, and other qualifications. All
assessment evidence and results for individual learners must be recorded and stored
in a secure place, to ensure availability in case of appeals, re-assessments and for
verification purposes.
Data capture systems must be suitable for processing and recording results and
submission of results to the ETDQA in the required format. These are in line with the
requirements of SAQA’s National Learner Records Data-base (NLRD), and make it
possible to upload learner achievements and other information to the central NLRD.
The ETDQA suggests that providers consider the following elements for a recording
and reporting system:
An internal candidate record per candidate: every provider must keep
learning records for each individual, capturing registration information and
personal details. The provider will have submitted the ETQA Learner
Registration Form to the ETQA at the beginning of the programme or RPL
process.
A candidate assessment record: every candidate will have his/her own
assessment record, which records assessment results and achievements of unit
standards throughout the course. The design of this form could vary: its purpose
is to record competency judgements against unit standards, and it should
include any reporting and observation tools and forms signed off by an
assessor. It does not include the direct evidence generated by a candidate (e.g.
observation records, assignments, etc.) as these will go into a candidate’s
portfolio of evidence (see below). When all necessary requirements have been
met and the candidate has been assessed as competent, the ETQA
Submission of Learner Results will be submitted on the required form. This
will trigger the necessary verification processes. The ETQA will then upload the
information to SAQA so that the learners’ achievements are recorded on the
NLRD. This form is provided in the ETQA file. This form is provided in the ETQA
file and is also now available electronically.
A portfolio of evidence (PoE): this is the file in which all assessment evidence
(e.g. assignments, third party evidence, performance reports, tests and
Assessor Checklist
Assessment Principles Yes No Comment / Evidence
Fair
1. All learners understand the assessment
procedures and the criteria on which
performance will be judged.
2. Barriers to learning or special needs are
considered during assessments.
3. Assessment adjustments for barriers to learning
do not provide the learner with an unfair
advantage and/or influence the reliability and
validity of the assessment.
4. Establishing procedures for appropriate re-
assessment opportunities and appeals, if
required.
5. Procedures are in place where learners provide
feedback on the assessment process and can
challenge the assessment if necessary, i.e. the
appeals process.
6. Sample group on which the assessment is
piloted is representative of learners of all races,
gender, social and cultural backgrounds.
7. Assessment process is as transparent as
possible. Transparency is obtained through
effective communication with learners who are
being assessed.
8. Avoiding the comparison of one learner’s work
with another learner’s work (norm-referencing).
9. An assessment guide based on the unit standard
/ qualification assessed is well planned and used
when conducting an assessment.
Examinations / test
Extended response questions
Grid questions
Logbooks
Matching questions
Multiple choice questions X
Oral questions X X X
Personal interviews
Practical exercise / demonstration X X
Portfolios X
Projects
Questionnaires X X
Restricted response questions
Role-plays X
Simulations
Short answer questions X X
Structured questions X X
Written Assessments
What types of evidence have been collected (used)? PER UNIT STANDARD
Examples Types of Evidence:
Direct Indirect Historical
Certificates & Qualifications
Completed work (product) X
Customer / client ratings
Direct observation of tasks, activities, etc X X
Documentary evidence completed by learner
Medals, prizes & trophies
Performance appraisals
Product & output evaluation
Projects & portfolios X X
Questioning, i.e. oral, written X X
Reviews & commendations
Team outputs
Testimonials X X
Training records
Video / photo / audio-taped performance
Work completed at an earlier stage
Please ensure that the Assessment Guide is available and reflects at least the
CHECK
following documented evidence:
Candidate Information X
Unit Standard ID no, course name, etc. X
Candidate request / acknowledgement of assessment X
Relevant role player’s acknowledgement of assessment X
Candidate Declaration of Authenticity X
Pre-Assessment briefing and signed agreements (inclusive of Appeals Process) X
Assessment (Foundational, Reflective, Practical competence) X
Assessment Plan ( according to ETQA Guidelines) X
Assessment instruments and tools X
Formative Assessments record of results X
Post-Assessment feedback (competent or non-competence guidance) X
Declaration of Competence X
Provision for proper recording of evidence gathered X
Provision for candidate’s feedback X
Provision for Moderation comments and signature X
Availability of candidate’s Journal / Logbook N/A
Availability of Workplace Training Program including Mentor signatures if N/A
Learnership
Review / changes made to assessment plan/s N/A
Module 4
Provide feedback on assessments
After completing this module, the learner will be able to provide feedback on
assessments, by successfully completing the following:
The assessor needs to portray professionalism, accuracy and not be biased when
giving the assessment feedback to the learner.
The organisational code of conduct comes into play as this process includes factors
such as:
Confidentiality
Privacy
The feedback can only be given to the learner and other parties as outlined in the
organisational policy.
Feedback to learners can take place verbally or in writing, however learners must
always sign off a document confirming that feedback was provided.
The assessor has to decide when to say that the learner has given enough evidence
of appropriate quality to confirm that s/he is capable of performing the outcome/s
consistently and to the required standard.
Sufficient evidence can include evidence generated over time, to enable valid,
consistent and fair assessment judgements to be made.
This judgement is made against the outcomes and assessment criteria in the unit
standards and evidence guides, taking the range (scope, context, underpinning
knowledge and any other relevant information) into account.
Supplementary evidence may be used when necessary, for example results of
formative assessment, class participation, etc.
The assessor decides on the competence of the learner once sufficient evidence has
been collected. The ability to make assessment judgments must be demonstrated
using diverse sources of evidence and in situations where:
special needs of candidates need to be considered
candidates meet all criteria
candidates clearly do not meet the criteria
candidates meet some, but not all criteria, and more evidence is required in
order to make a judgment.
Example:
"The first 3 steps were exactly according to the performance criteria, as were the
5th and 6th steps. It is only the 4th step that you need to practice.
You have demonstrated you understand the theory, it is only where you are
required to actually change the cash register rolls and complete the Point of Sale
paperwork that you need to demonstrate to me again. Some more practice will do
the trick.
Why don't we meet again here, next Tuesday (I'll arrange it) and you can have
another go. I think that's probably all it will take. Try to fit in some more practice
between now and then".
In the event that the learner has not achieved competency the assessor should
reinforce the need for:
The quality and type of evidence can be assessed in terms of the assessment
outcomes, against all the assessment criteria in the relevant unit standard or
qualifications. Assessment judgments are always justified by the quality and
sufficiency of the evidence. Judgments should be substantiated in terms of the
consistency and repeatability of the candidate’s performance and evidence from
various sources and time periods
The learner has to be informed what was correctly done and achieved, and if
necessary, what was not correctly done and achieved.
The learner should be told that s/he has been deemed competent or not yet
competent.
In formative assessment the learner should be told what his/her strengths and
weaknesses are, why s/he has the strengths and weaknesses, and what s/he needs
to do to deal with the weaknesses.
In summative assessment the learner has to be informed that s/he is competent or
not and why. If judged not competent s/he should be told what steps could be taken
to get him/her to competency.
Not all learners going through the same learning programme will reach competency
at the same time and the assessors should keep this in mind. Furthermore, some
learners may never be able to achieve competence based on a number of factors
and the reasons for this have to be explained to them and advice given of other
avenues which may be available; e.g., changing to other learning programmes.
Beware of:
Identifying with the learner.
Being influenced by the learner’s past performance.
Making assumptions, or being discriminating.
Being overly influenced by one particular thing the learner does, especially if it
happens early on in the process.
Confidentiality requirements
It is in the interest of the provider to treat the assessment results of every learner
as confidential. Only those who are entitled to be informed should be informed. Of
course, the person who is most entitled to the results is the particular candidate.
The facilitator, assessor, moderator and administrative person responsible for
processing and filing assessment results will inevitably also know what the results
were. They are also the people who must secure the information from those who
are not entitled to it.
A second element of confidentiality is that assessment results should not be made
available before moderation was done, since the moderator might change the
assessor’s recommendations. This is not always possible, since candidates are
always impatient to know the results. It is important to inform the candidates that
the results are still subject to moderation if this is the case.
Feedback should focus on the quality and sufficiency of the candidate’s performance
in relation to the agreed outcomes and criteria. The type of feedback and manner of
giving feedback should be constructive and related to the relevant party’s needs.
Sufficient information must be provided to enable the purpose of the assessment to
be met, and to enable parties to make further decisions. (Further decisions include
awarding of credits and redirecting candidates to alternative learning or re-
assessment.)
Feedback processes and models should be described in terms of the potential
impact on candidates and further learning and assessment.
The assessor must be objective and fair. Agreements reached and key elements of
the feedback must be recorded in line with the organisational quality assurance
system.
Qualities of Feedback
It is a two way process (there is communication between the learner and the
Assessor)
It is constructive and developmental
It is given as soon as the Assessor has evaluated evidence
The Assessor and the learner should identify weaknesses
It is handled confidentially
The Assessor and the learner agree on an action plan for further development
or re-assessment process
The learner should be told what steps s/he can take to close gaps
Close the session with motivating comments or suggestions
The summative assessment results should not be the end of the road for most
learners. It is the responsibility of the learning provider, facilitator and/or assessor to
motivate learners to continue learning. The following will typically happen after
assessment and the completion of a particular learning intervention, be it a unit
standard-based course, learnership, learning programme or national qualification.
Awarding of credits. Credits can only be awarded once the verifier or
verifiers endorsed the decision of the moderator. Awarding of credits is done
by reading the successful candidate’s credits into the National Learner
Record Database (NLRD). The learning provider forwards the results to the
ETQA, where the person responsible will read the credits into the NLRD.
Redirecting candidates for further learning. In a strategy of lifelong
learning, successful candidates should be urged to enrol for learning on a
higher level or the same level, perhaps in a different field. This also applies to
unsuccessful candidates, since they will often perform better in a different
field of learning or at a lower level.
Unit Standard(s)
Assessor
Learner
Date
Venue
Review Dimensions Agree Disagree
1. The principles / criteria for good assessment were achieved
4. The assessment was time efficient and cost effective and did not
interfere with the normal responsibilities of the learner
11. Did you find any parts of the Assessment Guide particularly helpful?
12. Did you find any parts of the Assessment Guide particularly awkward or difficult to understand?
Internal moderator.
Education and Training Committee.
Top management for final decision.
The assessment process has to have built in a process for reassessment. When a
learner has to undergo reassessment they have to be given feedback so as to
concentrate on areas of weakness. Ideally continuously conducting formative
assessment should minimise the need for reassessment as the assessor and learner
will decide on carrying out summative assessment when both have agreed that the
learner is ready for it. Reassessment should comply with the following conditions:
(SAQA Guidelines, 1999: 29.)
The reassessment should take place in the same situation or context and
under the same conditions.
The same method and instrument may be used, but, the task and materials
should be different – the task and materials should, however, be of the same
complexity and level as the previous ones – in case the methods and
instruments are changed it must be ensured that they are appropriate for the
outcomes specified.
Care should be taken regarding how often reassessment can be taken and the length
of time between the original assessment and the reassessment. Limits should be set
to the number of times a learner can undergo reassessment and for the length of
time between assessments. A learner who is repeatedly unsuccessful should be
given guidance on other possible and more suitable learning avenues.
There should be appeals procedures in place. The learners should have the security
of knowing that in the case of unfairness, invalidity, unreliability, impracticability,
inadequacy of expertise and experience, and unethical practices they are able to
appeal. (SAQA Guidelines, 1999: 29.):
Appeals are normally lodged in writing and the merits of all appeals must be
investigated.
A learning or assessment provider must have a clear and fair appeals
procedure and this must be brought to the attention of all learners.
An appeal against an assessment decision or the manner in which the
assessment was conducted may be lodged by any of the role players in the
assessment process.
Unit Standard(s)
Assessor name
Moderator name
Date
Venue
7. Special needs of the learner were identified and the assessment plan was Agree Agree
adjusted (if required) Disagree Disagree
Agree Agree
8. Feedback to the learner was constructive against the evidence required Disagree Disagree
9. The learner was made aware of the opportunity to appeal against the Agree Agree
outcome of the assessment Disagree Disagree
Agree Agree
10. The evidence was recorded in the assessment process Disagree Disagree
11. Did you find any problems with the assessment instruments and assessment guide that you have used in
this assessment? Please provide recommendations.
12. Did you find any problems with regards to the performance of the learners from the same organisation in
this assessment?
Module 5
Review assessments
After completing this module, the learner will be able to review assessments, by
successfully completing the following:
Ensure that the review identifies strengths and weaknesses in the instruments
and process, and record these for incorporation in assessment redesign
Analyse feedback from relevant parties and use it to influence future
assessments positively
Identify weaknesses in the assessment design and process that could have
compromised the fairness of assessment and deal with it according to the
organisation's assessment policy
Identify weaknesses in the assessment arising from poorly defined outcomes and
criteria, and take effective steps to inform relevant bodies
Review assessments
A final but extremely important part of the assessment process is the review and
evaluation of the assessment policies, strategies, methods and activities.
What do you look at when you review the Assessment Process and Design?
Good and bad practices in Assessment design and process
Recommendations for improvements
Feedback given by the parties who were involved in the process. For
example, the assessor should read the comments made by the learners and
other parties about the whole process when they do evaluation that could
assist him/her to identify the weaknesses and strengths.
Credibility of assessment
Quality of the unit standard
Using Self-Assessment
It is important to be honest and objective in this step. Review the entire assessment
process and ask yourself:
How do you feel it went?
Were there problems with any part of the assessment process?
Was the communication between assessor and learner positive?
How was the feedback process handled?
What could you do differently?
Are there any other problems/concerns?
The assessment process should be reviewed every time the instruments were used.
The moderator would have evaluated the assessment instrument before it was used,
but even this does not mean that the instrument will be perfect. Using the instruments
is probably the best acid test for any assessment instrument. The following is a list of
items that should be reviewed:
Was the assessment instrument designed in accordance with the quality
assurance policy?
Are instructions to the learners clear and unambiguous?
Was the assessment instrument sufficient to protect the integrity of standards
and qualifications?
Is each assessment task clearly described and outlined?
Is the purpose of each task clear and clearly linked to the purpose of the
learning programme?
Are the tasks relevant to the candidate’s context?
Are the assessment methods and tasks fit for purpose?
Is the evidence collection integrated into the workplace where appropriate?
Was the choice and design of assessment methods and instruments
appropriate to the unit standards and qualifications being assessed?
Is the assessment instrument consistent, accurate and well designed?
Does the assessment instrument make provision for reassessment?
Will it be necessary to redesign the assessment instrument?
Has the memorandum been prepared according to the quality assurance
policy?
If annotated drawings are required, do complete drawings with annotations
appear in the memorandum?
Is the design of the assessment instrument linked to an assessment strategy?
(Environmental analysis to find the best assessment opportunities and
approach.)
Is the grading design compatible with the assessment instrument?
(assessment criteria, weighting, format for judgements, etc.)
Is the assessment instrument feasible within any reasonable site costs and
time requirements?
Are marks for sections and subsections shown clearly?
Did the assessment instrument make provision for special needs without
compromising the validity of the assessment?
Does the assessment instrument endeavour to determine the attitude of the
learner towards his or her vocation as well as his or her sense of
responsibility towards his or her vocation?
Was the assessment instrument career- and practice-oriented?
Are critical cross-field outcomes also assessed?
Does the recording format clearly state criteria and evidence requirements?
Does the recording format allow for third party testimony/witness statement?
(Especially relevant to RPL.)
Does the recording format allow for levels of performance to be recorded?
Does the recording format enable accurate recording of administrative
information?
Assessment team
These can include the facilitator (training personnel), the moderator and the
verifier
The assessor needs to have the meeting with this team and discuss both the
strengths and the weaknesses of the assessment.
This is also the time when the assessor shares any challenges s/he had during
the assessment process and how s/he handled those challenges.
The team is also expected to give formal inputs which are recorded and utilised in
conducting the future assessment.
You also need to evaluate your own role during the process of conducting the
assessment. The common questions for an assessor to ask revolve around the
principles of good assessment:
Was the process fair, valid, reliable and practical?
Was the assessment method fair, valid, reliable and practical?
Did the learner understand the feedback and was s/he given an opportunity to
ask questions on the results?
Reflection
Individually, complete the formative activity in your Learner Workbook
Glossary
Accreditation The certification, usually for a particular period of time, of a person, a body or an
institution as having the capacity to fulfil a particular function within the quality
assurance system set up by SAQA
Achievement Recognition granted to a learner when all required learning outcomes have been
successfully demonstrated
Applied The ability to put into practice in the relevant context the learning outcomes
competence acquired in obtaining a qualification
Assessment A process in which evidence is gathered and evaluated against agreed criteria in
order to make a judgement of competence for developmental and/or recognition
purposes.
The process of collecting evidence of learners’ work to measure and make
judgments about the achievement or non-achievement of specified National
Qualifications Framework standards or qualifications
Formative Assessment
Refers to assessment that takes place during the process of learning and
teaching.
Summative Assessment
Is assessment for making a judgement about achievement. This is carried out
when a learner is ready to be assessed at the end of a programme of learning
Assessment what a candidate does or is involved in as a means of producing evidence e.g.
activities designing things, making things, repairing things, reporting on something,
answering questions, solving problems, demonstrating techniques
Assessment descriptions of the required type and quality of evidence against which
criteria candidates are to be assessed
Assessment design The analysis of defined outcomes and criteria to produce a detailed description
of how an assessment should take place, including all instructions and
information regarding the assessment activities and assessment methods. The
product of assessment design could be termed an Assessment Guide
Assessment (or evidence facilitator) - a person who works within particular contexts, under
facilitator the supervision of registered assessors, to help candidates/learners gather,
produce and organise evidence for assessment
Assessment guide This is a complete package based on a thorough analysis of specified outcomes
and criteria, assessment requirements and a particular assessment context.
Assessment Guides are designed primarily for use by assessors to conduct an
assessment (or possibly a series of related assessments) in terms of a
significant and coherent outcome of learning e.g. a unit standard. Assessment
Guides address the following key aspects in detail:
How will the assessment take place?
What is needed to make the assessment happen?
How will evidence be gathered, recorded and judged?
In general, Assessment Guides include descriptions of the approach to the
assessment, assessment conditions, assessment activities, instructions to
assessors and candidates/learners, assessment methods, assessment
instruments (e.g. scenarios, role-plays, questions, tasks), resource
requirements, guidance for contextualising assessments, relevant standard
operating procedures, administrative procedures, moderation requirements,
assessment outcomes and criteria, observations sheets, checklists, possible or
required sources of evidence and guidance on expected quality of evidence
including exemplars, memoranda or rubrics
Assessment those items that an assessor uses or a candidate uses as part of the
instruments assessment e.g. scenarios with questions, case studies, description of tasks to
be performed, descriptions of role play situations
Assessment For the most part, assessment methods relate to what an assessor does to
method gather and evaluate evidence. Assessment methods include observing
candidates, questioning candidates, interviewing supervisors / colleagues /
managers of candidates, listening to candidates, reviewing written material,
testing products
Assessment plan This is produced at provider level, and gives an overview of the timeframes and
responsibilities for assessment and moderation for the agreed delivery period.
The plan addresses practical implementation details, including, for example,
decisions about the clustering of certain outcomes or unit standards/outcomes
for integrated assessment, any planned RPL, and the relation of assessment
and moderation to delivery of modules/ programmes in terms of timeframes
Assessment Methods of Assessment:
principles Appropriate: The method of assessment is suited to the outcome
being assessed i.e. is capable of gathering evidence in relation to the
intended outcome, and not something else.
Fair: The method of assessment does not present any barriers to
achievements, which are not related to the achievement of the outcome
at hand.
Manageable: The methods used make for easily arranged, cost-
effective assessments that do not unduly interfere with learning.
Integrated into work or learning: Evidence collection is integrated
into the work or learning process where this is appropriate and feasible.
(Often referred to as naturally occurring evidence).
Evidence:
Valid: The evidence focuses on the requirements laid down in the
relevant standard and matches the evidence requirements of the
outcome/s at hand under conditions that mirror the conditions of actual
performance as closely as possible
Current: The evidence is sufficient proof that the candidate is able to
perform the assessment outcomes at the time the assessor declares
the candidate competent.
Authentic: The assessor is satisfied that the evidence is attributable to
the person being assessed.
Sufficient: The evidence collected establishes that all criteria have
been met and that performance to the required standard can be
repeated consistently in the future i.e. the performance to standard is
not a "once-off".
Overall Assessment Process:
Systematic: The overall process ensures assessment is fair, effective,
repeatable and manageable.
Open: The process is transparent i.e. assessment candidates
understand the assessment process and the criteria that apply and can
contribute to the planning and accumulation of evidence.
Reliable/Consistent: The same assessor would make the same
judgement again in similar circumstances and judgements match
judgements made on similar evidence.
Assessor A person who is registered by the relevant ETQA body to measure the
achievement of specified National Qualifications Framework standards or
qualifications
Audit The process undertaken to measure the quality of products or services that
have already been made or delivered
Candidate A person whose performance is being assessed by the assessor
Candidate/learner Person whose performance is being assessed by an assessor. Such people
include those who may already be competent, but who seek assessment for
formal recognition (candidates), as well as those who may have completed or
are in the process of completing learning programmes (learners)
Candidate- the person who is being assessed against this particular unit standard in order
assessor to become competent as an assessor
Conditional The registration of a private higher education institution as specified in the
registration Higher Education Act, (No. 101 of 1997)
Constituent Belonging to the defined or delegated constituency of an organisation or body
referred to in the NSB and ETQA regulations
Core learning That compulsory learning required in situations contextually relevant to the
particular qualifications
Credit That value assigned by the Authority to ten (10) notional hours of learning
Critical Cross-Field Critical Cross-Field Outcomes refer to those generic outcomes that inform all
Outcomes teaching and learning. For example CCFOs may include working effectively with
others as a member of a team, and/or collecting, analysing, organising and
critically evaluating information
Education and Body accredited in terms of section 5 (1)(a)(ii) of the SAQA Act, responsible for
Training Quality monitoring and auditing achievements in terms of national standards or
Assurance Body qualifications, and to which specific functions relating to the monitoring and
auditing of national standards or qualifications have been assigned in terms of
section 5 (1)(b)(i) of the Act
Elective unit A selection of additional credits at the (level of the National Qualifications
standard Framework specified), from which a choice may be made to ensure that the
purpose of the qualification is achieved
Evaluative The ability to judge the quality of a performance in relation to specified criteria
expertise consistently, reliably and with insight. Evaluative expertise implies deep subject
matter understanding and knowledge about the outcomes being assessed at a
theoretical and practical level, but does not necessarily include practical ability in
the outcome
Evidence Tangible proof produced by or about individuals, that can be perceived with the
senses, bearing a direct relationship to defined outcomes and criteria, based on
which judgements are made concerning the competence of individuals.
Evidence includes plans, products, reports, answers to questions, testimonials,
certificates, descriptions of observed performances, peer review reports
Evidence facilitator see assessment facilitator
Exit Level The outcomes to be achieved by a qualifying learner at the point at which he or
Outcomes she leaves the programme leading to a qualification and achievement of which
entitles the learner to a qualification
External customer An external person, body or structure that is a beneficiary of the services or
product of a particular organisation.
Facilitator of An individual who facilitates learning processes and activities and manages and
learning and administers assessment: educator, teacher, trainer, mentor etc.
assessment or
Formative
Assessment
Field of learning A particular area of learning used as an organising mechanism for the NQF.
Fundamental That learning which forms the grounding or basis needed to undertake the
learning education, training or further learning required in the obtaining of a qualification
and ‘fundamental’ has a corresponding meaning
Grade 12 The highest grade in which education is provided by a school as defined in the
South African Schools Act, 1996
Higher Education All learning programmes leading to qualifications higher than grade 12 or its
and training equivalent in terms of the NQF, including tertiary education
Integrated That form of assessment which permits the learner to demonstrate applied
assessment competence and which uses a range of formative and summative assessment
methods
Internal Customer An internal person, body or structure that is a beneficiary of the service and/or
products of a particular organisation
Learner Any person receiving education and training (in terms of the ABET Act of 2000)
Learnership Refers to a learning programme where the learner spends some time learning
theory and some time learning practical skills in a workplace. It leads to a
qualification registered on the NQF
Learning A structured set of learning offerings and related assessment and attainment
Programme requirements
Level Descriptor That statement describing a particular level of the eight levels of the National
Qualifications Framework
Moderating Body A body specifically appointed by the Authority for the purpose of moderation
Moderation A process that supports and evaluates the assessment environment, process
and instruments with a view to confirming the reliability and authenticity of
required skills and knowledge, it could be recognised for credits. In this sense,
RPL is an important principle of the NQF. RPL involves an assessment process
of preparing for RPL, engaging with RPL candidates, gathering evidence,
evaluating and judging evidence in relation to defined criteria, giving feedback
and reporting results. Given that the all candidates are assessed against the
same criteria, credits awarded through RPL are therefore just as valid as credits
awarded through any other assessment process
Registered Officially registered (recorded) in terms of the National Qualifications Framework
Registration of Standards or qualification registered on the National Qualifications Framework.
standards and
qualifications
RPL See Recognition of Prior Learning
Sector A defined portion of social, commercial or educational activities used to
prescribe the boundaries of an Education and Training Quality Assurance body
(ETQA)
Sector Education A body responsible for the organisation of education and training programmes
and Training within a specific sector
Authority (SETA)
Site-Based An assessment undertaken in the workplace making use of naturally occurring
Assessment evidence
South African The body responsible for overseeing the development and implementation of
Qualifications the National Qualifications Framework, established in terms of the SAQA Act no.
Authority (SAQA) 58 of 1995
Specialised That specialised theoretical knowledge which underpins application in the area
learning of specialisation
Specific outcomes Knowledge, skills and values (demonstrated in context) which support one or
more critical outcomes
Standard The registered statements of desired education and training outcomes and their
associated assessment criteria
Standards A body registered in terms of the SAQA Act, responsible for establishing
Generating Body education and training standards or qualifications, and to which specific
(SGB) functions relating to the establishment of national standards and qualifications
have been assigned
Unit standard Registered statement of desired education and training outcomes and its
associated assessment criteria together with administrative and other
information as specified in the regulations
Verifier Those who operate at systems level to monitor assessment and moderation
practices, trends and results
Acronyms
CHE Council on Higher Education
DoE Department of Education
DoL Department of Labour
ETQA Education and Training Quality Assurance body
FET Further Education and Training
GET General Education and Training
HE Higher Education
NCS National Curriculum Statements
NPDE National Professional Diploma in Education
NQF National Qualifications Framework
NSB National Standards Body
SAQA South African Qualifications Authority
SETA Sector Education Training Authority
Appendix A:
Specific details of assessment against this unit standard
It is important to take note of the range statement provided by SAQA for this skills
programme and unit standard:
1. This generic assessment unit standard applies to assessment in all fields of
learning. However, it is expected that assessments will be contextualised to meet
the requirements of different contexts.
2. Assessment of candidate-assessors will only be valid for award of this unit
standard if the following requirements are met:
Assessments carried out by the candidate-assessor are in relation to
significant, meaningful and coherent outcome statements that include criteria
for assessment purposes, and allow for judgements of competence in line
with SAQA's definition of competence i.e. embrace foundational, practical and
reflexive dimensions of competence. Outcomes that are highly task-orientated
and do not demand much, if any, in the way of reflexive competence, will not
be sufficient for measuring competence as an assessor in terms of this unit
standard. It is important that candidate-assessors select outcomes that
enable them to meet the requirement laid out here.
The candidate-assessor demonstrates repeatability by carrying out at least
two assessments :
o One of which may be a simulated assessment (in order to cover a
range of typical assessment situations), and
o At least one of which must involve a real candidate in a real
assessment situation, preferably under the guidance of a mentor.
The assessments may involve two or more candidates in relation to the same
outcome.
o Candidate-assessors produce evidence that they can conduct
assessments in RPL situations and for candidates who may have fairly
recently acquired the necessary knowledge and skills through courses
or learning programmes. However, candidate assessors do not need
to carry out both kinds of assessments in practice for the award of this
unit standard. Should candidate-assessors carry out an RPL-related
assessment for the purposes of this unit standard, then it is sufficient
for them to show how they might have conducted the assessment
differently had it been an assessment linked to recent learning, and
vice versa.
3. For the purposes of assessment against this unit standard, candidate-assessors
should have access to Assessment Guides and will not be expected to design
assessments. Candidate assessors will be expected to interpret the standards at
hand in order to ensure their assessment judgements are in accordance with the
requirements of the standard. In cases where Assessment Guides are not
available, providers should seek ways to make such guides available for the
purposes of this assessment. Where candidate-assessor also intend to design
assessments, then providers are encouraged to integrate the learning and
assessment of the unit standards:
Conduct outcomes-based assessments
3. The full range of unit standards or exit level outcomes are assessed and
their relevant assessment criteria are applied.
All unit standards or exit level outcomes are assessed.
Each unit standard/exit level outcome is fully/adequately assessed.
I, the undersigned, hereby commit myself to abide by the ETDP SETA Code of Conduct in
relation to all my work conducted as an ETDP SETA registered assessor. The Assessors’ code
of conduct has been drawn up to enable ETDQA registered assessors to carry out their
functions objectively in line with ETDQA policies and procedures.
1. Responsibilities:
to plan and conduct assessments as outlined in the unit standard ‘Plan and conduct
assessment of learning outcomes’;
to assess candidates against the relevant unit standard(s) and or qualification;
to be guided by the provider’s assessment plan, guide, tools and reporting format;
to assess in a fair and transparent manner, avoiding bias and addressing barriers to
learning;
to judge evidence observing the rules of evidence;
to give constructive written feedback to candidates; and
to give feedback to moderators on unit standards and qualifications.
2. Declaration of Interest:
On being requested to assess a group of candidates, assessors must inform the provider in
confidence:
Whether they have (past or present) a family relationship with any of the
candidates;
Whether they might have, or be seen to have, difficulty in assessing any
candidate objectively because of friendship or other obligation; and
Any other actual or potential conflict of interest involving candidates, moderators
or other relevant parties.
4. Confidentiality:
Information on a provider’s practices and procedure gained during the assessment
process remains confidential to the provider.
Information about individual learners and their organisations should remain
confidential.
I, the undersigned, hereby commit myself to abide by the ETDP SETA Code of Conduct in
relation to all my work conducted as an ETDQA registered moderator. The Moderators’ code
of conduct has been drawn up to enable ETDQA registered moderators to carry out their
functions objectively in line with ETDQA policies and procedures.
1. Responsibilities:
to plan and conduct moderation as outlined in the unit standard ‘Moderate
Assessment’;
to moderate candidates with reference to the relevant unit standard(s) and or
qualification;
to be guided by the provider’s moderation, guide, tools and reporting format,
to be guided by the assessment manager’s selection of the sample and reasons
given for the selection;
to moderate in a fair and transparent manner, avoiding bias and interviewing
candidates if this should prove necessary;
to moderate evidence observing the rules of evidence;
to give constructive written feedback to assessors; and
to give feedback to the ETDQA on unit standards and qualifications.
2. Declaration of Interest:
On being requested to moderate a group of assessment, moderators must inform the
provider in confidence:
Whether they have (past or present) a family relationship with any of the
candidates or assessors;
Whether they might have, or be seen to have, difficulty in moderating any
assessments objectively because of friendship or other obligation; and
Any other actual or potential conflict of interest involving candidates, assessors or
other relevant parties.
4. Confidentiality
Information on a provider’s practices and procedure gained during the moderation
process remains confidential to the provider.
Information about individual learners and their organisations should remain
confidential.
I, the undersigned, hereby commit myself to abide by the ETDP SETA Code of Conduct in
relation to all my work conducted as an ETDP SETA verifier. The Verifiers’ code of conduct has
been drawn up to enable verifiers to carry out their functions objectively on behalf of the
ETDQA.
1. Responsibilities:
to be guided by the ETDQA verification guide, tool and reporting format;
to confirm the results of verification of assessment against unit standards and or
qualifications;
to look for evidence from the moderators’ reports of the credibility of assessment
process;
to sample moderated assessments to ensure that judgements made by assessors
and moderators are consistent and reliable;
to sample moderated assessment plans and guides to make sure they are valid;
to verify that providers use registered assessors and moderators;
to record and report on verification findings and make recommendations to the
ETDQA;
to advise and support moderators and give them written feedback;
to collate and give feedback on unit standards; and
to analyse information gathered and determine and report on significant trends that
may emerge.
2. Declaration of Interest:
On being contracted to verify a given provider, verifiers must make known to the ETDQA in
confidence:
Whether they have (past or present) a contractual relationship with that
provider;
Whether they might have, or be seen to have, difficulty in verifying that provider
objectively; and
Any other actual or potential conflict of interest involving assessors, verifiers,
learners or other relevant parties.
4. Confidentiality
Information on a provider’s practices and procedure gained during the verification
process remains confidential to the provider.
Where it is necessary to examine Portfolios of Evidence as part of the verification
process, the identity of the individual learners and their organisations should remain
confidential.
Information relating to the verification process must not be disclosed outside the
ETDQA reporting process, unless ther verifier is required to do so by law.
Verifiers are responsible solely to ETDQA and are answerable to the QALA unit for
their conduct and activities.
Verifiers should report to the ETDQA, on relevant development or anticipated
difficulties or disputes. Disputed findings or any other differences with
Moderator/Provider should be referred to the QALA.
Verifiers must let the ETDQA know as soon as possible when they will be unavailable
for verification week.
6. Professional Development
It is a condition of undertaking to work as a verifier that the verifier should attend,
whenever possible, workshops in order to remain abreast of development and to
maintain consistency of standards.
Where appropriate, the verifier should make more frequent contacts with other
verifiers for similar purposes.