|
|
| Introduction |
The core activities of the department for Testing and
Certification have to be devoted to the development of
occupational tests. The occupational standards which have to
be created by the Center will serve as the basis. Identifying the
most suitable, effective and cost-efficient way of occupational
testing remains to be the crucial task for research and
development in this department. (more...)
Due to the large number of foreign workers needed by Oman's
thriving industries, the actual qualification levels of incoming
workers shall be monitored and subject to skill testing.

The department for Testing and Certification should be closely
associated with MoM's department of Occupational Standards
and Curriculum development because the basis of work for
testing lies in the occupational standards which have to be
developed by the experts of the respective department.
Furthermore, both the conceptual as well as the operational
work in testing have to be carried out in close cooperation with
the private sector because the alliance with the private sector
should be a constitutive part of the work of this department.
Testing necessarily goes along with certification as the seal of
confidence which should confirm any tested achievement. As
such, certification is part of testing and no specific positions
have been allocated for this task.
|
| Development of Test Items |
The format of the standards provides three basic guides to designing testing packages:
- Core Work Processes (CWP): generic skills which are a meaningful definition of a skilled worker, and a semi-skilled worker, in an occupation.
- Core Competencies necessary for mastering a CWP provide a basic structure for testing a particular core work process.
- Detailing of the Core Work Process provides contextual information to inform the development of specific test questions or tasks.
(more...)
Guidelines for Writing Competency-Based Multiple-Choice Items
While every core competency is unique, and can only be tested in the context of the CWP, it is not productive to develop guidelines for writing questions to test each one separately. There is, however, considerable common content between competencies across CWPs. For example, several CWPs require the worker to "communicate with customers and team members" in different contexts; others require the worker to "determine information needs and gather diagnostic information by various means - e.g., experience, scan tools, physical investigation".
In the case of the Automotive Mechatronic, the core competencies across all CWPs can be provisionally classified into the eight broad groups given in the table below.
| Types of Work-Process Competency |
- Background knowledge, understanding of principles, procedures etc.
- Communication - with customers in particular, and team members.
- Use of documentation (e.g. service plans) to gather information, applying written instructions.
- Determining information needs and gathering diagnostic information by various means - experience, scan tools, physical investigation
- Comparing and assessing different solutions to make recommendations or decisions based on available information
- Processing a job using standard procedures - planning, estimating, processing orders for parts etc., selecting tools etc., recording appropriately actions taken etc.
- Carrying out operations - repairs, replacements of parts, etc.
- Awareness and implementation of environmental and other rules (e.g., for safe disposal of waste, checking repairs or replacements, assuring safety etc.)
|
Focusing on tasks which are common to different core competencies helps to build item writing skills; and it is on this basis that a guide for item writing and review can be developed. Specific guidelines on how to develop multiple-choice questions to assess these eight types of process competency, with examples, are given in annex 2 below.
( more...)
Designing a Test to Meet a Specific Need
The framework for the CWP, as given above, is the basic guide to designing a test. However, tests may have different structures according to specific needs for testing.
- The test to licence foreign workers to practice an occupation in Oman needs to cover as wide a range as possible of the required skills and knowledge, to guarantee the knowledge and skills of the test-taker. But most testing will take place in the sending countries, funded by candidate fees; the time and facilities available for testing will be limited. The format of the test will therefore emphasise "objectivity" of scoring and ease of administration. Practical testing will be minimised. Content should be sampled rigorously, but systematically, to give the best coverage possible.
- Testing for certification of trainees also needs to cover as wide a range as possible of the required skills and knowledge. The testing will be distributed throughout the course, so the amount of content to be tested in any one session will be limited, and there will probably be no need to sample content. Facilities available in the training locations generally permit practical testing, and use of a wide range of assessment tools, with less emphasis on "objectivity" of format and scoring.
- Testing completion of a short course faces few limitations, because the amount of content is limited, and testing will be carried out in the training environment. The extent and level of detail of the testing will depend primarily on the purpose of the testing. A short course which is part of regular professional development may be self-assessed; on the other hand, a course teaching a new procedure which the trainee will carry out regularly is likely to be rigorously assessed.
- Certification of the training system can be based on either the results of certification of the trainees (assuming the certification of the trainees is done using appropriate instruments) or alternatively it can be done on a sample basis, using the same instruments as are used for testing foreign workers.
In certifying long-term training, it is essential that each CWP should be assessed, for both formative and summative purposes. There are also many opportunities for assessment during a training course, and few limitations on the type of testing tools used. Therefore, it is in this case both desirable and feasible to assess each CWP separately and in sufficient depth to make a reliable judgment about success or failure. In the case of a training course, the CWP-level table of specifications is therefore in effect the test plan.
In other cases, such as in licensing skilled foreign workers, it may be desirable but not feasible to test all CWPs. In such cases, tables of specification for individual CWPs will guide the final test plan; but the test designer will adapt them to the needs of the specific testing situation.
|
| Skill Levels |
While screening will be offered on a "yes/no"- basis the in-depth skill testing should refer to qualification levels which correspond to the actual skill requirements at the workplace. For the wider area of the skilled workforce, i.e. excluding the levels of the semi-professionals (technicians) and professionals, the following three levels are suggested to be incorporated in the skill testing: (a) semi-skilled workers, (b) skilled workers/ craftsmen and (c) master skilled worker/master craftsmen.
Obviously from the semi-skilled via the skilled workers to the master-craftsmen the level of skill competence is increasing, yet, this is not only a question of being in command of just "more" or "more complicated" skills but there is a unique concept of the quality of vocational interaction at the workplace behind each of these levels. These concepts attempt to address supplementary functions at the workplace.
(more...)
They can be described as follows:
(a) Semi-Skilled Worker
Semi-skilled workers are capable of carrying out a restricted number of work tasks in an occupational area. These tasks have to be regarded as part of the complete portfolio of work of a skilled worker. Yet, on top of their restricted scope of skills semi-skilled workers lack the vocational autonomy of being fully aware of all the implications of their work and in particular of the possible interdependencies between different work activities (as described in the occupational profile). Since the standards follow a rank-order of proceeding from the not so difficult to the more complicated ones, standard 1 and 2 are here recommended to constitute an area of skill requirements which may be mastered by semi-skilled workers.
(b) Skilled Worker/Craftsman
Skilled workers/craftsmen are capable of carrying out all skill requirements of an occupational area. Beyond the mere coverage of all the skill requirements which underlie the complete sequence of standards, a skilled worker/craftsman is in command of the vocational autonomy to assess, appraise and handle not only the obvious work to be preformed but also the implications which it may have and the interdependencies which may occur. Consequently he has the ability to asses the nature of the work to be done, to plan it in all its aspects, to carry it out and to hand over or pass on the completed work wherever relevant.
With regard to the occupational standards (example: car mechatronic) the skilled worker/craftsman must be able to master all work regarding all 9 standards including all technical implications which may arise from this work.
(c) Master Skilled Worker/Master Craftsman
Master skilled workers/master craftsmen are capable of carrying out all the tasks of a skilled worker, also including all implications which may arise from this work. Typically a master skilled worker/master craftsman possesses excellent skills regarding the whole portfolio of required skills in an occupation.
Yet, this excellence in qualification is not necessarily an information which needs to be assessed respectively tested. The proof of being competent for the full range of standards should be sufficient. However, what actually distinguishes the "master" level from the skilled level is a number of additional qualifications which place the "master" in a particular position catering to the following shopfloor needs:
- educational qualification which is needed to be the reference person for the trainees in a section and to define the further training needs for the semi-skilled and skilled workers,
- accountancy-qualification which is needed to understand the cost and benefit considerations for the operation of a section,
- personnel-affairs-qualification which is needed for the "master" to serve as an on-site reference for the other employees of the section,
- entrepreneurial qualification which is needed for the "master" to understand the business development implications of the operational procedures of the section, enabling him to pass this insight on to the company's management.
( more...)
An exemplar for the two level approach in skill testing is summarized in the table below for the Automotive Mechatronic with the Master Craftsman not included.
| Level 1 - |
Semi-Skilled |
Demonstrates competence in: |
|
| Standard 1: | standard servic |
| Standard 2: | wear and tear repair |
|
| Level 2 - |
Skilled |
Demonstrates competence in level 1 plus: |
|
| Standard 3: | standard diagnosis, diagnostic procedures, trouble shooting and minor repair |
| Standard 4: | general inspection |
| Standard 5: | undercarriage and suspension repair |
| Standard 6: | electrical and electronic repair |
| Standard 7: | advanced diagnosis and repair of aggregates, component groups and elements |
| Standard 8: | repair and overhauling of maggregates: engine, gearbox and automatic transmission |
| Standard 9: | standard extensions and accessory installation |
|
The OSTC-project is not expected to develop skill-testing on the level of Master Craftsmen.
|
|
|