Outline of presentation

(1)

JOGYAKARTA , 11 OKTOBER 2010

HEALTH PROFESSION EDUCATION

QUALITY PROJECT

(HPEQ PROJECT)

COMPONENT 2

Outline of presentation



Overview of Component 2

(2)

Overview of Component 2

 Introducing the national competence-based examinations

(NCE) for graduates of health professions (medicine, dentistry, nursing and midwifery) for certificate of competence

 The purpose of certification is to assure the standard of

education quality.

Objectives of Component 2

• to maximize the good conduct, sustainability and impact of NCE through establishment of the National Agency for Competence Examination of Health professional or

NACEHealthPro with national and international recognition

Sub-component 1

• to improve the NCE method and management by

introducing OSCE and advancing ICT use in many aspects such as Computer-based Testing (CBT).

Sub-component 2

• strengthen item bank system networking as Item Bank Networking for Assessment (IBNA) for improvement

(3)

Kegiatan & Indikator kinerja

Sub-Komponen 2.1

 Pertemuan di tingkat nasional

dan regional

 Technical assistance for NCE

Blueprinting, Rule and Regulation.

 International Benchmarking

for international collaboration and recognition.

 Policy studies for NCE

development.

 Research grant for scientific

publication in student assessment.

Indikator kinerja

 1 NACEHealthPro at

National, 6 Regional NACE HealthPro  1 NACEHealthPro website  1 ISO9001 award  85 Scientific Publications  25 International Conferences  3 Collaboration in assessment 

Pengembangan OSCE

center.



Pengembangan CBT

center.



Pengembangan dan

pelaksanaan OSCE



Pengembangan dan

pelaksanaan CBT



Workshop untuk

penguji OSCE,

SP

trainer

dan

standard

setting

.

Indikator kinerja

 12 Regional CBT center

 12 Regional OSCE center

 44 CBT implementation

 32 OSCE implementation

 288 National OSCE trainer

 4176 OSCE trainer

 288 National SP trainer

 4176 SP trainer

Kegiatan & Indikator kinerja

Sub-Komponen 2.1

(4)



Pengembangan

National Item Bank

Networking for

Assessment

(NIBNA)



Pengembangan sistem

bank soal di tingkat

regional dan

institusional



Workshop untuk

pengembangan bank

soal dan administrasi

bank soal

Indikator kinerja

 1 NIBNA dan 6 Regional NIBNA

 288 National MCQ Item

Developer dan Reviewer

 288 National OSCE Item

Developer dan Reviewer

 4176 MCQ Item Developer dan

Reviewer

 4176 OSCE Item Developer dan

Reviewer

Kegiatan & Indikator kinerja

Sub-Komponen 2.1

P R O J E C T O U T C O M E

(5)

C O M P O N E N T

2 Dampak yang diharapkan



Assessment drives learning

, karena itu peningkatan kualitas tenaga kesehatan dapat ditempuh melalui perbaikan sistem ujian yang akan mendorong perbaikan proses pendidikan

 Keberlanjutan pengembangan sistem ujian melalui

hibah penelitian, benchmarking dan kerjasama internasional, serta publikasi ilmiah sangat penting untuk keberlangsungan NACEHealth Pro dan international recognition.

(6)

Schedule of Component 2

Main Activity 2010 2011 2012 2013 2014

NACEHealthPro Preparation Establishment Mid-term

evaluation Final evaluation Sustainable

Computer-based Testing (CBT)

Paper-based, Preparation&Try

out

Implementation Implementation Implementation Implementation Preparation Preparation Preparation

and Try Out Implementation Implementation

Objective Structured Clinical Examination

(OSCE)

Preparation Try-out Implementation Implementation Implementation Preparation Preparation Preparation Try out Implementation

National Item Bank Networking for Assessment (NIBNA) Preparation Establishment Enhancement for Pre-clinical Formative Test Enhancement for Clinical Formative Test Enhancement for Progress Test Preparation Preparation Preparation Preparation Establishment

Medicine/Dentist Nurse/Midwife

Staff Development Framework

• Item KBE • Item OSCE • Penguji OSCE • SP Trainer Input • OSCE and CBT Center Coordinator • Item Bank Administrator Process • Standard Setting Output

(7)

Level of Trainings

National WS (HPEQ Project) Regional WS (HPEQ Project) In-house training (institution) Pengelola Pusat Pengelola regional Tempat Ujian Nasional Ketua Exam

Manager Item Bank Manager Manager IT Manager Asset Manager R&D Sekretaris

Dewan Penasehat

CBT

center OSCE center

(8)

PROJECT MILESTONE in 1

st

_Semester

National Commitment from stakeholders WS MCQ review, IBA, CBT Center in national & regional; Standard Setting WS OSCE examiner, OSCE development, SP trainer, OSCE center in national & regional Technical Assistance, International Conference & Benchmarking

CBT preparation & try out ; OSCE preparation (dr&drg)

% graduates passing national competency test

71.67 % (dr) 81.69% (drg)

Regional Workshop

0 20 40 60 80 100 120 140 WS Item Development Medicine WS OSCE Development Medicine WS OSCE Development Dentist WS Item Bank Administration WS OSCE Examiner

Medicine WS OSCE Examiner Dentist WS Standardized Patient Trainer Medicine Target Workshop Realization Workshop Target Institution Realization Institution Target Participant Realization Participant

(9)

0 20 40 60 80 100 120 140 Target Workshop Target Participant Target Institution Realization Workshop Realization Participant Realization Institution

National Workshop

Participants of Workshops in Component 2: Monthly Based

Total 42 Workshops from March-June 0% 20% 40% 60% 80% 100% 120% 140%

March April May June Regional Workshop Workshop Participant Institution 0% 20% 40% 60% 80% 100% 120% 140% 160%

March April May June National Workshop

Workshop Participant Institution

(10)

Development of NCE

International Technical Assistance from Prof.

Gordon Page (UBC, Canada)

 Paper #1 -- The Development of a Competence-Based National Board Examination for Indonesian Health Professionals

 Paper #2 -- Assessment Guidelines for the National Examinations Developed in the HPEQ Project

 Paper #3 -- The Function, Organization and Business Plan for NACEHealthPro

International Benchmarking in NBME, USA

 to get hands on experience in managing NCE of health profession has been planned to National Board of Medical Examination (NBME) in USA. It was cancelled due to visa problems. Communication and coordination had been fulfilled to depart on September, 20th_2010.

Plan of Action Semester 2

National Technical Assistance, International Benchmarking WS MCQ review, IBA; Standard Setting; WS OSCE examiner, OSCE development, SP trainer CBT try out CBT & OSCE center

Policy Study for re-taker UKDI & OSCE & CBT center Stronger Commitment between MoH & MoNE

(11)

Critical Issues

 NCE changes into National Exit Examination, prior to

graduation  institutional responsibility.

 NCE Management covers other health professional

education.

 NACEHealthProsustainability  institutional support.

 Incentive for institution: HRD, infrastructure support,

Results-based Financial Assistance Package.

 Rules and regulations

Kerangka UKDI

Input Process Output 1. Blueprinting 2. ICT support 3. Workshop Item

Writer dan Item Reviewer 1. Proses Review 2. Pengembangan Item Bank 3. Try-out 4. Pelaksanaan UKDI 1. Standard setting exercise 2. Failure rate

(12)

Tinjauan 1: KIPDI 3 Tinjauan 2 Tinjauan 3 Tinjauan 4 Tinjauan 5 Tinjauan 6 Tinjauan 7

Keterampilan dasar klinis

Kognitif Recall Reproduksi Pertumbuhan, perkembangan, dan degenerasi Promosi kesehatan dan pencegahan penyakit Individu Aplikasi biomedis, perilaku, klinis, & epidemiologi pada kedokteran keluarga

Prosedural Reasoning Kepala dan leher Kelainan genetik dan kongenital Penapisan (Diagnosis) Keluarga

Komunikasi efektif Konatif Syaraf & Perilaku Penyakit infeksi dan imunologi Manajemen (Terapi) Masyarakat Manajemen masalah kesehatan primer Dermatomuscul oskeletal Penyakit neoplasma Rehabilitasi Penelusuran, kritisi, dan

manajemen informasi Hemato dan immunology Penyakit akibat trauma atau kecelakaan Profesionalisme, moral,

dan etika praktik kedokteran Cardiovascular Kesadaran, pemeliharaan, dan pengembangan personal Gatrointestinal, hepatobilier, dan pankreas Respiratory Urogenital Endokrin dan Metabolisme

Blue Print UKDI

Proses Pengembangan Perangkat Ujian

Tulis

Call for Item Call for Reviewer

Item Development & Review Workshop

Rapat Panel Review

Blue Print Item Bank 1 Item Review Item Bank 2 Item Bank 3 Blue Print UKDI Standard Setting Item Analysis - + + - Book Production - +

(13)

Terima kasih

riyani@centrin.net.id