Administration guide - Economics: External assessment trial

(1)

Administration guide — Economics

External assessment trial

September 2016

(2)

PO Box 307 Spring Hill QLD 4004 Australia Level 7, 154 Melbourne Street, South Brisbane Phone: +61 7 3864 0299

Fax: +61 7 3221 2553 Email: [email protected] Website: www.qcaa.qld.edu.au

(3)

Contacts ________________ 1 Key dates 1 Key roles and responsibilities _ 2

SEA coordinator ... 2

Invigilator ... 2

Supervisor ... 2

Assessment materials ___________________________________ 2

Delivery and receipt confirmation ... 2

Storage ... 3

Collection ... 3

Assessment conditions __________________________________ 3

Economics ... 3

Room layout and seating plan ... 3

Late arrival ... 4

Early departure ... 4

Session record ... 4

Equipment ... 4

Protocols for students ... 5

General protocols for administration ... 5

Protocols for online administration ... 5

Script for the supervisor: Online administration ... 6

After 20 minutes ... 7

At the end of planning time ... 8

30 minutes remaining ... 8

At the finish time ... 8

After students have submitted ... 8

Script for the supervisor: Pen and paper administration... 10

After 20 minutes ... 11

At the end of planning time ... 11

At the finish time ... 11

Special provision ______________________________________ 12

General ... 12

Individual instructions ... 12

Varied seating position ... 12

Separate supervision ... 12

Bite-sized food ... 12

Rest breaks ... 12

Extra time ... 12

Use of a computer ... 12

Checklist _____________________________________________ 13

Session record ________________________________________ 15

(4)

Contacts

Topic Contact Phone number

• Assessment materials including misprints, delivery and collection

• Administration protocols

• Special provision

• Markers

• Invigilators

Senior External Assessment Operations (SEA Operations)

1300 381 575

Key dates

Date Activity Notes

Monday 5 September Assessment materials delivered to schools by courier

Delivery between 9:00 am and 3:00 pm

Monday 5 September Acknowledge receipt of assessment materials

SEA coordinator to complete in the QCAA School Portal

Friday 9 September Password for SEA coordinators to access the online assessment system

Monday 12 September Administration of the Economics external assessment

Session begins between 8:50 am and 9:20 am

Complete online student attendance roll

SEA coordinator to complete in the QCAA School Portal

Session record Complete, scan and email to

[email protected] Student responses collected from

schools by courier if required

If a collection is required, QCAA will email details to SEA coordinator Monday 19 September

to

Saturday 24 September

Marking operation

Early Term 4 Student results and PDF file of scripts available to schools

Mode of distribution to be confirmed

(5)

Key roles and responsibilities

SEA coordinator

The SEA coordinator at the school is responsible for:

• security of the materials from delivery to the school until collected

• management and administration of the assessment trial.

Invigilator

The Queensland Curriculum and Assessment Authority (QCAA) appoints invigilators to schools to:

• assist with the distribution of materials before the assessment

• observe the administration of the assessment session

• report and provide feedback to the QCAA about the administration of the assessment

• ensure accountability

• assist with the reconciliation of materials after the assessment, where time permits.

Supervisor

The SEA coordinator selects supervisors from the teaching staff of the school to:

• administer the assessment

• supervise students during the assessment session.

Assessment materials

Delivery and receipt confirmation

Materials for the Economics external assessment trial will arrive at the school office by courier on Monday 5 September between the hours of 9:00 am and 3:00 pm. A member of the

administration or teaching staff is required to sign for the delivery.

The SEA coordinator is required to confirm receipt of the assessment materials with QCAA by logging in to the School Portal. Instructions for this process will be communicated separately to SEA coordinators by email.

Assessment materials will arrive in a reusable box. Keep the box in case it is needed to return completed response books (see Collection, p. 3). The assessment materials will include:

• secure shrink-wrapped packages of the question books, response books and stimulus books (not to be opened until assessment day inside the assessment room — see Protocols for online administration, p. 5)

• non-secure shrink-wrapped place cards for students, which have a barcode label to affix to the response book (if required)

(6)

• pads of planning paper (two sheets per student)

• return address label/s.

Special provision assessment materials (if applicable) will be packaged in a satchel and included with the rest of the assessment materials.

Storage

All materials are to be securely stored in a locked room or a safe until the morning of Monday 12 September. Non-secure items (place cards and labels) can be removed from storage earlier, as needed. The shrink-wrapped assessment packages must not be opened until the point of distributing to students.

Collection

In the event that the assessment is completed using pen and paper, contact SEA Operations as soon as possible on assessment day. Arrangements will be made for courier collection of completed response books.

SEA Operations will inform SEA coordinators directly of collection arrangements, if applicable.

See Protocols for pen and paper administration, p. 9 for related information about the administration of pen and paper materials.

Assessment conditions

Economics

Date: Monday 12 September

Start time: Between 8:50 am and 9:20 am

Mode Duration

Online using the External assessment — online assessment system

If there are any problems with completing the assessment session online, keep the Safe Exam Browser open if possible, and phone SEA Operations for advice. The online assessment system automatically saves the session every two minutes.

• Login time: 10–20 minutes

• Planning time: 20 minutes

• Working time: 80 minutes

Pen and paper administration — if required for any students on the day — contact SEA Operations as soon as practicable.

• Planning time: 20 minutes

• Working time: 80 minutes

Room layout and seating plan

Seat the students separately in alphabetical order (by family name) from the front to the back of the room at individual workstations placed 1–1.3 metres apart, head to head. Where this is not possible due to room availability or configuration, phone SEA Operations to discuss seating arrangements.

(7)

Diagram of QCAA-preferred seating

Front of the room or hall

Schools are to keep a record of the seating plan for each room used in the assessment.

However, seating plans do not need to be forwarded to QCAA.

Late arrival

Students who arrive up to 30 minutes after the start time may be admitted to the session, and their finish time adjusted accordingly. Students who are more than 30 minutes late will not be admitted to the session.

Early departure

Students may not leave the session during the first 30 minutes or the last 30 minutes, except for welfare reasons. A student who leaves the session early (e.g. due to illness) may not

subsequently return to the room, or resume the assessment, except with the approval of QCAA (contact SEA Operations).

Record the times for students who arrive late or leave early in the Session record, p. 15.

Session record

Keep a separate Session record (p. 15) for each assessment room. A supervisor must record the duration of absence when a student leaves the room (for any reason) using the Session record.

Students must be accompanied by a supervisor when absent for a short break. No more than one male and one female student may leave to access toilet facilities at the same time.

Equipment

For this online assessment, the desktop or laptop computers used by students must be configured by a school officer before the assessment session. This may have already been completed as part of the practice assessment completed by schools during August. Configuration comprises installation of the Safe Exam Browser provided by QCAA. Online assessment

technology: External assessment guides are available from the School Portal:

• Safe Exam Browser installation guide

• Online assessment system user guide.

Contact SEA Operations if you require assistance.

Start A

Z

(8)

Student equipment is to be presented for inspection in a clear plastic container or ziplock bag.

The approved equipment for Economics includes pens (black inks), pencils, eraser, highlighters and ruler.

Protocols for students

Students are:

• not permitted to bring electronic devices, such as mobile phones and smart watches, into the assessment room (except for use by a supervisor in the event of an emergency)

• not permitted to bring food into the assessment room unless they have been approved special provision

• not permitted to communicate with each other in any way once they enter the assessment room

• not permitted to lend equipment to another student

• permitted to bring personal items including reading glasses and water in a clear bottle (labels removed). Supervisors have discretion to approve or reject personal items on a case-by-case basis

• permitted to signal a supervisor by raising their hand and waiting quietly.

General protocols for administration

• Remove or conceal any posters, charts or other items relevant to the subject that are affixed to walls.

• Ensure a supervision ratio of one supervisor to 30 students (except for students seated separately for special provision). The QCAA-appointed invigilator is not part of the supervision team.

Protocols for online administration

• Before the assessment session, generate the password that students will use to log in (see the Online assessment system user guide, p. 3 for further information). The password may be written on a whiteboard or similar once you are ready to supply it to the students.

• The invigilator will verify that the shrink-wrapped question book, response book and stimulus book packages have not been opened. If multiple rooms are in use, room supervisors should meet immediately before the assessment to collect the unopened assessment packages in the presence of the invigilator. If this is not possible for any reason, note it on the Session record, p. 15.

• Distribute the stimulus book and two sheets of planning paper face down on desks before students enter the room. Keep question books and response books at the front of the room and distribute only if required (see Assessment conditions, p. 3).

• Place cards may be distributed at the same time as assessment materials, or before the assessment day according to local circumstances. If a student does not have a printed place card with barcode label, provide a handwritten place marker on their workstation with their name and LUI.

• Once students have assembled to enter the assessment room, remind them that prohibited items cannot be taken in. A predetermined system for the collection of prohibited property and its return may assist this process.

(9)

• Remind students that it will not be possible for supervisors to assist them with interpreting the meaning of assessment questions or content, or to read questions to them.

• Check with students that they have the necessary equipment for completing the assessment and resolve any equipment deficiencies in line with local practice.

• Record the details of students who are absent (for entry in the School Portal immediately after the session).

• Record short absences, late arrivals and early departures in the Session record, p. 15.

• Thirty minutes after the end of planning time, collect all materials from the workstations of absent students.

• Once the session is underway, log in to the online assessment system and remove the access of absent students by checking the Remove access box next to their name in the Access tab.

• Track the progress of students in the Live Tracking tab.

• Record the mode in which each student completed their assessment and update in the Access tab.

• At the end of the session, ensure all students have submitted their work in the Live Tracking tab.

Phone SEA Operations if you have any problems or questions on the day.

Script for the supervisor: Online administration

As students enter the room and begin taking their seats:

SAY Please take your seat and wait for further instructions.

When students are seated and you are ready to start:

SAY On your desk is your place card with your name and LUI. For this Economics

assessment, you also have:

• one stimulus book

• two loose sheets of planning paper for notes.

Check you have all of these items. Raise your hand if anything is missing.

Allow time for students to do this.

SAY This assessment will be completed online.

Turn on your computer. Click the Safe Exam Browser icon on your desktop.

Raise your hand if you are unable to launch the Safe Exam Browser.

(10)

SAY A login table should be showing.

Your LUI is your User ID. Type in your LUI in the User ID field.

The password is _______________.

Enter the password and click Login.

Check your information is correct. Click Proceed if correct.

Raise your hand if you are unable to log in or the information displayed is incorrect.

Allow time for students to do this. Resolve login issues.

SAY You may now click the blue Begin button.

The cover of the question book should be displayed.

Read the cover of the question book. You may use the mouse to scroll the cover page.

Do not click the Begin button.

Raise your hand if you are unable to see the cover page.

Allow time for students to read the cover page. If the student is unable to see the cover page, ask the student to log out and log in again. If the problem persists, issue student a hard copy of the question and response books.

SAY During planning time, you may annotate the stimulus book and sheets of planning paper.

Annotations and notes on your planning paper are not part of the final response and will not be collected or marked.

Now open the stimulus book and check it has 11 sources. If your book is faulty, raise your hand.

Allow time for students to do this and replace any faulty stimulus books.

SAY You have 20 minutes for planning time.

Click the Begin button to view the task, but do not click the Start button until directed.

Raise your hand if you are unable to view the task.

SAY Your planning time starts now.

Time the 20 minutes of planning time.

After 20 minutes

SAY Planning time has finished, pens down.

(11)

At the end of planning time

SAY Time allowed for working is 80 minutes.

Do not communicate in any way with anyone other than supervisors. To signal a supervisor, raise your hand and wait.

Supervisors are not permitted to explain the meaning of the question or how to interpret it.

All rules relating to examination conditions apply — you must submit your own work.

When you click the Start button, you will see the question and an area to type your response.

At the right-hand side of the screen, you will see two tabs labelled Item 1 and Item 2.

Item 1 is the question and response area. Item 2 is the instrument-specific standards matrix.

Click the blue Start button — start work now.

Display the start time and remaining/finish times on a whiteboard or similar, visible to students.

• Start reading time ____________

• Start working time ____________

• 30 minutes remaining at ____________

• Finish time ____________

30 minutes remaining

SAY There are 30 minutes left. Remain seated until the end of the session.

10 minutes remaining

SAY A pink box around the on-screen timer should now be displayed. You have 10 minutes of work left. Remain seated until the end of the session.

At the finish time

SAY Stop typing now. Click the Finish button followed by the Submit button.

You will see a message asking if you want to submit the activity. Click OK.

Raise your hand if the Safe Exam Browser doesn’t automatically close.

Remain seated until instructed.

Check that students have submitted their work in the Live Tracking screen.

After students have submitted

Students can be dismissed following any local processes for logging out of their devices. They may take the assessment materials if they wish.

Record the mode in which each student completed their assessment in the Access tab.

(12)

Protocols for pen and paper administration

• The invigilator will verify that the shrink-wrapped question book, response book and stimulus book packages have not been opened. If multiple rooms are in use, room supervisors should meet immediately before the assessment to collect the unopened assessment packages in the presence of the invigilator. If this is not possible for any reason, note it on the Session record, p. 15.

• Distribute the question book, answer book, stimulus book and two sheets of planning paper face down on desks before students enter the room.

• Place cards may be distributed at the same time as assessment materials, or before the assessment day according to local circumstances. If a student does not have a printed place card with barcode label, provide a handwritten place marker on their workstation with their name and LUI.

• Once students have assembled to enter the assessment room, remind them that prohibited items cannot be taken in. A predetermined system for the collection of prohibited property and its return may assist this process.

• Remind students that it will not be possible for supervisors to assist them with interpreting the meaning of assessment questions or content, or to read questions to them.

• Check with students that they have the necessary equipment for completing the assessment and resolve any equipment deficiencies in line with local practice.

• Record the details of students who are absent (for entry in the School Portal immediately after the session).

• Record short absences, late arrivals and early departures in the Session record, p. 15.

• Thirty minutes after the end of planning time, collect all materials from the desks of absent students.

• At the end of the session and before students are dismissed, collect the response books in alphabetical order, consistent with the seating plan. Check that each response book cover has the correct barcode label applied and the student has correctly written their details —

particularly any students without a pre-printed place card/barcode label.

• If a student has used two response books, ensure the second book has the student’s details written on the cover and place it inside the first response book (no stapling please).

• Ensure there is a response book for every student present in the assessment room. Make a note for your records of the total number of response books collected.

• Pack the completed response books in the reusable box/es. No other items need be returned to QCAA.

Phone SEA Operations if you have any problems or questions on the day.

(13)

Script for the supervisor: Pen and paper administration

As students enter the room and begin taking their seats:

SAY Please take your seat and wait for further instructions.

When students are seated and you are ready to start:

SAY On your desk is your place card with your name and LUI. For this Economics assessment, you also have:

• one question book

• one stimulus book

• one response book

• two loose sheets of planning paper for notes.

Check you have all of these items. Raise your hand if anything is missing.

SAY Open the response book and check that it has 10 pages.

Now remove the barcode label from your place card and attach it to the cover of the response book in the space for the label.

Then write your name, LUI, school name and school code in the spaces shown.

Raise your hand if your response book is faulty.

Allow time for students to do this and replace any faulty response books.

SAY Put your pens down.

Now open the stimulus book and check that there is a total of 11 sources.

If the stimulus book is faulty, raise your hand.

Allow time for students to do this and replace any faulty stimulus books.

SAY Look at the question book; read the instructions on the cover without opening it.

SAY Now open the question book. There are two pages — the task is on page 1 and the instrument-specific standards matrix is on page 2.

If your question book is faulty, raise your hand.

Allow time for students to do this and replace any faulty question books.

When checks are complete:

SAY You have 20 minutes for planning time.

During planning time, you may make notes on the stimulus book or planning paper

(14)

only. Do not write on your question or response books.

Annotations and notes on your planning paper are not part of the final response and will not be collected or marked. Planning time begins now.

Time the 20 minutes of planning time.

After 20 minutes

SAY Planning time has finished, pens down.

At the end of planning time

SAY Time allowed for working is 80 minutes.

Do not communicate in any way with anyone other than supervisors. To signal a supervisor, raise your hand and wait. If you need another response book during the session, raise your hand and wait.

Supervisors are not permitted to explain the meaning of the question or how to interpret it.

All rules relating to examination conditions apply — you must submit your own work.

You may now open your response book and begin.

Display the start time and remaining/finish times on a whiteboard or similar, visible to students.

• Start planning time ____________

• Start working time ____________

• Finish time ____________

30 minutes remaining

SAY There are 30 minutes left. Remain seated until the end of the session.

10 minutes remaining

SAY There are 10 minutes remaining. Remain seated until the end of the session.

At the finish time

SAY Pens down and stop work now.

Remain seated until your response book is collected and you have been dismissed.

Do not insert your planning paper into your response book. It does not form part of your answer. Your planning paper will not be collected.

Collect the response books before students are dismissed. Remove any planning paper inserted into a response book (see Protocols for pen and paper administration, p. 9).

(15)

Special provision

General

The rules governing the most frequently approved provisions are set out below. For rules relating to provisions not listed here, refer to the Special provisions handbook: External Assessment Trial

— Semester 2, 2016. A link to the handbook is available in the School Portal.

Individual instructions

Students may be supplied with a written copy of the assessment instructions one week before the assessment. SEA Operations will contact relevant schools directly about these arrangements.

Varied seating position

The student may be seated at the front, back or side of the room (out of alphabetical order).

Separate supervision

The student may be seated in a room by themselves or in a small group. The SEA coordinator determines the arrangements for students with separate supervision, in consultation with the student. Seating in small groups should be alphabetical unless student welfare dictates otherwise.

Bite-sized food

Food in small portions is to be contained in a clear ziplock bag or similar.

Rest breaks

Unless otherwise specified, rest breaks are granted at the rate of 5 minutes per half hour.

Typically, students use rest breaks to relax, stand and stretch, use the bathroom, apply self-management strategies or refocus concentration.

The minimum length of a rest break is five minutes. Rest breaks may comprise a maximum of four 5-minute breaks per 2-hour session, or the time may be combined for one or more longer breaks. Response books are to be closed during breaks. Adjust the student’s finish time by the amount of rest time used.

Extra time

Unless otherwise specified, extra time is granted at the rate of 5 minutes per half hour. Extra time may be used to work or rest.

Use of a computer

Please note: This special provision applies if the assessment is not completed using the online assessment system and the student is approved the use of a computer.

Students type their responses using either Microsoft Notepad or Microsoft WordPad on a non-networked and non-internet connected PC or laptop. The document is to be prepared by a school staff member with the following settings:

• page header with the student LUI, name and subject

• left margin of 2.5 cm and right margin of 2.5 cm top margin of 2 cm and bottom margin of 3 cm

• single spacing.

Contact SEA Operations if you have questions about the administration of special provisions.

(16)

Checklist

Assessment materials

 Receive materials on Monday 5 September.

 Acknowledge receipt of materials in the School Portal.

 Print and distribute Administration guides to supervisors.

 Store remaining materials securely.

Invigilator

 Make contact with the invigilator.

 Communicate session start time.

 Confirm room arrangements for the day, including for students with special provision.

Seating plan

 Ensure seating is alphabetical.

 Record a plan for each room being used.

 Keep all plans on file — not required to send to QCAA.

Supervisors

 As required for main room/s.

 As required for students with special provision.

 Supplied with copies of Administration guide.

Special provision

 Book and organise rooms and seating.

 Confirm conditions with relevant students.

 Set up PCs or Macs if applicable — see Use of a computer, p.12.

Room preparation

 Secure room/s until the session starts.

 Sufficiently space workstations for supervision.

 Distribute place cards and materials.

Students

 Install Safe Exam Browser.

 Generate login password.

 Remove absent students from Access tab.

 Record absentees for later entry in School Portal.

 Monitor student progress in the Live tracking tab.

 Update mode of completion in the Live tracking tab at the end of the assessment.

 Collect all response books distributed to students.

(17)

Post-assessment checks (if applicable)

 Reconcile response books with attendance record.

 Check that, where students have used two books, one is inside the other.

 Pack response books in original reusable box and apply return label.

 Take box to the office for courier collection.

 Complete attendance information in the School Portal.

 Scan Session record and email to [email protected]. (Remember to write your school name and code on the form before emailing.)

 Check that materials are collected by the courier on time.

(18)

Session record

1. Copy this page as required for completion in each room. After the session, scan and email each record to [email protected].

2. Circle the appropriate response (for this room):

The invigilator has/has not verified that the question book, response book and stimulus book packages were unopened before the assessment session.

School name and code:

Student name Comment Time in Time out Accompanied by

Administration guide - Economics: External assessment trial