Evaluation of approaches for producing mathematics question banks and the automatic creation of numeric (variable) questions using Questionmark Perception and Excel Dr Giles Tewkesbury

Introduction • Assessment Software • Introduction to QM Perception • Numeric (variable) questions • Using Excel macros • Conclusions

Maple TA Questionmark perception

Blackboard

WILEY PLUS

Questionmark Perception (QMP)

Student Assessment

QMP – Types of Questions • Multiple Choice • Numeric • Boolean (Yes/No, True/False, etc) • Hotspot • Drag and Drop • Essay • Explanation • File Upload • Fill in Blanks

• • • • • • • • • +

Knowledge Matrix Likert Scale Matching Multiple Response Ranking Survey Matrix Text Match Adobe Captivate Adobe Flash Others

Questionmark Perception (QMP)

Authoring Manager

QMP – Adding Questions Questions in hierarchal topic list

Questions have: • • • •

Stimulus Choices Outcomes Metatags

QMP – Assessments • Open Access & Exams • Options available: – Randomised selection and ordering – Time limits – Outcomes & feedback – Branching

QMP - Reporting

Numeric Question Generation Library based...

On the fly...

• QMP

• Maple TA

• Victory

• (Wiley Plus)

• Third-Party Tool

Question Generation using Excel • Any type of QM question

• Flexible formula / logic • No special software required • Not reliant on browser ad-ons

Question Generation Create a question in QMP & export to QML file Import QML file to Excel Generate sets of answers Generate QML question blocks Import back in to QMP

Question Generation Create a question in QMP & export to QML file Import QML file to Excel Generate sets of answers Generate QML question blocks Import back in to QMP

Question Generation Create a question in QMP & export to QML file Import QML file to Excel Generate sets of answers Generate QML question blocks Import back in to QMP

Parameters for Generation

Create a question in QMP & export to QML file Parameters for Validation

Import QML file to Excel Generate sets of answers Generate QML question blocks

Generated Numbers

Formula

Import back in to QMP

Question Generation Create a question in QMP & export to QML file Import QML file to Excel Generate sets of answers Generate QML question blocks Import back in to QMP

Question Generation Create a question in QMP & export to QML file Import QML file to Excel Generate sets of answers Generate QML question blocks Import back in to QMP

Question Generation • Separate sub-topics for generated questions • In assessments: – 1 Randomly selected question from sub-topic – Traceability in reporting

• All the question types (shown earlier) can be produced using this method.

Conclusions • QMP provides a friendly UI for creating Questions. • Excel provides a well known platform for producing flexible Formula & Logic • This project bring the two together. • Generation prevents ‘learning the test’ • Libraries provide traceability.

Questions ?

Contact Information

Dr Giles Tewkesbury Dept Mechanical and Design Engineering Anglesea Building - Room A0-22 Tel: 023 92 84 2562 email: [email protected]