Overview
The Institute of Chartered Accountants in England and Wales (ICAEW) is a leading accountancy awarding body, delivering assessments to a global candidate population. They required a question authoring and test compilation software platform that would also enable them to undertake complex results analysis to ensure that their exams were fair, reliable, and consistent. The platform needed to be able to:
- easily import a large number of existing questions,
- be used by external question authors,
- provide detailed results analysis
- export data in the format required by ICAEW’s 3rd party psychometric software
- be easy to use and available to many ICAEW users.
The Challenge
ICAEW wished to continue to deliver tests using a global test centre provider which meant that the question authoring tool needed to export test questions in a highly customized form of QTI. There was little documentation available on this customised QTI configuration. Results data also needed to be imported into the results analysis tool in the same QTI format and then be able to be interrogated and exported to 3rd party psychometric analysis software.
The Solution
ICAEW chose Rogo, as Eintech’s software development team have proven capability in complex customization and integration with other platforms. Clear and open communication was required between Eintech, ICAEW and the test delivery provider. A ICAEW chose Rogo, as Eintech’s software development team have proven capability in complex customization and integration with other platforms. Clear and open communication was required between Eintech, ICAEW and the test delivery provider. A great deal of testing was required to ensure that tests delivered in the delivery system, worked exactly as setup in Rogo. A clear understanding from all parties on what was required, was needed. Without effective communication, this would not have happened.
The Results
Rogo provides ICAEW with a seamless link to their test delivery provider’s platform. Test questions are written, and tests compiled within Rogo. All data – including information on how questions and assessments operate – is passed through to the delivery platform and results data is passed back to Rogo. ICAEW use Rogo’s own results analysis and reporting functionality to provide the majority of results information and export data to a psychometric analysis tool for specialist results analysis.
Rogo is also being used by ICAEW to deliver practice examinations to over 3,000 candidates each month. These practice tests provide detailed feedback to candidates on areas of weakness and suggested learning topics.
