Why change the current system?
The OES survey and system was designed in 2004-5 and has been used for 8 years. In 2011 a consultation process and review of the current survey and system was set through Academic Senate.
Strategic reasons
- Address a variety of concerns raised by academic staff over the years about the OES instrument and system.
- Link the evaluation process clearly with principles of effective design and good teaching of subjects on dimensions within the control of academic staff.
- Introduction of a set of Workplace Learning items to be used by subjects designated as WPL in CASIMS. Greater flexibility around window closure allows for non-standard timing in these subjects.
- Provision of mobile access for students and staff from a range of mobile devices is part of CSU Mobile strategy and aims to lift response rates.
- Improved reporting (e.g. for Course Directors and Course Teams to use in course improvement) through a new system.
- Integration with Division of Planning and Audit database enables easier more targeted reporting.
- Review of survey instrument to align with CSU’s Curriculum Learning and Teaching principles and Smart Learning project has led to development of the Subject Experience Survey.
Better measurement reasons
A new five point variably-labelled response format was designed to:
- reduce ambiguity in the meaning of the points on the scale;
- amplify the distinctions between the points on the scale;
- focus on the occurrence of important aspects of the learning experience;
- increase the overall accuracy of responses;
- increase the capacity of the scale to represent the characteristics of a quality learning and teaching experience; and
- increase the capacity of the scale to represent student perspectives on quality learning and teaching experiences.
Technical reasons
- Contemporary Interface that is updated by vendor.
- Ability to offer different survey for workplace subjects.
- Variation in ratings wording possible.
- Easier modification of survey items.
- Mobile functionality provided and updated.
- Potential to use system for other surveys.
- An increase in the maximum size of “text” response fields.
- The ability to save a partially completed survey.
- Widely used in many Universities around the world -- benefit that comes from the ongoing and continual development of the product.