TOWARDS AN INTUITIVE AND OBJECTIVE ASSESSMENT FOR PROJECT-BASED MODULES

TOWARDS AN INTUITIVE AND OBJECTIVE ASSESSMENT FOR PROJECT-BASED MODULES

C. Lin (2021).  TOWARDS AN INTUITIVE AND OBJECTIVE ASSESSMENT FOR PROJECT-BASED MODULES. 11.

Assessing student design-implement skills in project-based modules integrated with CDIO framework has always been a challenging task to teaching staff. Even equipped with written rubrics, staff still assess the students’ performances based on their own understanding of observed students’ achievements as well as staff’s own interpretations of the given rubrics, which may vary from one teaching staff to another. This challenge is heightened for modules that have a large number of classes and involve more than 20 teaching staff, comprising both full-time and adjunct lecturers. The traditional rubrics often expect teaching staff to award marks ranging from 0 to 100 or from 0 to a preset maximum score. In reality, it is almost impossible to provide an equal number of different assessed works of students in different assessment fields to reflect that range of marks. This paper thus examines how an intuitive and objective assessment for one such project-based module - Introduction to Engineering. By applying this model, the teaching members of IE can simply match all the possible observable project criteria from a dropdown list of descriptors such as “Optimal and neat layout”, “Good and neat layout” …etc. for learning outcomes relating to design-implement skills. There is no need to specifically ensure that each assessment field has the maximum score when assessing. For any possible ambiguous interpretations, photos of past students’ work were captured and presented in another spreadsheet for reference. The work has also taken into account feedback and comments from 15 teaching staff, collected via a questionnaire and another 4 via causal conservations. After evaluating the usefulness of the assessment, a few missing observable criteria have been suggested for inclusion in the improved version of the assessment. Teaching staff commented on the ease of use and intuitive aspects of the assessment provided. Through visual inspection of the submitted projects done by the students, teaching staff only need to select the matching appropriate descriptors from the dropdown list provided in an excel spreadsheet. Most importantly, the teaching staff can also now make use of the descriptors to provide quick and meaningful feedback to students to support their learning.

Authors (New): 
Chia Chew Lin
Pages: 
11
Affiliations: 
Singapore Polytechnic, Singapore
Keywords: 
Learning Assessment
project-based module
Feedback
gradebook
Design Skills
implement skills
observable record
observable performance
CDIO Standard 11
CDIO Standard 12
Year: 
2021
Reference: 
Bloxham.S, (2009) Marking and moderation in the UK: false assumptions and wasted resources, Assessment and Evaluation in Higher Education, Vol. 34, No.2, pp 209-220.: 
B. McKinstry, H Cameron, R Elton & S Riley, (2004). Leniency and halo effects in marking undergraduate short research projects, BMC Medical Education, Vol. 4, No.28, 2004. Available online at http://www.biomedcentral.com/content/pdf/1472-6920-4-28.pdf: 
Crawley, E., Malmqvist, J., Östlund, S., Brodeur, D., & Eström, K. (2014). Rethinking engineering education: The CDIO approach (2nd ed.). New York: Springer.: 
Felder, R. (2009). Active Learning: An Introduction. ASQ Higher Education Brief, 2(4).: 
J. Archer & B. McCarthy, (1988) Personal biases in student assessment, Educational Research, Vol. 30, No. 2, pp142-145, 1988.: 
José-Luis Menéndez-Varela & Eva Gregori-Giralt (2018) The reliability and sources of error of using rubrics-based assessment for student projects, Assessment & Evaluation in Higher Education, 43:3, 488-499.: 
K. Willey & A. Gardner, 2010. Improving the standard and consistency of multi-tutor grading in large classes, ATN Assessment Conference, Sydney, Australia.: 
Leong H., Sale D. & Wee C.S.P., (2009). Evaluating the Implementation of CDIO Programs at Singapore Polytechnic: The First Year, 5th International CDIO Conference, Singapore.: 
Pee S.H. & Leong H., (2005). Implementing Project Based Learning using CDIO Concepts, 1st Annual CDIO Conference, Ontario.: 
Pee S.H. and Leong H.,(2006). Reformulating Engineering Education in Singapore Polytechnic, 2nd International CDIO Conference, Linkoping.: 
Go to top