Wednesday, July 25, 2012

What Makes a Bad Rubric?

Tierney and Simon (2004, ¶ 5) suggest that many rubrics are flawed due to a lack of consistency across the performance criteria descriptors. Performance criteria reflect the "dimensions of the performance or product that is being taught and assessed." These authors recommend that the performance criteria should remain consistent from level to level. Simply, the attributes listed in each criterion should be the same across all levels of quality. Another common mistake that causes a lack of consistency across the criteria is the use of excessively negative language to describe categories on the lower end of the quality continuum and excessively positive descriptors for the opposite end of the continuum.

Tips
  1. Avoid imprecise language.
  2. Avoid negative language.
  3. Establish valid categories.
  4. Match criteria to task requirements and goals/objectives.
  5. Use observable behaviors or product characteristics.
  6. Use clear language that students can understand.
  7. Difference between levels should be clear.
References

Tierney, R. & Simon, M. (2004). What's still wrong with rubrics: Focusing on the consistency of performance criteria across scale levels. Practical Assessment, Research & Evaluation, 9(2). Retrieved from http://PAREonline.net/getvn.asp?v=9&n=2 

Thursday, July 5, 2012

Test to Gauge Potential for Success

The SmarterMeasure Learning Readiness Indicator is a web-based tool which assesses an undergraduate learner's likelihood for succeeding in an online and/or technology rich learning program. SmarterMeasure indicates the degree to which an individual student possesses attributes, skills and knowledge that contribute to success including:

 - Self-motivation
 - Time-management skills
  - Self-discipline
 - On-screen Reading Rate and Recall
 - Persistence
 - Availability of time
 - Ability to use a laptop, printer, software, and the Internet
 - Typing speed and accuracy

SmarterMeasure is a tool that allows self-assessment of strengths and weaknesses. The report also generates a list of resources to help students improve their study skills; however, SmarterMeasure is not intended to be used as a screening tool for admission or enrollment.