4. Implement
4What tools and processes are needed in order to regularly measure the change and adapt?
Introduction
A rubric matrix (rubric) sets out clear criteria and standards for assessing different levels of performance, broken down in different categories1.
A rubric was developed for Goalkeepers to track their project specific targets and progress on a quarterly basis. The Goalkeepers tracked a set of domains relevant to their current and intended project stage.
A rubric is a method/tool of evaluation that provides examples of progress according to different criteria to help identify and assess learning. A rubric is often used to communicate your task expectations, provide meaningful feedback for reflection and improvement, and measure performance. A rubric can be used to observe or assess your performance in an initiative or project that may have a mix of developmental stages which cannot easily be measured with a single indicator or single set of indicators.
Step 1: Create the criteria for assessment
When designing your rubric criteria (first column in matrix) consider the following:
- What skills are utilised in your project?
- What learning do you want out of this project?
- What are the components of the project?
- How will the learning be demonstrated in the project?
Write up your criteria based on the above.
Tip: Too many criteria can be overwhelming, try prioritise 5-7 criteria based on project need and objectives of the assessment.
Remember: Your assessment criteria need to be: Clear and concise (i.e. be clear on what the various stages 0-5 mean in practice); Measurable; Central to the goal of the project; and Aligned with the learning outcomes.
Step 2: Create the rating scale
When designing your rating scale (top row in matrix) consider the following:
- The scale does not have to be fixed for every criterion – it may vary from one section to another
- Include the levels of achievements
- What are the numerical values or the qualitative descriptions (optional) for the levels of achievements?
In order to achieve a more detailed feedback use a 3- or 5- point system and list the scoring from the lowest to the highest.
Step 3: Make descriptions for each rating level per criteria
For each level of achievement, include a short description of the level within the criteria. Make sure your descriptions meet the expected expectations of the project goals and objectives.
Step 4: Use your rubric
Once your rubric has been designed, it needs to be implemented and tested throughout the project life cycle:
- On a monthly or quarterly basis (choose a frequency that makes sense to your project) score your project progress against each criteria: Choose which rating description best describes the status of the project at that point in time for each criteria.
- Test the rubric’s reliability and validity. For example, are your levels of achievements consistent? Do your descriptions make sense? Is it producing useful progress information for the project team?
- Communicate back to grantees, partners or members what the rubric is telling, how progress is measured etc.
Questions to consider:
- Does your rubric measure what you want to assess?
- Do your criteria reflect the objectives of your project?
More rubric examples:
- Example 1 by BetterEvaluation
- Example 2 by Research Gate / UMES
- Example 3 applied in project to advance the rights of people with disabilities
Rubric Matrix and Monitoring Template
Use this Excel template to set up your rubric matrix and monitor project progress.
Download 64.55 KB
Adapt this Pilot Progress Report from CIVICUS’ Diversity and Inclusion programme: