As a charity, it can be easy to assume that others will see the impact you are making. Often we receive positive emails from those we work with, such as:
‘The number of incidents have decreased since SRtRC started working with our learners. The learners seem to have more of an understanding of the impact of the language they use.’
But it may not be so clear for those who do not see our day-to-day work: going into schools and running educational workshops to develop an understanding of racism and what we can do to improve society.
How do we assess our work?
The main way we assess our work is through surveys. We sample a number of primary and secondary school pupils before and after the workshops and then again, three to six months later to assess the longer term impact of our interventions.
We also invite every teacher involved in the sessions to complete surveys.
In addition to this, the charity keeps a log of all incidents reported to us, our response and the follow-up work that was carried out.
In terms of adult training, including initial teacher training, again surveys are used.
How do we ensure these methods are fit for purpose?
We regularly evaluate these surveys in terms of language used, the administering of the survey and how questions are framed in order to ensure that they are accessible as possible, while also capturing the correct information.
In some cases, surveys may not be the most effective form of data gathering. For example, if a pupil has additional learning needs, is younger or has low literacy levels, they may not be able to communicate their views effectively. As such, we have tailored our methods to the setting and the pupils where required. We use methods such as sticking coloured dots on the images that reflect opinions, consultations, oral feedback transcribed by the educator, trainer notes and photographs of session work.
Last year, we were lucky enough to be supported over the course of a few months by a volunteer analyst from the Department of Work and Pensions Office of National Statistics. She asked probing questions that made us reconsider and re-evaluate our methods.
What was our impact last year?
Last year, SRtRC worked with over 20,000 children and young people across Wales. 36% of surveyed primary pupils rated their confidence as talking about racism as good/excellent before the workshops, with this rising to 77% after the workshops. Pupil quotes included:
If you have any questions or queries around this, please feel free to contact us. The charity is always keen to show what good use is being made of the funding we receive!