The monitoring and evaluation of community engagement activities

The monitoring and evaluation of community engagement activities at universities: The case of the North-West University Prof Hendri Coetzee (presenter) and Prof Werner Nell North-West University

Outline • • • Background / problem statement NWU's communities NWU's CE activities NWU's approach to monitoring and evaluating CE Proposed database Demonstration of database Examples of outputs (x 2) NWU's impact (2016 results) Conclusion and recommendations

Background / problem statement • Integration of Community Engagement (CE) in research, teaching-learning and outreach (perceptions, challenges and implications) • Required by DOE • Support risk management • Can also inform the strategic direction of universities • The case of North-West University (NWU)

NWU's communities

NWU's CE activities Community Impact Model

NWU's approach to monitoring and evaluating CE • Theory of practice (what it is that they want to change) • Theory of change (how they plan to change it) • Logic-frame model Data on all aspects are needed Community needs/assets Inputs Outcome Impact

Proposed database Category linked to logic frame Community needs/Assets Feasibility/Sustainability Baseline Funding General information Engagement nr Campus Rational for inclusion To identify theory of practice To determine the potential feasibility/sustainability of the activity To keep tract of the number of activities To develop and institutional profile of all CE activities General information Faculty, school, department or entity To develop and institutional profile of all CE activities General information General information Name of engagement leader (EL) Contact details of EL Engagement name Activity description Geographical location of activity Type of engaged research activity To identify a relevant contact person To improve communication To document activities To provide additional information (if needed) To monitor/manage risk To develop and institutional profile of all CE activities General information Type of engaged teaching-learning activity To develop and institutional profile of all CE activities General information Type of outreach activity To develop and institutional profile of all CE activities General information (inputs) Status Ethical clearance Names and contact details of main external collaborators To monitor activities Inputs Inputs Outputs Nr of staff involved Nr of students involved Frequency of engagement Time spend What else are you investing in the project? Who do you reach (nr of and contact details of partners/beneficiaries) What are the short-term results? What are the medium-term results? What are the long-term results (ultimate impact)? To report on To report on General information What are the benefits for the NWU? (provide your internal impact) How often do you report on the project? Legal-matters – do you have any agreement in place? General information Additional documentation (upload here) To add value to reports/access additional information General information Photographs or visual materials or links (upload here) To add value to reports/access additional information Outcome/impact Activity detail To report on To monitor activities To manage risk

Demonstration of database http: //v-kidz-ap-win 1. adt. nwu. ac. za/Kidz. Net

Example of output

Example of output

NWU's impact (2016 results) Item Behaviour of contractors linked to the NWU (as service providers) Professional (discipline based) advice Professional (discipline based) support Broad-based black economic empowerment strategy Community projects Community services Answers were recorded on an ordinal scale ranging from a ‘negative impact’, to ‘no impact’, and a ‘positive impact’, with another option allowing participants to indicate that they ‘do not know’. Negative impact Do not know (%) Total 47. 5 14. 8 24. 1 13. 6 Tlokwe 43. 8 11. 4 29. 5 15. 2 Emfuleni 60. 7 8. 8 21. 1 9. 4 Mahikeng 30. 6 25. 8 24. 8 18. 7 Total 42. 6 16. 4 19. 5 21. 5 Tlokwe 33. 6 16. 6 22. 3 27. 5 Emfuleni 56. 9 11 15. 4 16. 7 Mahikeng 27. 7 24. 2 23. 5 24. 5 Total 38. 1 16. 3 20. 6 25 Tlokwe 30. 3 12. 8 29. 4 27. 5 Emfuleni 53. 8 9. 3 15. 3 21. 7 Mahikeng 20. 6 29 22. 3 28. 1 Total 37. 3 12. 5 30. 3 19. 9 Tlokwe 35. 1 12. 5 31. 7 20. 7 Emfuleni 51. 3 10. 4 20 18. 2 Mahikeng 18. 4 15. 5 44. 2 21. 9 Total 34. 5 7. 4 18. 8 39. 4 Tlokwe 24. 9 4. 7 22. 1 48. 4 Emfuleni 45. 9 7. 5 14. 9 31. 6 Mahikeng 24. 2 9 22. 3 44. 5 Total 29. 9 8. 3 24. 0 37. 8 Tlokwe 13. 7 6. 6 27. 5 52. 1 (%) No impact (%) Positive impact (%)

Item Law clinics for the public Non-discipline based volunteerism by staff The social behaviour of NWU students (after hours) The general behaviour of NWU students The general behaviour of NWU staff The availability of the NWU’s infrastructure/facilities for use by the public. Negative impact Do not know (%) Total 34. 3 10. 3 21. 9 33. 5 Tlokwe 25. 4 7 22. 1 45. 5 Emfuleni 0 0 Mahikeng 18. 2 14. 6 26. 8 40. 4 Total 37. 1 12. 6 26. 4 23. 9 Tlokwe 30 12. 2 25. 4 32. 4 Emfuleni 48. 3 10. 7 23. 6 17. 4 Mahikeng 25. 6 15. 6 31. 2 27. 6 Total 33. 6 13. 8 31. 5 21. 1 Tlokwe 32. 7 10. 9 33. 2 23. 2 Emfuleni 44. 1 14. 3 26. 1 15. 6 Mahikeng 18. 8 15. 3 38. 3 27. 6 Total 36. 4 11. 2 29. 1 23. 3 Tlokwe 32. 1 7. 5 33. 5 26. 9 Emfuleni 43. 9 13 23. 8 19. 2 Mahikeng 28. 2 11 33. 8 26. 9 Total 37 8. 4 27. 9 26. 6 Tlokwe 32. 2 7. 1 29. 4 31. 3 Emfuleni 45. 7 8. 8 24. 3 21. 2 Mahikeng 27. 6 8. 8 32. 1 31. 5 Total 41. 4 8. 7 23. 2 26. 7 Tlokwe 34 8. 5 25 32. 5 Emfuleni 49. 8 6. 8 18. 1 25. 3 (%) No impact (%) Positive impact (%)

5 -point scale ranging from 1 (don’t agree at all) to 5 (fully agree) Results: Further impact/ contributions

Conclusion and recommendations The NWU's current database includes a number of very relevant (reportable) aspects. This is in line with what is required by the DOE and institutional management. Additional aspects will however have to be included to increase the impact of its engaged activities. In order to do so: • Theories of practice and change will have to be clarified. • Measurable (specific) indicators of change will have to be added. • Standardised categories for inputs, outcomes and impact will have to be created.

Contact details Prof Hendri Coetzee hendri. coetzee@nwu. ac. za