Monitoring and Evaluation 2019 activities and workplan for

Monitoring and Evaluation 2019 activities and workplan for 2020 Anicet Sambala International Institute of Tropical Agriculture (IITA) Africa RISING ESA Project review and planning meeting 11 – 12 September 2019, Dar es Salaam, Tanzania

Outline 1. Main M&E activities in 2019 2. 3. Key project results (Targets & outcomes) 4. Workplan for 2020 Data management in Dataverse

M&E activities in 2019 1. Reviewed research protocols & workplans and defined the critical dataset of Ft. F indicators for each research activity 2. Conducted M&E support visits to Karatu, Kongwa & Malawi, also to Provide definition and guidance on Ft. F & custom indicators Support data collection (Ft. F, exposure & scaling-up) Collect basic information on beneficiaries 3. Updating the Beneficiary and Technology Tracking Tool (BTTT) 4. Tracking & reviewing data quality and process requests in Dataverse 5. Updated PMMT 6. Reviewed the ESA M&E framework

Project beneficiaries/1 Target HH participating directly in AR research Phase II Direct beneficiaries from BTTT update 2019 • Malawi: 4, 649 • Tanzania: Update going on • Zambia: Update going on

Project beneficiaries/2 Targets HH in AR development partner activities phase II Targets and Achievement with the current partnerships

Key project outcomes- 2019

Scaling-up farmers – breakdown/1

Scaling-up farmers – breakdown/2

Scaling-up farmers – breakdown/3

Exposure farmers – overall

Dataverse…/1 What’s that? Centralized data repository for AR-generated data and documentation Why upload data on Dataverse? • • • To ensure research integrity and validation of results To increase research efficiency and impact To facilitate data security and minimize the risk of data loss To enable research continuity through secondary data use To ensure compliance with donor requirement To link/register AR datasets with USAID DDL (happening now!)

Dataverse…/2 Tracking Dataverse data uploads • Chief Scientists are responsible for ensuring: • Data collection plan is clearly identified in annual workplans • Data have been collected and uploaded annually or on an appropriately regular basis) • Support to the research teams to identify the appropriate timeline for open access • Data managers are responsible for compiling a list (“universe”) of datasets: • Collected thus far & those to be collected in FY 2019 and beyond • Along with info about experiment type and duration • …by reviewing work plans and progress reports…against which the completeness of (current and future) datasets on Dataverse can be assessed.

Dataverse…/3 Researchers • Having a Dataverse account gives you more control over your own and your team’s datasets • https: //dataverse. harvard. edu/dataverse. xhtml? alias=Africa. RISING • Once you create an account, IFPRI Dataverse administrator will assign different user rights (administrator, contributor, etc. ) as necessary: • Contributor account (for researchers): allows you to monitor access to your (restricted) datasets and downloads • Administrator account (for project manager/chief scientist account): allowed to add datasets, contribute to existing datasets, access and review restricted datasets uploaded by team members

Dataverse…/4 Review checklist • Metadata should be complete and consistent • PII (Personal Identifying Information -name, phone number, address, national identification number-) should be restricted • Supporting documentation (codebooks, survey questionnaires, sampling methodology, protocols) to assist with proper processing, extraction, and interpretation of the data should be submitted • Variables should be appropriately labelled; codebook and values (including value labels) in the datasets should be consistent.

Dataverse…/5 Dataverse dataset and file management 1 st Step 2 nd Step 3 rd Step Researchers complete Dataverse metadata template…. crucial for proper tagging and discoverability Researchers submit completed metadata, deidentified data files, documentation, and codebook to IFPRI M&E team and Dataverse administrator review submitted documents and data and uploads them (interoperability)

Dataverse…/6 Identified gaps in submission to Dataverse • Absence/Incomplete submissions • PII uploaded while confidential • Supporting documents not uploaded or incomplete • Datasets too raw to extract/interpret information; unfriendly for M&E purposes Recommended • Summaries of key preliminary findings be prepared and uploaded into dataverse

Other indicators

Ft. F indicators - challenges 1. Understanding Ft. F indicators (definition, targets, aggregation, etc. ) 2. Difficulty in accurately counting number of hectares under improved management practices & technologies (indicator EG. 3. 2 -25) 3. Absent/Incomplete targets 2019 -2021

Challenges related to BTT 1. Incomplete information on direct beneficiaries (sex, age, contact info, primary role, education) 2. Poor recording and documentation of ancillary information (e. g. new sites, new farmers, dropouts & reasons, technologies tested, etc. )

Ft. F indicators - timelines for reporting October 4: Annual FTFMS Webinar October 15: FTFMS opens October 30 (Internal): Ø Performance narrative submission to IITA for review Ø Ft. F indicators + discrepancy narratives submission to IFPRI for aggregation • November 9: Data submission to USAID for review • November 16: FTFMS data submission deadline • November 30: USAID data submission approval in FTFMS • • •

M&E workplan 2020 M&E Data Manager 1. Interact with AR researchers to secure necessary data and information for populating the BTTT 2. Participate & develop a centralized database of farmer field days and scaling beneficiaries using AR monitoring tools. 1. 2. AR Researchers Update & document beneficiary records (sex, age, education, contacts, HH information holder, dropout) Ensure all datasets of research conducted since 2012 have been submitted as required (datasets, metadata & supporting documents)

M&E workplan 2020 M&E Data Manager 3. Review datasets currently uploaded on Dataverse by ESA researchers since 2012 4. Review project workplans and other documentation since 2012 and prepare a list of datasets researchers proposed to collect 5. Ensure timely (and complete) submission of FTF indicators data for Fiscal Year 2019. AR Researchers 3. Ft. F data: § Carefully review your FY 2019 targets and share with the Data Manager § Complete and Submit Ft. F data on actual achievements for FT 2019 § Ensure consistent and adequate level of disaggregation § Provide consistent narrative where actuals and targets differ more than 10% 4. Include in your workplans, M&E support meetings

Questions for discussion • Are we on the right track, both on the BTTT, scaling-up, and exposure monitoring? • Any challenges? • What would you suggest?

Thank You Africa Research in Sustainable Intensification for the Next Generation africa-rising. net This presentation is licensed for use under the Creative Commons Attribution 4. 0 International Licence.