Issue link: https://takingitglobal.uberflip.com/i/1542824
R. Adeboye, C. Flewelling,V. Ogbole, E. O'Sullivan 2 Contents Executive Summary ........................................................................................................................ 4 Introduction and Purpose of the Evaluation .................................................................................... 4 Program Description ....................................................................................................................... 5 Evaluation Methodology ................................................................................................................. 8 Evaluation Approach .................................................................................................................. 8 The Program Theory ................................................................................................................. 10 Evaluation Questions and Associated Lines of Evidence ......................................................... 12 Coding, Analysis, and Interpretation ........................................................................................ 15 Findings......................................................................................................................................... 18 Evaluation Question 1: Is the program targeting the right outcomes? ...................................... 21 Evaluation Question 2: Is the program well designed? ............................................................ 21 Program Implementation Assumption #1: Sessions Provide Otherwise Unavailable Educational Opportunities .................................................................................................... 22 Program Theory Assumption 1: Virtual Experiences Convey Comparable Benefits to In- Person Benefits ..................................................................................................................... 23 Program Implementation Assumption #2: Sessions are Culturally Relevant ....................... 24 Program Implementation Assumption #3: Sessions are Interactive ..................................... 27 Program Implementation Assumption #4: Sessions are Aligned with School Curriculum and Customizable......................................................................................................................... 28 Program Implementation Assumption #5: Sessions are High Quality ................................. 28 Program Implementation Assumption #7: Teachers Provide Strong Support for Program Implementation ..................................................................................................................... 30 Program Implementation Assumption #8: Participants Have Access to Appropriate Teleconferencing Technology as well as Reliable Internet Connectivity ............................ 30 Evaluation Question 3: Is the outcomes chain reasonable? ...................................................... 31 The Student' Outcomes Chain .............................................................................................. 31 The Teachers' Outcomes Chain ............................................................................................ 34 Evaluation Question 4: Is the program being implemented as intended? ................................. 37 Implementation Assumption #1: Sessions Provide Otherwise Unavailable Educational Opportunities......................................................................................................................... 37