Issue link: https://takingitglobal.uberflip.com/i/1542824
R. Adeboye, C. Flewelling,V. Ogbole, E. O'Sullivan 13 questions, only the rating scale questions were used. The total number of responses over the period was 2992. Evaluation Questions The specific evaluation questions and associated targets are listed below, along with descriptions of the lines of evidence that were used to address each question. 1. Is the program targeting the right outcomes? ● Target: the program outcomes reflect user needs and priorities. The principal line of evidence used to explore this question consisted of Interviews with Principals. To respect the evaluation timeline, it was only possible to interview four respondents, who were identified by Connected North. While this small, purposefully selected sample is subject to potential bias, the risk is somewhat reduced given that the purpose of these interviews was not to assess program performance but to understand user needs, expectations, and perspectives on the program's intended outcomes. 2. Is the program well-designed? ● Target: key elements of the program design reflect pedagogical best practices Using the Literature Review of educational best practices, this question examines whether the Program Implementation Assumptions listed above are reasonable. That is, is there evidence that these design and delivery features are the right ones to trigger the outcomes chain? This question also examines the Program Theory Assumption surrounding whether virtual experiences convey comparable benefits to in-person experiences. 3. Is the outcomes chain reasonable? ● Target: The linkages among the elements of the outcomes chain are supported by pedagogical research. This question looks at the outcomes chain itself; i.e., whether there is evidence that the short- term outcomes will lead to the medium- and long-term outcomes, respectively. This question was also addressed using Literature Review on educational best practices to determine whether these relationships are consistent with established evidence on how student motivation, identity, and engagement, as well as teacher capacity, confidence, and cultural responsiveness, interact to influence educational outcomes. 4. Is the program being implemented as designed? ● Target: Teacher and Content Providers descriptions of how the program works indicate that it is being implemented as designed This question essentially tests the Program Implementation Assumptions (PIAs), determining what the evidence says about whether Connected North sessions are culturally relevant, interactive, etc. Key Informant Interviews were employed as described below: