From Tarek Azzam in Accra, Ghana: Yesterday was the first day of the AfrEA Conference and it was busy. I, along with a group of colleagues, presented a workshop on developing evaluation capacity. It was well attended—almost 60 people—and the discussion was truly inspiring. Much of our conversation related to how development programs are typically evaluated by experts who are not only external to the organization, but external to the country. Out-of-country evaluators typically know a great deal about evaluation, and often they do a fantastic job, but their cultural competencies vary tremendously, severely limiting the utility of their work. When out-of-country evaluators complete their evaluations, they return home and their evaluation expertise leaves with them. Our workshop participants said they wanted to build evaluation capacity in Africa for Africans because it was the best way to strengthen evaluations and programs. So we facilitated a discussion of how to make that happen.
At first, the discussion was limited to what participants believed were the deficits of local African evaluators. This continued until one attendee stood up and passionately described what local evaluators bring to an evaluation that is unique and advantageous. Suddenly, the entire conversation turned around and participants began discussing how a deep understanding of local contexts, governmental systems, and history improves every step of the evaluation process, from the feasibility of designs to the use of results. This placed the deficiencies of local evaluators listed previously—most of which were technical—in crisp perspective. You can greatly advance your understanding of quantitative methods in a few months; you cannot expect to build a deep understanding of a place and its people in the same time.
The next step is to bring the conversation we had in the workshop to the wider AfrEA Conference. I will begin that process in a panel discussion that takes place later today. My objective is to use the panel to develop a list of strategic principles that can guide future evaluation capacity building efforts. If the principles reflect the values, strengths, and knowledge of those who want to develop their capacity, then the principles can be used to design meaningful capacity building efforts. It should be interesting—I will keep you posted.
From Tarek Azzam in Accra, Ghana: The last two days have been hectic on many fronts. Matt and I spent approximately 4 hours on Monday trying to work out technical bugs. Time well spent as it looks like we will be able to stream parts of the conference live. You can find the schedule and links here.
I have had the chance to speak with many conference participants from across Africa at various social events. In almost every conversation the same issue keeps emerging—the disconnect between what donors expect to see on the ground (and expect to be measured) and what grantees are actually seeing on the ground (and do not believe they can measure). Although this is a common issue in the US where I do much of my work, it appears to be more pronounced in the context of development programs.
This tension is a source of frustration for many of the people with whom I speak—they truly believe in the power of evaluation to improve programs, promote self-reflection, and achieve social change. However, demands from donors have pushed them to focus on evaluation questions and measures that are not necessarily useful to their programs or the people their programs benefit. I am interested in speaking with some of the donors attending the conference to get their perspective on this issue. I believe that donors may be looking for impact measures that can be aggregated across multiple grantees, and this may lead to the selection of measures that are less relevant to any single grantee, hence the tension.
I plan on keeping you updated on further conversations and discussions as they occur. Tomorrow I will be helping to conduct a workshop on building evaluation capacity within Africa, and really engaging participants as they help us come up with a list of competencies and capacities that are uniquely relevant to the development/African context. Based on the lively conversations I have had so far, I anticipate a rich and productive exchange of ideas tomorrow. I will share them with you as soon as I can.
Hello my name is Tarek Azzam, and I am an Assistant Professor at Claremont Graduate University. Over the next few days I will blog about my experiences at the 6th Biennial AfrEA Conference in Accra, Ghana. The theme of the conference is “Rights and Responsibility in Development Evaluation.” As I write this, I await the start of the conference tomorrow, January 9.
The conference is hosted by the African Evaluation Association (AfrEA) and Co-Organized by the Ghana Monitoring & Evaluation Forum (GMEF). For those who live or work outside of Africa, these may be unfamiliar organizations. I encourage you to learn more about them and other evaluation associations around the world through the International Organisation for Cooperation in Evaluation (IOCE).
Ross Conner, Issaka Traore, Sulley Gariba, Marie Gervais, and I will present a half day workshop on developing evaluation capacity within Africa, along with a panel discussion.
I am also working with Matt Galen to broadcast via the internet some of the keynote sessions at the conference and share them with others. I will send links as they become available.
I am very excited about the start of the conference. It is a new venue for me and I look forward to sharing my experiences with you.