Evaluation Beyond Traditional Metrics: Key Reflections from SAMEA’s 9th Biennial Conference

Blog by Amahle Nciweni – Emerging Evaluator at SAMEA (2024)

Abstract

Attending the SAMEA 9th Biennial Conference offered a profound learning experience, showcasing innovative evaluation practices and fostering meaningful discussions on how to adapt and thrive in a rapidly evolving field. Here are my key takeaways and reflections as an emerging evaluator.

Introduction

In a rapidly evolving world, evaluation is moving beyond traditional metrics to embrace dynamic, tech-enabled tools, adaptive evidence, and an intersectional lens that accounts for the diversity of programme impacts. SAMEA 2024’s 9th Biennial Conference brought this shift to life, with sessions exploring how technology is transforming MERL (Monitoring, Evaluation, Research, and Learning), advancing evidence-based adaptive management, and promoting the power of inclusive evaluation practices.

The conference highlighted that real impact requires more than numbers; it demands innovation, responsiveness, and a commitment to inclusion. For both emerging and seasoned evaluators, it demonstrated how evaluations can go beyond metrics to create lasting, transformative outcomes.

Key Takeaways from Sessions

Embracing Technology for Evaluation

One particularly noteworthy session explored the use of AI tools such as Doc-Chat to perform a SWOT analysis for the Western Cape Department of Agriculture. It illustrated how AI can simplify evaluation processes by sifting through large amounts of text data and identifying key insights and themes.

Doc-Chat achieved an impressive feat by extracting 28 key themes from 30 documents. However, challenges such as misread images and misaligned data also highlighted AI’s limitations. The session emphasised a key message: technology is a tool, not a replacement for evaluators. Human judgment remains essential to ensure insights are both relevant and reliable.

Similarly, the presentation about Ghana’s Performance Tracker app demonstrated the power of digital innovation in promoting accountability and accessibility—providing daily health updates and enabling public service applications. However, discussions also showed that user-centric design and political stability are crucial for successful deployment.

Evaluating Social Impact Inclusively Amid Complexities

Another standout session focused on data-informed advocacy to address gender-based violence (GBV) in KwaZulu-Natal. It showcased a comprehensive intervention model involving survivors, traditional leaders, and community groups, supported by organisations like USAID.

It was inspiring to see how data systems were pivotal in driving targeted responses. However, challenges like low response rates and difficulties in documenting outcomes highlighted the need for more participatory approaches.

This resonated with me deeply:

As evaluators, are we genuinely empowering communities—or are we unintentionally excluding them?

Adaptation Through Learning-Based Approaches

The seminar on Learning-Based Management (LBM) systems offered a refreshing alternative to traditional frameworks like the Logical Framework Approach (LFA). LBMs emphasise continual learning and adaptation, incorporating methods such as Outcome Mapping and Outcome Harvesting.

This approach was particularly inspirational as it shifts evaluation from rigid accountability towards frameworks that encourage reflection and improvement. It reminded me that evaluation is as much about the journey as the results.

Co-Creation Workshop: Climate Change and Gender Through an Intersectional Lens

One of the most eye-opening experiences was attending a session organised by Southern Hemisphere on the intersection of climate change and gender. The discussions highlighted how climate change disproportionately affects women—especially those from vulnerable communities—and how standard evaluations often overlook these impacts.

The workshop stressed the importance of gender-sensitive evaluation approaches that address systemic inequalities. I left with a renewed commitment to incorporate intersectionality into my future work.

Relevance to Emerging Evaluators

As a young evaluator, I reflected on how these insights align with my professional journey. The conference reinforced that evaluation is about people, not just data—understanding diverse perspectives, asking the right questions, and driving meaningful change.

The emphasis on collaboration, especially in GBV sessions, was a powerful reminder that partnerships across disciplines and geographies amplify impact. Discussions about digital tools like Doc-Chat further showed that technology, when thoughtfully applied, can enhance our work without compromising ethical standards.

Personal Reflection and Call to Action

The conference challenged me to consider:

• How do we balance technical innovation with ethical responsibility?

• How do we ensure data integrity and protect participant privacy?

As AI and real-time management systems become more common, the human elements of evaluation—empathy, cultural understanding, and ethical judgment—remain indispensable.

I encourage fellow evaluators to embrace methods and frameworks that prioritise diversity, responsiveness, equity, and sustainability. Whether using learning-based models or leveraging social media for data collection, our work must amplify marginalised voices and foster real transformation.

Conclusion: A Vision for the Future

The SAMEA Biennial Conference was more than an event; it was a communal wake-up call (Vuka-VUKA!) to reimagine evaluation in a complex, modern world. It was a journey of growth, reflection, and inspiration.

As I look ahead, I am excited to apply these lessons in my work and remain engaged with this vibrant evaluation community. I am filled with joy and motivation to contribute to this development.

To those who attended the conference: what were your key takeaways?
And to those who could not make it: how do you envision the future of evaluation?

Let us keep the conversation alive—share your thoughts, and let’s build a future where evaluation drives real, lasting change.Let us keep the conversation alive—share your thoughts, and let’s build a future where evaluation drives real, lasting change.Let us keep the conversation alive—share your thoughts, and let’s build a future where evaluation drives real, lasting change.