top of page

ABOUT US

By: Patricia Moore Shaffer

Principal & CEO


Indigenous programs hold immense potential to revitalize communities, languages, and cultural practices. But measuring their success often feels like trying to fit a round peg into a square hole. Western evaluation frameworks, with their emphasis on objectivity, generalizability, and standardized metrics, often clash with Indigenous values and ways of knowing.


There's a growing movement toward grounding evaluation of Indigenous programs in Indigenous values and priorities. Key principles include:


1. Centering relationships

Western evaluation often feels transactional, but Indigenous evaluation prioritizes relationships. Build trust with participants, listen deeply to their needs and aspirations, and involve them throughout the evaluation process. As LaFrance (2010) emphasizes, evaluation should be "for the community, with the community, and by the community."


2. Focusing on holistic well-being

Indigenous evaluation goes beyond numbers and test scores. It considers the program's impact on cultural identity, language revitalization, spiritual well-being, and community cohesion. The Bowman and Archibald (2023) framework offers a helpful guide, encompassing dimensions like cultural revitalization, governance, and relationships.


3. Embracing storytelling

Indigenous knowledge is traditionally passed down through stories. Storytelling methods like focus groups, circles, and visual arts gather rich data that captures the program's nuances and complexities. This aligns with the "strengths-based" approach highlighted in the BCNEIHR toolkit (2023), focusing on what's working rather than deficits.


4. Prioritizing cultural protocols

Respecting cultural protocols is essential. Guidance from Elders and knowledge keepers help ensure evaluation methods are culturally appropriate.


5. Being flexible and adaptable

Indigenous communities are diverse and dynamic. Similarly, evaluators must be prepared to adjust their approach based on the specific program and community context.


By following these principles, we can move away from extractive evaluation practices that benefit outsiders more than the Indigenous communities we engage and serve. Instead, we can build evaluation processes that are culturally grounded, ethical, and truly answer the question: "Is this program making a good life for Indigenous people?"


This is just a starting point, of course! There's so much more to learn and explore in the realm of Indigenous evaluation. But by centering relationships, holistic well-being, and Indigenous ways of knowing, we can reclaim evaluation as a tool that empowers Indigenous communities.


Learn more about Shaffer Evaluation Group's evaluation of indigenous education services and programs by visiting our website.


Updated: Dec 18, 2023

By: Patricia Moore Shaffer

Principal & CEO


In the U.S. and around the world, nearly one million military-connected kindergarten - grade 12 students are enrolled in public education. These students move every two to three years because they are dependents of active-duty service members. Although these education transitions offer opportunities for learning, they can also present challenges for educational continuity while also impacting students' social and emotional well-being.


Public school staff can play a vital role in supporting military-connected students and their families. Here are 5 ways to support military-connected students that we've observed through our evaluation studies of DoDEA grant projects.


1. Promote an inclusive school climate.

This includes creating a welcoming and supportive environment for all students, regardless of their military affiliation. School staff can do this by:

  • Learning about military culture and the unique challenges faced by military-connected students

  • Celebrating military holidays and events

  • Displaying military symbols and artwork in the school

  • Providing opportunities for military-connected students to share their experiences with their peers

  • Fostering a sense of community and belonging for all students

2. Identify and provide resources for military-connected students and their families.

School staff can help military-connected students and their families access the resources they need, such as:

  • Military family support programs

  • Financial assistance

  • Mental health services

  • Academic support

  • Tutoring

  • Dedicated webpage with school- and community-based resources for military families

3. Provide goal-focused, evidence-based, short-term group and individual counseling services to address military-connected students' social/emotional needs.

Students may experience a range of social-emotional challenges, such as anxiety, depression, and grief. School counselors can provide support to help students cope with these challenges and develop healthy coping mechanisms.

4. Use data-informed approaches to identify academic needs and support remediation efforts for military-connected students experiencing learning loss/gaps due to transitions. Students may experience academic disruptions due to frequent relocations and deployments. School staff can use data to identify students who are struggling academically and provide them with the support they need to succeed.

5. Advocate for school policies that increase awareness, knowledge, support, and success when working with military-connected students. School staff can play a role in advocating for school policies that support students, such as flexible attendance policies and transition planning for students who are deploying or relocating.

 

By implementing these effective practices, school staff can help military-connected students succeed academically, socially, and emotionally.


Since 2011, Shaffer Evaluation Group has supported school-based initiatives supporting military-connected students and their families. Please contact us to learn how program evaluation can support your military-connected student initiatives.


The nationwide drops in state standardized test scores during the pandemic demonstrated one reason why it is important to use multiple measures, but also that it is important to use measures beyond achievement data. In this month’s blog post we will explore a variety of ways K-12 projects can demonstrate engagement in science, technology, engineering, and math (STEM).


Course Enrollment

To use course enrollment there will need to be a list of courses established. For STEM engagement, SEG often uses a list of STEM courses that would be considered optional or advanced. Examples of potential indicators using this data might include:

  • The number or percentage of students enrolled in at least one advanced/optional STEM course

  • The number of seats filled in advanced/optional STEM courses

  • The average number of advanced/optional STEM courses with student enrollment


Certification Enrollment

The number of students enrolling in STEM-related certificates can also be an indicator of engagement. These might be STEM-related Career and Technical Education Endorsements or professional certifications. Examples of potential indicators might include:

  • The number or percentage of students enrolled in a STEM-related certification program

  • The number or percentage of students who have earned a STEM-related certificate


Extracurricular Activities

Engagement in extracurricular STEM activities can be used as a measure. Often when people think of extracurricular activities they think about afterschool clubs and organizations, but this could also be clubs that happen during the school day, family events, and enrichment opportunities. Examples of potential indicators might include:

  • The number or percentage of students participating in STEM-related extracurricular activities


Student Survey

Student surveys are frequently used for measuring student outcomes, but not always used to measure engagement. Project directors may consider using pulse surveys or exit surveys to measure STEM engagement. Pulse surveys are brief surveys that can be administered with varying frequencies (e.g., monthly, quarterly). Exit feedback forms can be used to measure students’ experiences with an event such as a lab activity, visit from a STEM professional, or field trip. These can be designed to include as few as 2-3 questions to capture engagement at the end of the activity. Examples of potential indicators from surveys and feedback forms might include:

  • The percentage of students interested in STEM Careers

  • The percentage of students interested in pursuing a STEM degree in the future

  • The percentage of students who “agreed” or “strongly agreed” they had fun with an activity

  • The percentage of students who “agreed” or “strongly agreed” they enjoy the STEM activities they complete in class


Although STEM examples are used, these types of measures and indicators can be applied to all content areas. During the evaluation planning process, Shaffer Evaluation Group works with clients to design a series of measures that are responsive to your project’s needs and can effectively demonstrate success. If you are interested in partnering with SEG, we would love to talk with you!

Anchor 1

Shaffer Evaluation Group, 1311 Jamestown Road, Suite 101, Williamsburg, VA 23185   833.650.3825

Contact Us     © Shaffer Evaluation Group LLC 2020 

bottom of page