top of page

ABOUT US

By: Patricia Moore Shaffer, PhD

Principal & CEO


Professional development for teachers is essential for improving student outcomes and keeping up with the latest educational practices. But how do we know if these training investments are yielding results? One of the most important aspects of any teacher professional development program is its evaluation. As Thomas Guskey, a leading expert on professional development, highlights in his work, evaluating professional learning is more than just checking off a list of completed workshops. It’s a thorough process that considers multiple layers of impact, from teacher satisfaction to student achievement. In this blog post, we’ll explore an effective approach to evaluating teacher professional development, incorporating principles from Guskey’s model and other established training evaluation frameworks.


Why Evaluate Professional Development?

Before diving into the "how," let’s clarify why evaluating professional development is critical. Schools invest significant time and money into training teachers. Yet, without proper evaluation, it’s impossible to determine whether the effort is leading to desired outcomes, such as improved instructional practices and better student learning.


Evaluation ensures that professional development is not just a formality but a meaningful investment. It helps educators and administrators determine what’s working, what needs to be improved, and what future learning opportunities should look like.


Thomas Guskey’s Five Levels of Professional Development Evaluation

Guskey’s model for evaluating professional development provides a structured approach that considers the impacts of training over time. It's not enough to ask whether teachers liked the session or found it useful. Instead, Guskey encourages evaluators to dig deeper and consider multiple levels of impact:


  1. Participants' Reactions: The first level involves assessing how teachers responded to the professional development experience. Were they engaged? Did they find the content relevant and the delivery effective? While this level is often focused on immediate feedback (like satisfaction surveys), it’s essential because it sets the stage for deeper engagement in future training.

  2. Participants' Learning: The second level moves beyond satisfaction and looks at what teachers actually learned. This can be measured through assessments, reflective activities, or follow-up discussions. The goal is to ensure that participants are gaining new knowledge and skills that can inform their teaching practices.

  3. Organizational Support and Change: At this level, the focus shifts to the school or district environment. Are administrators and school leaders providing the necessary support for teachers to implement what they’ve learned? Guskey emphasizes that even the best professional development can fall flat if it isn’t reinforced by supportive policies, resources, and leadership.

  4. Participants' Use of New Knowledge and Skills: This level looks at how teachers apply what they’ve learned in their classrooms. Are they adopting new strategies? Are these strategies improving their teaching? This phase requires long-term monitoring through classroom observations, teacher self-reflection, and peer feedback.

  5. Student Learning Outcomes: The ultimate goal of professional development is to enhance student learning. At this final level, evaluators assess whether the professional development has led to tangible improvements in student achievement. This can be done by analyzing standardized test scores, student portfolios, or other performance indicators.


Incorporating Other Training Evaluation Models

In addition to Guskey’s framework, there are other well-established training evaluation models that offer useful insights into evaluating professional development. Kirkpatrick’s Four-Level Model, for example, shares similarities with Guskey’s approach and provides a simple yet effective structure for assessing training programs.

  1. Reaction: Similar to Guskey’s first level, this focuses on how participants felt about the training.

  2. Learning: This level assesses the knowledge and skills gained during the training.

  3. Behavior: Like Guskey’s fourth level, this examines whether participants are applying what they learned on the job.

  4. Results: This final stage aligns with Guskey’s focus on student outcomes, looking at the long-term impact of the training on broader organizational goals.


By blending these models, evaluators can ensure they are not only looking at teacher satisfaction and learning but also considering the broader impact on classroom practices and student achievement.


Practical Steps for Evaluation

How can schools and districts put these evaluation models into practice? Here’s a step-by-step guide for evaluating professional development:

  1. Pre-Training Assessment: Before the professional development begins, gather baseline data on teacher knowledge, skills, and student outcomes. This sets a starting point for measuring improvement.

  2. Post-Training Feedback: Immediately after the training, collect feedback from participants on their reactions. Use surveys, focus groups, or one-on-one interviews to capture their thoughts on the content, delivery, and overall experience.

  3. Learning Checks: To evaluate what teachers learned, incorporate knowledge assessments or reflective journals. Have teachers demonstrate new skills or describe how they plan to implement their learning.

  4. Classroom Observations and Peer Feedback: In the weeks and months following the training, observe teachers in the classroom. Are they using the strategies they learned? Encourage peer observations and discussions to foster a collaborative learning environment.

  5. Student Outcome Analysis: Finally, assess whether the professional development has led to improvements in student learning. Look at test scores, performance assessments, or other indicators of student growth. Keep in mind that changes in student outcomes may take time, so this step requires ongoing monitoring.


Conclusion

Effective teacher professional development doesn’t end when the workshop is over. It’s an ongoing process that requires careful evaluation at multiple levels over time. By using Thomas Guskey’s model or other training evaluation frameworks like Kirkpatrick’s, schools can ensure that their investment in professional development pays off—not just in terms of teacher satisfaction, but in improved teaching practices and, ultimately, better student outcomes.


In the end, the goal of professional development is to create lasting, meaningful change in the classroom. And that can only happen when we evaluate it with the same rigor and attention to detail that we bring to other areas of education.


Are you looking for an evaluation partner for your training or professional development program? Contact us and learn how we can support you.

By: Patricia Moore Shaffer, PhD

Principal & CEO


In today’s dynamic educational landscape, higher education institutions are increasingly adopting experiential learning to enhance student engagement and learning outcomes. This approach goes beyond traditional classroom teaching, providing students with hands-on, practical experiences that prepare them for real-world challenges.


What is Experiential Learning and Why is it Important?

Experiential learning is an educational philosophy that advocates for student learning through direct experience and reflection. It involves activities such as internships, co-ops, service learning, and project-based learning. This approach is vital as it fosters critical thinking, problem-solving skills, and deepens subject matter comprehension, thereby increasing student engagement and retention.


Designing Effective Experiential Learning Programs

To design effective experiential learning programs, higher education institutions have employed these strategies:


  • Integrate with Curriculum: Ensure that experiential activities align with academic goals and learning outcomes.

  • Collaborate with External Partners: Establish partnerships with businesses, non-profits, and community organizations for real-world projects.

  • Offer Internships and Co-ops: Provide structured opportunities for professional experience.

  • Implement Service Learning: Combine community service with academic coursework.

  • Develop Study Abroad Programs: Facilitate cultural and environmental immersion.


Successful Examples of Experiential Learning

There are many successful examples of experiential learning in the US higher education landscape. Here are a few to inspire you:


  • LaGuardia Community College: LaGuardia's experiential learning includes extensive internship opportunities and community-based projects that enhance students' professional skills and civic engagement.

  • Northeastern University’s Co-op Program: Integrates professional work experiences with academic study.

  • Stanford University’s d.school: Emphasizes design thinking through hands-on projects.

  • Valencia College: Offers service learning programs where students participate in community service projects as part of their coursework, promoting both academic learning and social responsibility.

  • Worcester Polytechnic Institute (WPI): Uses project-based learning to solve real-world problems.


Challenges and Solutions in Implementation

Implementing experiential learning programs presents several challenges. Resource allocation is a major concern as these programs can be resource-intensive. To address this, institutions can secure grants and form partnerships to support funding and logistics. Another challenge is assessing the outcomes of experiential learning. Developing clear assessment rubrics and using reflective practices can help measure student learning effectively. Additionally, scaling these programs for large student populations can be challenging. Leveraging technology, such as virtual simulations and online collaborative projects, can aid in making experiential learning scalable and accessible.


Benefits for Students and Institutions

Experiential learning offers numerous benefits for both students and institutions. For students, it enhances learning by providing a deeper understanding and retention of knowledge through practical application. It also improves career readiness by offering real-world experience and developing essential skills. Moreover, it fosters personal growth by increasing students’ confidence, independence, and sense of responsibility. For institutions, experiential learning enhances their reputation and attractiveness to prospective students. It strengthens engagement with industry and community partners, creating valuable networks and opportunities. Additionally, it contributes to fostering a culture of innovation and practical problem-solving within the institution.


Experiential learning is a powerful tool in higher education, offering numerous benefits to both students and institutions. By effectively designing and implementing these programs, institutions can provide valuable, real-world experiences that prepare students for future success. Shaffer Evaluation Group has supported higher education institutions that are designing and implementing experiential learning. Learn more about how we can help you assess the success of your experiential learning program by contacting us at seg@shafferevaluation.com.

By: Patricia Moore Shaffer, PhD

Principal & CEO


At Shaffer Evaluation Group, we pride ourselves on driving educational innovation through meticulous, insightful, and impactful evaluation. Our track record speaks volumes about our capability to conduct rigorous educational evaluation, and we'd like to share a few standout projects that illustrate our expertise and dedication. These projects not only showcase our ability to handle complex evaluations but also highlight our commitment to fostering educational equity and excellence.

Boston College logo

1. Boston College/DevTech Research Group: Coding as Another Language


Overview: The Coding as Another Language curriculum, which utilizes coding app ScratchJr, integrates computational thinking and computer science with learning about math and literacy through a collaborative, project-based process. 


Our Role: To assess the effectiveness of the Coding as Another Language curriculum, we designed and implemented a randomized control trial that met What Works Clearinghouse standards for study rigor. This study design allowed us to measure the effectiveness of the curriculum and its impact on student performance in literacy, mathematics, and coding skills. This evaluation was supported through an Educational Innovation and Research (EIR) grant from the U.S. Department of Education.


Key Findings:

  • Second-grade student participants demonstrated significantly higher coding skills compared to the business-as-usual control group.

  • The Hedge’s g effect size of 0.39 indicated a medium effect size of the impact of the curriculum on second grade students’ coding skills.


Grapeseed logo

2. GrapeSEED: Oral Language Program for Pre-K


Overview: Preschoolers must be able to understand language at an oral level to be expected to understand it at the text level. GrapeSEED is a research-aligned, teacher-led program that helps preschool students build oral language and critical listening skills.


Our Role: We conducted several studies in the U.S. and abroad to assess the program's impact on student oral language proficiency. Our mixed-methods approach included surveys, interviews, classroom observations, and test score analysis.


Key Findings:

  • GrapeSEED enabled at-risk preschool students to grow faster than their national non-risk peers in every category of language fundamentals.


National Board Certified Teacher logo

3. Teacher National Board Certification    


Overview: National Board Certification is the most respected professional certification available in education and provides numerous benefits to teachers, students and schools. It was designed to develop, retain and recognize accomplished teachers and to generate ongoing improvement in schools nationwide.


Our Role: We conducted a quasi-experimental study that evaluated student outcomes in Mathematics and Reading in classrooms taught by Board-certified and non-Board-certified teachers in a southeastern school district.


Key Findings:

  • Students taught by Board-certified teachers had significantly higher academic achievement in the subject areas of Mathematics and Reading. The gain in test scores was particularly large for students in Mathematics classes taught by Board-certified teachers.

  • Students of color benefited more than their white peers from instruction by Board-certified teachers.


Conclusion

Shaffer Evaluation Group's extensive experience in evaluating innovative educational programs makes us uniquely qualified to conduct an Educational Innovation and Research (EIR) grant evaluation. Our proven methodologies, coupled with our commitment to educational equity and excellence, ensure that we can provide valuable insights and actionable recommendations to drive innovation and improve student outcomes.


Whether it's boosting student performance in STEM or improving early literacy skills, Shaffer Evaluation Group is dedicated to making a positive impact in education. Let's work together to create a brighter future for all students through innovative and effective evaluation!


 

Interested in applying for an Education Innovation and Research (EIR) grant?

If you are interested in applying for the EIR Early-phase grant, and need assistance with your application, contact SEG (seg@shafferevaluation.com). Most recently, SEG collaborated with Boston College on their EIR Early-phase grant, which tested the efficacy of their Coding as Another Language curriculum. SEG will collaborate with you on research design at the grant application stage at no cost to your institution in exchange for being listed in your application as the external evaluator. Learn more about us here: https://www.shafferevaluation.com/


Please note the deadline for submitting the intent to apply is June 6, 2024, and the deadline for submitting the application is July 22, 2024. The mid-phase and expansion tiers have different deadlines. 

Anchor 1
bottom of page