Evaluation+of+Coaching

=__**Evaluation of Coaching**__=

__Conference Call May 22, 2009__
Jackie's Snapshot of 06-07 GTO Evaluation

Agenda for Conference Call

**__Committee Report Shared at April 7, 2009 CCB Meeting__**
[|Committee report to CCB 4-7-09.doc]

**__Committee Report Shared at March 13, 2009 CCB Meeting__**
[|Committee report to CCB 3-13-09 listing studies.doc]

__**PA Coaching Evaluation Studies - List Posted March 12, 2009**__
CFF Evaluation Page [] CFF Evaluation – Year 2 [] CFF Evaluation – Year 1 []
 * __Classrooms for the Future__**

Reading First Evaluation – Year 1 Reading First Evaluation – Year 2 Reading First Evaluation – Year 3 Reading First Evaluation – Year 4 http://www.ed.gov/programs/readingfirst/evaluationreports/pa.pdf Reading First Evaluation – Year 5
 * __Reading First__**

Reading First State Profile to 2006-07 http://www.ed.gov/programs/readingfirst/profilepa.pdf

Evaluation of Reading First in Pennsylvania 2003-2008 Some Lessons Learned - Powerpoint http://www.readingfirstpa.org/WebDocs%5CRFBeanZigmondOct08.pdf

PAHSCI Year 1 – Promising InRoads Executive Summary [] Full Report []
 * __PAHSCI__**

PAHSCI Year 2 – Making a Difference Executive Summary [] Full Report []

PAHSCI Year 3 – Links to Learning and Sustainability Executive Summary [] Full Report []

Mentor Study

Philadelphia Case Study

Program Evaluation 2006-07 by Metiri April 2008 [|Final_New GTO EVALUATION 2006-2007-1 (2).doc]
 * __Getting to One__**

Evaluation Snapshot [|GTO 06-07 Eval by Meteri Snapshot.doc]

Program Evaluation 2007-08 in Progress

2008-09 Mid-Year Report [] 2008-09 Mid-Year Report Appendices [] 2007-08 Mid-Year Report [] 2007-08 Mid-Year Report Appendices []
 * __Accountability Block Grants__**

Mid-Year Report Snapshot [|ABG Grant Coaching 07-08 and 08-09 Snapshot.doc]

West Chester Area School District Pittsburgh North Penn Sci-Tech HS in Harrisburg Hazleton SD Report for School Board Bellwood-Antis SD Wissahickon SD
 * __District and ABG Funded Coaching Initiatives with District Studies or Reports__**

__**Committee Report shared at February 12, 2009 CCB Meeting**__


[|Coaching Isn't Just For Athletes: The Role of Teacher Leaders" Ellen Guiney Phi Delta Kappan 2001]

**__Committee Conference Call - December 23, 2008__**
__**Areas of Focus:**__

//**Areas Discussed by Committee Call on Dec. 23rd - Rita, Ellen, Bruce, Holly, Jackie, Tiz**// Identifying common elements in current evaluations of PA coaching initiatives Identifying common conclusions about the positive effects of coaching shown by the coaching program evaluations Disseminate the results of coaching program evaluations to highlight the importance of coaching Build from the current successes of coaching initiatives as shown by the evaluation to design an evaluation that looks more deeply at the effects of coaching __**Committee Tasks:**__
 * Ideas for Current Action**

//**Next Steps Discussed by Committee Call on Dec. 23rd - Rita, Ellen, Bruce, Holly, Jackie, Tiz**//

CCB creates a paper that highlights the effects of instructional coaching as shown by current coaching program evaluations.
 * This paper will be a resources that can be shared with stakeholders to highlight the positive effects of coaching - school board members, district leadership, legislators.
 * The paper will summarize and highlight positive effects of coaching found across all the coaching evaluation studies.
 * Common elements will be collected for each coaching program evaluation: evaluation questions, data collected, results of evaluation.
 * The paper may use a common framework, such as Guskey's, to describe the elements of each evaluation study.
 * This "what we have" paper will lay the groundwork for a "what we need" paper - the case for designing and funding additional instructional coaching evaluations to look more deeply into the success of instructional coaching in PA schools.

Collecting Information for the evaluation paper
 * 1) Information to collect from each coaching program evaluation
 * 2) Conference call with program evaluators

Evaluation of Coaches and its connection to Evaluation of Coaching Programs Questions to ask about data from Coach Logs - good questions of guiding analysis of K-12ware coach log data
 * Topics to Remember**

__**Chairperson:**__ Tiz Powers

__**Committee Members:**__ Jacqueline Attinello Rita Bean Bruce Eisenberg Ellen Eisenberg Holly Jobe Amy Morton John Nau Tiz Powers Rhonda Sutton

__**Areas of Focus - Previous Work:**__

Some initial thoughts from Tiz and Bruce on Dec. 15th
 * 1) Identifying common elements in the coaching evaluation designs of PA coaching programs
 * 2) Identifying elements of effective coaching evaluations
 * 3) Identifying and sharing tools to be used in coaching evaluation

Some Evaluation Issues for the CCB from Rita 12-1-08


 * 1) What are some common questions that we want to have the various initiatives ask and answer? (changes in teacher practices, student learning, etc.; perceptions of various groups).
 * 2) What are some common assessment tools we can use?
 * 3) How can we study the “black box” of coaching…..the implementation of it (including the study of the situation, the coach, and the model of coaching).
 * 4) In what ways can we capitalize on past findings in designing evaluation for the future?
 * 5) Would it be possible to obtain funding to implement a well-designed evaluation study?


 * __Evaluation Questions for Instructional Coaching Initiatives- Draft from Rita Bean on February 11th 2009__**:

1. In what ways has the initiative affected student outcomes? 2. In what ways has the initiative affected instructional practices? 3. What are the perceptions of various constituencies about the value of the initiative? 4. What are the conditions within the school/district that have facilitated the initiative? Created barriers?
 * 1) Student learning – achievement
 * 2) Student Retention (especially at high school level)
 * 3) Etc.
 * 1) Changes in teacher practices
 * 2) Changes in teacher knowledge
 * 3) Changes in teacher beliefs and attitudes about ….
 * 1) Teachers
 * 2) Principals
 * 3) Coaches
 * 4) Students

__**Committee Tasks - Previous Work:**__

Some initial thoughts from Tiz and Bruce on Dec. 15th


 * 1) Creating a document that identifies the common elements and common sources of data used in the evaluations of PA coaching programs
 * 2) Creating a document or white paper that identifies the elements and data sources that should be used in highly effective evaluations of coaching programs - include a logic model for effective coaching evaluations?
 * 3) Finding and collecting and sharing tools that can be used to evaluate coaching programs


 * Priority Tasks:**

TBD by committee members


 * Timeline for Tasks:**

TBD by committee members


 * Resources for Committee Work:

[|PDE CCB Website]

[|US Department of Education Institute for Education Sciences Funded Studies of Teacher Quality - with inclusion of coaching]**