DEPARTMENT: Pre-K 4 SA
DEPARTMENT HEAD: Sarah Baray, Ph.D.
COUNCIL DISTRICTS IMPACTED: Citywide
SUBJECT:
Program Evaluations and Westat Amendment
SUMMARY:
This item includes a staff briefing of Pre-K 4 SA program evaluations and possible Board approval of an amendment to the Westat independent evaluation contract for a total amount not to exceed $254,148.
BACKGROUND INFORMATION:
Since its initial program authorization, Pre-K 4 SA has demonstrated a commitment to a results-driven approach through its use of independent research evaluations. Pre-K 4 SA contracted with Dr. Mike Villarreal at the UTSA Urban Education Institute in 2018 to conduct a longitudinal impact study of the program. The results of this study found that Pre-K 4 SA Education Center Students had better 3rd grade math scores, better 3rd grade reading scores, better attendance, and less need for special education services.
Since the findings were released in January 2019, Dr. Villarreal has proposed an update to the original impact study to include the most recent students who applied and enrolled in Pre-K 4 SA during the fiscal years of 2015 to 2020. This new study will allow the researchers to strengthen the statistical power of their analysis, and allow them to observe the impact of the program as it has matured and strengthened.
In addition to the longitudinal study, Pre-K 4 SA also conducts yearly independent program evaluations. In 2013, Pre-K 4 SA issued a Request for Proposals (RFP) for an independent program evaluation. The Board of Directors awarded a contract to Edvance Research to conduct an independent evaluation of the program. The contract was approved with an initial five-year term, and one three-year renewal option. Edvance Research went on to produce and release reports for years 1 and 2 of the program, which the organization presented to the Board of Directors in 2014 and 2015. In December 2015, Westat, a leading research organization, acquired Edvance Research. Westat has continued to assess Pre-K 4 SA to fulfill the original contract.
The Board exercised its three-year option to renew in 2018, and also increased the scope of work to include: a Cost-Benefit Analysis; Open Records Data Request for Longitudinal Analyses; Advisory Group: and WolfTrap Evaluation. Pre-K 4 SA and Westat have agreed to amend the scope and value of the Agreement on five (5) occasions. These amendments, in conjunction with the original contract value, have brought the total contract value to $2,283,313.
ISSUE:
Pre-K 4 SA is requesting to amend the current Westat independent evaluation contract to allow for a program assessment that examines key features of the program in its current form. Specifically, this amendment will alter the scope of the contract for Years 7 and 8, to include:
• Ceasing public information requests for kindergarten entry assessment data and attendance or academic data for students Kindergarten through Third grade;
• ceasing evaluation of GOLD outcomes for Pre-K 4 SA’s annual evaluation;
• revision, administration, and analysis of the Pre-K 4 SA family engagement survey
• train Pre-K 4 SA staff to administer direct assessments of executive function, oral language, literacy and/or math;
• revision, administration, and analysis of CHEF survey and data; and
• evaluation of Gardendale and a comparison school.
The total dollar value of the contract with the new amendment will not exceed $2,537,461, which represents an increase of $254,148 from the previous contract value. The revised payment schedule for Years 7 and 8 is as follows:
i) Year 7 ─ Payment of $105,572.00 on May 1, 2020;
ii) Year 8 ─ Payment of $207,601.50 on September 1, 2020; and
iii) Year 8 ─ Payment of $207,601.50 on February 2, 2021.
ALTERNATIVES:
If Pre-K 4 SA does not move forward with the contract amendment, staff would need to develop an alternate process for evaluating key features of the program in its current form.
FISCAL IMPACT:
Funds are budgeted and available within Pre-K 4 SA’s Operating Fund.
RECOMMENDATION:
Staff recommends the Board approve for Pre-K 4 SA to amend the current contract with Westat for expanded evaluation of the program, increasing the contract by $254,148, resulting in a total contract value of $2,537,461.