DDOE Education Insight Dashboard Implementation Project 25 th

DDOE Education Insight Dashboard Implementation Project 25 th Annual STATS-DC 2012 Data Conference July 13, 2012 1

Zero to Dashboard in 15 Months • Introductions • Project Background • Going Further Faster • Next Steps • Q & A 2

Who we are • Reese Robinson o Delaware Department of Education o Education Insight Project Manager • Lori Fey o Michael & Susan Dell Foundation o Director – Ed-Fi Initiative • Eddie Parker o Otis Educational Systems (Otis. Ed) o Founder & CEO 3

RTTT Project Aimed at Ambitious Targets K-12 data is increasingly important ● Federal mandates ● Management – Data-driven decisionmaking How do we close the gap? DOE Targets (RT 3) ● 90% of students will graduate by 2013 -2014 ● 100% will meet standard on state math and reading exams by 2013 -2014 4

Specific Focus on Equipping Educators with Meaningful Data to Help Students Are not “getting it” (DCAS, grades) Help educators find students who: Have other issues (conduct, special needs) Are unavailable to learn (absent) 5

Series of Education Insight Projects Required to Meet Goals Infrastructure Single Sign On Portal Microsoft – Forefront Identity Management Longitudinal Data Warehouse Otis Educational Systems - i. Mart Performance Management Dashboard Michael & Susan Dell Foundation – Ed-Fi 6

Project Timelines Posed Significant Challenge July 2010 Funding Sept RFI Dec RFP April 2011 Contract April 2012 Pilot 7

Insight Dashboard Preparation Process July 2010 – April 2011 • Documentation Review • System Inventory • Market Review • LEA Interviews • Findings: Many Existing Systems, Many Potential Providers • Request For Information: 26 Responses • Selected Ed-Fi standard for data structure and dashboards • Request for Proposal o Data Warehouse: ESP Solutions Group / Otis. Ed o Dashboard Design: Wireless Generation / Double Line Partners 8

Ed-Fi Leverages Existing Data for New Uses Ed-Fi includes: • Open data standard • Collection of best practice metrics • Dashboard source code • Extensive documentation • • • o Interface, Database, Metrics, Data Exchange Research-based Well received 3 Consistent with RT philosophy Public domain Growing adoption by states and districts o States of Arkansas, Colorado, Kansas, Texas o Little Rock School District • Adopted for the Strategic Learning Collaborative (SLC) o Piloted with Colorado, Georgia, Illinois, Massachusetts, New York, North Carolina 9

Architecture 10

Data Flow • • Warehouse e. School Master DCAS DIBELS College Board Source Data • • Extract Transform Load OLDS Load SLDS • • 26, 000 Records Evaluated Nightly 6 -7 Hours Extract Load Ed-Fi Generate Metrics Build Dashboards Dashboard 11 11

Insight Dashboard Designed to Meet RTTT Goals • Collection of research-based metrics (33) o Predictive of education outcomes • Integrated from multiple sources o e. School, DCAS, DIBELS… • Focused on students o Class, School, District rollups • Along with student characteristics o Contacts, Program Indicators • Designed by and for Teachers 12 12

How was it Developed? • 70 Student Metrics • 200 Aggregate or Rollup Metrics Texas Dashboards District Planning Sessions Delaware Focus Groups • 45 Individuals • All Districts • 4 Charter Schools • 11 Focus Groups • 175 Participants ― 122 Teachers ― 4 Principals ― 49 Admin Teacher’s Insight Dashboard 1. 0 13 13

Stakeholder Workshop Review Three stakeholder engagement workshops were conducted in June 2011. June 20, 2011 Glasgow HS 84 participants June 22, 2011 Polytech HS 55 participants June 23, 2011 Sussex Tech HS 36 participants 175 people attended the stakeholder workshops • 122 Classroom Teachers • 4 Principals • 49 Other Administration 11 Breakout Sessions with 4 stakeholder groups • Elementary Teachers • Middle School Teachers • High School Teachers • Principals, Counselors, and other Administrative personnel (sometimes as part of teacher breakout sessions) 14

Stakeholder Survey Feedback from the Workshop participants was overwhelmingly positive. 15

Several key factors enabled DDOE to get further, faster Fortunate environment • Single IIS system with nightly data feeds • RTTT funds and momentum • Flexible management, minimal bureaucracy, exceptional leadership support Leverage • Adopted widely used standards • Liberally used Ed-Fi and i. Mart • Extensively researched K-12 architectures and other states’ work Embraced change • Implemented new approaches to development projects • Actively collaborated with vendors 16

Leveraging Others’ Work Accelerated Development • Ed-Fi Tools o Data standard already created o Metrics research already synthesized and well-documented o Operational dashboard source code dramatically cut development time • Stakeholder Engagement Model from Texas o Metrics prioritized by Delaware educators o Built awareness and buy-in • i. Mart Data Warehouse o o OTS product with dimensional model and K 12 operational process Easily extensible Low cost of ownership Self-Sufficiency with Knowledge Transfer to DDOE staff 17

Embracing Change Eliminated Common Pitfalls • Adopting Standards o Provided common ‘language’ o Minimized design confusion and unnecessary development • Agile Management o ‘Time. Box’ development approach was key to meeting deadlines o Executives minimized bureaucracy • Specific Development Team Strategies o o o Mentoring Pair-programming Code reading and review Regular code walkthroughs Review of artifacts Question and answer 18

Metric Focus Metrics • Research Based • Prioritized by Stakeholders • Example: Reading Proficiency (Scale Score, Subject, Proficiency Level) Ed-Fi • Domains • Standards • Example: Student Assessment i. Mart • Educational ‘Facts’ • Dimensions • Example: Student Result Summary Source • e. School Student Information • External and Longitudinal Data • Example: AIR Assessment 19

Ed-Fi Provided Powerful, Free Accelerators • Texas Student Data System dashboard code developed into publicly licensable Ed-Fi tool suite • DDOE licensed Ed-Fi tool suite free • Implementation of Ed-Fi allows for extensibility (customization) for Delaware presentation and unique metrics • Ed-Fi core schema will evolve over time, but will still be compatible with Delaware implementation as long as extensibility points are only areas of customization Delaware Insight Dashboard extensions maintain compatibility with Ed -Fi Core if/as it is modified Ed-Fi Core 1. 2 Future Ed-Fi Core releases Ed-Fi Core 1. 3 20

Ed-Fi Footprint is Growing Momentum of State Adoption Creates Further Opportunities for Total US students 49. 4 M Total US teachers Leverage 3. 2 M 19% of students 19. 5% of teachers 34% of students 36% of teachers © 2012 Michael & Susan Dell Foundation 21

Scope of i. Mart to Mapping Process • Moving data from i. Mart Data Warehouse to Ed-Fi Operational Data Store • Tables o o Source Tables Used to read data: 65 Target tables loaded: § § 105 Type Tables (Code Tables) 84 Maps (Ed-Fi Target Tables) • 14 packages or modules This does not include the source mapping to the Data Warehouse (i. Mart) • 95 ETL jobs • Data points o o o 600 columns loaded of 84 Ed-Fi Tables 135, 000 unique Current Year enrolled students processed 26, 575, 792 Records processed (Most of them are only Current year records) 22

Data Mapping and Import Process Design Dashboard requirements Available data Ed-Fi Standard 23

Insight Dashboard Project Timeline 2011 4/1/11 2012 4/1 7/1 2013 10/1 Release 1. 0 • Interim Teacher Dashboard Development 6/30/13 Phased release • Pilot districts • Other districts Release 2. 0 • Teacher (expansion), Principal, Administrator, DOE Dashboards Release 3. 0 and beyond • Expansion, refinement, and support for additional Stakeholders Stakeholder engagement 24

Q&A Lori. Fey@msdf. org www. ed-fi. org Zeynep@doublelinepartners. com www. doublelinepartners. com Eddie. Parker@Otis. Ed. com www. Otis. Ed. com 25