Public Investment in Assessment Technology Source OPEN Standards Innovation Presented by: Dr. G. Anthony Benners, Sr. Dir. ADE View these slides: https://goo.gl/j7WwDz gbenners@schools.nyc.gov 1
About NYCDOE ★ The New York City school system is the largest in the United States, composed of approximately 1.1 million students and 75,000+ teachers in over 1,800+ schools. ○ ★ Diverse Student Demographics The City of New York has a commitment to become the most technology-friendly ■ HS: 41% and innovation-driven city in the world. ■ BK: 24% ★ DIIT Strategic Technology Plan 2015-2020 ■ AS: 16% ○ Upgrade Infrastructure, Bandwidth, ■ WH: 16% & Devices ○ 32 Community School Districts ○ Integration of Technology 2
★ Design - ○ designs assessment specifications and blueprints to guide the creation and alignment of assessment, curriculum, and instruction within NYC public schools. ○ reviews items, tasks, technical documentation, and ★ The Assessment Design & Evaluation (ADE) team a unit of supporting materials, providing rich feedback and the Division of Teaching & Learning, consists of assessment informed recommendations. ○ Identifies, develops, and supports assessment professionals, psychometricians, and educators who work technology that improves validity, accessibility, closely with assessment program sponsors and their and interoperability stakeholders to help ensure assessments are of the highest ★ Evaluation - quality. ○ evaluates technical, policy, and programmatic ○ serves as a valuable resource for assessment design, decisions related to the assessment programs. development, scoring, & technology in the service of ○ spearheads research, prototyping, and data analytic promoting and informing good teaching and learning initiatives to introduce innovative practices to in NYC public schools. program stakeholders to ensure that the NYCDOE is ○ liaison between Office of Assessment, DIIT, & NYSED at the forefront of educational assessment. 3
Utopian vs Dystopian Visions of our Digital Future Example Utopian View Example Dystopian View For a dystopian view of the future of digital testing in NY see “The Frightening Plans for New York: Competency Based Education, or Embedded Testing”: The “reformers” of education want to replace “teacher” with “individualized instruction” and/or “tablet”. They believe that quality teachers can be seamlessly replaced by a tablet, some headphones, and some wifi. Note. 0:00 -00:51 Source: Microsoft's Concept - Future vision 2020 How are you managing expectations in your state? 4
A pragmatic view of transitioning to digital Potential Challenges Potential Benefits ★ Proprietary Constraints Limiting ★ Increased Collaboration and Innovation through Innovation and Increasing Software Costs Open Standards and Open Source Assessment ★ Inadequate bandwidth & devices in some Technology schools ★ Shared costs of item development among users ★ Administration logistics ★ Cleaner collection of data and scoring, both for machine ★ Inconsistencies in technical expertise across & human scored responses schools ★ Greater enhanced content / higher fidelity KSAs ★ School, parent, student expectations & ★ Increased validity w/ growing use of tech in the perceptions classroom ★ Central staff knowledge & training ★ More convenient & sophisticated delivery, e.g., adaptive ★ Vendor learning curve 5
Open Source vs Open Standards Open Source: “ Open source simply means that the underlying software code is available for inspection and modification. Perhaps the most famous example is the Linux kernel…The best open-source projects are the ones that actually amplify a standard, increasing its acceptance in the marketplace and enhancing cross-platform compatibility.” Open Standards: “They're documents that outline agreed-upon conventions to enable different programs to work together, along with some means to ensure that they actually do--a process or set of tests. With open standards, your company can pick and choose among competing vendors and not be locked into any one of them.” see https://www.cnet.com/news/open-source-versus-open-standards/ 6
Open Source (Public Domain) for Assessment Technology “Increased reuse and collaborative development of software is in the interest of the government as a whole, as it reduces costs (by eliminating duplicative efforts) and can increase quality (through increased review).” “The government should require sharing software and release software as OSS by default if it was developed with public funds; this may require changes to contracting strategies.” “ensure that contracts require that the government receives unlimited rights for all software it pays to develop, and that the government receives the source code” “Switch from proprietary formats and protocols to modular systems and open standards, as this enables the transition to alternatives, including OSS. The government should take a more active role in developing these open standards and https://tech.ed.gov/open/ developing OSS implementations of them.” 7
Example Open Source Assessment Technology Projects Emerging Private Sector Partner 8
PARCC Released Open Source Math Interactions in TAO ★ PARCC PCIs https://github.com/parcc/extension-parcc-tei ○ Fractions ○ Graphing f(x) ○ Line & Point ○ Number Line ○ Point Graph ○ Zoom Number Line ○ Histogram ★ PARCC PICs (student tools) ○ Cm/Inch Ruler ○ Protractor 9
Open Standards for Assessment Technology 10
Join the Conversation With these members of the IMS EBA I pity the fool who doesn’t embrace open innovation State assessment leaders who want to be involved can get more information at 11 www.imsglobal.org/StateILN. Membership in IMS Global is not required to participate.
Contact Us Vendor Support: https://vendorportal.nycenet.edu/vendorportal/ 12
Recommend
More recommend
