Public Investment in Assessment Technology Source OPEN Standards - - PowerPoint PPT Presentation
Public Investment in Assessment Technology Source OPEN Standards Innovation Presented by: Dr. G. Anthony Benners, Sr. Dir. ADE View these slides: https://goo.gl/j7WwDz gbenners@schools.nyc.gov 1 About NYCDOE The New York City
Presented by:
gbenners@schools.nyc.gov
1
View these slides: https://goo.gl/j7WwDz
★ The New York City school system is the largest in the United States, composed of approximately 1.1 million students and 75,000+ teachers in over 1,800+ schools. ○ Diverse Student Demographics ■ HS: 41% ■ BK: 24% ■ AS: 16% ■ WH: 16% ○ 32 Community School Districts
2
★ The City of New York has a commitment to become the most technology-friendly and innovation-driven city in the world. ★ DIIT Strategic Technology Plan 2015-2020 ○ Upgrade Infrastructure, Bandwidth, & Devices ○ Integration of Technology
★ Design - ○ designs assessment specifications and blueprints to guide the creation and alignment of assessment, curriculum, and instruction within NYC public schools. ○ reviews items, tasks, technical documentation, and supporting materials, providing rich feedback and informed recommendations. ○ Identifies, develops, and supports assessment technology that improves validity, accessibility, and interoperability ★ Evaluation - ○ evaluates technical, policy, and programmatic decisions related to the assessment programs. ○ spearheads research, prototyping, and data analytic initiatives to introduce innovative practices to program stakeholders to ensure that the NYCDOE is at the forefront of educational assessment.
3
★ The Assessment Design & Evaluation (ADE) team a unit of the Division of Teaching & Learning, consists of assessment professionals, psychometricians, and educators who work closely with assessment program sponsors and their stakeholders to help ensure assessments are of the highest quality. ○ serves as a valuable resource for assessment design, development, scoring, & technology in the service of promoting and informing good teaching and learning in NYC public schools. ○ liaison between Office of Assessment, DIIT, & NYSED
4
For a dystopian view of the future of digital testing in NY see “The Frightening Plans for New York: Competency Based Education, or Embedded Testing”: The “reformers” of education want to replace “teacher” with “individualized instruction” and/or “tablet”. They believe that quality teachers can be seamlessly replaced by a tablet, some headphones, and some wifi.
Example Utopian View Example Dystopian View
5
Potential Benefits ★ Increased Collaboration and Innovation through Open Standards and Open Source Assessment Technology ★ Shared costs of item development among users ★ Cleaner collection of data and scoring, both for machine & human scored responses ★ Greater enhanced content / higher fidelity KSAs ★ Increased validity w/ growing use of tech in the classroom ★ More convenient & sophisticated delivery, e.g., adaptive Potential Challenges ★ Proprietary Constraints Limiting Innovation and Increasing Software Costs ★ Inadequate bandwidth & devices in some schools ★ Administration logistics ★ Inconsistencies in technical expertise across schools ★ School, parent, student expectations & perceptions ★ Central staff knowledge & training ★ Vendor learning curve
Open Source: “Open source simply means that the underlying software code is available for inspection and modification. Perhaps the most famous example is the Linux kernel…The best open-source projects are the ones that actually amplify a standard, increasing its acceptance in the marketplace and enhancing cross-platform compatibility.” Open Standards: “They're documents that outline agreed-upon conventions to enable different programs to work together, along with some means to ensure that they actually do--a process or set of tests. With open standards, your company can pick and choose among competing vendors and not be locked into any one of them.” see https://www.cnet.com/news/open-source-versus-open-standards/
6
7 “Increased reuse and collaborative development of software is in the interest of the government as a whole, as it reduces costs (by eliminating duplicative efforts) and can increase quality (through increased review).” “The government should require sharing software and release software as OSS by default if it was developed with public funds; this may require changes to contracting strategies.” “Switch from proprietary formats and protocols to modular systems and open standards, as this enables the transition to alternatives, including OSS. The government should take a more active role in developing these open standards and developing OSS implementations of them.” “ensure that contracts require that the government receives unlimited rights for all software it pays to develop, and that the government receives the source code”
https://tech.ed.gov/open/
8
Emerging Private Sector Partner
9
★ PARCC PCIs ○ Fractions ○ Graphing f(x) ○ Line & Point ○ Number Line ○ Point Graph ○ Zoom Number Line ○ Histogram ★ PARCC PICs (student tools) ○ Cm/Inch Ruler ○ Protractor https://github.com/parcc/extension-parcc-tei
10
Join the Conversation With these members of the IMS EBA
11
State assessment leaders who want to be involved can get more information at www.imsglobal.org/StateILN. Membership in IMS Global is not required to participate.
I pity the fool who doesn’t embrace
12 Vendor Support: https://vendorportal.nycenet.edu/vendorportal/