Technology Enhanced Items — Signal or Noise?

Wednesday, June 28, 2017: 8:30 AM-10:00 AM
JW Grand Ballroom - Salon 2 (JW Marriott Austin)
Presentations
  • Twing, J. S., (2017). Are we Delivering on our Promise of Better Measurement Fidelity with TEI (CCSSO-NCSA) PRESENTATION ONLY.pptx (4.1 MB)
  • NCSA 2017_CW.pptx (2.0 MB)
  • CCSSO.NCSA.2017.TEIs.Signal-Noise.StephenMurphy.627017.pptx (170.7 kB)
  • Wayne Camara NCSA2017-TEI innovative items.pptx (2.8 MB)
  • NCSA2017 Becker.pptx (4.0 MB)
  • Content Strands:
    1. Innovative Solutions to Assessment and Accountability
    2. Critical Issues and Considerations for Assessment Design
    SUMMARY:
    Expansive use of online tests and increased rigor in content standards has intensified interest in integrating TEIs into assessments. TEIs offer many potential benefits to test takers and users promising to improve quality, validity, and reliability by measuring higher-order thinking, offering insight into problem-solving, and representing authentic real-world tasks. In contrast, practitioners have observed that there is limited evidence of empirical validity to support such claims. This session will address four topics related to TEIs: validity, usability and engagement, item difficulty, and scoring. The presentation will open with challenges facing TEIs, leading into an argument for beginning with the construct and claim when determining task model and item type. Next, evidence for the difficulty of TEIs and the variety of observed response patterns will be presented. The discussion will conclude with how usability and survey data can inform design and development as well as recommendations for implementing TEIs in large-scale testing programs.
    See more of: 90 Minute Symposium