[Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28

[Bain, Brian]

Sorry for joining the conversation late.  I'm off on Fridays all summer, and had teachers in a training/workshop session all day on Thursday.

I agree with Bill and Catherine.  It would be a great tool, but only if it is "always on" and then accessible by the proctor on an "as needed" basis.  My understanding, during our meeting, was that AIR was caching student work every 2 minutes anyway.... is this not true?

I wouldn't recommend introducing the time machine to the state assessments given the limited implementation.


Just to clarify, I don't recall our recommendation being that the tool not be on for every student by default.  I thought we recommended that access to it be a tool in the proctor's back pocket and that they (the proctor) be allowed to access the time machine on the students' computer rather than having student directions that include time travel as part of the standardized administration.



Brian Bain
District Assessment Coordinator
Tigard-Tualatin School District
6960 SW Sandburg St, Tigard, OR 97223
503-431-4120 - bbain at ttsd.k12.or.us<mailto:bbain at ttsd.k12.or.us>

From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of Bill Stewart
Sent: Thursday, July 23, 2015 3:41 PM
To: CARTER Holly
Cc: assessment_advisory_committee at listsmart.osl.state.or.us
Subject: Re: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28

Thanks Holly!

Per your message and our phone conversation, it now seems like this would not be an effective tool to address the problems that a number of students across the state encountered this past spring.

If a TA has to have the tool turned on BEFORE the problem arises, then the TA is essentially 'required' to turn it on for all students at the start of the session to have any chance of recovering drafts. I'm not enough of a mind-reader to know, ahead of time, which kids will need this feature.
I'm not at all sure it is worth slowing down the system for all students.
I hope others will weigh-in and show me the error of my logic.
Bill

On Thu, Jul 23, 2015 at 3:32 PM, CARTER Holly <holly.carter at state.or.us<mailto:holly.carter at state.or.us>> wrote:
Thanks, Catherine. There’s one important piece of clarification that we have received that I want to share with you all. AIR has clarified that, regardless of whether it is in the same session or a different session, if a student pauses the test, they will not be able to view previous draft responses once the student logs back in.

When we reviewed this tool back in May, it was your collective recommendation that this tool should not be on for all students automatically as it may cause confusion/distraction, but that the TA should be able to enable the tool mid-test if the need arose. Given the recent clarification from AIR that the response history will not persist when a student logs out and logs back in (which is required for the TA to turn on a tool mid-test), how does this impact the benefit/use of this tool?

Holly

From: Catherine Carlson [mailto:CARLSON_CATHERINE at salkeiz.k12.or.us<mailto:CARLSON_CATHERINE at salkeiz.k12.or.us>]
Sent: Thursday, July 23, 2015 3:27 PM
To: 'CARTER Holly'; assessment_advisory_committee at listsmart.osl.state.or.us<mailto:assessment_advisory_committee at listsmart.osl.state.or.us>
Subject: RE: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28

Holly,
Given the technical problems we encountered around this issue, I think that being able to recover drafts in the current session is better than not having the ability at all.

Catherine Carlson
Coordinator
Testing & Evaluation/Student Records Department
Salem-Keizer School District
503-399-5590
FAX 503-391-4088
Supporting student achievement through information, professional development, and assessment services



From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of CARTER Holly
Sent: Thursday, July 23, 2015 1:24 PM
To: assessment_advisory_committee at listsmart.osl.state.or.us<mailto:assessment_advisory_committee at listsmart.osl.state.or.us>
Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28
Importance: High

At our May 6 meeting, AIR reviewed with us a new “Item Response Time Machine” tool that would be available in 2015-16. The slide below summarizes this proposed tool as AIR described it to us at the meeting:

[cid:image001.png at 01D0C87D.9EA11B50]

ODE has recently learned from AIR that they will need to limit this feature to retrieving responses entered during the student’s current test session as allowing students to go back and retrieve responses from an earlier test session uses too many system resources and risks slowing down the testing experience for all students.

Given this change in scope, ODE now requests your input whether there is still value in implementing the Item Response Time Machine for 2015-16. So that we can finalize our specifications and prepare communications to the field about supported tools, we request your input by COB Tuesday, July 28.

Thank you as always for your valuable feedback!

Holly Carter
Assessment Policy Analyst
Office of Learning | Inst., Stand., Asmt, &Acc. Unit | Oregon Department of Education
Phone: 503.947.5739 | Fax: 503.378.5156 | •holly.carter at state.or.us<mailto:holly.carter at state.or.us>



_____________________________________________________
Assessment_Advisory_Committee mailing list
Assessment_Advisory_Committee at listsmart.osl.state.or.us<mailto:Assessment_Advisory_Committee at listsmart.osl.state.or.us>
http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee
Hosted by the Oregon State Library. The Library is not responsible for content.
Questions related to message content should be directed to list owner(s) or the sender of the message, by phone or email.
Technical questions? Call 503-378-8800.



--
Bill Stewart
Special Projects
Gladstone SD
stewartw at gladstone.k12.or.us<mailto:stewartw at gladstone.k12.or.us>
503-805-8680 - cell
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://omls.oregon.gov/pipermail/assessment_advisory_committee/attachments/20150727/4415ef3e/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 46672 bytes
Desc: image001.png
URL: <https://omls.oregon.gov/pipermail/assessment_advisory_committee/attachments/20150727/4415ef3e/attachment.png>