[Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28

Fri Jul 24 09:14:21 PDT 2015

Good observation Don...thanks!  

I had understood the info to mean that "on" would archive for everyone and thus impact speed/performance of the test delivery for all test takers 

If that's not the case, then I'll rethink my concern. 

Bill

Bill Stewart's iPhone

> On Jul 24, 2015, at 8:35 AM, Don Staples <staplesd at newberg.k12.or.us> wrote:
> 
> Could it be turned on for all students in TIDE? Would this indeed slow down test delivery performance? If yes to slowing down performance, then it is likely not worth it.
> 
> Don Staples
> 
>> On Thu, Jul 23, 2015 at 4:37 PM, Karen Brown Smith <Karen.Brown at imesd.k12.or.us> wrote:
>> I agree with Bill.
>> 
>> Karen
>> 
>>  
>> 
>>  
>> 
>> Karen Brown Smith | ESD Partner, Data Specialist & Accountability Support
>> Karen.Brown at imesd.k12.or.us
>> InterMountain ESD | www.imesd.k12.or.us
>> 541.966.3124 or 800.706.4447 x3124
>> 
>>  
>> 
>> From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of Bill Stewart
>> Sent: Thursday, July 23, 2015 3:41 PM
>> To: CARTER Holly <holly.carter at state.or.us>
>> Cc: assessment_advisory_committee at listsmart.osl.state.or.us
>> Subject: Re: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28
>> 
>>  
>> 
>> Thanks Holly!  
>> 
>> Per your message and our phone conversation, it now seems like this would not be an effective tool to address the problems that a number of students across the state encountered this past spring.  
>> 
>> If a TA has to have the tool turned on BEFORE the problem arises, then the TA is essentially 'required' to turn it on for all students at the start of the session to have any chance of recovering drafts. I'm not enough of a mind-reader to know, ahead of time, which kids will need this feature.
>> 
>> I'm not at all sure it is worth slowing down the system for all students.
>> 
>> I hope others will weigh-in and show me the error of my logic.
>> 
>> Bill
>> 
>>  
>> 
>> On Thu, Jul 23, 2015 at 3:32 PM, CARTER Holly <holly.carter at state.or.us> wrote:
>> 
>> Thanks, Catherine. There’s one important piece of clarification that we have received that I want to share with you all. AIR has clarified that, regardless of whether it is in the same session or a different session, if a student pauses the test, they will not be able to view previous draft responses once the student logs back in.
>> 
>>  
>> 
>> When we reviewed this tool back in May, it was your collective recommendation that this tool should not be on for all students automatically as it may cause confusion/distraction, but that the TA should be able to enable the tool mid-test if the need arose. Given the recent clarification from AIR that the response history will not persist when a student logs out and logs back in (which is required for the TA to turn on a tool mid-test), how does this impact the benefit/use of this tool?
>> 
>>  
>> 
>> Holly
>> 
>>  
>> 
>> From: Catherine Carlson [mailto:CARLSON_CATHERINE at salkeiz.k12.or.us] 
>> Sent: Thursday, July 23, 2015 3:27 PM
>> To: 'CARTER Holly'; assessment_advisory_committee at listsmart.osl.state.or.us
>> Subject: RE: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28
>> 
>>  
>> 
>> Holly,
>> 
>> Given the technical problems we encountered around this issue, I think that being able to recover drafts in the current session is better than not having the ability at all.
>> 
>> 
>> Catherine Carlson
>> 
>> Coordinator
>> Testing & Evaluation/Student Records Department
>> Salem-Keizer School District
>> 503-399-5590
>> FAX 503-391-4088
>> Supporting student achievement through information, professional development, and assessment services
>> 
>>  
>> 
>>  
>> 
>>  
>> 
>> From: Assessment_Advisory_Committee [mailto:assessment_advisory_committee-bounces at listsmart.osl.state.or.us] On Behalf Of CARTER Holly
>> Sent: Thursday, July 23, 2015 1:24 PM
>> To: assessment_advisory_committee at listsmart.osl.state.or.us
>> Subject: [Assessment_Advisory_Committee] assessment advisory: input on time machine tool requested by 7/28
>> Importance: High
>> 
>>  
>> 
>> At our May 6 meeting, AIR reviewed with us a new “Item Response Time Machine” tool that would be available in 2015-16. The slide below summarizes this proposed tool as AIR described it to us at the meeting:
>> 
>>  
>> 
>> 
>> 
>>  
>> 
>> ODE has recently learned from AIR that they will need to limit this feature to retrieving responses entered during the student’s current test session as allowing students to go back and retrieve responses from an earlier test session uses too many system resources and risks slowing down the testing experience for all students.
>> 
>>  
>> 
>> Given this change in scope, ODE now requests your input whether there is still value in implementing the Item Response Time Machine for 2015-16. So that we can finalize our specifications and prepare communications to the field about supported tools, we request your input by COB Tuesday, July 28.
>> 
>>  
>> 
>> Thank you as always for your valuable feedback!
>> 
>>  
>> 
>> Holly Carter 
>> Assessment Policy Analyst
>> 
>> Office of Learning | Inst., Stand., Asmt, &Acc. Unit | Oregon Department of Education
>> 
>> Phone: 503.947.5739 | Fax: 503.378.5156 | *holly.carter at state.or.us
>> 
>>  
>> 
>>  
>> 
>> 
>> _____________________________________________________
>> Assessment_Advisory_Committee mailing list
>> Assessment_Advisory_Committee at listsmart.osl.state.or.us
>> http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee
>> Hosted by the Oregon State Library. The Library is not responsible for content.
>> Questions related to message content should be directed to list owner(s) or the sender of the message, by phone or email.
>> Technical questions? Call 503-378-8800.
>> 
>> 
>> 
>> 
>> --
>> 
>> Bill Stewart
>> 
>> Special Projects
>> 
>> Gladstone SD
>> 
>> stewartw at gladstone.k12.or.us
>> 
>> 503-805-8680 - cell
>> 
>> 
>> _____________________________________________________
>> Assessment_Advisory_Committee mailing list
>> Assessment_Advisory_Committee at listsmart.osl.state.or.us
>> http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee
>> Hosted by the Oregon State Library. The Library is not responsible for content.
>> Questions related to message content should be directed to list owner(s) or the sender of the message, by phone or email.
>> Technical questions? Call 503-378-8800.
> 
> _____________________________________________________
> Assessment_Advisory_Committee mailing list
> Assessment_Advisory_Committee at listsmart.osl.state.or.us
> http://listsmart.osl.state.or.us/mailman/listinfo/assessment_advisory_committee
> Hosted by the Oregon State Library. The Library is not responsible for content.
> Questions related to message content should be directed to list owner(s) or the sender of the message, by phone or email.
> Technical questions? Call 503-378-8800.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://omls.oregon.gov/pipermail/assessment_advisory_committee/attachments/20150724/3c9c4fdb/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.jpg
Type: image/jpeg
Size: 4553 bytes
Desc: not available
URL: <https://omls.oregon.gov/pipermail/assessment_advisory_committee/attachments/20150724/3c9c4fdb/attachment.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 46672 bytes
Desc: not available
URL: <https://omls.oregon.gov/pipermail/assessment_advisory_committee/attachments/20150724/3c9c4fdb/attachment.png>