Taking the Plunge into Recorded Remote Testing:
Lessons from the Hawaii Department of Education
Introduction
In response to the COVID-19 pandemic, the Hawaii Department of Education (HIDOE) faced the unprecedented challenge of administering statewide assessments remotely. The necessity to provide a flexible yet secure way to evaluate students led the department to adopt a model of recorded remote testing. In this article, we explore Hawaii’s journey into remote testing, the obstacles they overcame, and the successes that emerged along the way.
The Challenge: Moving Statewide Testing Online
Prior to the pandemic, Hawaii’s statewide testing was conducted in person, with assessments administered by teachers in classrooms or computer labs. The assessments covered a range of subjects, including English Language Arts (ELA), mathematics, and science. However, as the pandemic continued and many students remained in distance learning, HIDOE needed a solution to ensure that students learning from home could still participate in these critical assessments.
Hawaii, a Smarter Balanced state, considered several options. Ultimately, the department decided to offer a remote testing option to maintain the integrity of their assessments, ensuring the results from remote and in-person tests could be compared. HIDOE aimed to provide a testing experience that mirrored the in-person experience as closely as possible, focusing on security and consistency.
Why Recorded Remote Testing?
One of the major concerns with remote testing was the potential for discrepancies between the results of students testing in-person and those testing remotely. HIDOE knew that it was crucial to maintain a high level of security for remote testing, just as they would in a traditional classroom setting.
After examining what other states and higher education institutions were doing for remote testing, HIDOE decided to use a recorded remote testing model. This model required students to use two devices: one device (typically a laptop or Chromebook) to take the test and another device (such as a cell phone) to record the student’s testing environment. The goal was to ensure that students testing at home were subject to the same security standards as those testing in person.
The HIDOE team worked closely with their legal department to ensure that the remote testing plan complied with state and federal laws regarding privacy. This involved establishing clear protocols for handling recordings, including guidelines for what to do if inappropriate or sensitive material was captured during testing. These safeguards helped protect students’ privacy while ensuring the integrity of the assessment.
The User Experience: A Two-Device Setup
The remote testing experience for students required the use of two devices. The first device, typically a school-issued laptop or Chromebook, was used to access the testing platform. The second device, usually a cell phone or tablet, was positioned to capture the student’s testing environment, showing their hands and keyboard. This setup allowed HIDOE to monitor for any irregularities or potential test security violations during the assessment.
To ensure that students and their families were prepared for remote testing, HIDOE developed detailed guidance documents and training materials. These resources helped parents understand the testing requirements, including the need for a second device and a stable internet connection. Additionally, students were encouraged to complete a practice test using the same setup they would use for the actual assessment, which helped familiarize them with the process.
For test administrators, HIDOE developed a comprehensive training program that included certification for remote test administration. Test administrators were responsible for monitoring small groups of students via Zoom or Webex, ensuring that they adhered to the testing protocols.
Ensuring Test Security and Fairness
Test security was a top priority for HIDOE throughout the implementation of remote testing. To maintain fairness between in-person and remote testing, HIDOE implemented several key measures. One of the most important aspects was the use of recorded test sessions. Before any remote test could take place, the test administrator was required to submit a link to the test session’s Zoom or Webex meeting to the state office. This allowed HIDOE staff to monitor the session in real time if necessary and ensured that a record of the session existed for review later.
The recorded sessions were then uploaded to Caveon’s system, where security specialists reviewed them for any signs of irregularities or test security breaches. If any suspicious activity was detected, HIDOE would follow up with the test administrator and determine whether the test results needed to be invalidated or if the issue could be resolved without affecting the student’s scores.
In some cases, test administrators were found to have inadvertently assisted students during testing, such as by providing definitions of unfamiliar words. HIDOE treated these incidents as testing irregularities and addressed them on a case-by-case basis. Depending on the severity of the violation, the student’s test could be invalidated, or the results could be allowed to stand.
Accommodations for Diverse Learners
Ensuring that all students, including those with disabilities or special needs, could access the assessments was another challenge HIDOE had to address. The department worked diligently to ensure that students with Individualized Education Programs (IEPs) or other accommodations could receive the same support during remote testing as they would in person. While certain accommodations, like Braille assessments, were not feasible for remote administration, HIDOE successfully provided accommodations for most students testing remotely.
Lessons Learned and Future Plans
Looking ahead to future testing seasons, HIDOE has taken the lessons learned from their first foray into recorded remote testing and refined their processes. The department emphasized that remote testing is not their preferred method of delivery but recognized that it may be necessary for some students who are unable to test in person.
As HIDOE prepares for the 2021–2022 testing season, the focus will remain on in-person testing, with remote testing as a last resort. However, the department has made some adjustments to its procedures based on feedback from last year’s test administrators and families. These adjustments include better training for test administrators, clearer documentation, and improved communication with schools about deadlines and submission requirements.
While the number of students who participated in remote testing last year was relatively small (approximately 125 for ELA and math), HIDOE is prepared to offer remote testing again for students who need it. The department remains committed to ensuring that all students, regardless of their testing environment, receive fair and accurate assessments.
Conclusion: Maintaining Confidence in Remote Testing
HIDOE’s experience with recorded remote testing during the pandemic highlights the importance of flexibility, security, and preparation in assessment administration. By adopting a rigorous testing protocol and leveraging technology, Hawaii was able to offer students a remote testing option that maintained the integrity of the assessments.
Although remote testing presents challenges, particularly around technology and privacy, the HIDOE team demonstrated that it is possible to provide secure, reliable assessments to students learning from home. As testing environments continue to evolve, HIDOE’s experience offers valuable insights for other states and educational institutions considering similar approaches.
READY TO TALK TO AN EXAM SECURITY EXPERT?
Reach out and tell us about your organization’s needs today!