Any thoughts on acceptable practices for online tests, from the point of view of academic honesty?
I did a 'virtual' AC, which I felt was slightly poorly managed. There were two prior rounds: the form, then a proof-reading task using skillsarena, which had video proctoring activated.
The AC consisted of a group exercise, which makes sense, followed by what turned out to be another written task via skillsarena with video proctoring. It wasn't really clear why this second task was considered part of the AC, because the schedule read:
1. 11:10-11:40 - written exercise; zoom link provided
2. 11:40-12:00 - written exercise; zoom link provided
whereas in fact what happened was they sent out the skillsarena link at 11:02am, and then between about 11:10 and 11:15 were explaining that we'd need to log off zoom (because the skillsarena task is video-proctored), do the task, then rejoin afterwards. Since the allocated time within skillsarena was 30 minutes, it was quite disconcerting as the schedule implied that you were expected to rejoin at 11:40, whereas you probably wouldn't even have started your task until about 11:18, and only at that point would have learned that you had been allocated 30 minutes to complete the task. (As it turned out, when I joined the 11:40-12:00 session, it was just a "thanks for coming", and the entire second hour of the AC could just have been done offline.)
The fact that video proctoring is activated by skillsarena suggests that they are trying to stop cheating, but they don't define what cheating is.
One candidate asked "can we use Microsoft Word?" (it was a drafting exercise, and a formatted box was provided to reply within skillsarena)
In my opinion the answer to this should be "no", unless you've got a dispensation or something, because Word will identify grammar and spelling errors, and now has AI features as well that could generate the entire email.
However, the answer was given "yes".
I did not use Microsoft Word, out of an abundance of caution, and also did not use the full 30 minutes because I was concerned about being late back, even though this turned out not to be an issue. I did however ctrl+c my answer and checked it in Word AFTER submission, where it spotted a typo, and suggested a couple of missing commas.
It turned out that although you could copy out, Skillsarena disabled paste into the box, and two or three candidates were unable to submit because they had done their answers in Word and then copy + pasted them at 29:30, and then found out that it didn't work. So they had to email them manually, lol.
I've noticed in other online tests that they say they have "behind the scenes metrics". It's not clear what this means, but technologically apps can detect when you switch to other windows, and can also detect copy pasting (although often this is disabled), track response times. In SJTs where they have numerical questions I would tend to use Excel unless it's trivially simple to do by mental arithmetic, because that just seems like the only sensible way to do things, but it's not really clear whether Excel use is somehow frowned upon.
In addition, AI can accurately answer many types of question, and while this is presumably deemed cheating, it's not necessarily spelled out, nor do they typically make even minimal efforts to stop this (e.g., by using a locked-down exambrowser-type tool). (Although I suppose such efforts might be deemed OTT in that these are not exams but merely one of several stages in a recruitment process).