In the last year, literally millions of students worldwide have signed up for MOOCs, short for massive open online courses. The free, web-based classes available to everyone, taught by professors at Harvard, Duke, M.I.T. and other universities.
When those students take the final exam in calculus or genetics, how will their professors know that the test-takers on their distant laptops are doing their own work, and not asking Mr. Google for help?
The online cheating concerns is present for many educators, particularly as more students take MOOCs for college credit, and not just for personal enrichment. Five classes from Coursera, a major MOOC provider, offer the possibility of credit, and many more are expected to join the initiative.
Here are few options on checking the honesty of the learners:
- Students can travel to regional testing centers at exam time. However, reaching such centers is next to impossible for many students, whether working adults who do not have the time off to travel, or others in far-flung places who can not afford the trip.
Eavesdropping technologies worthy of the C.I.A. can remotely track every mouse click and keystroke of test-taking students. Squads of eagle-eyed humans at computers are able to monitor faraway students via webcams, screen sharing and high-speed Internet connections, checking out their photo IDs, signatures and even their typing styles to be sure the test-taker is the student who registered for the class.
The developing technology for remote proctoring may end up being even better than the live proctoring at bricks-and-mortar universities, said Douglas H. Fisher, a computer science and computer engineering professor at Vanderbilt University. He was co-chairman of a recent workshop that included MOOC-related topics. “Having a camera watch you, and software keep track of your mouse clicks, that does smack of Big Brother,” he explains. “But it doesn’t seem any worse than an instructor at the front constantly looking at you, and it may even be more efficient.”
Employees at ProctorU, the company that offers remote proctoring, watch test-takers by using screen sharing and webcam feeds at offices in Alabama and California. ProctorU signed an agreement to proctor new credit-bearing MOOCs from Coursera, including one in genetics and evolution offered at Duke and one in single-variable calculus at the University od Pennsylvania.
MOOC students who want to obtain credit will have to pay to the remote-proctoring fee of $60 to $90, depending on the class, said Dr. Andrew Ng, co-founder of Coursera, based in Mountain View, California.
Other remote proctoring services offer different solutions. At Software Secure in Newton, Massachusetts, test-takers are recorded by camera and then, later, three Proctors independently watch a faster-speed video of each student.
Compared with services where the proctors are monitoring students in real time, this combination of recording first and viewing later “gives greater latitude for the institution to adjust the timing of exams to whenever they want,” said Allison Sands, Software Secure’s director of marketing. This service costs $15 per exam.
Employees at ProctorU say they are well-versed in the sometimes ingenious tactics used to verify the testing rules. “We’ve seen it all,” said Matt Jaeh, Vice president for operations. “After you’ve sat there a while watching people, the patterns of behavior for normal people versus the people trying to sneak in a cellphone to look up information are very clear.”
Each Proctor can monitor up to six students at a time, watching three side-by-side camera feeds, on each of two screens. If a student’s eyes start to wander, the Proctor gives a warning via video-conferencing software. It is the same as a classroom monitor might tell students to keep their eyes on their own papers. For an overwhelming majority of people, that warning will suffices, said Jarrod Morgan, a co-founder.
With this system in place, “cheating usually isn’t a problem,” he said. If it does occur, ProctorU follows the rules of the institution giving the exam. “Some schools ask us to cut off the exam on the spot if there’s a suspicious incident,” he explains, others ask that the exam be continued and the incident reported.
Apart from the issue of proctoring, MOOCs are addressing the problem of making sure that credit-seeking test-takers are the same students who enrolled in the course. In that direction, Coursera is offering a separate service, called Signature Track and costing $30 to $99. This confirms students’ identity by matching webcam photographs, as well as pictures of acceptable photo IDs.
Students have to type a short phrase, which is analyzed by a software program that takes note of the typing rhythm and other characteristics, like how long the keys are pressed down. Then, when a student submits homework, exam or takes a test, the algorithm compares a bit of new typing with the original sample. (And if you have broken your arm, there is always your photo ID!!)
Online classes are not a new thing, but earlier courses typically did not have to handle exam proctoring on the scale required for vast MOOCs.
The University of Florida in Gainesville, has long offered many programs for students studying far from the campus, with some monitoring done by ProctorU, said W. Andrew McCollough, Associate Provost for teaching and technology.
Now they have set up its first MOOC, on human nutrition (enrollment 47,000), and is working on four others, all through Coursera. The question of proctoring is being debated, he adds, as faculty members worry about academic integrity amid the growth of open, online classes. “They don’t want any fooling around,” he explains. “But as we get more experience and evidence, the Faculty are getting familiar with ways technology can replicate a classroom experience.”