>>When the University of California at Davis tried out such technology a couple years back, lecturer Andy Jones decided to try to trick "e-Rater."
Prompted to write on workplace injuries, Jones instead input a letter of recommendation, substituting "risk of personal injury" for the student's name. "My thinking was, 'This is ridiculous, I'm sure it will get a zero,'" he said.
He got a five out of six.
A second time around, Jones scattered "chimpanzee" throughout the essay, guessing unusual words would yield him a higher score.
He got a six.
In Brent's class, sophomore Brady Didion submitted drafts of his papers numerous times to ensure his final version included everything the computer wanted.
"What you're learning, really, is how to cheat the program," he said.<<
So, add a few monkeys here and there, and the very smart computer figures out you have a nice elevated vocabulary, and therefore gives you a higher score. I know I am oversimplifying a bit here, but the fact that you can so easily fool the computer says a lot about why this may not be such a hot idea. While it is accepted in composition studies that educators can agree on what makes a good paper or not, I don't quite think the machine can detect the nuances and subtleties in an individual piece of writing. True, teachers create rubrics and other basic scales to decide on how good a paper is. I used to use rubrics in some of my classes back in the day, but often these rubrics were discussed in class as part of the learning process, negotiated somewhat with students, and students would learn how to recognize good writing through practice. This took time, then again, anything worth doing right takes time. And maybe that is what makes me wonder about using software to replace something that takes time and effort for the sake of efficiency and savings. Sure, you can feed a rubric to a machine and program it to look for certain traits, but unless the computer can actually "read" the essay rather than scan it for certain things, the results may not be the most desirable. Anyhow, this seems something interesting to keep an eye on as more and more administrators and bosses look to cut corners with automation for the sake of saving money.
As a note, the link to the article leads to the newspaper's website. The usual caveats about access after a while apply.