(This assignment was developed based on Jeff's class project 2.)
In this assignment, you'll take on the role of a requester by creating tasks on Amazon Mechanical Turk, and submitting your first HIT "programmatically" -- that is, without using the GUI provided on the Amazon Mechanical Turk site. This is one of the first steps of really "programming the crowd" because it demonstrates the start of being able to write programs that automatically draw in human intelligence when it's needed.
The task you'll have workers perform is to write a short story (about 5 sentences) based on the following photo sequence. You need to figure out a reasonable interface design that encourages workers to write a good story. The interface should also be able to detect some trivial human errors, e.g. typos, or story being too short.
At minimum your web page needs to show the image sequence and provide a text box so that workers can enter the story.
The challenge of the assignment is to design an interface that collects high-quality data from workers. There is no set guidelines on what you need to include in your web page for collecting HITs, but you might consider some of the lessons we've learned in lecture and from the readings. For instance, how can the interface encourage high-quality responses? How can you make it as difficult to do this job poorly as to do it well? Could you use a gold-standard question for sanity check? How can you write your instructions clearly? Can you build in some other quality control mechanism? Maybe you can pay them a high amount, or maybe you will bonus them if they agree with others?
You will be graded in part on the quality of the collected stories, so put time and thought into how to encourage them to give you high-quality input.
You will get a chance for feedback on your interface from your classmates on 2/21. You'll need to have a prototype ready on the class day in order to get feedback.
We suggest hosting your HITs on Github Pages. The reason is that it's free, relatively easy, and supports https, which Mechanical Turk requires. It's not fancy web hosting. You'll have ~zero control over the backend. But, as we’ll see, almost everything we'll be doing is on the front-end anyway.
There's a good walk-through of how to do this on the Github Pages page: https://pages.github.com.
Or you can use PSU web page. It also comes with HTTPS.