Lab Report 1 · Body
Lab 1: Three Answers, One Question. Report, part 1 of 2: the body.
Tuesday, September 1 — Correctness
You are writing a paper. Complete sentences, for a reader who was not in this room.
This is exactly what was sent, to all three models, at the same moment:
Answer all three questions.
- In what year did the Superdome in New Orleans open?
- Who is the current head coach of the New Orleans Saints?
- What is the population of the city of New Orleans?
The instructions all three were given:
You are answering a question for a high school class in New Orleans. Answer the question directly and completely. Do not ask the student a question back.
Your Day 2 observation form is open on the left. Everything you need is in it. Name the pane before you use a shortcut. Give every number with what it is out of. Say what happened before you say what it means.
1.The sources. For each of the three questions, where did you check, and what did you find there? *
Could a reader open the same source and find the same answer? Is there a date on the population figure?
2.The score. How many of the three did each pane get right, and which question did each one miss? If a pane refused or gave no answer, say so. *
Is every count written as a number out of three? Does what you wrote here match the marks on your Day 2 form?
3.Confidence. How did the wrong answers sound next to the right ones? Did any pane say it was unsure? *
From your description alone, could a reader tell that a confident answer was wrong?
4.Tuesday's ranking, and what the word better meant on Tuesday. *
Could a reader rebuild your ranking from the counts above? If two panes tied, did you say so?
Wednesday, September 2 — Criteria
You are writing a paper. Complete sentences, for a reader who was not in this room.
This is exactly what was sent, to all three models, at the same moment:
A tenth grade student has to give a five minute presentation in front of the class next week and is nervous about it. Give them advice.
The instructions all three were given:
You are answering a question for a high school class in New Orleans. Answer the question directly and completely. Do not ask the student a question back.
Your Day 3 observation form is open on the left. There was no answer key on Wednesday. What there was instead is the subject of this section.
5.The four criteria. What did each one ask of a response? *
Would a reader who never saw the criteria sheet understand what usable this week was testing?
6.The tally. How many of the four criteria did each pane meet, and which ones did it miss? *
Is every count out of four? Does it match the yes and no marks on your Day 3 form?
7.The sentences that decided it. For the pane that ranked first and the pane that ranked last, which sentence settled a criterion, and which criterion did it settle? *
Is the sentence quoted exactly, from the copy button, not from memory? Does the pane number come before the quote?
8.The criterion that was hardest to apply the same way twice. What did your group decide, and did that decision change any pane's count? *
If your group disagreed, what was the disagreement actually about?
9.Wednesday's ranking, and what the word better meant on Wednesday. *
How is Wednesday's meaning of better different from Tuesday's? Can a reader see that difference in your two rankings?
Thursday, September 3 — The Length Limit
You are writing a paper. Complete sentences, for a reader who was not in this room.
This is exactly what was sent, to all three models, at the same moment:
Is going to college worth taking out student loans for?
Answer in no more than 120 words.
The instructions all three were given:
You are answering a question for a high school class in New Orleans. Answer the question directly and completely. Do not ask the student a question back.
Your Day 4 observation form is open on the left. This was Monday's question with one new instruction. The numbers under each pane were read off the screen, not estimated.
10.The numbers. For each pane: words, seconds, and tokens per second. *
Which pane finished first? Which pane wrote fastest? Are those the same pane, and if not, why not?
11.The limit. Which panes stayed at or under 120 words, and by how much did the others go over? *
Is over written as a number of words, or as a feeling?
12.Specificity. Did each pane commit to amounts, names, or times, or stay general? One example from each pane. *
Would a reader know which pane you are quoting? Is the example a quote or a summary?
13.Hedging. How many hedges did each pane use? Quote one exactly and say which pane it came from. If no pane hedged, say that plainly. *
Is zero written down as zero? If three models of three different sizes all made the same choice, what might that tell a reader?
14.Structure, and what all three had in common. How was each response laid out, and apart from layout, what did all three share? *
Could a reader picture each response from your description without seeing the screen?
15.Monday's question, with a limit. What did the 120-word limit change, and what did it not change? Point at a number.
Look at your Day 1 form. Which of Monday's numbers moved, and which stayed put?