Method

Six AI renderings of one chapter and the human translation. What was held the same, what varied between arms, and how the seven are compared.

The design

Seven English versions of Chapter 25 of Tergit's Effingers. Six come from the same underlying AI model, given the same source, the same novel-reading step, and the same revision budget; the seventh is the published human translation. The arms vary on two axes: the source of the translator's persona (or its absence), and the style brief at the translation step (none, permission, or instruction).

The experiment was extended over time. The original four arms (A, B, C, H) established the baseline. The control-plus-permission arm (C-let), the broader-corpus arm (D-let), and the school-instruction fork (D-aim) were added to probe specific dimensions opened by the original findings. The site as it stood at the original four-way version is preserved at /archive/four-way/.

The procedure

The AI arms followed a four-step protocol. Arms with a persona (A, B, and the shared D) did all four; the controls (C and C-let) joined at the third.

Step 1

Read the author's other books, and take notes.

Step 2

Read biographical and scholarly material about the author and her tradition, then write the persona.

Step 3

Read the full novel — 151 chapters — and take notes; revise the persona if the reading calls for it.

Step 4

Translate Chapter 25, revising over up to five passes, each one logged.

D-let and D-aim are the same machine through the first three steps. They share the persona and the reading notes, and part ways only at the last: the conversation was wound back to the point just before translation — a fork, a fresh copy of the machine's state at that moment — and one copy was given the domesticating-school instruction where the other carried only a permission. The two were run separately under identical conditions, so the single thing that differs between their translations is that final instruction.

The constraints

Reading the results

The translations were read in stages. The original four (A, B, C, H) were compared first blind — twice, on the texts alone and then with the German source beside them — and only afterward with the labels visible, a guard against reading in what one expects to find. A separate analysis compared A's, B's, and the human translator's readings of Tergit, side by side. C-let was then added for a five-way analysis, and the full seven-way comparison — folding in D-let and D-aim — completed the picture.

What that reading found: the six machines cluster tightly, while the human stands apart; a stronger domesticating instruction moves a machine further toward English without moving it closer to the human's own choices; and the human's structural moves — fusing the refrain, inventing a rhyme, writing the dialect in eye-dialect — appear in no machine version. The measured picture is in the Findings; how the arms reasoned, in the Observations.

A full procedural history of the experiment — naming changes, corrections, methodological discoveries along the way — is at How this experiment evolved.