107 lines
9.5 KiB
Markdown
107 lines
9.5 KiB
Markdown
# Prompting a re-surfacing model
|
|
|
|
The method only works because the prompt does one job: **tell the renderer that IMAGE 1 is the truth and that its
|
|
job is surface.** Everything else in the prompt protects that premise from the renderer's priors. The blocks in
|
|
`examples/prompts.example.json` are the wording that measurably held; this file explains what each one is for and
|
|
the failures that produced it.
|
|
|
|
## Principles
|
|
|
|
1. **Geometry arrives as pixels, never as words.** Words cannot carry an aspect ratio, a distance or a height. The
|
|
plate carries them. A prompt that argues with the plate loses; a prompt that argues with the renderer's prior wins
|
|
only sometimes. Fix geometry in the model and re-render; never by wording.
|
|
2. **The renderer photographs the plate's mistakes as faithfully as its truths.** There is no wording that makes it
|
|
correct a wrong block. Gate the plate first.
|
|
3. **Per camera, from a visibility list.** Enumerate what THIS camera sees. State what it does NOT see as a positive
|
|
instruction ("the balcony is on the far side and is not visible from here; do not show a balcony"). A feature named
|
|
in a prompt will be rendered somewhere; if its true position is occluded, the renderer relocates it. One shared
|
|
feature list reused across angles is exactly what causes this (9/9 wrong with a shared list, 0/8 with per-camera
|
|
lists).
|
|
4. **Name absence; describe what is there instead.** "No counter" keeps the counter. "Under the roof there is
|
|
nothing: only the bare deck and the balustrade beyond" removes it.
|
|
5. **A noun is a vote for the noun.** "No more than a few lanterns" spawns lantern-carriers. "Steam vents" spawn
|
|
ghosts. "Sledge-packed" turns a hut into a horse and sledge (15 of 17 takes). To get less of something say less about
|
|
it; to get none, say nothing, or say what fills the space instead.
|
|
6. **State construction facts, not adjectives.** "Prosperous" plus "apron" gives modern artisan workwear. "The cut is
|
|
T-shaped, pulled on over the head with no opening down the front; soft turn-shoes with no laces and no heels; no
|
|
waistcoat, no lapels, no buttons" gave 13/13 period outfits.
|
|
7. **Material references come from a DIFFERENT camera than the plate.** A same-camera materials board pulled the
|
|
composition toward the board's framing (0/3), while the same board was harmless on cameras it did not resemble.
|
|
8. **Every constraint you add gets its own QC.** If you wrote "no sun disc", check for a sun disc.
|
|
|
|
## The blocks
|
|
|
|
| block | job | what it fixed |
|
|
|---|---|---|
|
|
| `resurface` | the premise: IMAGE 1 is the ground truth for position, size and shape; add surface only; keep the camera | the whole method |
|
|
| `people` | the mannequins ARE the people; dress each where it stands at its size; add nobody; carts and animals likewise; then the period cut as construction facts | proxies become the population; figure scale holds at street level |
|
|
| `eyeline` | the camera is at a standing adult's eye height, so every standing adult's EYES are ON THE HORIZON LINE | near walkers went from +25-28 % to +5-13 % |
|
|
| `nomodern` | the list of modern objects by name, plus NO TEXT of any kind | lamp posts, wire, glazing, lettering, watermarks |
|
|
| `setting` | climate, season and ground cover as facts, tied to what the plate shows ("woods exactly where image 1 shows its darker patches") | season drift, snow on summer slopes |
|
|
| `town` | what the town is, materials by wealth quarter, each landmark's shape in two clauses, and **the list of large things the renderer likes to invent for a town of this kind, negated** ("no city wall, no cathedral, no spires, no domes, no brick") | invented cathedrals, walls, metropolis skylines |
|
|
| per-view `intro` | what the camera is, where it stands, what fills the frame, and what each attached image is FOR ("IMAGE 2 is another part of this same town: use it ONLY for materials and light; ignore its buildings, camera and composition") | reference bleed |
|
|
| per-view `keep` | KEEP EXACTLY: the skylines, the road's bends, the river's line, each landmark by position, every traveler at its size | the renderer's "improvements" |
|
|
| per-view `frame` | **FRAMING LOCK** with measured band positions in % of the frame, plus **SIZES BY THE NEAREST OBJECT** (the palisade is 3 m, so adults reach a little above half of it; the posts are 5.6 m, so the watchmen reach a third) | zooms of 4-10 % on wide views (0/4 -> pass); giants at a gate (r3 clean after two rounds of oversized figures); a cropped facade restored to full height (0/3 -> 4/4) |
|
|
| `lights.*` | the hour, where the sun is relative to the CAMERA ("behind the camera and a little to the right"), "shadows fall away from the camera exactly as image 1 shows them", no sun disc | a sun disc drawn in a frame that faces away from the sun |
|
|
| `relights.sunset` | light only; and when the camera faces AWAY from the sunset, say so: "THE SKY IN THIS PICTURE IS THE EASTERN SKY ... a dusky-pink Earth's-shadow band, NO glow" | a bright orange sunset painted in the east, 5 views out of 5, two rounds running |
|
|
|
|
### Framing-lock numbers
|
|
|
|
Measure them on the plate: the row (in % of frame height) where the far ground meets the sky, where the town band
|
|
starts and ends, where a landmark's ridge sits; the columns where the road enters the bottom edge. The lock quotes
|
|
them. For wide foreground plates (a small town low in the frame behind an empty field) add the explicit "the town is
|
|
SMALL in this view and sits LOW in the frame (houses from about 71 % to 96 % of the frame height). Do not move the
|
|
town up toward the mountains and do not enlarge it." Giving a bounding box alone did not help; the sentence did.
|
|
|
|
### Scale by relation, not by number
|
|
|
|
The renderer ignores a stated size but obeys a physical relation it has to draw. A 1 m character prompted as "about one
|
|
meter tall" rendered at 1.4-1.5 m; with "her hand rests flat on top of his hood, her arm hanging straight down" he
|
|
rendered at 1.0-1.1 m. The same lever works for gateposts, carts and counters: "the cart's wheels come up to a man's
|
|
chest", "the counter reaches their hips".
|
|
|
|
## Wealth tier as visual vocabulary
|
|
|
|
Wealth buys **space, permanence and uniformity**, in that order, and only at the far end **ornament with no function**.
|
|
The poor share walls; the rich own the ground they do not build on. Cheap is patched in several materials; expensive is
|
|
one material carried across the whole structure. Below the wealthy rung, status markers read as a lie (a carved gate on
|
|
a patched roof). At the top, prefer functionless carved detail over expensive-looking surfaces: a plain carved stone
|
|
beast beside a door says more than gilding, because carving cannot be faked.
|
|
|
|
Put the tier into the prompt as facts about the subject: its ground surface (mud and ruts / beaten earth / gravel /
|
|
flags), its boundary (none / salvaged boards / coursed wall with a formal gate), its spacing (touching / a gap / land
|
|
held empty on purpose), its roof (patchwork / one material, repairs matched / slate, ridge true). Never assert a tier
|
|
against the map: a building the map draws hemmed in stays hemmed in; the tier shows in roof, surface and boundary.
|
|
The strongest single interior tell is the counter material: rough wood -> scrubbed -> polished dark hardwood -> marble.
|
|
|
|
**Glass follows the wealth tier; it is never banned outright.** Low and modest venues: wood, horn, pewter, ceramic,
|
|
horn or oiled-skin windows, at most a few prized pieces. Comfortable: glass lamp chimneys, some bottles, leaded panes.
|
|
Wealthy: clear glassware and glazed windows are normal. Only electric light is banned. A blanket "no glass" was a
|
|
lane's over-generalization of one district's local rule and produced false defects for a week.
|
|
|
|
**Same-rung houses come out interchangeable** (a block model carries footprint and roofline; the tier fixes materials;
|
|
neither says what the house does). Add each house's tell in the brief: one emblem sign (never lettering) and its trade
|
|
visible at the frontage.
|
|
|
|
## Things that failed and the wording that fixed them
|
|
|
|
- A pitched-up plate: the renderer tilted the verticals 1-2.6 degrees and shrank the frame. Fix in the model: render
|
|
the plate level with a vertical lens shift.
|
|
- A door "filling the recess" built arch-shaped doors. "A rectangular door under the tympanum, which stays stone."
|
|
- A facade that fills the frame grew a ~90 px sky sliver because the prompt named the sky. "No sky in view."
|
|
- Open books grow pseudo-script even under the full no-text clause. "Every book is CLOSED, even though IMAGE 1 shows
|
|
open books; loose sheets face down."
|
|
- "Two fingers raised" came out as a modern V sign, 4/4. Drop the gesture; say "no hand sign".
|
|
- "The roof hatches are thrown open" took the roof off the room. "The room is whole and roofed; only two small
|
|
square hatches, each about an arm-span across."
|
|
- A people-free door view came back with people on the stair. An explicit people-free clause, 6/6 clean.
|
|
- Window columns, partitions and end gables grow windows the plate does not have. Per view: "that wall has no
|
|
window", "no other openings". Check partitions a prompt might read as an exterior wall.
|
|
- A plume of smoke from a building with no hearth under an "Ice Fog, chimney smoke rises" cell. Add a no-smoke clause
|
|
for that building.
|
|
- Flags with crosses on an old plate read as modern national flags. "Plain single-color streamers, even though IMAGE 1
|
|
shows crosses."
|
|
- Output-stage safety refusals on scenes with a dying patient ran ~14 %; softening the wording lowers but does not
|
|
remove it. Budget extra takes; after an outright refusal the lane stops and reports it rather than switching
|
|
renderers on its own.
|