Files

9.5 KiB

Prompting a re-surfacing model

The method only works because the prompt does one job: tell the renderer that IMAGE 1 is the truth and that its job is surface. Everything else in the prompt protects that premise from the renderer's priors. The blocks in examples/prompts.example.json are the wording that measurably held; this file explains what each one is for and the failures that produced it.

Principles

  1. Geometry arrives as pixels, never as words. Words cannot carry an aspect ratio, a distance or a height. The plate carries them. A prompt that argues with the plate loses; a prompt that argues with the renderer's prior wins only sometimes. Fix geometry in the model and re-render; never by wording.
  2. The renderer photographs the plate's mistakes as faithfully as its truths. There is no wording that makes it correct a wrong block. Gate the plate first.
  3. Per camera, from a visibility list. Enumerate what THIS camera sees. State what it does NOT see as a positive instruction ("the balcony is on the far side and is not visible from here; do not show a balcony"). A feature named in a prompt will be rendered somewhere; if its true position is occluded, the renderer relocates it. One shared feature list reused across angles is exactly what causes this (9/9 wrong with a shared list, 0/8 with per-camera lists).
  4. Name absence; describe what is there instead. "No counter" keeps the counter. "Under the roof there is nothing: only the bare deck and the balustrade beyond" removes it.
  5. A noun is a vote for the noun. "No more than a few lanterns" spawns lantern-carriers. "Steam vents" spawn ghosts. "Sledge-packed" turns a hut into a horse and sledge (15 of 17 takes). To get less of something say less about it; to get none, say nothing, or say what fills the space instead.
  6. State construction facts, not adjectives. "Prosperous" plus "apron" gives modern artisan workwear. "The cut is T-shaped, pulled on over the head with no opening down the front; soft turn-shoes with no laces and no heels; no waistcoat, no lapels, no buttons" gave 13/13 period outfits.
  7. Material references come from a DIFFERENT camera than the plate. A same-camera materials board pulled the composition toward the board's framing (0/3), while the same board was harmless on cameras it did not resemble.
  8. Every constraint you add gets its own QC. If you wrote "no sun disc", check for a sun disc.

The blocks

block job what it fixed
resurface the premise: IMAGE 1 is the ground truth for position, size and shape; add surface only; keep the camera the whole method
people the mannequins ARE the people; dress each where it stands at its size; add nobody; carts and animals likewise; then the period cut as construction facts proxies become the population; figure scale holds at street level
eyeline the camera is at a standing adult's eye height, so every standing adult's EYES are ON THE HORIZON LINE near walkers went from +25-28 % to +5-13 %
nomodern the list of modern objects by name, plus NO TEXT of any kind lamp posts, wire, glazing, lettering, watermarks
setting climate, season and ground cover as facts, tied to what the plate shows ("woods exactly where image 1 shows its darker patches") season drift, snow on summer slopes
town what the town is, materials by wealth quarter, each landmark's shape in two clauses, and the list of large things the renderer likes to invent for a town of this kind, negated ("no city wall, no cathedral, no spires, no domes, no brick") invented cathedrals, walls, metropolis skylines
per-view intro what the camera is, where it stands, what fills the frame, and what each attached image is FOR ("IMAGE 2 is another part of this same town: use it ONLY for materials and light; ignore its buildings, camera and composition") reference bleed
per-view keep KEEP EXACTLY: the skylines, the road's bends, the river's line, each landmark by position, every traveler at its size the renderer's "improvements"
per-view frame FRAMING LOCK with measured band positions in % of the frame, plus SIZES BY THE NEAREST OBJECT (the palisade is 3 m, so adults reach a little above half of it; the posts are 5.6 m, so the watchmen reach a third) zooms of 4-10 % on wide views (0/4 -> pass); giants at a gate (r3 clean after two rounds of oversized figures); a cropped facade restored to full height (0/3 -> 4/4)
lights.* the hour, where the sun is relative to the CAMERA ("behind the camera and a little to the right"), "shadows fall away from the camera exactly as image 1 shows them", no sun disc a sun disc drawn in a frame that faces away from the sun
relights.sunset light only; and when the camera faces AWAY from the sunset, say so: "THE SKY IN THIS PICTURE IS THE EASTERN SKY ... a dusky-pink Earth's-shadow band, NO glow" a bright orange sunset painted in the east, 5 views out of 5, two rounds running

Framing-lock numbers

Measure them on the plate: the row (in % of frame height) where the far ground meets the sky, where the town band starts and ends, where a landmark's ridge sits; the columns where the road enters the bottom edge. The lock quotes them. For wide foreground plates (a small town low in the frame behind an empty field) add the explicit "the town is SMALL in this view and sits LOW in the frame (houses from about 71 % to 96 % of the frame height). Do not move the town up toward the mountains and do not enlarge it." Giving a bounding box alone did not help; the sentence did.

Scale by relation, not by number

The renderer ignores a stated size but obeys a physical relation it has to draw. A 1 m character prompted as "about one meter tall" rendered at 1.4-1.5 m; with "her hand rests flat on top of his hood, her arm hanging straight down" he rendered at 1.0-1.1 m. The same lever works for gateposts, carts and counters: "the cart's wheels come up to a man's chest", "the counter reaches their hips".

Wealth tier as visual vocabulary

Wealth buys space, permanence and uniformity, in that order, and only at the far end ornament with no function. The poor share walls; the rich own the ground they do not build on. Cheap is patched in several materials; expensive is one material carried across the whole structure. Below the wealthy rung, status markers read as a lie (a carved gate on a patched roof). At the top, prefer functionless carved detail over expensive-looking surfaces: a plain carved stone beast beside a door says more than gilding, because carving cannot be faked.

Put the tier into the prompt as facts about the subject: its ground surface (mud and ruts / beaten earth / gravel / flags), its boundary (none / salvaged boards / coursed wall with a formal gate), its spacing (touching / a gap / land held empty on purpose), its roof (patchwork / one material, repairs matched / slate, ridge true). Never assert a tier against the map: a building the map draws hemmed in stays hemmed in; the tier shows in roof, surface and boundary. The strongest single interior tell is the counter material: rough wood -> scrubbed -> polished dark hardwood -> marble.

Glass follows the wealth tier; it is never banned outright. Low and modest venues: wood, horn, pewter, ceramic, horn or oiled-skin windows, at most a few prized pieces. Comfortable: glass lamp chimneys, some bottles, leaded panes. Wealthy: clear glassware and glazed windows are normal. Only electric light is banned. A blanket "no glass" was a lane's over-generalization of one district's local rule and produced false defects for a week.

Same-rung houses come out interchangeable (a block model carries footprint and roofline; the tier fixes materials; neither says what the house does). Add each house's tell in the brief: one emblem sign (never lettering) and its trade visible at the frontage.

Things that failed and the wording that fixed them

  • A pitched-up plate: the renderer tilted the verticals 1-2.6 degrees and shrank the frame. Fix in the model: render the plate level with a vertical lens shift.
  • A door "filling the recess" built arch-shaped doors. "A rectangular door under the tympanum, which stays stone."
  • A facade that fills the frame grew a ~90 px sky sliver because the prompt named the sky. "No sky in view."
  • Open books grow pseudo-script even under the full no-text clause. "Every book is CLOSED, even though IMAGE 1 shows open books; loose sheets face down."
  • "Two fingers raised" came out as a modern V sign, 4/4. Drop the gesture; say "no hand sign".
  • "The roof hatches are thrown open" took the roof off the room. "The room is whole and roofed; only two small square hatches, each about an arm-span across."
  • A people-free door view came back with people on the stair. An explicit people-free clause, 6/6 clean.
  • Window columns, partitions and end gables grow windows the plate does not have. Per view: "that wall has no window", "no other openings". Check partitions a prompt might read as an exterior wall.
  • A plume of smoke from a building with no hearth under an "Ice Fog, chimney smoke rises" cell. Add a no-smoke clause for that building.
  • Flags with crosses on an old plate read as modern national flags. "Plain single-color streamers, even though IMAGE 1 shows crosses."
  • Output-stage safety refusals on scenes with a dying patient ran ~14 %; softening the wording lowers but does not remove it. Budget extra takes; after an outright refusal the lane stops and reports it rather than switching renderers on its own.