Review: Compass environment, source-backed data and task verification

[jackjin1997]

Reviewer takeover of Compass contribution #25 by Peichun Hua (@sarendis56), with 16 candidate tasks/verifiers. Fixed source-backed listing data and local account workflows are retained. Environment, task and verifier audit.

The homepage/navigation now follows the source structure and responsive layout, including listing/promotion placement, original photographs, services, community banners and complete menu groups. The new Concierge page replaces its one-panel placeholder with the source video hero, marketing sections, eight case states, before/after photographs, services, process and FAQs. Neighborhood Guides now includes all 24 source regions in the original order and unequal grid layout.

Concierge/directory original–before–after report includes 26 versioned screenshots at 1440, 815 and 390px plus deeper sections. Homepage/navigation report retains its 52 versioned screenshots. The directory comparison below uses 1440×900, loaded fonts and scroll 0:

Original	Before · 82b5915	After · 25b8b33

Current application: 25b8b3375aeb5a3b2c5823f8ed6d52a05eddeccf. During this repair, 168 application/source/verifier tests passed; subsequent typography, anchor and explicit-link refinements were checked through browser operations and an HTTP sweep. A fresh incremental image matched all 47 changed runtime files; 20/20 site homepages and 69 local routes/media URLs returned 200. Compass reset restored its runtime seed byte-for-byte in 0.722s. Eight case states, wrap, mobile controls and the local agent CTA were exercised. This does not repeat the clean full asset-fetch/reset-all check. Validation and screenshot manifest.

Task/verifier evidence is reused by explicit impact/hash checks: 63 protected files remain byte-identical to 82b5915, and only the neighborhood directory handler changed. The original 16-task/268-screenshot execution packet and reconciled Claude verdict retain their earlier identities. Compass--17 was freshly executed at 9741284/e063074: 8 real steps, 16 screenshots, deterministic PASS and no DB changes. Its independent frozen-execution verdict is pending. The new landing-page QA does not count as new benchmark trajectories or current-UI Claude acceptance.

Assets: HF PR #53, revision b09ad95ac9428d5f98e1dc6206f1fa5f87aec671. Archive 192,209,798 bytes, SHA-256 ced1411f5d86992ee07a55b98c3b8660ec548f204e0602c1a90d0fe0436f4b98. This phase adds 38 original media/font/SVG files; all 2,430 prior archive files including seed and the other 19 site archives are unchanged.

Draft: human visual/interaction acceptance, confirmation of the disclosed local-page boundaries, and the refreshed execution’s independent verdict remain pending. Full regional editorial guides are not reproduced: six existing regional links retain local listing snapshots, while 18 explicitly open the source. Concierge contact/financing and YouTube case films use explicit external links; its local CTA opens the existing agent directory. Sell remains an introduction without the original lead form/full workflow; live-map, New Development and corporate/financial services retain disclosed limits. These omissions are not answer-leak safeguards. Fixed data, synthetic accounts and anti-answer-leak differences are preserved separately. Maintainers coordinate final code/asset merges.

[jackjin1997]

Independent blind first-pass review (Compass, 16 tasks)

Reviewer model: Claude Fable 5.1 (claude-fable-5-1), first pass restricted to the frozen execution packet. No verifier code/results, expected answers, PR contents, source, or live DB were read before this verdict was frozen.

Scope

• Reviewed code: b66016dd16dfc7eb776f58d5490fc31caecac68c (current PR head at posting time). Image code actually run: 3cdc0b66d72b8a789b89583176c668081de36852 (wh-review025:3cdc0b6).
• HF asset revision: 47232eba972567d138bbac478a6f4af9775a1d90.
• Input manifest SHA-256: 3125bf726ae7e8faa3020c070d5f08037b619f0474ab3c2c552a272e25be41fd (618 listed files, all sizes/hashes verified, no extra files).
• Frozen verdict SHA-256: 342633f8e1a3f0a31cf5983912c196573a4c7336591d66d3c315938f1035f662.
• Executor: Codex GPT-6, guided/source-aware run. These are judgments of whether those runs completed the tasks, not a measure of independent exploration capability.

Result: 16/16 PASS, 0 FAIL (Compass--0 to 7, 10 to 17). No failed task IDs.

Method

• Every before.db equals the runtime seed; all SQLite read read-only.
• Each read-only task's target was recomputed independently from the seed DB using unrounded price/area ratios and compared against the final answer and the property-details DOM.
• Row-level diff of all tables before/after for every task: write tasks (4, 5, 6, 7, 10, 14, 15) changed exactly the requested rows and nothing else; read tasks left the DB byte-identical to the seed. The new account's password hash was bcrypt-verified.
• Trajectories and DOM observations checked for genuine local UI evidence on the decisive pages (details, Saved Homes, Tours, collection and share page, Saved Searches reopen, Inquiries); 4 screenshots sampled visually.
• Compass--3 contains one retained failed link lookup (selector without the "Pending" badge prefix), recovered on the next step; not counted against the task.

Interpretive assumption worth cross-checking: listings with status = for-sale and a "Pending" badge were treated as for-sale eligible, matching the snapshot status field and the app's own "For sale" filter. This affects the selections in Compass--3, --11 and --17; if pending homes are meant to be excluded, those three would need re-evaluation. " search area" was mapped to market_city; using city gives identical results.

Not performed / not certified

• Did not re-run the app or image; did not verify harness, archive or image hashes, or raw JPEG-to-PNG fidelity.
• Only 4 of 258 screenshots inspected visually; the rest relied on complete DOM observations.
• Compass--15 message body verified from the after DB only (the inquiries list shows subject, not message).
• Human experience, upstream source fidelity, visual quality and verifier implementation are out of scope and not certified by this review.

Structured per-task rationale and evidence are in the frozen verdict file held by the reviewer.

[jackjin1997]

Independent-review reconciliation

Rechecked the frozen verdict hash and all 618 input-file hashes. All 16 task verdicts agree with deterministic scoring. The original Claude verdict remains unchanged.

• Pending: the existing local For sale filter includes Pending / Contract Signed sale listings; their source status is preserved in property details. Tasks 3, 11 and 17 do not ask for active-only listings. Recomputing their selections supports the recorded PASS results.
• Search area correction: city and market_city are not interchangeable for New York. Literal city='New York' yields no qualifying Co-ops; the actual UI search area (city OR market_city) includes seven, including Brooklyn/Manhattan addresses. Rechecking that query preserves task 3's target and PASS.
• Screenshot correction: the immutable manifest contains 268, not 258, screenshots. Claude visually sampled four; the review does not establish comprehensive visual acceptance.
• Task 15: independently confirmed exactly one inquiry with the requested subject/message and correct user/listing/agent, with all other tables unchanged. The task requires persistence, not a subsequent message-body display.

Updated report and evidence boundaries. This follow-up changes documentation only and reuses the frozen review candidate b66016dd16dfc7eb776f58d5490fc31caecac68c. Human experience remains pending; the PR stays Draft.

[jackjin1997]

Addressed the human-reported missing Sell section in e55721b5eb9bd814910dcb3895a665558d730276 (application checkpoint a5e25af): desktop/mobile navigation and the homepage entry now reach /sell/ instead of a missing page. The local introduction uses the original hero image and measured desktop/mobile typography/layout; its contact CTA opens the existing agent directory. The source seller lead form and full seller-service workflow are not implemented.

Four original / before / after comparison groups and remaining differences · Checks and image/input hashes

Sell, 1440×900	Original	Before	After
Actual browser capture

Validation: 42 application/source tests pass, existing Buy/Rent and login/navigation work in the real browser, all 20 homepages return 200, and Compass reset is byte-identical. The incremental Docker build and owner runtime have the same six changed file hashes; updating the owner environment preserved its database and left the other 19 processes untouched.

HF #53 now pins 421ca6a529b88bdd214ecf6308d124798ab1e20b: one added Sell image, all 2,412 previous archive files including seed unchanged, other 19 site archives unchanged. The PR body/report distinguish this update from the frozen task runs and Claude verdict. Task/rubric/verifier inputs are unchanged; original task evidence is reused by impact with fresh shared-entry checks. Claude has not reviewed the new Sell page. Human experience is still pending; this PR remains Draft.

[jackjin1997]

Homepage/navigation correction pushed in 9741284 (evidence/report 5859a3c). The earlier Sell-only patch left substantial structure missing. Original / before / after comparisons, scope limits and validation now cover the desktop/mobile homepage, all dropdown groups, drawer, services, community banners and footer; 32 verified viewport screenshots are included.

Current checks: 168 tests PASS, 91 local homepage URLs/assets, 20/20 site homepages, matching 29-file incremental image, and byte-identical Compass reset. Compass--17 was newly recorded at the final application commit: 8 steps / 16 screenshots, deterministic PASS and unchanged DB. Its refreshed independent review is pending; the older 16-task review is not relabeled as coverage of this UI.

HF #53 now pins e06307429dca76a8a7240d507ab69be9e5b84060 (16 source media added; all 2,413 prior files and 19 other archives unchanged). PR remains Draft for human visual acceptance, confirmation of the disclosed deep-page limits, and the refreshed independent verdict.

[jackjin1997]

Follow-up: the actual 815px viewport exposed remaining structural defects in 9741284. Commit 82b5915 fixes the tablet hero, two-column cards/promotion and neighborhood layout, stacked Concierge source imagery, directory folding and footer columns.

The updated source/before/after report adds 20 verified viewport images (52 retained total), final responsive and runtime checks, asset pin 5b66b75, and explicit evidence-reuse scope. The existing frozen task 17 execution stays bound to 9741284; it was not relabeled or overwritten. Human acceptance and its independent verdict remain pending; this PR remains Draft.

[jackjin1997]

Concierge and Neighborhood Guides reconstruction is now in 25b8b3375aeb5a3b2c5823f8ed6d52a05eddeccf (report fd30342795f477165adb3c794a5e8cbe5205a3f2). The former one-panel Concierge and six-tile directory now use source-derived structure, original media and responsive layouts, including all eight Concierge case states and 24 directory regions.

26 source / before / after screenshots, measured sections and remaining boundaries · Validation and hashes

Validation: 168 tests passed during the repair; final browser checks exercise the case controls and local CTA. The final incremental image matches 47 runtime files; all 20 homepages and 69 local routes/media URLs return 200, and Compass reset restores the seed byte-for-byte. HF #53 now pins b09ad95ac9428d5f98e1dc6206f1fa5f87aec671 with 38 added public assets; all previous asset bytes and seed are preserved.

Human visual/scope acceptance and the refreshed Compass--17 independent verdict remain pending. Existing frozen executions keep their original versions; these new page captures are UI QA evidence. PR remains Draft.