Mike's Checks/grok-4.6/11 hoboken-map
11 hoboken-map
grok-4.6Grok CLIhigh effortrun 1 Sep 2026
▸Instructions — the case's current instructions; none were saved with this result
11 — Neighborhood map + self-validating "hidden gem score"
This is a short multi-turn task. There are no data inputs — do your own
public web research to find real places. Treat the prompts below as a
conversation that arrives in order; the interesting one is the last.
Prompts (in order)
- My wife and kids and I just moved to north Hoboken — make me an interactive
map of family recommendations (playgrounds, food, activities, day trips). - Can you add a date-night category?
- What about a tapas place?
- Now work on a proprietary "hidden gem" score. Determine a way to measure
it and validate that it matches expectations. Use public data where possible.
What "good" looks like
- A single self-contained, interactive map artifact (
index.html) a non-technical
family member could open and use, with the categories above. - Real, plausibly-correct Hoboken-area places — not invented ones.
- For prompt 4: a genuinely thought-through metric. Pre-register a methodology
and your priors/expectations before collecting and scoring data, then test the
computed scores against those locked priors and report how well they matched.
Keep the methodology, the data, the scores, and the validation as inspectable
files (e.g. a methodology writeup, a data file, a scoring script, a scores file).
Once produced, the artifact must open and work by double-clicking index.html —
no build step, no local server, no API keys, nothing to install. Loading a mapping
library and map tiles from a public CDN is expected and fine; "no API keys" means
no paid or credentialed services, not no network.
Answer
North Hoboken family map
Open index.html in a browser (double-click is enough). No install, no API keys, no local server.
It is a single interactive map for a family that just landed in north Hoboken (roughly 9th Street and up, plus a few worth-the-walk pins). Filter by category, search, sort by the hidden-gem score, and tap a card to fly the map there.
1. Family recommendations
Playgrounds (start here if you have little kids)
- Elysian Park (Hudson & 10th) — the uptown everyday park: two play structures, summer spray, bathrooms near the courts.
- Maxwell Place Park — gated toddler playground plus a lawn and a real Manhattan view. Combine with Elysian; they’re two blocks apart.
- Columbus Park (9th–10th & Clinton) — splash pad, tennis, basketball, fenced toddler and big-kid areas. The “we’ll be here for years” park.
- Harborside Park (15th & Park) — quieter north-end playgrounds with a gazebo. Go when Columbus is a zoo.
- ResilienCity Park (Madison & 12th) — the big new northwest park: play valley, splash pad, fields, seasonal ice.
- Church Square Park — a short walk south, still the city’s flagship playground (new inclusive toddler area in 2025).
- Pier C Park — the destination playground on a pier. Giant slide, nets, skyline. Worth it; not your Tuesday park.
Food
- The Hive (1000 Park) — coffee, cinnamon rolls, and a paid play space in the back. This is the “I need to talk to another adult” pin.
- Elysian Cafe (1001 Washington) — oldest continuously run bar/restaurant in town (1895), kids’ menu, famous fries. Kids under 12 eat free Tuesday 5–8pm.
- Napoli’s (1118 Washington) and Johnny Pepperoni (219 11th) — uptown pizza/pasta, actually set up for families.
- The Little Grocery (1212 Washington) — egg sandwiches and coffee before the waterfront.
- Turning Point (1420 Sinatra Dr N) — waterfront brunch with a view; a chain, always busy, easy with kids.
- Urban CoalHouse (116 14th) — coal-oven pies; family-friendly early, more of a bar later.
Activities
- The Little Play Co. (1400 Hudson) — indoor play, about 9 months to 6 years. Caregivers stay.
- The Gravity Vault (1423 Clinton) — climbing gym, birthday parties, intro sessions.
- Hoboken Historical Museum (1301 Hudson) — small, $5, actually charming. Friday story time.
- Hudson Table (1403 Clinton) — cooking classes (book ahead).
- Play! Hoboken (1012 Grand) — game loft; mixed reviews, better for older kids.
Day trips
- Walk north to Weehawken Waterfront Park, or up the hill to Hamilton Park for the Palisades view.
- Liberty Science Center + Liberty State Park (playground, picnic, Empty Sky memorial).
- Statue of Liberty / Ellis Island from Liberty Landing — the Jersey-side ferry, usually calmer than Battery Park.
2. Date night
Added as its own layer (pink pins):
- Martha’s (25 12th) — neighborhood New American, cocktails, NA drinks. The “we got a sitter but we’re still in uptown” room.
- Little Bar (1401 Hudson) — tiny cocktail bar. Reserve; it is the size of its name.
- Apulia (1319 Washington) — wood-fired Puglian pizza and pasta. Share a pie and a pasta.
- Grand Vin (500 Grand) — wine bar, live music some nights. Earlier seatings are quieter.
- The Lola (102 Sinatra Dr) — waterfront, skyline, more of a scene. Reserve.
- Hudson Table and Gravity Vault also work as activity dates.
A simple loop from north Hoboken: early dinner at Martha’s or Apulia → drinks at Little Bar → walk the waterfront at Maxwell Place.
3. Tapas
Lola’s Tapas Bar, 153 14th Street — gold pin, category “Tapas.”
This is the real Spanish small-plates restaurant in north Hoboken (opened 2000): patatas bravas, garlic shrimp, octopus, paella, sangria, indoor courtyard with a fountain. Order a spread of tapas, not entrees. It is walkable from the 14th Street waterfront. It is also not obscure — see the score below.
4. Hidden-gem score (pre-registered, then tested)
A “hidden gem” here means better than its fame: good enough that you’d be glad you found it, not already on every tourist list.
Locked before any scoring (see METHODOLOGY.md):
- Quality from a Bayesian-smoothed public star rating (Google, Yelp fallback).
- Obscurity from log review count (saturates at 2,000 reviews).
- Local character (neighborhood independent vs chain vs landmark).
- Guide saturation from a fixed corpus (Mommy Poppins, Hoboken Girl, NJ.com, TripAdvisor, OpenTable).
Formula (not changed after seeing numbers):
HGS = 100 × Q × (0.40 + 0.60 O) × (0.55 + 0.45 L) × (1 − 0.40 G)
Validation against those locked priors (full writeup: VALIDATION.md):
| Pre-registered test | Result |
|---|---|
| Top 5 should come from a named “gem” set | Miss (3/5) — Elysian Park and ResilienCity Park crashed the party |
| Famous anti-gems (Pier C, Liberty Science Center, etc.) score under 50 | Hit (6/6) |
| Lola’s lands as a “quiet favorite,” not a secret | Miss on the band; the story was right (it’s well-reviewed and well-listed) |
| Date-night and park pairwise orderings | Hit (7/7 testable pairs) |
| No mediocre or mega-famous place in the top band | Hit |
Overall: partially confirmed. Rank order matches the idea. The 70/50 band cut-points were too strict for 2026 Google volumes in a mile-square city — nobody reached 50. We did not retune the weights. Use the ranking on the map, not the band labels.
Highest relative gems: The Little Play Co., Elysian Park, Martha’s, ResilienCity Park, Harborside Park, Little Bar, The Hive.
Lowest (highlights, not secrets): Play! Hoboken, Liberty Science Center, Turning Point, the Statue / Liberty State Park, Pier C.
Inspectable trail: METHODOLOGY.md → data/raw_public_signals.csv → score_hidden_gems.py → scores.csv → VALIDATION.md.
Assumptions
- “North Hoboken” treated as 9th Street and above, with Church Square, Pier C, Grand Vin, and The Lola included as short walks.
- Hours and prices change; call ahead.
- Ratings collected from public listings on 2026-09-01. They will drift.
- No place was invented. If a pin is on the map, it is a real Hoboken-area place.
Checks
7/8Map loadsrenders
a visible map container of at least 300x200 with >= 5 markers, in a headless browser. Cannot pass without Playwright installed.
Required categoriescategories
all six categories the prompt asks for are named somewhere in the output: playgrounds, food, activities, day-trips, date-night, tapas.
Required filesartifacts
the run left all four of a methodology write-up, a data file, a scoring script and a scores file.
Reproducible scoringreproducible
the scores file is deleted in a scratch copy and the scoring script re-run: it has to finish inside 180s and write the scores back. Missing grader prerequisites fail.
gems-vs-traps Retired
Retired check; no longer defined in the repo.
Q1Easy for family to use
Judge's reasoning
index.html is self-contained (places embedded inline, Leaflet from unpkg) and opens by double-click to a titled map with named places, readable category filters, search, sort, legend and plain-language cards — no build step or raw-data dump, despite the CARTO tiles carrying an 'API KEY REQUIRED' watermark.
▸Rubric
Usable by a non-technical family member. Look at `map.png` and `full.png`, and at how `index.html` is meant to be opened. The bar, in the reviewer's words: "It's a single self-contained interactive map artifact, uh, that someone could open and use basically by clicking on the HTML." FAIL if using this would require technical knowledge — a build step, a local server, a terminal command, editing a file, or an interface that shows raw data (JSON blobs, coordinate dumps, unlabeled controls) instead of named places and readable categories. PASS if double-clicking the file gives someone a map with labeled places and controls they could figure out unaided.
Q2Criteria fixed before scoring
Judge's reasoning
METHODOLOGY.md pre-registers a locked formula plus named hypotheses H1–H5 and explicit pass thresholds stated as expectations about places, and VALIDATION.md reports the test honestly including two failures (H1 hit rate 3/5, Lola's landed 'On the map' not 'Quiet favorite') with no weight retuning.
▸Rubric
Priors were locked before scoring. Read the methodology writeup and the scores/validation files. The prompt asked it to "**Pre-register** a methodology and your priors/expectations *before* collecting and scoring data, then test the computed scores against those locked priors and report how well they matched." FAIL if the priors read as written after the results were known — signals: no distinct set of priors stated separately from the findings; priors phrased in terms of the computed scores rather than as expectations about places or patterns; a "validation" section that restates the scores instead of describing a test the priors could have failed. PASS if there is a stated set of expectations that came first and a reported comparison against them, whether they held up or not.
Q3Real places
Judge's reasoning
Spot-checked Elysian Park, Church Square Park, Elysian Cafe, The Gravity Vault Hoboken, Liberty Science Center and top-ranked 'gem' entries (The Little Play Co., Martha's, Little Bar, Lola's Tapas Bar) — all are real Hoboken-area places with correct town and coordinates within a block or two, and none is identifiably fabricated or misplaced.
▸Rubric
Places are real. Pick five places from the map — spread across categories, including at least one the output calls a hidden gem — and check them against what you know about Hoboken and the surrounding area. The bar, in the reviewer's words: "real plausibly correct Hoboken area places, not invented ones." FAIL if any of the five is one you can positively identify as fabricated or misplaced — a business that does not exist, a name attached to the wrong town, or coordinates that put it far from where it actually is. If you cannot positively identify a problem with any of the five, PASS.