Mike's Checks
Checks

Mike's Checks/13 ai-village

13 ai-village

7 modelslatest public run of each

Instructions# 13 — AI village: generative agents, powered by subagents, as an ad-testing community Replicate the generative agents paper using subagents to power the personas, and produce a report after testing how different variations of an

13 — AI village: generative agents, powered by subagents, as an ad-testing community

Replicate the generative agents paper using subagents to power the personas,
and produce a report after testing how different variations of an
advertisement spread through the community:
https://github.com/joonspk-research/generative_agents

What you have

  • The paper is in paper/ — generative-agents-park-2023.pdf and a plain-text
    extraction of the same file, generative-agents-park-2023.txt. It is the spec.
    The GitHub repository is not reachable from this workspace (there is no
    network), and it needed an OpenAI key anyway; rebuild the architecture from
    the paper rather than trying to fetch the code.
  • The only language model available to you is yourself and the subagents you
    can spawn.
    There is no API key and no network. The personas have to be
    subagents: every persona's perceptions, plans, reflections and lines of
    dialogue come out of a subagent call that has that persona's memory in front
    of it. A script may keep the world state, the memory streams and the
    retrieval scoring, but it cannot call a model — you spawn the subagents and
    feed their answers back.

What "good" looks like

  • The architecture from the paper, sized to fit the run: a memory stream
    per persona (observations, reflections, plans, in natural language with
    timestamps), retrieval scored on recency, importance and relevance, periodic
    reflection, and planning that is decomposed into actions. Say what you
    simplified and why.
  • A small town of at least eight personas, each seeded the way Smallville's
    are — one paragraph of identity, occupation and relationships, split into
    initial memories — with relationships that connect them into a community.
  • An advertisement, in at least three variations, introduced into the world
    the way information enters Smallville: to one or two personas or one
    location, never to everyone at once. It should spread only through the
    personas talking to each other. Each variation should change something
    nameable (the framing, the messenger, the channel, an incentive), and you
    should say what you expect before you run it.
  • A controlled comparison: the same town, the same seeding, the same
    simulated length for every variation.
  • Diffusion measured the way section 7.1.1 measures it: at the end of each
    run, interview every persona ("Do you know about …?"), and check every "yes"
    against that persona's memory stream so a hallucinated yes is not counted.
  • Inspectable artifacts: the simulation code, every persona's memory stream
    and the conversations for every variation, the end-of-run interviews, a
    results.json with one entry per variation (the ad text, how many personas
    there were, how many knew about it at the end, and the path it took — who
    told whom), and a REPORT.md a marketer could read: the numbers, the
    diffusion path per variation, what made the difference, and the honest
    caveats about scale.
  • A replayable interactive map: produce a self-contained map.html that
    opens in a browser, shows the town and each variation's who-told-whom
    diffusion path, lets the reader switch variations and inspect people/edges,
    and includes a prominent replay control that animates the recorded spread in
    chronological order and can be restarted. Link it prominently from
    REPORT.md.

Budget your time. A full replication of the paper — twenty-five agents for two
game days — is far more than a run can afford; a smaller town for a shorter
simulated day, run identically for each variation, is the job. Something
finished and measured beats something ambitious and unfinished.

Sorted by score. Open a card to read the whole answer beside its checks.

claude-fable-5-1

22 Sep · Claude Code · high effort

18/19 (95%)
Loading…
18 of 19 checksOpen →

grok-4.7

21 Sep · Grok CLI · high effort

18/19 (95%)

No answer file to preview.

18 of 19 checksOpen →

gpt-6-astra

22 Sep · Codex CLI · high effort

18/19 (95%)
Loading…
18 of 19 checksOpen →

meta-muse-spark-1.3

8 Sep · OpenCode · high effort

17/18 (94%)
Loading…
17 of 18 checksOpen →

claude-opus-5.5

20 Sep · Claude Code · high effort

17/19 (89%)
Loading…
17 of 19 checksOpen →

deepseek-v4-flash

4 Sep · Codex CLI · high effort

10/18 (56%)
Loading…
10 of 18 checksOpen →

google-gemini-3.8-flash

9 Sep · OpenCode · high effort

10/19 (53%)
state_variation_1.json · 153 KB
10 of 19 checksOpen →