An experiment in discrete diffusion

Language, out of noise.

Ten hidden tokens. Eighteen small steps.
Watch a tiny transformer turn uncertainty into a sentence — right here in your browser.

01 / Live inference On-device model

Token canvasCompleted example · seed 100

the wandering tower brings secret blossoms across the cedars gently

Resolved token Masked token

Bidirectional attention · 10 positions

Start from pure noise. Let the model find the words.

34,998Learned parameters

278Token vocabulary

300Training sentences

0Runtime requests

A small collection of possibilities

20 model samples. Open any sentence to see it emerge.

SAMPLE 01 / SEED 10018 steps · complete

the wandering tower brings secret blossoms across the cedars gently.

Replay denoising

Step 0 / 18

the wandering tower brings secret blossoms across the cedars gently

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

06the ▁ ▁ ▁ ▁ ▁ across the cedars ▁

07the ▁ ▁ ▁ ▁ ▁ across the cedars ▁

08the ▁ ▁ brings ▁ ▁ across the cedars ▁

09the ▁ ▁ brings ▁ ▁ across the cedars ▁

10the ▁ ▁ brings ▁ ▁ across the cedars gently

11the ▁ tower brings ▁ ▁ across the cedars gently

12the ▁ tower brings ▁ ▁ across the cedars gently

13the ▁ tower brings secret ▁ across the cedars gently

14the ▁ tower brings secret ▁ across the cedars gently

15the wandering tower brings secret ▁ across the cedars gently

16the wandering tower brings secret ▁ across the cedars gently

17the wandering tower brings secret blossoms across the cedars gently

18the wandering tower brings secret blossoms across the cedars gently

SAMPLE 02 / SEED 10118 steps · complete

the late deer finds amber peace beyond the canyons nearby.

Replay denoising

Step 0 / 18

the late deer finds amber peace beyond the canyons nearby

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ beyond the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ beyond the ▁ ▁

06the ▁ ▁ ▁ ▁ peace beyond the ▁ ▁

07the ▁ ▁ ▁ ▁ peace beyond the ▁ ▁

08the ▁ ▁ ▁ ▁ peace beyond the canyons ▁

09the ▁ ▁ ▁ ▁ peace beyond the canyons ▁

10the ▁ ▁ ▁ ▁ peace beyond the canyons nearby

11the ▁ ▁ finds ▁ peace beyond the canyons nearby

12the ▁ ▁ finds ▁ peace beyond the canyons nearby

13the ▁ deer finds ▁ peace beyond the canyons nearby

14the ▁ deer finds ▁ peace beyond the canyons nearby

15the late deer finds ▁ peace beyond the canyons nearby

16the late deer finds ▁ peace beyond the canyons nearby

17the late deer finds amber peace beyond the canyons nearby

18the late deer finds amber peace beyond the canyons nearby

SAMPLE 03 / SEED 10218 steps · complete

the road deer finds warm peace beyond the canyons nearby.

Replay denoising

Step 0 / 18

the road deer finds warm peace beyond the canyons nearby

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ beyond the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ beyond the ▁ ▁

06the ▁ ▁ ▁ ▁ peace beyond the ▁ ▁

07the ▁ ▁ ▁ ▁ peace beyond the ▁ ▁

08the ▁ ▁ ▁ ▁ peace beyond the canyons ▁

09the ▁ ▁ ▁ ▁ peace beyond the canyons ▁

10the ▁ ▁ ▁ ▁ peace beyond the canyons nearby

11the ▁ ▁ finds ▁ peace beyond the canyons nearby

12the ▁ ▁ finds ▁ peace beyond the canyons nearby

13the ▁ deer finds ▁ peace beyond the canyons nearby

14the ▁ deer finds ▁ peace beyond the canyons nearby

15the road deer finds ▁ peace beyond the canyons nearby

16the road deer finds ▁ peace beyond the canyons nearby

17the road deer finds warm peace beyond the canyons nearby

18the road deer finds warm peace beyond the canyons nearby

SAMPLE 04 / SEED 10318 steps · complete

the young road keeps warm stars across the valleys calmly.

Replay denoising

Step 0 / 18

the young road keeps warm stars across the valleys calmly

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

06the ▁ ▁ ▁ ▁ ▁ across the valleys ▁

07the ▁ ▁ ▁ ▁ ▁ across the valleys ▁

08the ▁ ▁ ▁ ▁ ▁ across the valleys calmly

09the ▁ ▁ ▁ ▁ ▁ across the valleys calmly

10the ▁ ▁ keeps ▁ ▁ across the valleys calmly

11the ▁ ▁ keeps ▁ stars across the valleys calmly

12the ▁ ▁ keeps ▁ stars across the valleys calmly

13the ▁ road keeps ▁ stars across the valleys calmly

14the ▁ road keeps ▁ stars across the valleys calmly

15the young road keeps ▁ stars across the valleys calmly

16the young road keeps ▁ stars across the valleys calmly

17the young road keeps warm stars across the valleys calmly

18the young road keeps warm stars across the valleys calmly

SAMPLE 05 / SEED 10418 steps · complete

the tiny hill finds hidden fire across the houses nearby.

Replay denoising

Step 0 / 18

the tiny hill finds hidden fire across the houses nearby

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

06the ▁ ▁ ▁ ▁ ▁ across the houses ▁

07the ▁ ▁ ▁ ▁ ▁ across the houses ▁

08the ▁ ▁ ▁ ▁ ▁ across the houses nearby

09the ▁ ▁ ▁ ▁ ▁ across the houses nearby

10the ▁ ▁ finds ▁ ▁ across the houses nearby

11the ▁ ▁ finds ▁ fire across the houses nearby

12the ▁ ▁ finds ▁ fire across the houses nearby

13the ▁ hill finds ▁ fire across the houses nearby

14the ▁ hill finds ▁ fire across the houses nearby

15the ▁ hill finds hidden fire across the houses nearby

16the ▁ hill finds hidden fire across the houses nearby

17the tiny hill finds hidden fire across the houses nearby

18the tiny hill finds hidden fire across the houses nearby

SAMPLE 06 / SEED 10518 steps · complete

the fresh harbor reveals soft music across the stars together.

Replay denoising

Step 0 / 18

the fresh harbor reveals soft music across the stars together

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

06the ▁ ▁ ▁ ▁ ▁ across the stars ▁

07the ▁ ▁ ▁ ▁ ▁ across the stars ▁

08the ▁ ▁ reveals ▁ ▁ across the stars ▁

09the ▁ ▁ reveals ▁ ▁ across the stars ▁

10the ▁ ▁ reveals ▁ ▁ across the stars together

11the ▁ ▁ reveals ▁ music across the stars together

12the ▁ ▁ reveals ▁ music across the stars together

13the fresh ▁ reveals ▁ music across the stars together

14the fresh ▁ reveals ▁ music across the stars together

15the fresh harbor reveals ▁ music across the stars together

16the fresh harbor reveals ▁ music across the stars together

17the fresh harbor reveals soft music across the stars together

18the fresh harbor reveals soft music across the stars together

SAMPLE 07 / SEED 10618 steps · complete

the ancient dusk reveals distant blossoms across the stars together.

Replay denoising

Step 0 / 18

the ancient dusk reveals distant blossoms across the stars together

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

06the ▁ ▁ ▁ ▁ ▁ across the stars ▁

07the ▁ ▁ ▁ ▁ ▁ across the stars ▁

08the ▁ ▁ reveals ▁ ▁ across the stars ▁

09the ▁ ▁ reveals ▁ ▁ across the stars ▁

10the ▁ ▁ reveals ▁ ▁ across the stars together

11the ▁ ▁ reveals ▁ blossoms across the stars together

12the ▁ ▁ reveals ▁ blossoms across the stars together

13the ancient ▁ reveals ▁ blossoms across the stars together

14the ancient ▁ reveals ▁ blossoms across the stars together

15the ancient ▁ reveals distant blossoms across the stars together

16the ancient ▁ reveals distant blossoms across the stars together

17the ancient dusk reveals distant blossoms across the stars together

18the ancient dusk reveals distant blossoms across the stars together

SAMPLE 08 / SEED 10718 steps · complete

the clear weaver finds quiet dreams beside the streets nearby.

Replay denoising

Step 0 / 18

the clear weaver finds quiet dreams beside the streets nearby

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ beside the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ beside the ▁ ▁

06the ▁ ▁ ▁ ▁ ▁ beside the streets ▁

07the ▁ ▁ ▁ ▁ ▁ beside the streets ▁

08the ▁ ▁ ▁ ▁ ▁ beside the streets nearby

09the ▁ ▁ ▁ ▁ ▁ beside the streets nearby

10the ▁ ▁ finds ▁ ▁ beside the streets nearby

11the ▁ ▁ finds ▁ dreams beside the streets nearby

12the ▁ ▁ finds ▁ dreams beside the streets nearby

13the ▁ weaver finds ▁ dreams beside the streets nearby

14the ▁ weaver finds ▁ dreams beside the streets nearby

15the clear weaver finds ▁ dreams beside the streets nearby

16the clear weaver finds ▁ dreams beside the streets nearby

17the clear weaver finds quiet dreams beside the streets nearby

18the clear weaver finds quiet dreams beside the streets nearby

SAMPLE 09 / SEED 10818 steps · complete

the summer sparrow reveals tranquil music across the stars together.

Replay denoising

Step 0 / 18

the summer sparrow reveals tranquil music across the stars together

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

06the ▁ ▁ ▁ ▁ ▁ across the stars ▁

07the ▁ ▁ ▁ ▁ ▁ across the stars ▁

08the ▁ ▁ reveals ▁ ▁ across the stars ▁

09the ▁ ▁ reveals ▁ ▁ across the stars ▁

10the ▁ ▁ reveals ▁ ▁ across the stars together

11the ▁ ▁ reveals ▁ music across the stars together

12the ▁ ▁ reveals ▁ music across the stars together

13the summer ▁ reveals ▁ music across the stars together

14the summer ▁ reveals ▁ music across the stars together

15the summer sparrow reveals ▁ music across the stars together

16the summer sparrow reveals ▁ music across the stars together

17the summer sparrow reveals tranquil music across the stars together

18the summer sparrow reveals tranquil music across the stars together

SAMPLE 10 / SEED 10918 steps · complete

the late deer finds grand peace beyond the canyons nearby.

Replay denoising

Step 0 / 18

the late deer finds grand peace beyond the canyons nearby

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ beyond the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ beyond the ▁ ▁

06the ▁ ▁ ▁ ▁ peace beyond the ▁ ▁

07the ▁ ▁ ▁ ▁ peace beyond the ▁ ▁

08the ▁ ▁ ▁ ▁ peace beyond the canyons ▁

09the ▁ ▁ ▁ ▁ peace beyond the canyons ▁

10the ▁ ▁ ▁ ▁ peace beyond the canyons nearby

11the ▁ ▁ finds ▁ peace beyond the canyons nearby

12the ▁ ▁ finds ▁ peace beyond the canyons nearby

13the ▁ deer finds ▁ peace beyond the canyons nearby

14the ▁ deer finds ▁ peace beyond the canyons nearby

15the late deer finds ▁ peace beyond the canyons nearby

16the late deer finds ▁ peace beyond the canyons nearby

17the late deer finds grand peace beyond the canyons nearby

18the late deer finds grand peace beyond the canyons nearby

SAMPLE 11 / SEED 11018 steps · complete

the spring owl greets golden joy beside the stones freely.

Replay denoising

Step 0 / 18

the spring owl greets golden joy beside the stones freely

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ beside the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ beside the ▁ ▁

06the ▁ ▁ ▁ ▁ ▁ beside the stones ▁

07the ▁ ▁ ▁ ▁ ▁ beside the stones ▁

08the ▁ ▁ ▁ ▁ ▁ beside the stones freely

09the ▁ ▁ ▁ ▁ ▁ beside the stones freely

10the ▁ ▁ greets ▁ ▁ beside the stones freely

11the ▁ ▁ greets ▁ joy beside the stones freely

12the ▁ ▁ greets ▁ joy beside the stones freely

13the ▁ owl greets ▁ joy beside the stones freely

14the ▁ owl greets ▁ joy beside the stones freely

15the spring owl greets ▁ joy beside the stones freely

16the spring owl greets ▁ joy beside the stones freely

17the spring owl greets golden joy beside the stones freely

18the spring owl greets golden joy beside the stones freely

SAMPLE 12 / SEED 11118 steps · complete

the clear weaver finds quiet patterns beside the streets nearby.

Replay denoising

Step 0 / 18

the clear weaver finds quiet patterns beside the streets nearby

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ beside the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ beside the ▁ ▁

06the ▁ ▁ ▁ ▁ ▁ beside the streets ▁

07the ▁ ▁ ▁ ▁ ▁ beside the streets ▁

08the ▁ ▁ ▁ ▁ ▁ beside the streets nearby

09the ▁ ▁ ▁ ▁ ▁ beside the streets nearby

10the ▁ ▁ finds ▁ ▁ beside the streets nearby

11the ▁ ▁ finds ▁ patterns beside the streets nearby

12the ▁ ▁ finds ▁ patterns beside the streets nearby

13the ▁ weaver finds ▁ patterns beside the streets nearby

14the ▁ weaver finds ▁ patterns beside the streets nearby

15the clear weaver finds ▁ patterns beside the streets nearby

16the clear weaver finds ▁ patterns beside the streets nearby

17the clear weaver finds quiet patterns beside the streets nearby

18the clear weaver finds quiet patterns beside the streets nearby

SAMPLE 13 / SEED 11218 steps · complete

the late deer keeps amber branches beyond the orchards calmly.

Replay denoising

Step 0 / 18

the late deer keeps amber branches beyond the orchards calmly

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ beyond the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ beyond the ▁ ▁

06the ▁ ▁ ▁ ▁ branches beyond the ▁ ▁

07the ▁ ▁ ▁ ▁ branches beyond the ▁ ▁

08the ▁ ▁ ▁ ▁ branches beyond the ▁ calmly

09the ▁ ▁ ▁ ▁ branches beyond the ▁ calmly

10the ▁ ▁ keeps ▁ branches beyond the ▁ calmly

11the ▁ ▁ keeps ▁ branches beyond the orchards calmly

12the ▁ ▁ keeps ▁ branches beyond the orchards calmly

13the late ▁ keeps ▁ branches beyond the orchards calmly

14the late ▁ keeps ▁ branches beyond the orchards calmly

15the late ▁ keeps amber branches beyond the orchards calmly

16the late ▁ keeps amber branches beyond the orchards calmly

17the late deer keeps amber branches beyond the orchards calmly

18the late deer keeps amber branches beyond the orchards calmly

SAMPLE 14 / SEED 11318 steps · complete

the ancient dusk reveals distant music across the stars together.

Replay denoising

Step 0 / 18

the ancient dusk reveals distant music across the stars together

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

06the ▁ ▁ ▁ ▁ ▁ across the stars ▁

07the ▁ ▁ ▁ ▁ ▁ across the stars ▁

08the ▁ ▁ reveals ▁ ▁ across the stars ▁

09the ▁ ▁ reveals ▁ ▁ across the stars ▁

10the ▁ ▁ reveals ▁ ▁ across the stars together

11the ▁ ▁ reveals ▁ music across the stars together

12the ▁ ▁ reveals ▁ music across the stars together

13the ancient ▁ reveals ▁ music across the stars together

14the ancient ▁ reveals ▁ music across the stars together

15the ancient ▁ reveals distant music across the stars together

16the ancient ▁ reveals distant music across the stars together

17the ancient dusk reveals distant music across the stars together

18the ancient dusk reveals distant music across the stars together

SAMPLE 15 / SEED 11418 steps · complete

the sparkling waterfall shares patient silence beneath the roses peacefully.

Replay denoising

Step 0 / 18

the sparkling waterfall shares patient silence beneath the roses peacefully

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ beneath the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ beneath the ▁ ▁

06the ▁ ▁ ▁ ▁ silence beneath the ▁ ▁

07the ▁ ▁ ▁ ▁ silence beneath the ▁ ▁

08the ▁ ▁ shares ▁ silence beneath the ▁ ▁

09the ▁ ▁ shares ▁ silence beneath the ▁ ▁

10the ▁ ▁ shares ▁ silence beneath the ▁ peacefully

11the ▁ ▁ shares ▁ silence beneath the roses peacefully

12the ▁ ▁ shares ▁ silence beneath the roses peacefully

13the ▁ waterfall shares ▁ silence beneath the roses peacefully

14the ▁ waterfall shares ▁ silence beneath the roses peacefully

15the sparkling waterfall shares ▁ silence beneath the roses peacefully

16the sparkling waterfall shares ▁ silence beneath the roses peacefully

17the sparkling waterfall shares patient silence beneath the roses peacefully

18the sparkling waterfall shares patient silence beneath the roses peacefully

SAMPLE 16 / SEED 11518 steps · complete

the dark potter scatters ancient patterns beside the streets lightly.

Replay denoising

Step 0 / 18

the dark potter scatters ancient patterns beside the streets lightly

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ beside the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ beside the ▁ ▁

06the ▁ ▁ ▁ ▁ ▁ beside the streets ▁

07the ▁ ▁ ▁ ▁ ▁ beside the streets ▁

08the ▁ ▁ ▁ ▁ ▁ beside the streets lightly

09the ▁ ▁ ▁ ▁ ▁ beside the streets lightly

10the ▁ ▁ scatters ▁ ▁ beside the streets lightly

11the ▁ ▁ scatters ▁ patterns beside the streets lightly

12the ▁ ▁ scatters ▁ patterns beside the streets lightly

13the dark ▁ scatters ▁ patterns beside the streets lightly

14the dark ▁ scatters ▁ patterns beside the streets lightly

15the dark ▁ scatters ancient patterns beside the streets lightly

16the dark ▁ scatters ancient patterns beside the streets lightly

17the dark potter scatters ancient patterns beside the streets lightly

18the dark potter scatters ancient patterns beside the streets lightly

SAMPLE 17 / SEED 11618 steps · complete

the bright garden follows spring sunlight through the plains again.

Replay denoising

Step 0 / 18

the bright garden follows spring sunlight through the plains again

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ through the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ through the ▁ ▁

06the ▁ ▁ ▁ ▁ sunlight through the ▁ ▁

07the ▁ ▁ ▁ ▁ sunlight through the ▁ ▁

08the ▁ ▁ ▁ ▁ sunlight through the plains ▁

09the ▁ ▁ ▁ ▁ sunlight through the plains ▁

10the ▁ ▁ ▁ ▁ sunlight through the plains again

11the ▁ ▁ follows ▁ sunlight through the plains again

12the ▁ ▁ follows ▁ sunlight through the plains again

13the ▁ garden follows ▁ sunlight through the plains again

14the ▁ garden follows ▁ sunlight through the plains again

15the bright garden follows ▁ sunlight through the plains again

16the bright garden follows ▁ sunlight through the plains again

17the bright garden follows spring sunlight through the plains again

18the bright garden follows spring sunlight through the plains again

SAMPLE 18 / SEED 11718 steps · complete

the faint lighthouse greets dusty leaves beside the stones freely.

Replay denoising

Step 0 / 18

the faint lighthouse greets dusty leaves beside the stones freely

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ beside the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ beside the ▁ ▁

06the ▁ ▁ ▁ ▁ ▁ beside the stones ▁

07the ▁ ▁ ▁ ▁ ▁ beside the stones ▁

08the ▁ ▁ ▁ ▁ ▁ beside the stones freely

09the ▁ ▁ ▁ ▁ ▁ beside the stones freely

10the ▁ ▁ greets ▁ ▁ beside the stones freely

11the ▁ ▁ greets ▁ leaves beside the stones freely

12the ▁ ▁ greets ▁ leaves beside the stones freely

13the ▁ lighthouse greets ▁ leaves beside the stones freely

14the ▁ lighthouse greets ▁ leaves beside the stones freely

15the ▁ lighthouse greets dusty leaves beside the stones freely

16the ▁ lighthouse greets dusty leaves beside the stones freely

17the faint lighthouse greets dusty leaves beside the stones freely

18the faint lighthouse greets dusty leaves beside the stones freely

SAMPLE 19 / SEED 11818 steps · complete

the young road scatters warm footprints across the ponds lightly.

Replay denoising

Step 0 / 18

the young road scatters warm footprints across the ponds lightly

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ across the ▁ ▁

06the ▁ ▁ ▁ ▁ ▁ across the ponds ▁

07the ▁ ▁ ▁ ▁ ▁ across the ponds ▁

08the ▁ ▁ scatters ▁ ▁ across the ponds ▁

09the ▁ ▁ scatters ▁ ▁ across the ponds ▁

10the ▁ ▁ scatters ▁ ▁ across the ponds lightly

11the ▁ ▁ scatters ▁ footprints across the ponds lightly

12the ▁ ▁ scatters ▁ footprints across the ponds lightly

13the young ▁ scatters ▁ footprints across the ponds lightly

14the young ▁ scatters ▁ footprints across the ponds lightly

15the young ▁ scatters warm footprints across the ponds lightly

16the young ▁ scatters warm footprints across the ponds lightly

17the young road scatters warm footprints across the ponds lightly

18the young road scatters warm footprints across the ponds lightly

SAMPLE 20 / SEED 11918 steps · complete

the wild child watches silent hope beyond the kitchens inside.

Replay denoising

Step 0 / 18

the wild child watches silent hope beyond the kitchens inside

Stored trace · all 18 steps

00▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁ ▁

01▁ ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

02the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

03the ▁ ▁ ▁ ▁ ▁ ▁ the ▁ ▁

04the ▁ ▁ ▁ ▁ ▁ beyond the ▁ ▁

05the ▁ ▁ ▁ ▁ ▁ beyond the ▁ ▁

06the ▁ ▁ ▁ ▁ hope beyond the ▁ ▁

07the ▁ ▁ ▁ ▁ hope beyond the ▁ ▁

08the ▁ ▁ watches ▁ hope beyond the ▁ ▁

09the ▁ ▁ watches ▁ hope beyond the ▁ ▁

10the ▁ ▁ watches ▁ hope beyond the ▁ inside

11the ▁ ▁ watches ▁ hope beyond the kitchens inside

12the ▁ ▁ watches ▁ hope beyond the kitchens inside

13the ▁ child watches ▁ hope beyond the kitchens inside

14the ▁ child watches ▁ hope beyond the kitchens inside

15the wild child watches ▁ hope beyond the kitchens inside

16the wild child watches ▁ hope beyond the kitchens inside

17the wild child watches silent hope beyond the kitchens inside

18the wild child watches silent hope beyond the kitchens inside

From masks to meaning

01 Learn what is missing

Trained offline on 300 short, template-generated sentences. Random words are replaced with [MASK]; the transformer learns to predict the originals.

02 Look in both directions

One attention block, 32 embedding dimensions. Each masked position considers the whole sentence, including words that have already emerged.

03 Reveal the confident words

At each of 18 steps, the model scores the remaining masks. The most confident positions resolve first. Ten tokens emerge; some steps only reassess.

A tiny model, with tiny-model quirks. These are unconditional samples from a narrow, poetic training set. Expect repetitions, unusual combinations, and occasional grammatical slips. No prompt, no server, no sentence lookup during live generation.