Room to Speak: a dimmed room with one kettle lit inside a terracotta ring Built for Build With AI: Basics · Devpost

When the words won't come,his room speaks for him.

His living room, dimmed; the kettle stays lit inside its terracotta ring
Aku mau kopi.I'd like coffee.
/api/detect → 7 spots · 4.48 s · gemini-3.1-flash-lite
v0.2.0

He understands everything.The words won't come.

A parent with aphasia after a stroke, at home with family.

v0.2.0

The hospital card isn't his life.

MAKANMINUMTOILETSAKIT

The generic card (scope.md)

His living room in afternoon light, with rings on his own things

His room

Boards made from his own room need every object outlined by hand.

v0.2.0

One photo becomes a voice.

Setup on a phone: seven numbered rings and the list of phrases
Speak mode on a tablet: the room dimmed, the kettle lit, the five core words along the bottom

Setup · caregiver

The caregiver photographs his room once. Gemini rings up to 8 things and drafts a phrase for each.

Speak · him

v0.2.0

Online once. On the device after.

api/detect.ts Setup · once Speak · every day Photo /api/detect Geminilabel · phrase · box_2d ≤ 8 checked box → ring this device tap (on release) nearest ring speechSynthesis id-ID room dims
v0.2.0

Rings, one fix, his voice.

Real Setup capture: seven numbered rings on his room
1Gemini rings 7 things
Real Setup row: teko, “Boleh minta minum?”, with Ubah and HapusThe same row being edited to “Aku mau kopi”, with Simpan
2The caregiver rewrites one
Real Speak-mode capture: the kettle lit, the room dimmed
3One tap: Aku mau kopi
v0.2.0

Built for one hand, one room.

  • Taps count on release.
  • Five core words always on.
  • Setup needs a 2-second hold.
  • No voice? Large text instead.
  • No account, no server storage.
Speak mode on a phone, kettle lit
v0.2.0
box_2d [502, 575, 708, 685] x .630 y .605 r .033

One call does the outlining.

Gemini returns a box and a phrase per object, in one structured answer.

v0.2.0

Four slices, each one verified.

  • Photo → rings
  • Tap → voice
  • Every spot correctable
  • Saved, every failure handled

25 tests · 43 browser checks · live at roomspeak.edycu.dev

v0.2.0

Try it ina real room.

Photograph a room or pick an example. Tap what you'd say.

github.com/edycutjong/roomspeak · MIT · v0.2.0 · demo video

roomspeak.edycu.dev
Aku mau kopi.I'd like coffee.
v0.2.0