Web Dev Challenge builds sci-fi help desks on Twilio, GPT-Live

Jason Lengstorf's Web Dev Challenge opened its seventh Season 3 episode with a Twilio-sponsored brief. The ask, verbatim: "Build the interdimensional customer support we'll all need in the sci-fi future." The CodeTV episode premiered on November 3, handing teams Twilio's voice stack and OpenAI's GPT-Live and asking them to design a help desk "worthy of a sci-fi future" that threads voice control, multi-device functionality, contextual awareness, and a handoff from automated verification to a human agent.

The toolkit on the episode's resource list is specific: Twilio Agent Connect, the Conversations API, Twilio's integration with OpenAI's Realtime API, OpenAI GPT-Live, and the Twilio Dev Phone. GPT-Live is a family of "full-duplex speech-to-speech models that separates having the conversation from doing the work," with tool calls delegated to a developer's own backend. Agent Connect, per Twilio's own description, "bridges Twilio Programmable Voice Media Streams directly to GPT-Live-1 in the OpenAI API."

Teams build in four hours. A challenge deadline follows on November 17.