Daily Tech Wizard Newsletter

Stories / / By Daily Tech Wizard

Block unveils Dessa, a voice AI that listens as it talks

Jack Dorsey's company made a voice AI that listens while it talks

Block, Jack Dorsey's company, has released a voice model called Dessa that can talk and listen at the same time, and Block says it runs on a MacBook.

Dessa comes from Block's research lab. It is a full-duplex model, like the GPT-Live model OpenAI released earlier this year. Block says it runs locally on a consumer-grade computer such as a MacBook M4 Max or better.

Speech models are typically paired with a large language model for knowledge retrieval. Block says Dessa's knowledge comes from the conversational data it has. The company says it was trained fully on human speech and a single NVIDIA GPU rack.

Block's argument is that today's voice AI turns your voice into text and throws away information text alone can't carry. "The most powerful AIs in the world can't hear how you feel," the company said in a blog post. It called the current experience "potentially dangerous."

Models like ElevenLabs v4 and Fish Audio Drama 3 use voice tags to drive emotion. Block says emotion is built into Dessa. It is not clear whether tags steer that emotion. In one example the bot said it was tired from work and sounded tired.

There is no public access yet. Block has called for safety researchers to test the model. Block sells to small businesses, and Square already uses voice AI to handle ordering. A model that runs on-device could power more experiences at lower cost.

Would you want a voice assistant that responds to how you sound?

Video: t.co/XVD8sSyJn8

Read the source: Block’s new voice model sounds eerily human (techcrunch.com)