Live AI Vocals: Unlocking the Future of On-Stage Innovation

Technology has always played a crucial role in the world of live music. Few artists have embraced it as boldly as Holly Herndon, who has taken the step of integrating AI singers and AI vocals into her performances. Holly Herndon isn’t just adding a digital layer to her music—she’s redefining what live performance can be. In this article, we’ll explore how artists like Holly are using AI to create unique live performances, the challenges they must overcome, and what this innovation means for the future of music.

Live Performance in the Age of AI: Virtual Singers

Live music has always been about the raw, human connection between artist and audience, but with the advent of AI singing voices, artists like Holly Herndon are exploring new ways to enhance that connection by blending human and machine elements. AI vocals, when used creatively, can add a rich and dynamic element to a performance that goes beyond what’s humanly possible, thanks to the advanced capabilities of AI voice technology.

Herndon, who holds a PhD in Music and Acoustics from Stanford’s Center for Computer Research, developed Spawn, her “AI baby.” Spawn plays a central role in her live performances as an active participant that responds to Herndon’s live input by generating real-time harmonies, textures, and vocal effects. The result is a performance that feels both organic and otherworldly, challenging the audience to rethink the boundaries between human and machine.

Overcoming Technical Challenges in Real-Time AI Vocal Performance

While the concept of using AI in live performance can be exciting, it also comes with some serious technical challenges:

1. Latency: In a live setting, even a slight delay between a performer and their AI counterpart could disrupt the flow of the performance. To manage this, Herndon uses a custom-built gaming PC with high performance GPUs to handle the intensive processing required. This system is designed to minimize latency and keep the live performance in the moment.

2. AI Adaptability: For AI to contribute effectively to a live performance, it must be able to adapt to changes in tempo, pitch, and style on the fly. Herndon trained Spawn on a diverse range of vocal data, enabling the AI voice model to react dynamically throughout a performance.

Tips for Incorporating AI Singing Voices into Your Live Performances

If you’re intrigued by the possibilities of AI vocals and want to incorporate them into your live performance, here are some tips to help you get started:

1. Start with Simple AI Elements: Begin by adding basic AI vocal effects or harmonies to your performance, which can significantly enhance your music production quality. This will allow you to get familiar with the technology before moving on to more complex real-time processing.

2. Iron Things Out in Rehearsal: AI can introduce a degree of unpredictability, so buckle-down and rehearse extensively. Test your setup and push the limits of its potential so you know what to expect when you’re on stage.

3. Embrace the Unpredictability: Despite all the preparation, using AI and a voice changer in live music can lead to unexpected results. Embrace this unpredictability and use it as a source of creative inspiration.

The Future of Live Performance: Lessons from Holly Herndon on Vocal Identity

Holly Herndon’s use of AI in live performance is more than a technical achievement–it’s an artistic statement. By bringing AI into the mix, Herndon is not only expanding the sonic possibilities of her music but also prompting the audience to question the role of technology in art. Her performances could be a glimpse into the future, where AI becomes a common element on stage, enhancing and evolving the live music experience. As AI technology continues to advance, more artists are likely to follow her lead, using AI to create performances that are as unpredictable and engaging as they are innovative.

Learn more about Holly Herndon and her unique approach to live performance in her TED Talk and explore AI tools for free on Kits AI.

-SK
Sam Kearney is a producer, composer and sound designer based in Evergreen, CO.