Senior Product Quality Analyst - AI Voice

Spotify - London - Global - IT & Technology

The Personalization team makes deciding what to play next easier and more enjoyable for every listener. From Blend to Discover Weekly, we’re behind some of Spotify’s most-loved features. We built them by understanding the world of music and podcasts better than anyone else. Join us and you’ll keep millions of users listening by making great recommendations to each and every one of them.

We are the Voice Production Team, the creative team behind Spotify’s AI voice experiences. We think about AI voices from a casting perspective — including voice type, age and gender — and from a performance perspective, recognizing that a voice may need to perform differently for DJ than it does for an audiobook recap. We bring expertise in voice casting, direction, recording and production, and work closely with Speak to set the quality bar for AI voice models across experiences including AI DJ, Generative AI Ads, Personalized Podcasts, Agent Voice Chat and more.

As a Senior Product Quality Analyst, you’ll bring a dedicated evaluation perspective to the team. You’ll own how we define and measure AI voice quality, bringing together Voice Production’s creative bar, Speak’s technical bar and the wider industry bar. Your goal won’t simply be to determine whether Spotify has the “best” AI voice technology on the market. You’ll help us answer a more important question: is our technology the best at serving Spotify’s specific needs?

 

What You'll Do
  • Own the quality bar for Spotify’s AI voice models, defining what “good enough” means for different products, audiences, languages and use cases.
  • Independently design evaluation rubrics and build an evaluation approach that measures qualities such as naturalness, tone, pacing, pronunciation, accent, audio quality and overall experience.
  • Plan and carry out evaluation campaigns, turning qualitative and quantitative findings into clear recommendations for Voice Production, Speak and product teams.
  • Establish an ongoing evaluation rhythm, including when and how we reassess model quality as our technology and products evolve.
  • Benchmark Spotify’s AI voices against third-party models and competitors to understand where our experiences lead, where they differ and where there are opportunities to improve.
  • Help determine appropriate quality trade-offs as Spotify expands into additional languages and regions, considering the product use case and needs of each market.
  • Partner closely with voice experts, machine learning teams, product partners and vendors to maintain a consistent quality bar across demanding and sometimes competing priorities.
  • Surface the most meaningful gaps in model performance and use evaluation insights to help influence future research and technical priorities.

    • Who You Are
  • You have experi

    • Browse more GCC jobs on EzWorkers