Blob Opera

Blob Opera is an online skill and music game. This game was developed by David Li in collaboration with Google Arts & Culture. What makes this game special and unique is that it uses a machine learning model trained on the voices of four opera singers to create an interactive experiment that anyone can enjoy, regardless of musical skill.

Game introduction

Blob Opera is a machine learning experiment by David Li in collaboration with Google Arts and Culture. Opera singers use their voices as expressive and beautiful musical instruments. This experiment pays tribute to those voices, as musical instruments anyone can learn how to play. Play four opera voices in real time. No singing skills required!

We collaborated with four opera singers to teach a machine learning model how to sing. Tenor, Christian Joel, bass Frederick Tong, mezzo‑soprano Joanna Gamble and soprano Olivia Doutney recorded 16 hours of singing to train an algorithm called a Convolutional Neural Network. In the experiment you don’t hear their voices, but the machine learning model’s understanding of what opera singing sounds like, based on what it learnt from them. Drag the blobs up and down to change pitch. Or forwards and backwards for different vowel sounds. Another machine learning model lets the blobs respond to and harmonise with your input in real time.

Read moreRead more
Leave a Reply
Your email address will not be published.