Lay's Crispy Subtitles

Solution

While viewing videos on YouTube, the plugin runs a lightweight machine learning model in the background that can recognize the crunchy sound of crisps through the microphone. When the model recognizes the sound of crisps, the subtitles of the video are automatically turned.

We trained a custom Tensorflow model on over 178 hours of crispy crunch sounds gathered worldwide. This trained model is embedded within the browser plugin so audio is never recorded or sent to a server. The plugin is available for free on the Google Chrome store.