Unleashing the Power of AI #4: Endless game music
Welcome to another chapter of the "Unleashing the Power of AI" series. Last week, our readers have chosen Riffusion as the AI topic for discussion. In this post, we will be exploring the potential of Riffusion in creating AI-generated music for video games. Get ready to be amazed at the possibilities that Riffusion can bring to the world of gaming.
What is Riffusion?
Riffusion is a neural network, designed by Seth Forsgren and Hayk Martiros, that generates music using images of sound rather than audio. It was created as a fine-tuning of Stable Diffusion, an existing open-source model for generating images from text prompts, on spectrograms. This results in a model which uses text prompts to generate image files, which can be put through an inverse Fourier transform and converted into audio files. While these files are only several seconds long, the model can also use latent space between outputs to interpolate different files together. This is accomplished using a functionality of the Stable Diffusion model known as img2img.
Endless rhythm game
We have all played rhythm games like Rock Band or Guitar Hero, but they have always been limited by the length of the songs. But what if we wanted to see how long we could last playing an infinite game without repeating the same songs every time? This is where Riffusion comes in. Using this technology, we can create endless amounts of unique and diverse music for rhythm games, keeping the gameplay fresh and exciting.
The possibilities of Riffusion are truly endless, and we can't wait to see how developers will use this technology in the future. We would like to thank our readers for choosing this topic and invite you to join my discord server to vote for next week's AI post. The future of gaming is looking brighter than ever with the help of AI technology like Riffusion.
As a final note,
we want to remind our readers that Riffusion is a new technology, so it is still in development, and we will have to wait a while to see it in action in the market, but it's worth to keep an eye on it and see how it evolves. Thanks again for reading and we'll see you next week with another exciting post about AI in the world of gaming.