AI MIDI generators are next-generation programs that leverage gen AI models (on a neural network) to create original MIDI material. They are available on web browsers, standalone apps, and as DAW plugins.
Music producers tend to favor plugins over web apps. It's easier than toggling between browsers and DAWs. So in 2024-25, we expect to see more AI MIDI generation plugins built for music producers.
YouTube artist Nobody and the Computer created the poetic video below exploring AI powered MIDI generation as a theme.
No generative model? Then it's not AI.
The "AI" prefix in the phrase AI MIDI generator is an important one.
What does it mean for a MIDI generator to be powered by artificial intelligence in 2024? There was a time where the term AI could be used loosely.
Today, many high quality AI audio models exist. The bar has been raised and companies using the expression "AI" owe it to users to offer some transparency.
Here are some of the most popular products in this space today. We were not paid by any of the following companies to promote their service in this article.
Lemonaide VST: MIDI seed generator
Lemonaide is the most promising AI MIDI generator we've seen to date.
Why do we love it? For starters, it's an actual DAW tool built for music makers.
The plugin lets you create and collect seed ideas (chord and melodies in MIDI) to assist in the beat making workflow. These seeds might sprout into a new idea or help you build new verses, choruses, bridges, and so forth.
The Lemonaide MIDI generator is coupled with a “seed bank” that stores all of the MIDI creations, so you can refer back at any time in your future DAW sessions.
Lemonaide's founder and team
Lemonaide's founder MJ previously worked as a Google cloud engineer. He set off on a journey and started his company, where he now manages a team of programmers, designers and marketers.
Near the end of 2023, AI researcher Julian Lenz joined the team. Lenz is formerly of prominent AI music companies Okio and Neutone. He brings prior experience and AI expertise to their team. Machine learning engineers Anirudh Mani and Saif Abid are the other two people working on the team.
The company explains on their website that they've ethically sourced their MIDI data. We're not sure what music that is, but it's nice to know that we can use it royalty free!
Is Lemonaide's truly generative AI MIDI?
Yes, there are several indicators that suggest Lemonaide runs actual AI models on neural networks in the cloud.
First, MJ and Julian both have proven backgrounds in AI and cloud services. Lemonaide asks users to authenticate through the app with an internet connection, in order to access their AI MIDI generation credits and render new seeds.
Lemonaide's pricing is currently set $4.99 for 50 credits and $9.99 for 150 credits. Pro plan users get longer (8-bar) generation, rollover credits, and the option to bring in their own sounds.
Recognized by A16Z as a pioneer in the AI MIDI niche, Lemonaide is a great product and shows a lot of growth potential. They are among the first arrivals to the AI MIDI generation party and who knows - maybe they will set the standards for an emerging industry in the coming years.
AIVA: Browser + Standalone AI MIDI Generator
Skrrrt. Alright let's turn back the clock a few years.
AIVA is one of the most powerful multi-track AI MIDI DAWs online, and they were arguable one of the first to do it. They serve up multitrack MIDI with mixing and effects modules for handling most composition workflows.
AIVA's simplest interface is the one you land on when you first sign up. It's a kind of song panel, where music parameters like key signature and BPM dictate the music you get from the machine.
However, if you dig a bit deeper into the product, it's easy to discover their MIDI DAW. The workstation runs in most modern web browsers (Chrome, Firefox) and also as a standalone DAW on Mac and Windows devices.
AIVA brings a lot to the table, and if they can improve the default instrument quality, it would give them a huge competitive advantage in this space.
Also, a VST would be a nice alternative to the full DAW, as many people prefer to work in their existing audio workstation.
Unison MIDI Wizard 2.0: MIDI generator
Unison’s MIDI Wizard is a chord and melody generation app with several of the core features people look for in a MIDI generator. It can create chord progressions and melodies in a given key signature and genre, at your tempo of choice.
Unison's reputation precedes them. Seasoned DAW producers recognize the Unison brand. Their MIDI chord packs have been online for years, attracting more vocal criticism than praise.
One of the main complaints we've heard about MIDI Wizard is the cost. It retails at $347. By comparison, Captain Plugins (one of the most advanced non-AI MIDI generators) costs $99. Scaler 2 retails for $59 and AudioCipher is $29.99.
So acting when taken in the context of the greater product ecosystem, $347 for a chord and melody generator is very steep.
If you can look past the plugin's price, the MIDI Wizard is nevertheless a visually dynamic, fun and comprehensive product. Here's how it works:
A control panel sits at the top left quarter of the design, with input variables like genre, key signature, chord/melody mode, leads/pluck articulation, and length of the MIDI output.
A belt of audio controls divide the interface. Here you'll find synth effects, volume knob, glide, and several other musical parameters.
A MIDI editor piano roll occupies the bottom half of the app. This is where your MIDI generations appear. Edit the notes as needed, before dragging them into their DAW for further refinement and sound design.
Is MIDI Wizard 2.0 generative AI MIDI?
There has been speculation that MIDI Wizard 2.0 might not be running real AI, however at this time it's still being determined. On the MIDI Wizard’s marketing page, they explain that:
“The software leverages advanced AI tools and machine-learning technologies to analyze and create MIDI data that is technically proficient and musically expressive.“
The MIDI Wizard plugin doesn’t require an internet connection.
Maybe they've built a lightweight AI model that consumes minimal CPU. After all, MIDI file size is considerably smaller and less complex than generative AI audio.
As for training data, my guess is that Unison trained on their own MIDI pack library. This takes a pretty big leap of imagination to believe, as someone who monitors Twitter and LinkedIn closely.
If a company creates new AI MIDI generation models, on par with Google Magenta or Microsoft's MuseCoco, one would expect to see an FAQ page bragging about the tech, their ethically sourced training data, and if not open sourcing the model, at least giving a basic description of what it is.
There are no public records on this matter, so customers are left in the dark. I think this is why people are doubting that MIDI Wizard is truly generative AI.
On the other hand, it sounds like Unison has hired AI experts. That's what their founder Seb claimed in a recent promotional video.
So maybe Unison is just playing it cool and keeping their cards close to their chest. They don't have any legal obligation to be transparent, and it may work to their advantage to say as little as possible while they're still developing the tech.
We now have over 20 people on our team, including many more plugin developers, many more music theory experts, AI experts, and a creative director. - Unison MIDI Founder
At the end of the day, MIDI Wizard is a fun AI MIDI generation app. Let's see how they continue to build on it in the coming years.
WavTool: An AI text-to-MIDI browser DAW
We’ve reported at length about WavTool here on the AudioCipher blog.
This AI DAW runs in a browser, accompanied by an OpenAI ChatGPT assistant. You can talk to the bot as if it's a bandmate or teacher, asking questions and sharing ideas.
The really impressive thing about WavTool is the assistant's ability to take direct actions in the DAW. Ask it for musical compositions in MIDI, or have it build custom wave table synthesizers to achieve a certain sound you want.
Beginners will learn how to create effects chains, through ordinary conversation with the bot, and be able to generate AI audio samples to go beyond MIDI.
Find tutorials in the app to guide you through all of the presets. Check out our full write up about WavTool here.
Staccato AI MIDI Maker plugin: Chords and lyrics
The Staccato team built a MIDI generator plugin that loads in Ableton and other popular DAWs. Its design features a MIDI piano roll interface with a few controls labaled complexity, cut-off, and length.
One odd thing about Staccato is that it doesn't constrain itself to a key signature. It seems to study the MIDI notes directly and compose from some mysterious place, rather than conforming to programmatic music theory rules.
If you're someone who wants a non-music theory app, with a few parameters to experiment on, this could be the perfect MIDI generator for you!
AudioCipher V3: Text-to-MIDI without AI
AudioCipher is an AI emulator. That means it imitates artificial intelligence.
We released our V1 in 2020, a few years before AI text-to-music took off with MusicLM and Suno.
Our original mission was to promote experimentation through a fun and kinda weird DAW plugin.
We were inspired by a centuries-old musical cryptogram technique where words were converted into melodies. Our team built out a custom algorithm that incorporates all keys and chord extensions.
Composers and secret agents used this technique through the 18th and 19th century, but it lost steam during the 20th century. Audiocipher brought musical cryptograms to the DAW, as a VST and standalone app.
Our text-to-midi generator lets your type in a word or phrase and choose melody or chord mode. Pick from nine scales, chord extensions and rhythm settings. Drag MIDI directly into your DAW of choice, including FL Studio, Ableton, and Logic Pro.
AudioCipher version 4.0 is due for release mid-2024. Existing customers get lifetime free upgrades on future app versions.
Visit the AudioCipher website to learn more.
AI MIDI models from Google, OpenAI, Microsoft
Google published an early MIDI generator prototype called Magenta Studio, but the quality was not great. OpenAI's MIDI generation at MuseNet was better in our opinion. When ChatGPT launched, the company stopped hosting Musenet as a service. It has since faded from the public eye.
Microsoft Asia's Muzic team built an AI MIDI generation model and published research about it in 2023. The MuseCoco model seems to produce sheet music inspired by classical harmony. No user interface has been deployed by the team.
2023 was a good year for companies like this. Suno was brought into the fold at Bing-Microsoft and Riffusion raised a $4M round.
As recently as March 2024, AI song playback is at near real-time streaming on Suno’s V3 model.
The creative experience is becoming addictive. These AI song apps will become like Midjourney for music. We're on the crest of that wave in the first half of 2024.
Market conditions have favored AI song generators for a few reasons. They are remarkably easy to use. They play into people's desire to create original music, without necessarily knowing how to play an instrument.
These companies sprang forward with low regulatory barriers. Some companies may have scraped copyright protected music for their models, and if that comes to light, lawsuits are certain to eventually follow.
Despite the question of ethics, everyday users are adopting and enjoying the new high quality AI music models becoming available. Apps that turn text prompts into audio and MIDI represent an exciting new development in the industry.
We'll likely to see more developments here over the next 4-12 months.