Adobe’s latest AI experiment enables you to generate music from text

Adobe unveiled an experimental AI audio tool this week to go along with Photoshop’s image-based tools. Adobe’s Project Music GenAI Control is “an early-stage generative AI music generation and editing tool” that can produce music (and other audio) from text prompts and then refine it within the same interface.

Unlike generative audio efforts like Google’s MusicLM, Adobe presents the Firefly-based technology as a creative ally that eliminates the difficulty of transferring the output to external tools like Pro Tools, Logic Pro, or GarageBand for editing. “Project Music GenAI Control could help users create exactly the pieces they need solving workflow pain points end-to-end, instead of manually cutting existing music to make intros, outros, and background audio.” via announcement blog by Adobe.

The business advises laying a foundation of text inputs such as “sad jazz,” “happy dance,” or “powerful rock.” From there, you can add more cues to change the song’s length, tempo, structure, and repetition, intensify it, remix whole portions, or make loops. According to the business, it can even alter audio by using a reference melody as a guide.

The generated music is safe for commercial use, according to Adobe. Additionally, in an effort to be open about the fact that your work of art contains AI assistance, it is integrating its material Credentials, which function as “nutrition labels” for generated material.

The interesting thing about these new tools is that they’re not just about creating audio; instead, they’re elevating it to the same level as Photoshop by providing artists with the same amount of intricate ability to mold, adjust, and edit the audio. It functions somewhat like pixel-level music control. Nicholas Bryan, a scientist at Adobe Research, writes.

The Carnegie Mellon University School of Computer Science and the University of California, San Diego are partners in the research. The experimental aspect of Project Music GenAI Control was highlighted in Adobe’s release. Therefore, it’s possible that you’ll have to wait before the feature (supposedly) becomes available in Adobe Creative Cloud.