DMR News

Advancing Digital Conversations

Adobe to Transform Text into Music with AI

ByHuey Yee Ong

Feb 29, 2024
Adobe to Transform Text into Music with AI

Adobe to Transform Text into Music with AI

Adobe is pioneering the next wave of music creation and editing with the introduction of Project Music GenAI Control, a groundbreaking generative AI (GenAI) tool. Announced at the Hot Pod Summit in Brooklyn, this innovative platform is designed to transform text descriptions into complex audio tracks, offering users unprecedented control over music production.

Introducing Project Music GenAI Control

Project Music GenAI Control stands out in the crowded field of GenAI-powered music tools by allowing customization within the same workflow. Users can input simple text prompts like “happy dance” or “sad jazz” or even a reference melody to generate music. From there, the platform offers a variety of editing capabilities, including adjusting tempo, intensity, repeating patterns, and structure. It even allows for the extension of tracks to arbitrary lengths, enabling remixing or the creation of endless loops.

Developed in collaboration with experts from the University of California and Carnegie Mellon University, Project Music GenAI Control is currently in the research phase and lacks a user interface. Adobe’s head of audio and video AI research, Gautham Mysore, emphasized that the tool places the user in the director’s seat, making music generation accessible to all, regardless of musical expertise.

Ethical and Legal Considerations

The advent of GenAI tools in music raises numerous ethical and legal concerns, especially regarding the potential for copyright infringement. As AI-generated content becomes more prevalent, distinguishing between authentic and AI-created music blurs, prompting music labels to issue takedowns of tracks that mimic copyrighted material closely. The legal landscape remains unclear, particularly with a recent federal ruling that AI-generated art cannot be copyrighted and the U.S. Copyright Office’s ongoing deliberation on AI-related copyright issues.

Copyright InfringementPotential for AI-generated music to mimic copyrighted material closely, raising concerns over authenticity and originality.
Federal RulingsRecent rulings suggest AI-generated art cannot be copyrighted, adding to the complexity of copyright laws for AI creations.
U.S. Copyright OfficeHas begun seeking public input on copyright issues related to AI, indicating evolving discussions and potential policy changes.
“Deepfake” MusicViral tracks using GenAI to replicate familiar sounds raise questions about the legality and ethics of such creations.

Adobe’s approach to navigating these waters also includes:

  • Using Data Responsibly: Ensures the use of data that is either licensed or in the public domain to mitigate potential copyright infringement issues.
  • Exploring Watermarking Technology: Investigates the development of watermarking technology to help identify audio produced by its GenAI tool, aiding in the traceability of AI-generated content.
  • Commiting to Responsible Innovation: Reflects Adobe’s commitment to balancing cutting-edge tool creation with respect for copyright and intellectual property rights, aiming to foster an ethical environment for creativity and innovation.

Revolutionizing Music Production with AI

Project Music GenAI Control is part of Adobe’s broader experiment with generative AI, aimed at democratizing music production. Unlike existing tools that solely generate audio based on text prompts, Adobe’s tool introduces a level of editability akin to Photoshop but for music, offering “pixel-level control” for audio. This positions Adobe at the forefront of a new era in creative tools, potentially integrating these capabilities into established products like Audition and Premiere Pro in the future.

While the tool is not yet available to the public, and no release date has been specified, Adobe’s foray into GenAI music editing signals a significant shift in how music can be created and customized. By providing a platform that marries the simplicity of text-based music generation with advanced editing capabilities, Adobe is not just enhancing creative possibilities but also sparking a conversation about the future of copyright, creativity, and AI in the music industry.

As Project Music GenAI Control progresses, it promises to open up new avenues for musical expression, allowing users to explore their musical ideas without the need for formal composition skills. This tool represents a step towards a future where the barriers to music creation are significantly lowered, fostering an environment of innovation and creativity powered by AI.

Related News:

Featured Image courtesy of Gabby Jones/Bloomberg

Huey Yee Ong

Hello, from one tech geek to another. Not your beloved TechCrunch writer, but a writer with an avid interest in the fast-paced tech scenes and all the latest tech mojo. I bring with me a unique take towards tech with a honed applied psychology perspective to make tech news digestible. In other words, I deliver tech news that is easy to read.