Deep Dives

Meta Open Sources an AI-Powered Music Generator

June 12, 2023
We summarized this source into key points to remember. To know more about it, please click on the link above.

Receive a daily summary of what happened in tech, powered by ML and AI.

Thank you! We sent you a verification email.
Oops! Something went wrong while submitting the form.
Join 1,500+ thinkers, builders and investors.
Meta has introduced its own AI-driven music generator named MusicGen, surpassing Google by making it open source. It can transform a text description into approximately 12 seconds of music and can be controlled with reference audio.

Introduction to MusicGen: Meta has unveiled an AI-powered music generator called MusicGen.
  • MusicGen can convert textual descriptions into a short musical composition.
  • It can be controlled or 'steered' with reference audio, such as an existing song.

  • Training and Accessibility: MusicGen was trained using 20,000 hours of music from various sources.
  • It utilized 10,000 licensed music tracks and 390,000 instrumental-only tracks for its training.
  • Pretrained models are accessible for anyone with the necessary hardware, primarily a GPU with about 16GB memory.

  • Performance Evaluation: The performance of MusicGen is passable but not exceptional.
  • Its music compositions are reasonably melodic, comparable to or slightly superior to Google's AI music generator, MusicLM.
  • It however does not produce award-winning music compositions.

  • Comparison with Google's MusicLM: The author compared the output of MusicGen with Google's MusicLM on various musical prompts.
  • MusicGen outperformed MusicLM in producing musically coherent compositions.
  • In the case of generating a piano piece in the style of George Gershwin, MusicGen could handle the prompt unlike MusicLM due to copyright-related restrictions in the latter.

  • Ethical and Legal Implications: The rise of AI like MusicGen poses ethical and legal challenges.
  • Generative music technology like MusicGen "learns" from existing music, a fact that makes some artists and AI users uncomfortable.
  • Increasingly, home-made tracks using generative AI have been going viral, resulting in music labels citing intellectual property concerns.
  • There is ongoing debate and legal scrutiny over whether "deepfake" music infringes on the copyright of artists and rights holders.

  • Meta's Position: Meta has no restrictions on how MusicGen can be used.
  • They stated that all the music used for training MusicGen was covered by legal agreements with the rights holders.
  • They had also struck a deal with Shutterstock regarding this.

  • Did you like this article? 🙌

    Receive a daily summary of the best tech news from 50+ media (The Verge, Tech Crunch...).
    Thank you! We sent you a verification email.
    Oops! Something went wrong while submitting the form.
    Join 1,500+ thinkers, builders and investors.
    You're in! Thanks for subscribing to Techpresso :)
    Oops! Something went wrong while submitting the form.
    Join 5,000+ thinkers, builders and investors.
    Also available on:

    You might also like