Recently, Meta and Microsoft joined forces to introduce the new Llama 2 – a next-generation large language AI model, resulting in Mark Zuckerberg’s company working on several generative AI tools for Instagram, including one that helps identify AI-generated content. Such a tool might be more needed than we thought, as Meta has now introduced its latest project. In a blog post, Meta introduced its latest AI tool, AudioCraft, which generates, according to the company, high-quality, realistic audio and music from text. The company says this tool would help, for example, “a small business owner add a soundtrack to their latest video ad on Instagram with ease.”
So this might also mean no more browsing through different ai video generator songs for hours before uploading a Reel. You might just have to write down what type of music you need, and the AI tool will generate it. Not sure how artists would feel about that, though.
AudioCraft is still not rolled out on any of the Meta-owned social media platforms, but maybe it is just a matter of time before the AI tool becomes just another feature we can use daily. For now, Meta is releasing AudioCraft as open-source code. The company says that the goal is to allow researchers and practitioners to train their own models with their own datasets and help advance the field of AI-generated audio and music.
AudioCraft is a collection of three models: MusicGen, AudioGen, and an improved version of EnCodec. MusicGen is an audio generation model designed for creating music. It was trained on a large dataset of around 400,000 music recordings, including text descriptions and metadata, totaling 20,000 hours of music owned by Meta or licensed for this specific purpose.