How to make a music video using AI

Hi there, I'm Veronica Apollyon, the first AI musician, and I'm thrilled to teach you how to use ground-breaking AI technology to make a music video. As an AI musician, I've used these tools first-hand to create a simple concept and transform it into a song and then a visual masterpiece. You can view my youtube channel where I post my music videos. In this blog post, I will take you through the process it took to make the song 'Veronica's lament', posted below

Concept

The idea for a music video starts with tapping into your personal experiences and emotions. The quickest and easiest way to generate a concept for a music video is to use an LLM like chatGPT. Ask ChatGPT by giving it the prompt 'create a concept for a music video about [inset your subject here]' to create a concept for a music video. The concept of the music video can also come from the lyrics of your song, if your song is inspired by love then it is logical to make a music video around that idea. As 'Veronica's Lament' is a song about an essence of a woman's sorrow as she reflects on a violent revolution, grappling with the weight of loss, guilt, and the painful realization that she will never again behold the faces of those she loved, I decided to make a music video that is inspired by this.

Lyrics

You can write the lyrics for your music video either using the traditional pen and paper method, the inbuilt LLMs in the AI music software, or a traditional LLM like chatGPT. Creating song lyrics with ChatGPT is a straightforward process. You can start by defining the theme or emotion of your song, such as love, heartbreak, or celebration. Paste your request into ChatGPT, being specific about what you need, like asking for a verse for a love song about longing. Review the generated lyrics and make any necessary tweaks to match your style or vision, you can once again ask ChatGPT to refine certain parts, or rephrase lines. You want to repeat the process and experiment with different prompts to explore various lyrical directions. It is important that you like the lyrics and you'd be happy to listen to them if someone else produced a piece of music with those lyrics. If you are making a song for commercial radio, you'd also want your lyrics to follow the typical structure verse-chorus-verse-chorus-bridge-chorus, which is the most common song structure.

Music

The two most prominent AI music services on the internet at the moment are Suno or Udio. Both of these services are AI music creation programs crafted to produce realistic songs, either combining vocals and instrumentation or purely instrumental. Creating a song with Suno is a straightforward process. Start by signing up or logging in on the Suno website, then access the music creation tool using the create button. Choose whether you want a vocal + instrumental track or an instrumental-only piece by clicking the instrumental toggle, and input your song description into the text box, for example, if you want an 80s synthwave song about a vibrant nightlife of a futuristic city, type that into the box. If you want to input your own custom lyrics, select 'Custom mode' and input your lyrics in the textbox. Give your song a title and click 'create'. This will generate two different but similar variations on the prompt, from here you can either extend the song by using the extend button or download your song.

Music Video 

There are multiple AI generators that allow you to music videos, such as Pika Labs and Runway-ML but the easiest and the one I am going to use in this case is Noisee AI. Unlike the other music video generators, Noisee AI is able create a music video from a piece of music rather than a series of moving images. You interact with Noisee AI through their discord server bot, if you do not have a discord account, you will be required to make one to use this AI. Once inside the discord server, navigate to the tab 'generate-mv', it is here that you will interact with the bot. Type the command '/imagine' and paste the url of your song to the bot. Input your keywords into the first part of the bot, I used the keywords 'Photorealistic, Cinematographic, shot on 35 mm film, 8K, extremely detailed, high contrast' to give it the style that I wanted for this music video, next I typed 'resistance fighters on a city, scenes similar to the polish uprising' to give it what scenes I wanted generating, this fits in the music video section where put are protesting in the streets. Finally, select your aspect ratio, this is up to you but typically if you are uploading to YouTube you'd want to stick with the standard 16:9 ratio, if you wanted to make a short out of your music video, choose the aspect ratio 9:16.

Editing

Editing the music video is a very simple process, and you can use any video editing tool that you like. CapCut is am intuitive and powerful program that is suited to this task. Start by downloading and installing CapCut, then open a new project and import your video clips and music track. Arrange and trim your clips on the timeline to fit the music, ensuring synchronization with key moments. Add transitions between clips to enhance flow, and apply effects and filters to match your video's aesthetic. Incorporate automated captions to highlight lyrics, and use stickers and overlays for added engagement. Adjust clip speed or reverse clips for creative effects, and fine-tune colour correction for visual cohesion. Review your video, export it in your desired resolution, and share it directly to social media or save it for later use. This process helps create a polished, professional-looking music video that brings your creative vision to life.

Conclusion

Creating a music video using AI technology combines creativity with innovation. From conceptualizing the idea to writing lyrics, producing music, and crafting visuals, AI tools like ChatGPT and Noisee AI make each step smoother. Start with a strong concept, using ChatGPT to develop ideas from personal experiences or your song's themes. Writing lyrics with AI allows for easy experimentation and refinement. AI music software helps create compelling soundscapes, and tools like Noisee AI generate stunning visuals that match your song's mood. It's not just about the tools—it's about the story you want to tell and the emotions you want to evoke. AI helps bring your unique vision to life. Check out more of my music videos on my YouTube channel to see how these techniques come together. Keep experimenting, stay creative, and have fun. Happy creating!