transcribe

I Tried Fully Automating My Video Editing With AI (RAW RESULTS)

Ali Abdaal · 46m · transcribed 7d ago
More from Ali Abdaal Business
𝕏 Share ▶ YouTube 📥 PDF 🤖 .md

Section Insights

# 0:00

Exploring AI Video Editing

How does AI video editing compare to human editing?

The speaker expresses skepticism about AI video editing but decides to experiment with it during a public holiday. They aim to see if AI can produce a video that is close to the quality of a human editor, hoping for at least 80% effectiveness.

  • AI video editing is rapidly evolving, raising concerns for traditional video editors.
  • The speaker has prior editing experience but is new to AI tools.
  • The goal is to learn and share insights on using AI in video editing.
# 9:18

Getting Started with Da Vinci Resolve

What challenges arise when starting with a new video editing software?

The speaker finds Da Vinci Resolve intimidating at first but decides to set up AI assistance to help navigate the software. They express curiosity about how the AI will assist them in the editing process.

  • New software can be daunting, but AI tools can ease the learning curve.
  • Setting up AI assistance can streamline the initial setup process.
  • Curiosity and experimentation are key to learning new technologies.
# 18:37

Initial Results and Refinements

What are the initial impressions of the AI-generated video?

The speaker reviews the first AI-generated video and finds it somewhat amusing but acknowledges it needs significant refinement. They plan to improve the output after a lunch break.

  • Initial AI outputs may be rough and require further editing.
  • Humor can be found in the imperfections of early AI attempts.
  • Refinement is essential to achieve professional-quality results.
# 27:56

Understanding Motion Plates

What is the significance of motion plates in video editing?

The speaker realizes that creating motion plates is crucial for the editing process, allowing for easier integration of A-roll and B-roll footage. They express satisfaction with the AI's capabilities in generating these elements.

  • Motion plates are essential for effective video editing.
  • Understanding the workflow can simplify the editing process.
  • AI can significantly enhance the efficiency of creating video elements.
# 37:15

Finalizing the Video Edit

How does the speaker evaluate the final output of the AI editing process?

The speaker assesses the final cut of the video, noting that while it is not perfect, it shows promise. They reflect on the challenges of creator marketing and how their tool, Creator Grid, addresses these issues.

  • AI editing can produce usable content, but it may not meet all expectations.
  • Creator marketing involves complex logistics that can be streamlined with the right tools.
  • Continuous improvement and feedback are vital in the editing process.

Transcript

0:00 Oh my god, Opus 5.5 is incredible at making launch videos. Look at this one shot. How far can I go trying this sort of AI editing compared to our human video editor who is very good. If this works, I will be absolutely amazed. That is really good. Oh no. Oh no. I'm worried for video editors. We've got amazing video editors on my team. So, every time a new AI model comes out, my Twitter feed fills up with people saying that this one can now edit videos. And I've been seeing that with basically every model release for the last few months. And so I was a little bit skeptical. Now, for context, I edited my own videos for about three years back when I was working as a doctor for somewhere between 10 and 40 hours a week. And so I kind of know what a good edit feels like, but I'd never actually sat down and properly tried editing with AI. But then a public holiday came around and the team mostly had a day off and we needed a launch video for Creator Grade, one of our platforms. Path, one of our editors, was already doing it the normal way. And so I decided to challenge myself for the day. Could I, as someone who's never tried AI video editing, learn how to use AI for video editing and make a video that comes as close as possible to a world-class human editor? And to be honest, if AI could get me like 80% of the way there, I would be delighted.

1:05 This video is a little bit experimental. Usually, I tell you about stuff that I already know. But in this video, I'm taking something that I don't have any idea about. And so, if you want, you can watch the process of how I'm sort of learning it and figuring it out. And hopefully there'll be something that you can take away from this to apply to your own workflows for learning things or for applying AI. This is going to be a super long video, so there'll be timestamps down below. Feel free to skip around if you like. But now before touching anything, I tried to work out what video editing actually is because that's how we're going to figure out how to break it down using AI. What is video editing at its core? Okay, so if we think of when you've already got some footage compared to when you don't. So when you've already got some footage, what is video editing? Well, firstly you import the footage and then you need to basically cut out all the mistakes to get a clean a cut. Then once you've got a clean a cut, you then add in B-roll.

1:51 It would be like the screen recordings and the screenshots and stuff. Then the hard part, the bit that takes ages is animating the B-roll so that you've got like zoom in and zoom out instead of just showing a screenshot which would be boring. These launch videos often go in and out and then there's motions and transitions and fadeins and movements and swipes and pans and all those things. So that takes a human video editor ages to do. Once you've done that, then it's like background music and sound design. So the background music, you know, we've got a particular vibe, but then sound effects like risers and swipes and swishes and all that kind of stuff. That is ultimately what video editing comes down to. And then obviously the taste factor is telling a good story and deciding what to cut out, deciding what to keep in. I feel like once we break it down into all those things these days, surely the AI should be pretty good at all that stuff. To be honest, I would be very amazed if it manages to just even get the a cut right immediately, right? Cuz when I, as a human, I'm editing a video, if there is a pause or there is a retake, you have to know where to cut and splice the footage together so that it doesn't sound weird. You know, we had a whole lesson in my course where I taught people how to use Final Cut Pro. There was a lot of time spent on just like nailing the A cut cuz if you can nail the A cut, then everything becomes smoother further down the line. But if the A cut sucks, then everything else will kind of feel a bit disjointed. The stuff I've seen on Twitter is like super super super polished. They're like, "Oh my god, Opus 5.5 is incredible at making launch videos. Look at this one shot."

3:09 And I'm like, "There's no way that was actually one shot. Surely you had to go back and forth quite a lot and do a lot of tinkering to get that particular result." So, I'm going to be very interested to see what does the oneshot look like where I've just I I'm not really driving it. I'm just like giving it copied and pasted stuff from Grock into cloud code and then claw code into claw code just like raw dog and just see what it does. And then when I've dabbled with AI stuff just for anything in the past, getting it to like 80% good enough happens with one shot. But then polishing that final 20% takes freaking ages and the bulk of the time is spent in polishing it so it feels good and looks good and has, you know, taste applied to it rather than just the oneshot version.

3:48 All right, so phase one of this project is I want to start by getting the lay of the land. What options do we even have for AI video editing? So, I'm just going to use drug Grock cuz I don't need a VPN for it. I'm trying to figure out how to do AI video editing. I've got some footage I need to turn into a launch video for Creator Grid platform that helps pitches learn grow and monetize. I want to see if I can use AI video editing to make a alternative edit.

4:20 Ideally, the whole thing, but also we could do a 30 to 60sec faceless launch trailer type thing using motion graphics and stuff. Or we could do it like talking head with screen shots like a YouTube video, some combo of all of the above. Help me figure this out. three different pipelines. So, one option is the Da Vinci thing with an API. Okay. Descript for the cut and then resolve for grade graphics and finish.

4:53 Okay, option three. This is the remotion hyperframes lane faceless brand launch trailers. Cool. Not entirely sure what any of this means just yet, but I think we have a reasonable lay of land. All right, so quick translation because there was a lot of jargon over there. There are basically two ways AI can make you a video right now. The first one is to edit the footage that you've actually filmed. For that, I used Da Vinci Resolve, which is a proper professional video editor that recently started letting AI control it directly. But then the second is to not edit footage at all. You instead get the AI to write the video as code and it generates every single frame. That's what tools called hyperframes and remotion do and it's how a lot of those launch videos that you might have seen on YouTube and Twitter are being made. I didn't know which approach would work and so I decided to try both of them at the same time. Oh, what a vibe. Right as of literally right now, Path, one of our human video editors, has actually just sent me the first draft of this video that he was manually editing. So, I don't want to watch it right now, but that could be interesting to compare. How far can I go with trying this sort of AI editing stuff for the first time compared to our human video editor who is very good.

5:59 Okay, awesome. I've got a roll filmed already. How do we get started? Okay, firstly, Hen Hyperframes core skills experiment B A Cut Resolve MCP needs Da Vinci Resolve Studio 21.1 295. All right, guess I'm paying $295 for Da Vinci Resolve Studio. We are buying Da Vinci Resolve Studio. All righty, it worked. We have just bought Da Vinci Resolve Studio for about $300 and it is an 8.5 GB file. So, it is downloading. All right, now I need to Claude plug-in marketplace. Hen hyperframes. Install Hen Hyperframes. Let's open up Claude code. so what I want to do is let's go local. Let's make a new folder.

6:39 creator grid launch video or something and let's open 5.5. Okay, I'm trying to use hyper frames to make a launch video for creator grid. I've already got some a roll, but we don't necessarily need to use it. Here are some pre notes from Grock. Let's see what Claude does. Okay, we are installing hyperframe skills into the project. All right, so I've already got that footage. Should I just chuck it into the project folder? Oh, and by the way, I've added in the existing video into the project folder. FYI. okay.

7:16 Claude code is asking ffmpeg isn't installed. Yes, by all means, please do. Yes, install ffmpeg. Happy for you to install it globally on this machine. Pablo, our co-founder, has put together this claude artifact with product views that we can use. I want to see what a pure faceless just music no voice video looks like, but also I want to see what it looks like with just my voice as a voice over and also what it looks like with both my voice and face because I think my face and voice carries trust to some degree. Let's do a pipeline test first. It's doing stuff.

8:00 Installing FFmpeg and Whisper CPP. I know what both of those things mean, so I don't need to ask. But if I didn't, I would totally ask. The screenshots are good. Real UI at 4K. Setting up Hyperframes project and running the 10-second pipeline test. Great. It's just doing stuff. Oh, quick note from the sponsor of this video, which is Whisper Flow. Now, on a good day, I can type at about 156 words per minute. But even with that insane typing speed, I can still speak faster than I can type.

8:23 And so, Whisper Flow is a wonderful tool for turning your voice into text in pretty much any app you might be using. So, for example, I'm going to try this right now in Slack. Hey, Angus, we've got three things for Austin. firstly, can we book the flights by Friday? Hang on. Thursday, actually. And make sure everyone's landing the evening before. Second, can you please send everyone the agenda with the planning sessions in the morning and the afternoons left free? And then thirdly, can we sort out a group dinner, please, for the first night? Ideally, somewhere that we can all fit in one table. Cool.

8:47 Thank you so much. Okay, so that took me under 30 seconds. And if you look at what's come out, it's turned my spiel into a very nice numbered list that makes it very easy for the person to see what I'm talking about. I made a mistake on saying Friday, no wait Thursday, and it took that into account. Now, people always say that, "Yeah, but my phone's got built-in dictation." To which I would say, "Have you seen how bad the built-in dictation on your phone is?

9:04 Let's just try it out." "Hey, Tam. are you around for a call on Saturday?" No, wait, Sunday. And, can you send me the name of that book that you mentioned? So, yeah, it doesn't know how to spell my brother's name. It doesn't clock the mistake. And now, if we try exactly the same thing in whisper flow. Hey Tam, are you around for a call on Saturday? no, wait, Sunday. And, can you send me the name of that book you mentioned?

9:22 Great. And it even knows that this is exactly how I spell my brother's nickname. His name is Tamour, and I call him Tame. And it knows exactly how to spell it. and it's automatically taken the error into account and removed it from the text, which is awesome. In my case, I've currently written 167,630 words on Whisper Flow so far, which is a fun little stat to see. Anyway, Whisper Flow is free to use, and if you want to use it absolutely loads, then you can get Whisper Flow Pro. That gives you unlimited words, and you can get a month of Whisper Flow Pro completely free by checking out the link in the video description. And when they ask you how you heard about them, please do write YouTube and put my name in the how did you hear about us box because then they're more likely to sponsor more of our videos, which is awesome. So, thank you Whisper Flow for sponsoring this video. and let's get back to it. Okay, awesome. Have we downloaded Da Vinci Resolve yet? Yes, we have. Let's install this. I've literally never worked with Da Vinci Resolve, but how hard can it be? Okay, classic. You look at a video editor and it looks intimidating AF.

10:13 What do I do here? Help. AI. Set up AI assistance. All right, let's do that. Da Vinci has been added to these. Please res Oh, wow. Okay, cool. It's already done. So, claw desktop extension extension installer opened. Da Vinci Resolve Studio extension. Okay, then install. Let's go. Oh, that was quick. let's see what's Claude Code saying now. Still doing stuff. It's using some tokens. 3% of session limit. All right, we've got plenty of plenty of headroom here. So, what the hell do I do next on Da Vinci? I mean, in theory, it should be connected to Claude code, right? So, I could just Do you see the Dainci resolve connection MCP thing? Let's see what happens. Yes. Wow, we're about half an hour in. So far, we've managed to buy and download Da Vinci Resolve Studio and Claude Code is cooking away on trying to do the hyperframes method. By the way, can you write me a brief I can put in another Claude code chat within this project to test out Dainci Resolve MCP for building this video as an alternative method. Nice. All right.

11:21 Well, claw code is basically telling me what to copy and paste into claw code. Boom. I love a good old copy paste from AI into itself. Oh, wow. Okay, cool. Storyboards are written. No animation code yet and your bands gradients, glow-ins, fade in, blah blah blah. Film a music and text 30 seconds. This is its own edit with no voice. The type and the product shots have to tell the whole story. Okay. Yep. Film B, your voice 45 seconds with a 7second extended cut. Build it once, render it twice.

11:51 voice only and then with your face added film a silent has three options. Okay, let's look at that. Oh, okay. It's fun. All right, let's just ask these. one, demo data. Two, yes, we can show client logos. Three, that's okay. Four, is there a logo file? get logo from creator grid.io. Yes, static. No, animation. Still render to prove the setup works. Please pick an A option and the B length. Okay, so B length 45 seconds feels good. And A, you do two things, we do everything else. All right, creative marketing without the chaos. Nice. I quite like that. That's really good. A1 option I like. Let's go.

12:35 Hey, this is so good. Okay, now let's see what Resolve's doing. Creating work folders. Find whisper models. Probe source view live output. Resolve scripting API. All right, it's just doing stuff. I guess maybe I won't even need to use. It's not visibly doing anything, but I guess it's doing stuff in clawed code with the Da Vinci Resolve connector. If this works, I will be absolutely amazed. There's no way it's going to work first time. There's just no way. But this is quite cool.

12:59 It's such a vibe, isn't it? Oh, open and split view. Oh, wow. This is really cool. So, at this point, we've got stuff happening basically side by side. So, on this side of the screen, we've got the Da Vinci Resolve method of trying to do AI video editing. On this side of the screen, we have the co claude code hyperframes method of doing AI video editing. And I'm just sort of sitting back and waiting for it to like do stuff. which feels pretty good.

13:27 Yeah, this IMAX fans are starting to starting to get pretty Yeah, this is hot. Everything's hot. If this really works, I might just upgrade to an M5 Max Studio. Oh, wow. Look at that. That is actually not bad. Creator marketing without the chaos. That actually looks pretty freaking solid. That looks pretty good. I mean, as anyone can generally generate a still these days, but let's, you know, remains to be seen how good this is for video editing. Let's see what happens next. All right, both story boards are sketched. No animation code has been written yet. Okay, cool. Let's look at these story boards. This actually remarkably good. Creative marketing without the chaos. I don't like this font, but I think this is our font. Is that our font? Okay, I might have to redesign the creative grid branding if we do use that font. I'll get to the style later. Pick your creators. Prove the content. We handle the in sourcing, negotiating, time briefing, reviewing, invoicing, paying, tracking, everything else. Nice. Okay.

14:13 So far, I'm I am quite impressed by this storyboard. I wonder if I should use storyboards more when doing stuff. What's happening on Da Vinci side? Okay, it's still doing stuff. Okay, so Da Vinci has been cooking for 20 minutes and this just seems to be running into a bunch of issues. I probably should have done this one at a time, but you know what? Let's just see. Let's just see what it's going to do. One shot. You know, one of the things with working with AI is figuring out what to do while it's while it's thinking. I could try and do a third thing. Why not? By the way, I want to try using reotion as a third experiment running concurrently with hyperframes and resolve. Write a brief that I can give to a new clawed code instance within this project for this. Boom. So, we've got hyperframes number one. We've got resolve is method number two. And we've got remotion which is method number three. So we now have hyperframes over here, resolve in the middle, and then reotion over here.

15:13 Okay, all three drafts are rendered. We have MP4 files. All right, let's see what does this look like and is it any good? H. Okay. Well, that's pretty bad as a faceless version. Let's try Draft V2 voice. No face. Let's see what happens.

15:43 If you're a brand trying to grow with creator marketing, you probably know that it is a total nightmare. If that resonates, I would love to tell you about Creator Grid, where we will literally run your creator campaigns for you end to end. You don't pay anything upfront. There is no retainer. There's no subscription. And you only pay for results. Entrepreneur and creator. If we haven't met, hello. I'm What the hell? Ali, I'm a doctor turned entrepreneur and creator with about 8 million.

16:09 Creator Grit is our attempt to basically give you the level of service. Oh no. Oh no. It didn't. It screwed up the A cut. Just the basic A cut. It just doesn't get it. I knew it. I knew it. The pauses. The pauses. The pauses are bad. It's not It's not doing the A cut properly. And now, what if we have my face in it as well? What does that look like? If you're a brand trying to grow with creator marketing, you probably know that it is a total nightbeck. If that resonates, I would love to tell you about creator grid where we will literally run your creative campaigns for you end to end. You don't pay anything up front. There is no retainer.

16:43 There's no subscription. And you only pay for results. entrepreneur and creator if we haven't met. Hello, my name is this this is bad. But this would have been magical a few years ago that like wo you could just do that with like just getting a robot to operate Da Vinci Resolve. But I had way higher hopes of the V1. Okay, hopefully Hyperframes does a better job with this. So, I think what I may have to do is I might have to actually manually decide what to keep in in terms of what I've said or maybe even record a separate video that's like explicitly word for word scripted 45 seconds long cuz this one was more like 5 minutes long and it's just tried to figure out which bits to Hm. This is frustrating. I do not like this. Let's grab something from Epidemic Sound. I want to find a track that people would recognize.

17:39 Oh, beautiful. Right. Okay. So, we're using Valdi's spring as the background music for the hyperframes one. Okay. Still we've got hyperframes doing stuff. We've got Resolve doing stuff and now we've got Remotion that's been doing stuff for the last 23 minutes. Also, one thing that I didn't really do is I could have like I've been seeing stuff on Twitter recently about that where people have come up with these like elaborate prompts for hyperframes. So, maybe I could have just copy pasted one of those just to see what that would do. But we're not going to get ahead of ourselves. We're just going to try and focus on the the simple stuff. We have a silent draft of the hyperframes video.

18:13 Shall we see what this looks like?

18:43 >> >> Okay. It It's It's not bad. The classical music makes it kind of funny. it's a little bit janky. It's the equivalent of if I were like 15 years old and learning video editing for the first time and deciding to use Vivaldi's spring as the background music. It's impressive as a V1, but of course we need refinements to make it actually good. Okay, I'm going to go for lunch. We're going to come back and my prediction is that I will be disappointed with the oneshot results of this and then we will done. We will start the actual work of doing anything with AI which is polishing All righty, ladies and gentlemen. We are back after our lunch break and it is time to see what is happening. So, we're going to start with the hyperframes one.

19:35 So, we saw the silent one a little bit earlier. Let's try voice and no face. If you're a brand trying to grow with creator marketing, you probably know that it is a total nightbeck. I would love to tell you about creator grid where we will literally run your creator campaigns for you end to end. All you have to do is basically two things. So firstly, you decide which creators you want to work with. So we'll source them for you. You just sort of approve or reject them. We will give you a bunch of content and you just decide to approve it or not. Everything else is handled by us. So the sourcing of creators, negotiating, reviewing the content initially, and then invoicing and paying the creators, tracking all the views, blinds, all of that annoying stuff we take off of your plate. Oh wow. Okay, that's like remarkably impressive.

20:14 That's way better than the Da Vinci Resolve one. That's really well done. let's see what this looks like with my face as well. >> If you're a brand trying to grow with creator marketing, you probably know that it is a total nightmare. I would love to tell you about creator grid where we will literally run your creator campaigns for you end to end. All you have to do is basically two things. So firstly, you decide which creators you want to work with. So we'll source them for you and you just sort of approve or reject them. We will give you a bunch of content and you just decide to approve it or not. Everything else is handled by us. So, the sourcing of creators, negotiating, reviewing the content initially, and then invoicing and paying the creators, tracking all the views, blinds, all of that annoying stuff we take off of your plate.

20:52 >> Wow. Okay, that is very good. I mean, obviously, it could do with a lot of work, but that is remarkably impressive. I did not think it would be that good. Let's see how Remotion does it. Wa! Remotion has literally given me a video editor interface. What the hell? I didn't realize I could do that. That's cool. Okay, let's see what this version looks like. >> If you're a brand trying to grow with creator marketing, you probably know that it is a total nightbeck. If that resonates, I would love to tell Hang on, let's try the voice face one. If you're a brand trying to grow with creator marketing, you probably know that it is a total nightbeck. If that resonates, I would love to tell you about Creator Grid, where we will literally run your creator campaigns for you endto end. You don't pay anything upfront. There is no retainer. There's no subscription. And you only pay for results.

21:43 Oh, okay. We need a bit of quality control on this one. I I don't know why it's bugging out. Like it it looks campaigns for brands like Notion, Whisper Flow, To-Doist, Superhum, Victor, and a bunch of others. >> I see what they're trying to do, but this is just like super super super buggy. Like, what the hell is it doing? How the hell did you create a video editor within the browser itself? I didn't build that. The browser is Remotion Studio, which comes free with Remotion. It's a small local web app.

22:10 Interesting. Okay, so Remotion Studio is probably the most like similar to a video editing experience, but like it was a bit buggy, just not as good as the one that Hyperframes made. But Hyperframes doesn't have like the video editing interface. It's purely the code. And the one in Da Vinci Resolve just was not very good at all. So at this point, I would rate Hyperframes as being like probably a 7 out of 10. Da Vinci Resolve, I would rate it being probably a 3 out of 10. And Remotion was super buggy, so I'd probably give it a 2 out of 10 right now. but it does have the right idea. It does have the right idea.

22:43 Here is the problem. I think if we think about like the two versions of the video, if we imagine a roll is what what being said that needs to be a cut. So we go for raw a- roll. What we what this kind of needs is a script to raw a-roll then you get the a cut and then you get the add in effects. What I was trying to get Resolve to do is basically take 10 GB worth of A-roll footage and hope that it would a magically be able to 45 seconds of that to turn into a cut, but then also to actually be able to edit an A cut using J cuts and L cuts to the level that I would like. Now, that is probably a little bit unfair and that's a little bit beyond what Opus 5.5 can do at this stage. Maybe one day you'll be able to just give it a bunch of footage and say, "Eedit this for me." But today is not that day. So, we are going to have to at least on the Resolve front drill down and start doing things a little bit manually. By which I mean kind of breaking things down a little bit more step by step. Maybe that's the way to think about AI editing with Resolve. Prove the concept first for 30 seconds, you know, and okay, this was dumb of me to not realize beforehand. In fairness, it's always good to just one shot and see what happens because then you see the holes in your in your prompting. Because if we were hiring a human video editor and now we're testing out a brand new video editor, the way we do that is we give them 10 minutes of footage and we ask them to just give us the first 60 seconds as an edit because it gives us a feel for how are they doing. It it would be unfair to ask a human video editor to say, "Hey, of these 10 minutes, pick the best 45 seconds and turn it into a cohesive story and then let's see see the editing because it would be a lot for a human video editor who's good at video editing but maybe not good at scripting. Maybe actually the thing that I recorded is not suitable to be spliced into a 45se secondond chunk. Yeah, I don't want to be one of those people that tries to oneshot something, gets a slightly response, and then thinks AI sucks. Like, I knew it. I knew it was using too much data. I knew the data centers were evil, etc., etc. It's like, no, I'm sure that there's definitely a way to do this. I just need to be a little bit more sophisticated with the process and make it happen. So my learning here, learning number one is treat the AI like a human and give it the task that you would give to a human with the same level of instruction.

24:55 Okay, I'm actually going to switch out of Claude and go into go back into Grock. You know what? Let me just use Swiss flow. So I think what's happening here is that we actually have two different work streams. One is a pure faceless launch video with like text and music and stuff. And so that is one that doesn't need the original footage, but then the second one is editing original footage. Those are actually two very different things. Editing original footage involves bringing in the footage, sorting out the A cut, and then doing the B-roll and the animations and stuff. Whereas the pure Faceless is just about doing really good animations. Now I think what we can actually do aha is a hybrid of the two hybrid because for example if we figure out a system of nailing the editing of actual footage like making the a cut really good and then separately we had an absolutely sick way of generating insanely highquality motion video that shows the screenshots of the app with all the relevant zooms and pans and all those things. Those are more similar to the ones that people post on Twitter. We can then combine the best of both worlds to create a talking head explainer video that also has all of the bells and whistles that like a purely animated launch video would have. Yes, treat them as two factories and then a third step that only composites. Stream one, a cut of real footage. Stream two, motion plates, hyperframes when product screenshot, zooms, pans, connected type, music hits, build each plate as its own 3 to 8 second composition against real UI. Drop hyperframes, MP4 into the V3 as B-roll. Talking head stays on V1. Okay.

26:20 Yep. Nice. Why are you calling them motion plates? Is that like industry terminology for this sort of thing? Oh, it's just a post-production word for a finished piece of motion graphics that you drop into a timeline. A plate is a self-contained visual layer. Oh, I had no idea. In old film work, it was a painted a photograph background you composite piece people against. In this workflow, it's a short already rendered movie. 3 to 8 seconds of zoom pans type in product UI that does not need to be built inside Resolve. motion just means it's animated. You're not asking Resolve to animate the dashboard. You're asking to place a clip that already has the animation in it. That's clever. One thing I find when learning about AI stuff or when trying to do AI stuff is that I learn terminology that's actually used in the industry. So, for example, the other day I was doing some thumbnails for a thing. And I learned what a contact sheet is, which is basically like a a series of thumbnails for a storyboard or something like that to explore different concept directions.

27:08 And then because I then had that terminology, I was able to use that terminology in future prompts. I've never heard the phrase motion plate before, but this is exactly what I want. I want the a cut of of the video, the A-roll of me talking, and then I want really high quality motion plates to appear over the top based on what I'm saying in the video. Learning number two, learn the words that the professionals use. Because as soon as I knew it was called a motion plate, I could then ask the AI for exactly what I wanted. All right, this is exciting. I now have more of a mental model of what I'm trying to actually do here.

27:39 Okay. So, I'm going to start with what I want is I'll give you a raw a cut a cleaned up a cut of the video of me talking. Ultimately, what I want is really nice motion plates that I can add to the a cut using something like resolve. All right. Hyperframes can do this. Only the motion graphic shows with no blacks blocks around it. PNG sequences with transparency, 4K output, amazing frame rate match to your footage, one plates project with each plate as its own file. Let's just do exactly the same one for remotion and see. Okay, I think I can basically get rid of worrying about resolve Dinci Resolve for now because I know that I don't need that for this stage of the process. I'm now realizing that I just need to create the motion plates because then the script, the A- roll, the A cut, that's like the easy part. I could always do it manually if I really wanted to. I could chuck it into Premiere and use Fire Cut if I really wanted to. The A cut is the easy part.

28:42 The hard part is what I now know is called the motion plates, which is cool. it's rendering a contact sheet. Let's see. Okay, that's quite good. That's quite good. You pick the creators. That is all pretty good. Wow, I like this. The only thing I don't like about it is the sort of solid colors. Okay, I like this. I just don't like the solid colors of the backgrounds of the vertical video thumbnails. I want them to look more like actual UGC. So, let's use real/ AI gen photo realistic images.

29:12 Oh, wow. That's pretty good. So, it's using Canva to generate casual UGC style images to replace this stuff that looks a little bit a little bit fake. I mean, it all looks a bit fake, but like I think that would like sell the the vision a little bit better. Learning number three, get the AI to show you the plan before it builds anything. If you have a storyboard or a contact sheet, that takes seconds to go through and fix stuff. But if you get it to oneshot the render all the way at the end, then like you have to spend a lot more time fixing stuff. All right, so Remotion has actually done a bunch of stuff. Let's see what it looks like. Inbox triage in 60 seconds.

29:47 You approve the content. Yep. You pick the creators. Okay, that's really good. Your campaigns run end to end. That is remarkably good. Well done, Remotion. That's solid. Look at that. Wow. Okay. I mean, we can definitely make it make a nicer graph, but this is really solid. Okay, I now like reotion again.

30:21 Let me just give it the same prompts as I did with this one. All right, at this point it's 3:45 p.m. I have a couple of calls in about an hour and so I want to make as much progress as I possibly can in the next hour. I think we're getting there. Like the motion plates are actually getting surprisingly good. So I just need a properly scripted 45se secondond video which I can then just record now get I don't know one of these tools to get the a cut of it. Once I have a clean a cut that I'm happy with, I can then overlay all of these different motion plates that we're creating whether it's from reotion or hyperlapse. Okay, so at this point I'm very happy with the images of what this stuff looks like. I think it's done a really solid job. This is the hyperframes method. Let's see what it does when it animates it.

31:06 All right, updated reel. New views chart. Let's see what this looks like via remotion. Nice. Nice. Okay, well done, Remotion. Now, at this point, the thing I'd finally clocked was that my original video was about 5 minutes long. And I'd basically been asking the AI to dig out a 45se secondond launch video out of 5 minutes of me talking, which is a job that I would never give to a human editor either. And so, learning number four is that if you want a short video, film a short script. So, I got Claude to write me a very tight script based on what it said in the original and then I filmed it again. Let's get Claude to create the script for me because it knows exactly what I said previously and it's been doing all this stuff. In this project, we should have the transcript of the VSSL I filmed for creator grid. Write me the V1 of the script. Okay, this is actually a very solid script. Let's now film the thing. If you're a brand doing creator marketing, you will know that it's a total nightmare. Okay, so we have just filmed the video. So now we need to export a clean a cut of this video. How do how do I most expediently export a clean a cut? You know what?

32:22 Let's download Final Cut for Resolve. I think Final Cut for Resolve, somewhat ironically, is actually the tool that I'm going to use for this. Fire Cut for Da Vinci Resolve. I've never actually used Final Cut myself. Our video video editors use it and we built it as an initial tool to use in-house for our for our team. Okay, so now I want to do the first cut. Boom. Can I just generate the first cut? Let's see what happens. Nice.

32:45 Okay. If you're a creator doing paint agency. Yep. I'm a total noob to Resolve having literally never used it before in my life. But let's see. Let's see what happens. How do I zoom in and out? Oh, okay. Yeah, fine. >> If you're a brand doing creator marketing, you will know that it's a total nightmare. Either you pay an agency a massive retainer and wake either you pay a >> Safari has given me a very rough first cut, but it hasn't quite made it. You know what? Maybe this is just a case of me actually just doing this manually.

33:13 what how do I do cuts on this thing? Command T. blade tool. Boom. it's not a magnetic timeline for goodness sake. I haven't done this sort of in absolutely ages. But this literally used to be my bread and butter in Final Cut >> Produced by us, our team, and our platform. >> So at this point, we have just exported a clean a cut. I probably could have done it with AI, but I didn't have the time to figure it out, so I don't know how long it would take me. So now what I want is I want the transcription. So I'm going to use this tool, whisper transcription for that. Okay, we finally have a clean cut that I've just edited.

33:48 This is the transcript. I want you to generate all the motion plates for this new transcript. Boom. And let's just do the same thing over here. So the A cut is done in Resolve using Far Cut and using a bit of manual editing. Now for the B-roll, motion plates are being done by hyperframes and by remotion. Sick. Then background music. And I think then maybe the final thing might be to add in some sound design actually like plops and whooshes and stuff. Conveniently, Epidemic Sound has a bunch of that stuff in it. They've got swooshes, ambience, water, vehicles, whoosh. Can I just give the AI access to Epidemic Sound? Cuz that would be handy if it could find API keys. I love it when there's API keys.

34:33 So, I don't want to do this try and try and do this one shot. We're going to see what it does with just the motion plates and then we'll add the background music and the sound effects. But I've got it ready so that we can save some time. Bonjour. >> How's it going? >> Good. You are on the camera. >> Hi. >> Okay, now that we've actually done this, while we're waiting, we can actually check out Parth. What path said, let's see. If you're a brand trying to grow with creator, >> that's really good.

35:00 >> Oh, he gets it, right? >> Marketing, you probably know that it is a total nightmare. Either you pay an agency a massive retainer and then you wait a few months to years for the content that may or may not be usable or you and your team is trying to like manually reach out to creators and then you're doing the outreach, the negotiation, the invoicing, the review, all of that kind of stuff yourself in house which you just don't have the time for. If that resonates, I would love to tell you about creator grid where we will literally run your creator campaigns for you end to end. You don't pay anything up front. There is no retainer. There's no subscription and you only pay >> Oh, that's good. It's good.

35:34 It's good >> for results. That means if you're looking for creators for UGC or content for ads, you only pay for the stuff that you approve. Or if you launch an organic CPM campaign, you only pay for the view. >> I mean, yeah, he's definitely using AI systems as well, but like obviously totally fine. >> Creators actually get you. If we haven't met, hello, my name is Ollie. I'm a doctor turned entrepreneur and creator with about 8 million followers across socials and I've been on the creator side of brand deals for the last decade.

35:56 But the reason me and my team are building Creator Grid is that for the last 2 or 3 years, we've been trying to do creator marketing ourselves for our own software products and realizing how much of a nightmare it is, which is why we built Creator Grid for ourselves. But then as we started speaking to other brands, everyone started saying to us, "Oh my goodness, I need this." And so we turned it into a product that now lots of big brands around the world are actually using >> nice >> using for their creative marketing. And so in the next few minutes, I want to show you exactly how it works and why I think it is a better way for you to do your creative marketing rather than working with an expensive agency or trying to do it in house. Creator Rit is our attempt to basically give you the level of service that a done for you agency would, just way faster, way cheaper, and with a lot less bandwidth from your team.

36:32 >> Nice. That's pretty solid team. The creative platform is kind of like having a teammate who lives in your Slack. So you tell them what you're trying to achieve and then we will literally run the campaign for you end to end. A bit like how simple it is to run meta ads. You set the objective. So whether you want content for ads or for UGC. >> Bloody hell, that's good. >> See? Or whether you want an organic CPM campaign and we will handle every aspect of the delivery. All you have to do is basically two things. So firstly, you decide which creators you want to work with.

36:54 >> Okay. So I mean he's going going a little bit more like real life rather than like the fake Harry Potter stuff that I was using. >> So we'll source them for you and you just sort of approve or reject them. And secondly, if you want to approve >> I like the sound design >> content manually. We will give you a bunch of content and you just decide to approve it or not. Everything else is handled by us. So the sourcing of creators, negotiating, reviewing the content initially and then invoicing and paying the creators, tracking all the views, making sure the content is in line with your brand guidelines, all of that annoying stuff we take off of your plate.

37:19 >> Oh, that's really good, man. Path is sick of this. Let's see if we can come close to his level of quality. Yeah, mate. This Mac is absolutely heating up like a like a barbecue. Yeah, actually hard to hard to hard to hold on to it. This means that I can campaign to the wife that I need the fully decked out M5 Max Studio, right? Which costs about 20,000 USD, but it's worth it. It's my boy math cuz it will make that AI editing a little bit faster. Even though I don't really do editing myself. I'm just doing this for the vibes, right? Is that okay? Can I get an M5 Max Studio, please?

37:51 >> We can talk about it later. >> Nice. Very good. Very good. All right. So, Remotion is rendering all its things. This hyperframes is rendering all its things. Compositing all plates over the cut into a review MP4. That's what we like to see. Okay, I think we are done. Your first cut with all nine plates dropped in at the time codes for review only. Let's see what happens. So, this is hyperframes. If you're a brand doing creator marketing, you will know that it's a total nightmare. Either you pay loads of money to an agency and wait ages for content, or your own team gets stuck doing everything, finding the creators, DMing them, negotiating with them, doing the invoices, writing briefs, contracts, like all of that stuff. Creator Grit started as our in-house tool for dealing with all this f. But then loads of brands told us they love the idea and so we spun it out. Now we run your creator campaigns end to end, whether it's UGC for ads or whether you want organic views on content. Okay, that is not bad. I wish it did more picturein picture. okay, not bad.

38:44 but I don't like the full screen nature of the graphics. I want always picturein picture but done in a nice way. Okay, let's see what Remotion has done. If you're a brand doing creator marketing, you will know that it's a total nightmare. Either you pay loads of money to an agency and wait ages for content, or your own team gets stuck doing everything, finding the creators, DMing them, negotiating with them, doing the invoices, writing briefs, contracts, like all of that stuff. Creator Grit started as our in-house tool for dealing with all this f. Loads of brands told us they love the idea and so we spun it out. Now we run your creator campaigns end to end. Whether it's UGC for ads or whether you want organic views on content. Okay, so at this point we have got V1 of the renders from Hyperframes and from Remotion. Both are like pretty good. I would say they're like 85% there. There's a little there's a bit of polish that they could all do with the one. The Remotion one looks a little bit more AI sloppy with like the gradients and stuff. So maybe we can just like stop it from doing that. And there were a couple of bugs like a few like random frames and like flash frames and things in the reotion one, but the hyperframes one looked pretty good. Okay, so I'm getting both hyperframe and reotion to both do the picturein picture thing that sort of looks like a loom video. All right, while this is still rendering, let's do a wee. I've got 9 minutes until my next call. So maybe while I'm on the call, we'll get it to keep just cooking in the background for the sound effects and the background music. Let's see if the new Remotion version is good. If you're a brand doing creator marketing, you will know that it's a total nightmare. Either you pay loads of money to an agency and wait ages for content, or your own team gets stuck doing everything, finding the creators, DMing them, negotiating, invoices, writing, briefs, contracts, like all of that stuff. Okay, I like the Remotion one. I think we are 90% there now. So, I'm just getting it to tweak the very first line and add a bit more juice to the motion graphics initially. And now I have got a call which I'm going to take on my laptop so I can keep this stuff running in the background without dying. At this point, I was on a call with Pablo, my co-founder on Creator Grade, and he actually sent over a brand new logo.

40:39 Now, when it comes to normal video editing, doing a rebrand when you're 90% done with a video is a total pain in the neck because it often means going back and redoing every single graphic by hand. But because these videos were basically code, my theory was I could just give Claude the new logo and I could ask it to update the entire design system based on that logo. And so, let's see how it does. So, this is the new kind of logo for creator grid. This is the new creator grid logo.

41:06 Can you update the styles etc of the video to match including the relevant colors and vibe? Boom. And boom. Cool. All right, it is officially 7:05 p.m. I need to head home for family dinner and then baby bedtime with the baby girl. But I think Izzy is still here on some onboarding calls for her new Dream 21 community. And so until then, we're going to see if we can wait for these draft renders to finish and then we'll see how good a job this does at just like reskinning the videos based on the new logo. Yeah, it's having to like rerender all of the motion plates.

41:47 Learning number five, when your video is basically code, changing your mind is super cheap. Imagine how sick it would be if I had a fully decked out Mac Studio that was able to run local AI models and I could just dump footage onto it and overnight it would edit the footage into what is at least a rough cut. And so then our editors just get the rough cut that they can then finalize. That would be absolutely freaking bananas. But for now, I feel like this is a good final test of today's learning project to learn how to do AI video editing in a day. And here we go.

42:18 Boss battle. If you're a brand doing creator marketing, you will know that it's a total nightmare. Either you pay loads of money to an agency and wait ages for content, or your own team gets stuck doing everything, finding the creators, DMing them, negotiating with them, doing the invoices, writing briefs, contracts, like all of that stuff. Creator Grit started as our in-house tool for dealing with all this f. But then loads of brands told us they love the idea. And so we spun it out. Now we run your creator campaigns end to end. Whether it's UGC for ads or whether you want organic views on content, you just have to do two things. Firstly, you just approve the creators that you want to work with that we give to you. And secondly, you approve the content that they produce. Everything else is handled by us, our team, and our platform.

42:52 There's no retainer, there's no subscription, and you only pay for the content you approve or the organic views that that content gets. We're currently working with a bunch of big brands, and we have over 10,000 creators on the platform just waiting to work with you. So, if you'd like to try creator marketing without the chaos, please do get in touch, tell us what you're after, and we will just send you creators that might be a good fit. It costs you absolutely nothing to find out. Nice.

43:12 That is really good. It's background music is a little bit egregious. A few of the sound effects are a little bit like there's a couple of flash frames where I got things a little bit wrong, but like holy moly, this is like 97% there. Okay, now this was hyperframes. Let's check out Remotion. If you're a brand doing creator marketing, you will know that it's a total nightmare. Either you pay loads of money to an agency and wait ages for content, or your own team gets stuck doing everything, finding the creators, DMing them, negotiating with them, doing the invoices, writing briefs, contracts, like all of that stuff. Creative Grit started as our in-house tool for dealing with all this f. for them. Loads of brands told us they love the idea and so we spun it out. Now we run your creator campaigns end to end. Whether it's UGC for ads or whether you want organic views on content, you just have to do two things.

43:54 Firstly, you just approve the creators that you want to work with that we give to you. And secondly, you approve the content that they produce. Everything else is handled by us, our team, and our platform. There's no retainer. There's no subscription and you only pay for the content you approve or the organic views that that content gets. We're currently working with a bunch of big brands and we have over 10,000 creators on the platform just waiting to work with you.

44:12 If you'd like to try creator marketing without the chaos, please do get in touch. Tell us what you're after and we will just send you creators that might be a good fit. It costs you absolutely nothing to find out. Wow, that is also not bad. That is also pretty solid. This AI editing thing, holy moly. Do you want to check out what I've been cooking all day? >> Yes. Is it filming? >> It's it's it's filming. If you're a brand doing creator marketing, you know, it's a total nightmare. Either you pay loads of money to an agency and wait ages for content, or your own team gets stuck doing everything, finding the creators, DMing them, negotiating with them. I mean, these look quite contracts, like all of that stuff.

44:43 Creator Grid started as our in-house tool for dealing with all this fat, but then loads of brands told us they love the idea. We spun it out. Now, we run your creator campaigns end to end. Whether it's UGC for ads or whether you want organic music, you just have to do two things. Firstly, you just approve the creators that you want to work with that we give to you. And secondly, you approve the content that they produce.

45:00 Everything else is handled by us, our team, and our platform. >> Was this one shoted? >> No, of course not. >> Okay. >> About 20 shoted. >> I was going to say like this is like this is really good. That's very good. >> So, if we scroll like this is how much back and forth it was. >> Okay. >> So, it's it's it's not a huge amount like and if we look at the amount of words of you know I'm mostly just giving it minor prompts here and there.

45:20 >> Yeah. And it's mostly just sort of >> and it's mostly just like doing stuff >> doing stuff. Video editors are cooked >> except our guys of course. >> Our guys are great. >> Except our guys of course. >> Yeah. Our guys are using this using this a lot. I saw partit part was also very good. >> Yeah. better than this stuff but nice. >> I think human plus AI is the that's >> the sweet spot.

45:37 >> It's the sweet spot right now. Yeah. >> Now, I said at the start of the day that I would be happy with the AI getting to 80% as good as our human editors. By the end of the day, I reckon we got it to about 97%, especially on the motion graphics front. It took about 6 hours from start to finish, and it didn't cost anything on top of my Claude subscription. And now that I've done this once, I've firstly got all of the code that Claude generated, and so it'd be easier to do it again. But more importantly, I have more of a mental model for exactly how AI video editing works. I feel like I I have I've unlocked a part of my brain that's now able to think of more ways to use this miraculous technology for loads of other things in the business. Just going to be really fun. And what's flabbergasting is that this is the worst it is ever going to be. It only gets better from here.

46:23 Now, if you've gotten to this point in the video and you enjoyed it, you might like to check out my video right over here where I talk about tips for using AI to learn anything super fast. That'll be right over there. Thank you so much for watching and I'll see

Summary

The video chronicles an experiment where the creator attempts to use AI tools for video editing, comparing them to traditional human editing methods. The goal is to see if AI can produce a launch video for their platform, Creator Grid, that matches the quality of their skilled human editors. After a day of trial and error, the creator finds that while AI can achieve impressive results, it still requires manual input for refinement and storytelling.

- The creator is skeptical about AI's ability to edit videos compared to skilled human editors.
- They break down the video editing process into key components: A-cut, B-roll, animations, sound design, and storytelling.
- Three AI tools are explored: Da Vinci Resolve, Hyperframes, and Remotion, each with different capabilities.
- Initial attempts with AI yield mixed results, particularly struggling with the A-cut and timing.
- The creator learns to treat AI like a human editor, providing clear instructions and manageable tasks.
- They discover the importance of scripting concise video content for better AI output.
- The final results show AI achieving around 97% of the quality of human editing, particularly in motion graphics.
- The creator concludes that AI video editing will continue to improve and can significantly enhance the editing process when combined with human oversight.

Questions Answered

How does AI video editing compare to human editing?

The speaker expresses skepticism about AI video editing but decides to experiment with it during a public holiday. They aim to see if AI can produce a video that is close to the quality of a human editor, hoping for at least 80% effectiveness.

What challenges arise when starting with a new video editing software?

The speaker finds Da Vinci Resolve intimidating at first but decides to set up AI assistance to help navigate the software. They express curiosity about how the AI will assist them in the editing process.

What are the initial impressions of the AI-generated video?

The speaker reviews the first AI-generated video and finds it somewhat amusing but acknowledges it needs significant refinement. They plan to improve the output after a lunch break.

What is the significance of motion plates in video editing?

The speaker realizes that creating motion plates is crucial for the editing process, allowing for easier integration of A-roll and B-roll footage. They express satisfaction with the AI's capabilities in generating these elements.

How does the speaker evaluate the final output of the AI editing process?

The speaker assesses the final cut of the video, noting that while it is not perfect, it shows promise. They reflect on the challenges of creator marketing and how their tool, Creator Grid, addresses these issues.

© transcribe · For agents Built with care and craft by Gokul Rajaram