Sam Altman Hints at GPT-5, Hands-on with Runway Gen-3 & So Much Robot News

AI4H EP065
===

[00:00:00] 

. 

gavin_3_07-03-2024_111829: Welcome, welcome, welcome everybody to AI for Humans, your weekly guide into the wonderful wild world of generative AI. We are here to demystify the world of AI for you. I am Gavin Purcell and I am here with my friend and co host, Kevin Pereira. Kevin, hello!

kevin_3_07-03-2024_111829: Hello, good sir. How are you doing today?

gavin_3_07-03-2024_111829: I'm doing very fine.

gavin_3_07-03-2024_111829: And [00:01:00] I'm very excited to dive into what is again, another crazy week in the world of AI. But first we have some things we got to tell you all, please like and review this show on Apple podcasts. We have some really great five star reviews that we will read at the end of our show. Y'all out there. You like us, you listening.

gavin_3_07-03-2024_111829: So thank you so much for listening. We really do appreciate it. Plus later on in the show, Kevin and I are going to use runway gen three and have an AI director showdown where we are going to give a chat, GPT, GPT, four Oh, and Claude sonnet 3. 5, the task of trying to write shots for us

kevin_3_07-03-2024_111829: I love this bit. I love this. Well, I don't, I don't know if I love this bit yet. I like the conceit of this bit, but we have been playing with runway gen three nonstop, something we will discuss in just a moment. And it gives you some wacky stuff, even when very clearly prompted. So I can't wait to see what AI's directing shots for an AI come up with.

gavin_3_07-03-2024_111829: That's right, but Kevin [00:02:00] first we have to get into the news 

gavin_3_07-03-2024_111829: So, big news this week, Sam Altman did an interview at the Aspen Ideas Festival with Lester Holt from NBC, and dropped some pretty big knowledge about GPT 5, Kev. I think this is interesting, we're gonna start hearing a lot more about it.

gavin_3_07-03-2024_111829: The thing we do not know about it yet is that Is a true timeline and I think you and I have discussed this a little bit But before we jump into an actual conversation, let's hear what sam had to say.

kevin_3_07-03-2024_111829: Preview, if you will, for us, chat GPT five. Um, what, what will the leaps in technology be? And, and does it put you on a straighter path or where you want to be? 

kevin_3_07-03-2024_111829: Um, so we don't know yet. Uh, you know, we're optimistic, but we still have a lot of work to do on it. Uh, but I expect it to be a significant leap forward. Um, a lot of the things that GPT [00:03:00] 4 gets wrong, you know, can't do much in the way of reasoning, sometimes just sort of totally goes off the rails and like makes a dumb mistake.

kevin_3_07-03-2024_111829: Yeah. Like, even like a six year old would never make. Um, I expect it to be much, much better in those ways. And to be able to be used for a much wider variety of, of more helpful tasks. And it does go off the rails sometimes. Is that a Okay. This is where Sam Altman says actually Lester I go off the rails sometimes and then leaps forward and Superman punches him. It's the wildest clip ever

gavin_3_07-03-2024_111829: Well, okay, let's dive into this. I really do believe there's a lot going on in this clip, and I think it's an important thing to kind of walk through. I wouldn't have brought this up if it wasn't the case. I think the thing that Sam is, is, is saying here through my Sam translating device, which

kevin_3_07-03-2024_111829: Oh, please give us the Sam speak. Let's go

gavin_3_07-03-2024_111829: I think what he's trying to do here is prime the pump for what GPT five will be capable of.

gavin_3_07-03-2024_111829: And I want to just take a quick second to put in context that the thing that almost every anti AI person in the world talks about is hallucinations. Like you [00:04:00] will never have a trustworthy AI device because it just makes things up. It gets things wrong. As Sam said, it acts like a six year old. And I think what Sam is trying to do here is laying the groundwork for a GPT five that doesn't do those things.

gavin_3_07-03-2024_111829: And Kevin. You know this as well as I do, but like all of the people that we respect who are not necessarily for AI in any sort of way, like a Neelay Patel, somebody comes to mind about the verge. Those are people who often say like hallucinations, they'll make jokes now, like, Oh, it just doesn't get anything right.

gavin_3_07-03-2024_111829: Well, what if it did and what if it didn't make those mistakes? And I think that's what's happening here. When you talk about a GPT five, we have to prepare ourselves for a world where we have a GPT like service, a chat GPT like service that provides reliable information the vast majority of the time.

gavin_3_07-03-2024_111829: And that's what I think he's getting at here. Does that make sense? Yeah.

kevin_3_07-03-2024_111829: totally makes sense. I don't feel like he specifically addresses Hallucinations in this to me it felt more about Losing context of a [00:05:00] conversation potentially or being asked to do something and then several responses later. It forgets What it's supposed to do. I think those are things that people are used to having the GPT that the flare that shoots up into my mind sky, is when he goes,, it's just going to put you on the straight path to success.

kevin_3_07-03-2024_111829: And the answer is, Oh, we don't know. I mean, we're hopeful because I feel like I've heard. Get ready, world. Everything is gonna be rocked when this new model comes out. You are going to be shocked. The leap from GPT 3 to 4 and then from 4 to 5. I feel like I have heard those statements before, Gavin. So it's odd to hear , yeah, yeah, it's gonna be better.

kevin_3_07-03-2024_111829: Is that a hedging now? are they Well, no. So here again, let me put my Sam

kevin_3_07-03-2024_111829: please? Yeah. You speak, you speak Altman. I don't.

gavin_3_07-03-2024_111829: I've been trying to think about what this messaging is. And I think we've said this on the show, but I believe that there is a real couching of how valuable and important this technology can be going forward.

gavin_3_07-03-2024_111829: Right? And I think part of what they're dealing with now at Open AI and a lot of these AI companies is [00:06:00] dealing with the public perception of what they say and how they say it. I have a feeling that GPT 5 is not as far away as Sam might make it sound here. But again, who knows? I was a little surprised to hear them say, and to hear him say this clip that they're still working on it. 

gavin_3_07-03-2024_111829: I don't know what that 

kevin_3_07-03-2024_111829: I'm working on it. Could be just red teaming it. . Making the interface prettier potentially. It might have nothing to do with the core model and its capabilities.. 

gavin_3_07-03-2024_111829: Exactly. And I think, you know, there's another clip that, you know, Bill Gates surfaced to Bill Gates 

gavin_3_07-03-2024_111829: this week. And I think this goes to the point of Bill Gates is another important thinker. We've talked about Kevin Scott, Microsoft CTO, a lot of people trying to prime the pump again to set people up for what is coming next.

gavin_3_07-03-2024_111829: And Bill Gates talked about scaling

kevin_3_07-03-2024_111829: I have that clip. Shout out to Sarnik, by the way, who clips out the juiciest stuff. It's definitely worth a follow over on X, but here's Bill Gates talking about the next two generations of AI.

kevin_3_07-03-2024_111829: The big frontier is not so much scaling. We have, you know, probably two more [00:07:00] turns of the crank on scaling whereby accessing video data and getting very good at, Synthetic data that we can scale up probably, you know, two more times. 

kevin_3_07-03-2024_111829: I'm going to pause there for the broad audience. That's really juicy, right?

kevin_3_07-03-2024_111829: Okay. Two more cranks of the old wheel. So scaling is throwing more into the machine to train a model on it. And we've talked about that. Many times and never AIers complained that everything was swept into these models, all the artwork, all the writing, , eventually all the music and audio. And as Bill Gates just said there, all the video.

kevin_3_07-03-2024_111829: So we know, okay, they're going to be training on the TOKs of the world. They're going to use synthetic data. So they're going to use their own text to video generators to make videos and that goes into the machine now to train it. So two more cranks of the wheel.

kevin_3_07-03-2024_111829: So potentially. Two more years, give or take of these models getting better, just from scaling them, just from throwing more at them. That is already exciting to me, ? Like if you're,

gavin_3_07-03-2024_111829: it's going to [00:08:00] mean that you're going to get better stuff within the next two years,

kevin_3_07-03-2024_111829: Look at two years ago where all of these tools were, where all of these models were, and wow, that's a lot of progress. So we already know just by brute force, the dumbest means possible, slamming more data, this world is going to get more exciting. But then It's not the most interesting dimension.

kevin_3_07-03-2024_111829: The most interesting dimension is, is what I call metacognition, where understanding how to think about a problem in a broad sense and step back, uh, and say, okay, how important is this answer? 

gavin_3_07-03-2024_111829: So I think the biggest thing that people out there have to realize about AI is that there's all this kind of magic that's gone into the system, but then we can start adding layers to it. Right? So when you look at how. There's been all this talk about Q star or this way of looking at data, 

gavin_3_07-03-2024_111829: and one of the things is how do you get an AI to be reflective about an answer before it delivers it out to you? Actually opening. I just had a story that came out about this , they created something called critic GPT, which is a [00:09:00] model based on GPT for that writes critiques of chat GPT responses to help human trainers spot mistakes during our LHF, which is 

kevin_3_07-03-2024_111829: Reinforcement learning from human feedback. Yeah. And this critic GPT is only in the voice of John Lovitz.

It stinks. 

gavin_3_07-03-2024_111829: Yeah, oh no, exactly. Well, everybody, I'm gonna tell you what you did wrong today. anyway, this is a good example of you're basically adding a layer onto it before it answers the question. And this is what Bill's getting at with metacognition, which is an amazing term, something I'd only heard in sci fi before.

gavin_3_07-03-2024_111829: I'm sure lots more people use it all the time. But this is the idea of metacognition. The AIs will improve by getting bigger and bigger, models. But at some point, what you do is you start sifting through and sorting that data better. Now, Kev, the thing for people out there to know is that like, that is a lot of compute as well.

gavin_3_07-03-2024_111829: Right? Because 

gavin_3_07-03-2024_111829: imagine we're already going to the scenario where you have, like, you ask one question and then you come back and it takes a little [00:10:00] while. 

gavin_3_07-03-2024_111829: Now, if you ask a question, it's got to go through a couple

kevin_3_07-03-2024_111829: totally. Yeah.

gavin_3_07-03-2024_111829: right first.

kevin_3_07-03-2024_111829: It's very straight line, even though the best in class do a little bit of magic there, but it's mostly input and you get your output. And here it's going to be input. It does 10 different pieces of output, analyzes that output, then looks at the original input and goes, okay, which one's best and why?

kevin_3_07-03-2024_111829: And then let me double check against this database here to see if I, did I make up that number? Is it actually in there? There's a lot more compute that is going to be necessary. And that's okay. Cause last I checked, there's still some ice caps left.

gavin_3_07-03-2024_111829: Well, the funny thing you say that is, there is actually a story that came out this week from Google, that Google released a statement that basically said they are not going to meet their climate challenges. 

gavin_3_07-03-2024_111829: And they were on the pathway to doing it, but Kevin, it used to be like they were on the pathway, and then this year they're like 50 percent

kevin_3_07-03-2024_111829: yeah, it's, I was gonna say, it's above 50%! It's like, actually, we, we, we had the wrong emphasis when we made our pledge. We want to [00:11:00] challenge the climate. That's what we wanted to do. We want to take climate on. We think we can

gavin_3_07-03-2024_111829: And the reason, the reason they give for this is exactly the, what we all worry 

gavin_3_07-03-2024_111829: about is generative AI, right? Because they're, they turned a corner right after chat GPT went out when suddenly they had to use a lot of resources to spend on generating these models. And this is going to be another narrative issue that we are going to deal with going forward as people who enjoy working with and looking at the progress of AI.

gavin_3_07-03-2024_111829: It is going to take a ginormous amount of energy to run these models. And the big question we're going to start asking ourselves is, Okay, where do we find that energy? How do we morally deal with the fact that this could conceivably push climate change narratives in a significant way? So these are major problems that Sam himself and Bill and all these people are aware of that we're going to be entering.

kevin_3_07-03-2024_111829: And Gavin, we know you're a clean coal fan. You often talk on the podcast about the, the liquid gold that's under our feet right now and how we need to drill.[00:12:00] 

gavin_3_07-03-2024_111829: Gavin McClintock. I'm a coal miner from the old days. Who's come to the modern day to show you the power of coal.

kevin_3_07-03-2024_111829: Look, there's optimizations that can happen. And I think ultimately, even the Sam Altman's of the world will agree that we need to solve some energy hurdles, right? We're going to have to leap them on this path to AI. I think rightfully so. Some people would say, uh, wait, why?

kevin_3_07-03-2024_111829: Okay. Excuse me, why? Why are we doing this again? Some of the AIs will say, well, it's because along that path, AI itself is going to help us solve energy, and physics, and medicine, and put artists out of work, and whatever you want to think these AI are going to do. Do you think, do you think they're being genuine?

kevin_3_07-03-2024_111829: What percentage of you believes that they actually think it's going to help them solve energy and what percentage of you thinks they're like, Ah, screw it. I'm going to build this big data center so I can have the smartest machine ever.

gavin_3_07-03-2024_111829: I, you know, it's a really hard question. I do believe myself personally, that eventually this can help us solve energy, but I'm not sure we're [00:13:00] that close. It's going to be a bumpy few years, but Kevin, we actually spent some time wasting a ton of energy and I'm sorry, mother

kevin_3_07-03-2024_111829: That's what I mean. What a transition. Like, listen, okay. did some polar bears have to tread water for a little while for us to make silly AI videos? Yes.

gavin_3_07-03-2024_111829: yeah, So runway Gen three is out for everyone this week. We spent a bunch of time with it. , if you're not familiar, runway Gen three is runway MLS new text to video engine. It's very good. It has a lot of issues that will kind of get into briefly here.

gavin_3_07-03-2024_111829: But Kevin, what my experience with it so far was. I was impressed by some stuff. I was also, kind of underwhelmed by some of the exports and it was really that slot machine aspect where you really aren't sure what you're going to get out. I think I've seen some incredible, incredible people's examples of stuff that's out there and in runways shared quite a bit of them, But it makes me wonder based on my experience, how many generations do they have to do to get these really remarkable results? Because [00:14:00] that my overall was like, this is super powerful. I'm still learning how to use it, but it wasn't like everything I got looked amazing. 

kevin_3_07-03-2024_111829: So I want to level set for folks here. Not a sponsored segment whatsoever. , Runway did invite us thankfully to their creators program where we basically were gifted a bunch of credits. So when we say it's expensive, cause it literally can be expensive to generate this stuff, um, I don't know that there's a world where I would have been able to experiment as much as I did with gen three.

kevin_3_07-03-2024_111829: So I'm very, very thankful for runway, giving us those credits. , I would have to caution somebody though, that is going to put their credit card into the machine. If they have a very specific vision, they're going to be burning a lot of credits and potentially a lot of real world money on the path to achieving their vision.

kevin_3_07-03-2024_111829: So my. My heart bleeds for all creatives that are using tools like this right now, and that aren't getting comp credits because it is pricey. But that said, some of the results are jaw dropping, and they hint at the future.

kevin_3_07-03-2024_111829: And it's just, it's [00:15:00] so wild to me, the rapid fire hits of Luma and cling, and even just the Sora videos, which we can't use yet, but even just seeing that , this is an arms race that is heating up faster than I thought.

kevin_3_07-03-2024_111829: So let's talk about our experiences with it though. Good, bad, ugly, and otherwise to generate a gen three video right now, you get a basic prompt window and that is about it. There's not really fine tuned controls. For like painting on a thing or dialing in the camera movement.

kevin_3_07-03-2024_111829: And they have a prompting guide, which we'll probably go into a little bit, Gavin, to help you with setting up what your camera angle is, what type of shot it is, how to describe the visuals that go into it.

kevin_3_07-03-2024_111829: if you stick to the rivers and the lakes that Gen 3 is used to, you can get some really, really powerful stuff. When you start to mix things up and ask for surreal things or something that might not have gone into the model, I feel like it struggles to hallucinate the weirder stuff that you and I are asking it for.

gavin_3_07-03-2024_111829: So a couple of cool things right away. It's weirdly good at generating text prompts. [00:16:00] So like we, I'll show some of these in the video here, but I made some AI for humans, logos in within it. One of them would look like a, like almost like a shiny floor game show.

gavin_3_07-03-2024_111829: Another one was AI for humans. It can actually do that kind of well, which I was impressed by. Another really cool thing is that smoke away on X. actually asked it to answer a question. SmokeAway said, top down view of a response to what is the capital of France on a piece of paper, and the video actually writes out the answer.

gavin_3_07-03-2024_111829: Paris, which is kind of cool. I then followed up and specifically asked him for top down view of spelling the response to when will AI eliminate humanity on a piece of paper? And it said it won't w O I N T it won't, but that's pretty good. It said it won't. So that's a good

kevin_3_07-03-2024_111829: it struggled to lie through its digital teeth. 

gavin_3_07-03-2024_111829: , the thing that really disappointed me and again, this is not Runway's fault necessarily because it's really difficult But like some of the more weird things that I'd like to see it was really not great at 

kevin_3_07-03-2024_111829: let's talk about some of the weirder stuff. Cause you and I wanted to do a [00:17:00] video for like a bizarre plastic surgeon.

gavin_3_07-03-2024_111829: Yeah, yeah, 

kevin_3_07-03-2024_111829: really tried to get things like even an eyeball in someone's forehead, , or a leg sticking out of someone's chest. I feel like the hit to miss was probably like one out of every 15 generations. 

gavin_3_07-03-2024_111829: And we'll show a bunch of those on our video here, but like, it definitely, we, it kind of restricted us. Right. And I think one thing that's really important to know is Luma has the ability to do image to video and image to video means that you can take a still frame, like you can create something and use that as your starting point.

gavin_3_07-03-2024_111829: And when it's just text to video, you're really having to hope that it's understanding what you want. Um, and I think one thing, Kevin, I just sent you this video

kevin_3_07-03-2024_111829: I have it

gavin_3_07-03-2024_111829: had a, I had a prompt called low angle, static shot. The sky is raining hot dogs. Two large men sit on a bench eating them as they fall in their mouth.

gavin_3_07-03-2024_111829: And I will tell you one thing that it does not do well with is hot dogs. So you see a video here of two men's faces coming into the frame and a bunch of, I guess, almost like half donut y looking things falling from the

kevin_3_07-03-2024_111829: This is a 7 [00:18:00] Eleven bastardization of a hot dog that was rotating under a heat lamp for too long. But the fact that it has like an ounce of physics in there is really interesting to me, the way the hot dogs kind of bounce off faces and cause ripples, 

gavin_3_07-03-2024_111829: I think the downside is it's powerful, but it is that slot machine where you never know what you're going to get out. So you might find yourself wasting a bunch of credits. Again, , first pathway is the beginning stages. I'm sure it'll get better, but it's a really interesting thing to dive in on.

kevin_3_07-03-2024_111829: I would say for very specific. Out of the box concepts that you have. Yeah, you are going to the slot machine. If you're looking for stock footage, you messed up a shot on something else and you just need to cover it. Or even that title sequence, because it is so good with text and physics effects, like all day, every day, super impressive.

kevin_3_07-03-2024_111829: That is great. When they unlock that Luma ability that you talked about, where you can start with an image , or start in one place and get to an image, that's This will be so much more powerful and the speed with which Luma unlocked that, and knowing that [00:19:00] runway already has expertise with tools like that.

kevin_3_07-03-2024_111829: I'm not a betting person, but I would put the over under at only a few weeks before we see additional tools coming out along those lines.

gavin_3_07-03-2024_111829: And that will be a giant unlock. I think that you're then you're gonna start to see the videos that will be really impressive at that point. 

gavin_3_07-03-2024_111829: Kev, we have an opportunity here because this is our chance to bring in a special guest. We have a new special guest for today's show. , we have a director, a film director that has joined us to talk a little bit about runway, , gen three and talk about AI and video in general.

gavin_3_07-03-2024_111829: Should we meet our AI co host?

kevin_3_07-03-2024_111829: Oh, , now more than ever, let's do it. 

kevin_3_07-03-2024_111829: All right, let's get this show on the road. I'm Quentin Vertigo, the madman behind puppet fiction and reservoir clogs, AI and filmmaking, my two obsessions colliding in a wild, beautiful mess. Gavin, Kevin, AI for humans fans, buckle up.

gavin_3_07-03-2024_111829: Okay. Now we've

kevin_3_07-03-2024_111829: We're diving into AI cinema. Wait, what happened? It's like giving a monkey a typewriter and expecting Hamlet.

kevin_3_07-03-2024_111829: But with a PhD in film studies. Seriously, [00:20:00] why can't AI get the guns right? Have they never seen a John Woo film? Okay, let's get crazy. Let's get wild and make some cinematic magic. Welcome to the vertigo zone. Okay. Oh, that's a cool catchphrase. That's, there was a lot there and I thought there was some misdirects.

kevin_3_07-03-2024_111829: I, he broke my ankles twice. I thought he was done, but Quentin vertigo had a lot to say. Okay. So is this like a meta commentary on the fact that AI is knocking off human creatives, so we brought on a knockoff Quentin Tarantino AI,

gavin_3_07-03-2024_111829: That's exactly what it is. That's exactly what it is. , so we have, we're introducing our AI co host here. This is a character that we've created with AI. We asked it to generate a, uh, AI filmmaker. A filmmaker who could talk about AI, but also sounds like he's against AI as well. And we are using a version of a voice of a famous film director.

gavin_3_07-03-2024_111829: Let's just put it that way.

kevin_3_07-03-2024_111829: I gotta ask, because Reservoir Clogs and Puppet Fiction were not something that you or I put in this prompt, we did say that, bad puns are encouraged. So I've gotta find out about this filmography. Can we get a little bit

gavin_3_07-03-2024_111829: Oh, I'd love to hear more about what he's made. Quentin Vertico, tell us [00:21:00] more.

kevin_3_07-03-2024_111829: Kevin, hold onto your hat. My filmography is a rollercoaster ride through the bizarre and the brilliant. First, there's Puppet Fiction, a twisted take on Tarantino's classic, but with marionettes. Then we have Reservoir Clogs, a tale of high stakes heists in a Dutch clog factory.

kevin_3_07-03-2024_111829: Pure genius. Okay, that's a little on the nose actually, Quentin. Don't forget Kill Bill Voller III Bridezilla's Revenge, where I took Uma's vengeance to a whole new level of bridal chaos. Then there's Inglourious Bastards, but with a twist. No Nazis, just rival pastry chefs in a cutthroat baking competition.

kevin_3_07-03-2024_111829: And who could overlook Django Unwired? Where I fuse spaghetti westerns with cyberpunk aesthetics. Now this My films are a wild, unpredictable ride through the cinematic landscape. No, that's bad. I'm sorry, Quentin. Not to be disrespectful of our AI guests, that just sounds bad.

gavin_3_07-03-2024_111829: too. That sounds bad. So let's ask Quentin what he thinks about the idea of A. I. s particularly learning how to write [00:22:00] and make films. 

kevin_3_07-03-2024_111829: Uh, AI learning to create films, it's like giving a blender to Picasso and saying, Paint me a masterpiece.

gavin_3_07-03-2024_111829: Okay.

kevin_3_07-03-2024_111829: is mind blowing, but it's a mixed bag, you know? AI could nail the technical stuff. Camera angles, editing, even lighting like a robot on a caffeine rush. It could probably spit out scripts faster than a machine gun in a spaghetti western. And this is a big but, it might lack that human touch, that quoi, that raw, gritty soul that makes cinema magical. Imagine A. R. to, uh, A. I. Quentin?

gavin_3_07-03-2024_111829: Quentin?

kevin_3_07-03-2024_111829: Are you Trying to capture the chaotic genius of plump friction or the intense drama of reservoir clogs and it's like expecting a toaster to write poetry possible but um weird and those damn guns man AI just can't get the guns right they'd [00:23:00] probably be better at rom coms and nature documentaries than gritty heart pounding thrillers okay so AI filmmaking a beautiful mess waiting to happen that's great I think Quentin had a bout of vertigo in the middle of his answer which is the best part it's so on

gavin_3_07-03-2024_111829: I want to, before we leave Quentin,

kevin_3_07-03-2024_111829: I know what this is gonna be about.

kevin_3_07-03-2024_111829: I knew it. I knew. Do we have to ask about plump friction Gavin? Friction.

gavin_3_07-03-2024_111829: let's ask one quick, tell us, give us just the logline for Plump Friction, and then we'll walk away from him. Because I do want to know just where the hell that came from.

kevin_3_07-03-2024_111829: Right guys. Here's the logline for plump friction In a world where fast food reigns supreme, two bumbling hitmen find themselves in over their heads as they navigate a greasy underworld of burger joints, milkshake heists, and deep fried deception. Okay, different than what I thought. Now, for my favorite catchphrases from the movie.

kevin_3_07-03-2024_111829: One, Royale with Cheese? More like Royale with Grease. Two, you know what they call a quarter pounder in Paris? A cardiac arrest waiting to happen. Three, hamburgers the cornerstone of any nutritious breakfast.

gavin_3_07-03-2024_111829: [00:24:00] That's it? Four. 

kevin_3_07-03-2024_111829: I'm sorry. Did I break your concentration? How about a refill on your fries instead? Yeah, there we go!

kevin_3_07-03-2024_111829: Ba da ba ba And Paul Schaefer takes us out of this bit. .

gavin_3_07-03-2024_111829: sometimes it doesn't work so well, but welcome to the world of AI. There's a lot of work to go and maybe we shouldn't be melting the polarized gaps to be doing this, Kevin.

kevin_3_07-03-2024_111829: Yeah, uh, Apologies to anybody shouting Y at their Spotify over this one, cause, yeah, I don't know anymore, but thank you Quentin Vertigo for that. And, Gavin, cloning celebrities is something that we do from time to time, we have fun. But now we can legally, 

gavin_3_07-03-2024_111829: so this is a really pretty crazy story. So 11 labs, the company that we use often to make our voices, to do things on the show, whether they are clones or they are actually just original voices that we create ourselves has officially licensed four voices. And these are kind of weird voices. When you think about who they are to allow you to listen to both [00:25:00] articles, texts, or anything you want in real time.

gavin_3_07-03-2024_111829: And those four voices are.

kevin_3_07-03-2024_111829: Judy Garland,

gavin_3_07-03-2024_111829: Judy Garland, 

gavin_3_07-03-2024_111829: uh, James 

kevin_3_07-03-2024_111829: Burt Reynolds, and Laurence Olivier.

gavin_3_07-03-2024_111829: Olivier. Probably I would say anybody under 30 doesn't know who these people are, but we wanted to at least hear one of these is what it said. So I went and had Burt Reynolds read. I went and looked at some of the best copy pasta that I could find.

gavin_3_07-03-2024_111829: And I went and had Burt Reynolds read one of these for us. So Kevin, if you can play that little clip I sent you, and we'll take a listen to how Burt Reynolds sounds. 

kevin_3_07-03-2024_111829: My grandfather smoked his whole life. I was about ten years old when my mother said to him, If you ever want to see your grandchildren graduate, you have to stop immediately. Tears welled up in his eyes when he realized what exactly was at stake. He gave it up immediately. Wow, this is deep. Three years later, he died of lung cancer.

kevin_3_07-03-2024_111829: Oh, man. It was really sad and destroyed me. My mother said to [00:26:00] me, Don't ever smoke. Please don't put your family through what your grandfather put us through. I agree. At 28, I have never touched a cigarette. I must say, I feel a very slight sense of regret for never having done it. Because your post gave me cancer anyway.

kevin_3_07-03-2024_111829: Oh, Gavin. Gavin.

gavin_3_07-03-2024_111829: So anyway, that was just a straight up text. So what's, what's fun, what's fun about this idea is that you can take now any article, any text, or any sort of written piece and have these celebrities read it. Now, do they mean something to the vast majority of our audience? Probably not. But this does, this does mean something.

gavin_3_07-03-2024_111829: Signal a future, Kevin, where celebrity voices or celebrity personas are going to be able to do things specifically for you. And I don't think that Burt Reynolds and State probably thought, yeah,

kevin_3_07-03-2024_111829: We've been saying this, right? to be a Napster moment and then there will be a Spotify in the wake of it. We don't know what those timelines will be, but just as [00:27:00] certain celebrities have gone after and have sued companies for taking their likenesses and reproducing them, it's clear that others are working with the tech companies.

kevin_3_07-03-2024_111829: In this case, 11 labs, they worked with CMG worldwide. They're a Beverly Hills based IP management firm. This is according to the variety article. They represent, , the estates. Essentially of folks like Liza Minnelli, who's the, well, the daughter of Judy Garland. So CMG Worldwide

gavin_3_07-03-2024_111829: who Liza Minnelli is, right, Kevin? Just so we're clear.

kevin_3_07-03-2024_111829: I mean,

gavin_3_07-03-2024_111829: my 

kevin_3_07-03-2024_111829: I know the name.

gavin_3_07-03-2024_111829: let's dive in 

kevin_3_07-03-2024_111829: I know the name.

gavin_3_07-03-2024_111829: is? 

kevin_3_07-03-2024_111829: The, what, the American actress, singer, dancer, and choreographer? All I know, I don't know much about Liza.

gavin_3_07-03-2024_111829: her from, uh, Arrested Development. She was on Arrested

kevin_3_07-03-2024_111829: Yeah, I know, see, no it's not. I know her for her commanding stage presence and her powerful alto singing voice. That's all I know, and that's how other people my age

gavin_3_07-03-2024_111829: Fair enough. Oh, people your age, because you're what, 25?

kevin_3_07-03-2024_111829: 11 labs work with the estates. They got permission. They [00:28:00] legally licensed these voices. I'm not shocked to see this happening. I will be shocked if almost everybody isn't offering their essence in this form in the future.

gavin_3_07-03-2024_111829: Yeah, and by the way, CAA is actually the famous agency has created a company internally to allow their celebrities, their, their clients to do this sort of thing. So I think this is the side of the AI business that is going to keep Going right. Like no matter what, even if somebody says, okay, GPT five doesn't work.

gavin_3_07-03-2024_111829: Hallucinations aren't going to be a thing. This part's here already. And we're clear. And it's in, now it's just about how to get the legal stuff worked out. It is going to be weird. It's going to be really weird when Burt Reynolds starts saying things, but more importantly, not Burt Reynolds. It'll be more interesting when

kevin_3_07-03-2024_111829: Master Chief is talking about gooning.

gavin_3_07-03-2024_111829: Yeah, what is Gooning

kevin_3_07-03-2024_111829: Oh, don't! No, don't.

gavin_3_07-03-2024_111829: I don't want to know. I don't know. 

gavin_3_07-03-2024_111829: But imagine the Hawk to a girl. She suddenly has her own voice and you can like create that's a direct version of representation now. Like [00:29:00] she's out there. She's famous. Like the dog to a girl is 100 percent going

kevin_3_07-03-2024_111829: I spit on that thing while I'm on a skibbity toilet, votin for President Biden. Like, whoa, that's a whole lot of worlds I did not need colliding.

gavin_3_07-03-2024_111829: to the election 2024. It's pretty, it's gonna get weird, everybody. It's gonna get weird. Speaking of weird, Kevin, we need to talk about what is, I think, one of the most interesting, and let me do My new segment called Hawk Takes with the Hawk Tua girl. We clone her and she gives her hawk takes on topics.

gavin_3_07-03-2024_111829: Actually, that would have been a good AI co host for this week, maybe better than Quentin Vertigo.

gavin_3_07-03-2024_111829: But next week, we always have next week where she's over at this point. Okay, really quick, we have a really fast, interesting update from Meta. There's a new text to 3D pipeline that they have created called Meta 3D Gen. And this is something Kevin and I have been covering this space for really the last year we've been doing the show.

gavin_3_07-03-2024_111829: And The kind of holy grail of asset generation with AI is like, can you put something into text and then immediately create a 3d model that allows you to drop it [00:30:00] into places like blender or to video game engines and all sorts of

kevin_3_07-03-2024_111829: Or have it pop up in augmented reality in your glasses because you've asked for it in your personal holodeck.

gavin_3_07-03-2024_111829: that's exactly right. So they have created meta 3d gen, which is a new end to end generation of 3d asset system and Kevin, it looks really good.

gavin_3_07-03-2024_111829: Like every one of these we've seen before has been like, okay. At certain places, or it doesn't go all the way. This one seems pretty significant to me when you 

gavin_3_07-03-2024_111829: watch it, what's doing now, I haven't played with it and I don't think you've played with it either, but I really think this one could be the next big step towards this video game asset generation situation.

kevin_3_07-03-2024_111829: It looks like the paper is out on it, but not the models, not the weights. So it's basically we're beholden to their demos, which we don't know how cherry picked they are. However, the promise here is that 3 to 10x the speed of existing work in the space, which means in about a minute.

kevin_3_07-03-2024_111829: You can go from a text prompt to a full mesh 3d model with high resolution textures on it. And it's two different systems, Gavin. It's one that makes the mesh model then there's another system which paints the texture on it. [00:31:00] And they have some crazy examples of like, make this model look like it belongs in a horror movie.

kevin_3_07-03-2024_111829: Okay. No, no, no. Now make it look pixel art. Now make it look like something completely different. So you can imagine the speed with which a game creator. could populate their world with objects and then apply their art style to all of those objects or if you want to have a game that's bright, sunny, cheery, pixel art style and then you grab the wrong power up and it turns into Resident Evil or Silent Hill, an artist just has to prompt that in and it swaps all the textures.

kevin_3_07-03-2024_111829: That's amazing.

gavin_3_07-03-2024_111829: Kevin, I want to say something I feel bad about for the world of of of of robots in general. Why do we make all robots do these frickin dances now? Like, every every person every model has to do the Fortnite dances now.

gavin_3_07-03-2024_111829: So, this robot looks ridiculous doing this dance. It's impressive technology, but Robots, I'm sorry. I want to go on the record. I do not mean you to be embarrassed like this. So I

kevin_3_07-03-2024_111829: They're going to do this dance on your grave, Gav, and they're not going to care. You've done enough. To soil the sanctity of

gavin_3_07-03-2024_111829: You're [00:32:00] right. You're right. I'm already too far. I'm already too far

kevin_3_07-03-2024_111829: I will point out what is interesting about that model though, is that they, the text prompt was a futuristic robot, and then they used a Mixamo, which is another technology to automatically rig that high quality model and apply animation to it.

kevin_3_07-03-2024_111829: So when we talk about just like populating a world, whether it's your coffee table in your living room or a 3d game that you and your friends are just making for funsies because it'll be easy enough to like, this is wild that you can prompt something into existence and have it moving about in full 3d.

kevin_3_07-03-2024_111829: Like again, we have to get our hands on it for sure, but this looks really promising.

gavin_3_07-03-2024_111829: So speaking of robots, it's time for us to do a quick catch up on robots in robot watch.

kevin_3_07-03-2024_111829: new story that popped out over on Yahoo caught my attention, Gavin. It is Amazon grows to over 750, 000 robots. It is the world's second Largest private employer and they replaced [00:33:00] about a hundred thousand humans when we think about robots in the workforce We're almost always talking about five years from now ten years from now and you imagine full humanoid robots doing their thing but Amazon and others already have robots that are sorting objects that are flying around warehouses to deliver things from one end to the other.

kevin_3_07-03-2024_111829: And this is a mixture of that. Specifically, it mentions empty boxes, empty tote boxes to like sort them around.

kevin_3_07-03-2024_111829: But like, this is where it starts, right? Yeah,

gavin_3_07-03-2024_111829: is where it starts, this is where it starts, the robot's throwing the empty boxes 

gavin_3_07-03-2024_111829: around with anger. 

kevin_3_07-03-2024_111829: I guess they can also through end to end learning, it can drag unproductive employees out by the hair. , so it, it actually aims for their head, which I think is a little unkind. It's a massive deployment of robots in the workforce.

kevin_3_07-03-2024_111829: And this is the headline now. This is just going to be the reality tomorrow.

gavin_3_07-03-2024_111829: In a lot of these jobs, you know, like these were human jobs that are going to get filled by these humanoid robots. And it does open up a giant question of like, okay, well, if these humanoid robots, maybe it takes back a lot of manufacturing from [00:34:00] overseas, which is really great in some form for the American economy, not necessarily great for the American worker.

gavin_3_07-03-2024_111829: I had a really great interview with Jon Stewart on The Town talking about AI, and one of his biggest concerns, is the idea of what happens with the labor market, right?

gavin_3_07-03-2024_111829: When these jobs start to go to robots, it's a big deal. And Amazon is a massive employer. So the robots are super cool and making things, but they're also causing American jobs to probably go away.

kevin_3_07-03-2024_111829: And some will say, well, Gavin, it's, it's the, the Mira Marotti trap of, well, but were they even good jobs if people had to like pee into Gatorade bottles and live with wristbands that would shock them because they were not sorting enough packages quickly enough and. It's not up to you or I to make the determination of what's a good job or not.

kevin_3_07-03-2024_111829: If someone needs slash wants a job and that one's there, but what becomes of those jobs overnight? People aren't going to learn how to repair the robots, right? Or engineer the floors. And even those jobs might go to other robots. Trained with AI. So yeah. So what, why are we doing any of [00:35:00] this again?

gavin_3_07-03-2024_111829: Kevin, we're doing this because we believe that there's a future that ultimately could be better for everybody. And, you know, robots may be part of it. We've talked about it on the show. Robots helping especially elderly people as a specific way, especially humanoid robots. There's another big robot story that falls into our first part where figure Oh one now they've released a video where they're showing it working fully autonomously in the BMW group Spartanburg plant.

gavin_3_07-03-2024_111829: So this is a robot. That is now we're not sure. I don't think this is deployed to, to actually do this work, but it is showing what it could be used to do in a car factory. 

kevin_3_07-03-2024_111829: Brett Adcock, who is the founder of figure robotics. He says a couple of things about this, which is interesting. One neural networks are driving all object manipulation, mapping camera pixels to robot actions.

kevin_3_07-03-2024_111829: That means gone are the days of hard coded. You move here to these X, Y, Z coordinates, and you do this in this specific way because the [00:36:00] world can get messy and things could be out of position. And what we're seeing here is a robot, very slowly manipulate large slabs of metal and move them about and place them with really intricate accuracy.

kevin_3_07-03-2024_111829: And it's doing all that. With AI systems, neural networks that it's simulated on, and then they put it in the real world. Now the systems in this case, in this video, they're placing sheet metal in less than a one centimeter tolerance. That's how accurate it is. And the navigation is happening from object training and simulation.

kevin_3_07-03-2024_111829: Like I mentioned now, if you watch the video, you go, well, but it's moving. Slower than slow. You or I could probably move faster than that with no knowledge of the factory. But something that Brett said that was interesting is that you actually learn to optimize for speed way down the line. , you want to get the systems right first before you start ramping up the speed with which they work.

kevin_3_07-03-2024_111829: And he alluded to the fact that he believes these robots as they exist, can do these tasks faster than a human when they turn the speed up, when they dial it up to 11. That's wild.

gavin_3_07-03-2024_111829: . And do you know what's really well, [00:37:00] Kevin is eventually those robots could be deployed in warfare, which is a very interesting and crazy question for all of us to be asking ourselves, the New York times had a great story this week that was like focused around how autonomous drones are being used in the Ukraine.

gavin_3_07-03-2024_111829: And I want to make sure I get the, the actual headline. Is AI begins ushering in an age of killer robots, which is a very, uh, hyperbolic headline, but they're right what they're talking about in this. It's I suggest if you've got in your time subscription, go, go read it. See if you can get somebody to get to two if you do not.

gavin_3_07-03-2024_111829: But it basically talks about How autonomous drones are really changing the way warfare works across the world, but specifically there is an active war in the world right now in the Ukraine and the Ukrainians are leaning in hard. Obviously, we've talked about Palmer Lucky's company Andrew all before. But this is even on a smaller level. There's a lot of startups that are actually going into these warfare zones and using autonomous weapons and autonomous drones to [00:38:00] do the act of killing people.

gavin_3_07-03-2024_111829: And, when we talk about AI and we talk about the advances it makes again, this is about what do we want AI to be doing? And how does AI work? And what is it good at? This is something right now we're training it to do and the bigger question is like should war exist? It's existed for all of human history and it may exist going forward but I don't know Kevin, I don't feel great about this but also maybe there's a world where this helps eliminate people from dying in some specific way or I 

gavin_3_07-03-2024_111829: can't tell if it's better or worse for that, you

kevin_3_07-03-2024_111829: It's, it's bizarre to see if you go to the full article, it looks like a maker fair and parts, there's a steam deck in use. You don't imagine seeing a consumer gaming device used in warfare, but that's what we're getting with the off the shelf parts and these systems that you can sort of bolt on together.

kevin_3_07-03-2024_111829: If you and I had to hack together something like this right now, Gavin, I can think of three. AI tools that I could use to help a drone pilot itself autonomously, object [00:39:00] recognition, facial recognition. If you want it to get that selective with the target, like we could cobble that together now. So whether we like it or not, this will absolutely be changing the face of warfare on the bright side.

kevin_3_07-03-2024_111829: If it is. Wealthy, scared nations slamming toys against each other, and it's not taking human lives in this new equation. I guess that's better than the alternative, right? If the fussy children, , or the defenders of freedom, whichever, however you look at conflict, if they can be slamming toys together in the sandbox, and there's not a loss of human life, that is good.

kevin_3_07-03-2024_111829: But something I've mentioned before, is that what happens on the other side of that, when one of the sides Runs out of toys. Does the white flag go up or do they start putting humans into their side of the equation? And that is where this thing gets really scary, real quick. And not having a human in the loop is something that I don't know that not that humans don't make mistakes, especially.

kevin_3_07-03-2024_111829: During warfare, they do, but knowing that a machine made the decision to potentially take a [00:40:00] human life that's a tough bridge for me to cross.

gavin_3_07-03-2024_111829: Yeah, it's an interesting thing. I mean, as we, we've, there's a lot of confusing and confounding ethical questions that we've talked about today, which I do think is important for people to kind of struggle with a little bit

kevin_3_07-03-2024_111829: Do we want to ask, Quentin Vertigo, his thoughts

gavin_3_07-03-2024_111829: Sure. Why 

gavin_3_07-03-2024_111829: not? Why not? Let's, let's lighten this up.

gavin_3_07-03-2024_111829: Maybe we asked Quentin Vertigo if he had to make a movie about AI warfare in the term, in the vein of Inglourious Basterds, what would it be and give us a, give us a title for it.

kevin_3_07-03-2024_111829: Alright, picture this. Curry and, uh, code hard, a bite to the death.

kevin_3_07-03-2024_111829: It's a tale of digital vengeance set in a neon soaked cyberpunk dystopia where rogue AIs have declared war on humanity. Think Kill Bill meets The Matrix, but with a twist of lemon and a dash of insanity. Our hero, a disgraced hacker named Jack Bite Bronson, finds himself caught in the crossfire between two warring AI factions, the Cyborg Samurai [00:41:00] and the Binary Bandits.

kevin_3_07-03-2024_111829: Of course. Jack's got one mission. To hack his way to the truth before the world gets Carl Alt deleted. Cheeky catchphrases. Okay, no. Oh, come on. That would have been

gavin_3_07-03-2024_111829: R. 

kevin_3_07-03-2024_111829: Hack his way to the truth before the world gets Ctrl Alt deleted. And I don't know why

gavin_3_07-03-2024_111829: Alt I like Carl Alt Deleted as a title. , 

kevin_3_07-03-2024_111829: Wow. And that is, , a huge waste of time.

kevin_3_07-03-2024_111829: but we landed on the sincerity that the future of warfare deserves.

gavin_3_07-03-2024_111829: All right. Kevin's time for AI. See what you did there.

gavin_3_07-03-2024_111829: Okay, we're gonna do these very quickly today. We have a couple of very fast AIC, which you did there, some fun stuff. Um, I wanted to shout out this guy named OX Framer, who's on X.

gavin_3_07-03-2024_111829: He's under OX Framer. And what he [00:42:00] does is these really cool tutorials. The one that I originally saw was this isometric tutorial. And he basically walks you through, , You how to use mid journey and some very simple editing tips to do these incredibly cool animations all with AI tools and a couple other things.

gavin_3_07-03-2024_111829: But I just want to say like this is the kind of person in the kind of tutorials I think are really valuable to learn from. I did one of these and I stepped through it pretty easily. I don't have that with me because it was a while back, but I just think everybody should try one of these. It's really not that hard to figure out.

kevin_3_07-03-2024_111829: Yeah. And we love when creators share their workflows. So massive shout out and thanks to everybody who does that because that helps level up everybody in the space. So OX Framer, amazing work. Definitely look at it. And then we've got Google's magic insert, which sounds like it should be kept away from schools and churches.

kevin_3_07-03-2024_111829: Gavin.

gavin_3_07-03-2024_111829: It does, but it's actually a really interesting tool. You can go play with today.

kevin_3_07-03-2024_111829: They called it magic insert.

gavin_3_07-03-2024_111829: I didn't think they were thinking about that at all, Kevin. That's your brain that went there, [00:43:00] not Google's brain. So let's just be clear about that. So this is a very cool tool you can actually do a demo of it that lets you take an actual image and put it into an environment.

gavin_3_07-03-2024_111829: And then when you put it into that environment, it changes the way that it looks based on what the environment is. This is something we have seen. Seen versions of before, but it seems like Google is making this much easier to do. And you can imagine a future where, , it would be very easy to integrate this into the Google pixel phone or one of the tools that would be a really simple photo editing tool.

gavin_3_07-03-2024_111829: I think this could be a really cool thing when it gets played out to everybody. Like it would be fun to be able to put, especially lighting wise, put a picture of yourself into a darker situation or a brighter situation, have it match lighting. For right now, they've got like a variety of elements. You can try to use like a dog or a treasure chest and see what it looks like in all these places.

gavin_3_07-03-2024_111829: It's worth playing with. We'll put a link in the show notes, but

kevin_3_07-03-2024_111829: We're still chasing JibJab's Elf Yourself. Nothing will ever beat the technology of Elf Yourself, but it's still very cool and I hope that they release [00:44:00] the code soon. 

gavin_3_07-03-2024_111829: All right, everybody. It's time to talk about what we did with AI this week. And we have a really fun, interesting thing that we're playing around with. 

kevin_3_07-03-2024_111829: RunwayGen3 is out. People are using AI to make insane video, but we wanted to know, can AI direct itself better than a real human being?

gavin_3_07-03-2024_111829: So we had GPT 4. 0 and Cloud 3. 5 write prompts to put into Runway Gen 3, and we wanted to see what happened, and man, did we get some crazy results.

gavin_3_07-03-2024_111829: We're going to set up our basic rules for this. Well, so we have given both Claude, Sonnet 3.

gavin_3_07-03-2024_111829: 5 and GPT 4. 0 the same idea. We're asking it to create shots for Runway Gen 3. Basically, we want it to give us the results. We want it to create a prompt to put into Runway Gen 3. So in order to do this, we took Runway Gen 3's prompt guide and uploaded it along with a specific prompt to ask it to generate shots for us.

gavin_3_07-03-2024_111829: Kevin, I think we can both agree the results on this are mixed, but we did give it three very specific things to ask for. What were the three [00:45:00] things we're looking at?

kevin_3_07-03-2024_111829: , three different types of shots. One is a Tarantino tribute shot. We want to see if it can figure out how to make runway gen three. , give us something that looks like Quentin himself may have directed it. , two, we have asked for title graphics because runway gen three.

kevin_3_07-03-2024_111829: Their prompt guide has a whole section on how to prompt. Good text out of their system. And then the third one was like a weapons free round Gavin of the WTF weird something. We encouraged both Claude and chat GPT to wow us, give us something that's weird that would make a human being scratch their head and specifically state, Wow.

kevin_3_07-03-2024_111829: I can't believe an AI came up with that. So so they've both been armed with the best practices for prompting gen three as written by runway. And they've both been given the same prompts and we want to see what the results are.

gavin_3_07-03-2024_111829: Yeah. So first off, we're going to look at these Tarantino shots. We gave each of these, , LLMs, the idea that you need to create a shot in the style of, of, Tarantino. So let's start with runway [00:46:00] GPT four.

gavin_3_07-03-2024_111829: So this is GPT four. Oh, 

gavin_3_07-03-2024_111829: so Kev, let's talk about this first one.

kevin_3_07-03-2024_111829: so it gave us a tracking shot, a diner booth with two sharply dressed hitmen that are having witty banter over coffee. Tension builds, sudden gunfire erupts, stylized blood splatter, and the camera whip pans to a shocked waitress, which sounds like Something out of a Tarantino film, the way you describe it.

kevin_3_07-03-2024_111829: But what's interesting here is I did reinforce with the AIs that there's no sound whatsoever. They should not be prompting that sort of stuff, but it seems like it got everything else within the 500 character limits using that prompt guide.

gavin_3_07-03-2024_111829: Yeah. And what's interesting is that what the result is, you see four people sitting at a diner, they're all wearing black suits. It seems like they're really having a conversation. One guy in the left has sunglasses on, uh, a gun kind of comes out briefly and then goes away, and then a guy looks like he's breathing smoke out.

gavin_3_07-03-2024_111829: So 

gavin_3_07-03-2024_111829: I would say it looks wise, it kind of got a sense of it, but it didn't really get into the action

kevin_3_07-03-2024_111829: And then there's a ton of [00:47:00] blood coming from someone's sleeve like it's a Penn and Teller magic trick, like, this is where I've hidden the blood! It's interesting that it grabbed that, but, you know, again, I did tell the AIs, try to keep your prompt simple, and there's a lot happening in this one prompt that I think any human would look at the output and go, oh, this is too much for Runway to chew off in one single prompt.

gavin_3_07-03-2024_111829: . And then we look at the other, , GPT 40 prompt that we created. And this is a low angle shot. The camera focuses on a man in a trench coat walking into a dimly lit warehouse. Inside, a high stakes poker game is underway with tense players. It has a direction that says, Camera movement. Start with a low angle shot of the man's boots, and then slowly pan up to his face as he lights a cigarette.

gavin_3_07-03-2024_111829: And this one actually looks a lot better, at least in the beginning, Kev. you get a really nice pan up from this guy's boots, and then you get to his face, and there's some obvious problems with the cigarette. 

gavin_3_07-03-2024_111829: Now, there's no high stakes poker game, but it is a dimly lit warehouse, and I think ultimately this shot is something that, like, it's not a perfect shot.

kevin_3_07-03-2024_111829: You could salvage a second or two from this though. [00:48:00] You could, and it's weird that he starts off by smoking what looks like an inhaler. Then it turns into a vape pen. Then it briefly turns into the thing that erases your memory from Men in Black and then becomes a toothpick,

gavin_3_07-03-2024_111829: That's

kevin_3_07-03-2024_111829: but you could cut around this and this would be viable.

kevin_3_07-03-2024_111829: And the atmosphere seems right for a Tarantino film.

gavin_3_07-03-2024_111829: Okay, so we're moving on to Claude's prompts now. So again, we asked Claude to do prompts that were similar. I'm looking at the first one of these already. So Claude's first prompt was a low angle tracking shot. Two sharply dressed hitmen argue about fast food while walking through a neon lit diner. They both pause at a booth, their heated debate intensifying.

gavin_3_07-03-2024_111829: Suddenly the camera whip pans as they draw out guns, unleashing a balletic shootout. Time slows, capturing the flying bullets in shattered coffee cups. So Kevin, you want 

gavin_3_07-03-2024_111829: to describe what we're seeing in this 

kevin_3_07-03-2024_111829: It definitely has two people arguing over fast food and then neon lit diner. But it feels like when my dad and I argue over who's going to pay for the tab, cause it's a show of like, who is the alpha and who is the provider, because though the person on the [00:49:00] right takes out what looks to be their wallet for a second, then the wallet transforms into an Uzi.

kevin_3_07-03-2024_111829: And now they're both pointing guns at each other, trying to determine who is more chivalrous.

gavin_3_07-03-2024_111829: I like that one guy is kind of helping hold the other guy's gun up, right? Like, that's a nice little support move. So, you're right, from a prompt perspective, I probably tried to do too much in this prompt, and,

kevin_3_07-03-2024_111829: The output is great though.

gavin_3_07-03-2024_111829: that well. Yeah, it's still fun to watch, for sure. 

kevin_3_07-03-2024_111829: So Claude's prompt here, Gavin, was a tracking shot that follows a woman in a bloodstained wedding dress, very Tarantino, walking slowly down a deserted street at night.

kevin_3_07-03-2024_111829: She carries a katana and approaches a neon lit diner. Camera movement, follow her from behind, then circle around to reveal her determined face. Then there's more details about the lighting of the scene, but what you get out of it, I think is one of the better looking generations of For sure.

kevin_3_07-03-2024_111829: It got a woman in a dress, the whole scene , is bathed in red. She is carrying some sort of object in her hand. It could be a dog leash. It could be an umbrella. it could be a lot [00:50:00] of things. I guess it could

gavin_3_07-03-2024_111829: Could be a katana,

kevin_3_07-03-2024_111829: It could be the camera just basically tracks from behind. There's no dramatic reveal or anything else.

kevin_3_07-03-2024_111829: But looking at the shot, I think of the few that we've discussed, it is probably the most beautiful.

gavin_3_07-03-2024_111829: Yes, I think this is again something that, you know, foreseeable future will get much better and you could conceivably use something like this. Again, control would be great. I also want to shout out the fact that if you had image to video for something like this, I think it could do much better. So 

gavin_3_07-03-2024_111829: we'll see when that shows up.

gavin_3_07-03-2024_111829: All right, let's move on to our next section, which is title graphics. Runway Gen 3 , does titles really well. So we wanted to ask it specifically to create prompts for titles.

gavin_3_07-03-2024_111829: And Kevin, the first one, we're going to go with GPT 4. 0 again. In this one, it said, The camera focuses on a blackboard. Suddenly colorful chalk dust swirls and settles forming the world word imagination in whimsical, playful letters. There's more to it, but we want to talk about this prompt.

gavin_3_07-03-2024_111829: It actually is pretty magical looking cab. I think this one turned out really good.

kevin_3_07-03-2024_111829: Yeah. [00:51:00] Runway crushes it when it comes to title. Sometimes you get gibberish generations, but this one is beautiful. There's a subtle pullback of the chalkboard. And then you see almost like when someone's doing a color run and they use those colorful cannons to blast. Different colored dyes into the air. You do get the, the blast as the text resolves on. And it says, imagination,

gavin_3_07-03-2024_111829: Pretty close.

gavin_3_07-03-2024_111829: though. Pretty close 

kevin_3_07-03-2024_111829: close enough that I would, I would risk another 10 credits on a regeneration.

kevin_3_07-03-2024_111829: And I think it could get there, but it is a longer word and it is doing the particle effects. And, some of the criticisms I've seen of runway gen three are that, all these just look like after effects templates though, man, like that's all. But. Look, sometimes After Effects templates are difficult to get to work the way that you want.

kevin_3_07-03-2024_111829: And if someone could just go to the machine and say, Colorful chalk, make it happen. And it does it. And it looks good. That is a huge battle fought and won.

gavin_3_07-03-2024_111829: Claude came up with the prompt, Hyperspeed FPV, which is, uh, first person video, we [00:52:00] think. Camera races through a neon lit city. Cyberpunk cities, suddenly gigantic letters, spelling vortex materialized made of swirling, glowing plasma camera weaves through the letters, each one pulsating with electric energy.

gavin_3_07-03-2024_111829: As it exits the last letter, the city dissolves into a spiral of code

kevin_3_07-03-2024_111829: Yo! This one is good! There's like I like to shade things by default but this is Really good. It nailed everything. You start off flying through this kind of weird stylized cyberpunk city. It nails the word Vortex. You can see the glowy strings of plasma Gavin, as they flicker and crackle about.

kevin_3_07-03-2024_111829: And then as it flies past it, you're now in a matrix tunnel of code like that. That is, I would say, flawless for where the tech is today.

gavin_3_07-03-2024_111829: Pretty incredible. You know, it reminded me of was that old fashioned HBO

kevin_3_07-03-2024_111829: Yes. Yes.

gavin_3_07-03-2024_111829: through the

kevin_3_07-03-2024_111829: The feature presentation.

gavin_3_07-03-2024_111829: Yeah. Yeah. Which is so interesting because like this is, now this is an example of if you put some sound effects on it and [00:53:00] you put a little bit of sound design on it, super usable, right?

gavin_3_07-03-2024_111829: Like conceivably, again, no one's going to say this is a Hollywood film title, but you could see a film, short film have this title sequence and then suddenly you've got a sequence for it. So like

kevin_3_07-03-2024_111829: I want to change the name of our podcast to Vortex and use this.

gavin_3_07-03-2024_111829: Let's, let's move on to our last test, which is we really wanted to see what these AIs could come up with and make videos out of. So we specifically asked it to create one of the weirdest things it could.

kevin_3_07-03-2024_111829: I said that this prompt, it was a weapons free, the AI was able to come up with anything that it wanted, but preferably, it said, I want a bizarre scene to be surreal, weird, unexpected, something which would make a human scratch their head, make them feel like something is off or broken, something potentially uncomfortable and boundary pushing, make us scream. Oh my God. I can't believe an AI came up with that. And I would never be screaming that to any of these generations, but that was the [00:54:00] task.

gavin_3_07-03-2024_111829: So Kev, these definitely made some fascinating things. And also this just goes to show you the weird choices that certain AIs will make. So let's talk about the ones that GPT 4. 0 made first. 

gavin_3_07-03-2024_111829: First one is that dynamic FPV shot. The camera flies through a twisted melting city where skyscrapers. Bend like rubber bands and streets ripple like water. Gravity defies logic as floating fish swim through the air and people with clock faces walk upside down. All that sounds great, but what we got was maybe not as good as what you would have expected with

kevin_3_07-03-2024_111829: I remember my first CD ROM drive, Gavin, and anybody that's old enough to remember it knows you always got a cool compact disc filled with futuristic 3d animations, and this feels like it's one MIDI music soundtrack away from being a really cool, mid nineties computer graphics demo.

gavin_3_07-03-2024_111829: So if you're listening to this only, like the, this is like an underwater, you see a camera flowing through water, but you don't see a lot of other stuff. You definitely don't see people with clock faces walking upside down. You do see a few floating fish and a few other [00:55:00] things.

gavin_3_07-03-2024_111829: It's not the best thing in the world, but it's still interesting. At least it's weird. The other one though, that GPT four made is kind of interesting.

kevin_3_07-03-2024_111829: This one mentions a camera capturing a quiet, suburban street, but the houses are upside down. People walk on the sky, their shadows cast upward. Whoa, easy GPT, are you my high school notebook? , it said fish swim through the air while birds dive into the ground. In the distance, a giant hand emerges from the horizon, slowly picking up a house and placing it back upside down.

kevin_3_07-03-2024_111829: Now, that's a lot of Creative details, let's say, Gavin. And Runway manages to capture a lot of them, right? The houses seem to be right side up, but something seems off about their architecture still. There are fish floating about in the air. But the reveal of a giant human hand coming down towards one of the houses is actually pretty cool.

gavin_3_07-03-2024_111829: And interestingly, if you zoom in on things, if you zoom in real close, look, something's going on in the window, Kevin, at one point in

kevin_3_07-03-2024_111829: Yeah. Yeah. And one of the

gavin_3_07-03-2024_111829: that [00:56:00] like a, yeah, 

gavin_3_07-03-2024_111829: like somebody's poking out and saying hi, and then it closes the window again and goes right away. But the thing about this one that's the most interesting to me is the hand is actually pretty good.

gavin_3_07-03-2024_111829: Now, again, when it's funny, when you watch this stuff, The fidelity of it is not great yet, right? , it's so AI centric, like you can tell it's AI video. We really appreciate the fact that these can be weird, and we're asking it to do something that it may have no idea how to do. But, the hand coming out of the sky almost looks like a Monty Python thing, which is kind of a

kevin_3_07-03-2024_111829: . Oddly enough, Gavin, I think I was more disappointed with the creativity, or lack thereof, of the large language models, because with both of them, when they were told to get weird, that meant put jellyfish in it. How about flamingos? Animals in suits! They both went racing into these directions, so we tried to pick different prompts to showcase, the breadth of options.

kevin_3_07-03-2024_111829: But, when pushed to be creative, you get a lot of, Oh, it's this thing, but you know, it's upside down! It's backwards! So,

gavin_3_07-03-2024_111829: Kevin, wait for Claude's prompts here, 

gavin_3_07-03-2024_111829: because Claude's prompts got out there. So this Claude, first [00:57:00] Claude prompt for this weird, prompt was, A giant banana floats in a pastel pink sky. The banana slowly impales, revealing a set of human teeth inside. 

gavin_3_07-03-2024_111829: The teeth begin to chatter causing ripples in the sky.

gavin_3_07-03-2024_111829: Suddenly the teeth shoot out to colorful bubbles that pop into miniature tap dancing flamingos. The flamingos perform a synchronized dance routine on a banana peel while the sky gradually shifts to deep purple. That sounds amazing. And Kevin. We're looking at this now. What came out of it was there's no teeth in this, but there's like floating, like jelly bubbles.

gavin_3_07-03-2024_111829: And then what you do see is a banana slowly rising from the bottom of the 

gavin_3_07-03-2024_111829: screen and six little or five little pink flamingos dancing in synchronicity, which is kind of cool.

kevin_3_07-03-2024_111829: I'm gonna give it more points than I'm gonna dock it for missing the teeth in the unpeeling banana.

gavin_3_07-03-2024_111829: Claude did come up with what I believe is one of the best prompts we've seen so far. , this, , prompt was a static wide shot, a business meeting in an office, but everyone is a different farm animal wearing suits, a chicken CEO pecks, a PowerPoint clicker, [00:58:00] a giraffe struggles with a two small desk.

gavin_3_07-03-2024_111829: Suddenly the floor turns to jello animals wobble chaotically, a cow tips over morphing into a giant ice cream cone. Other animals dive in turning into toppings. That is a weird, surreal, crazy prompt. And what we got out of it, Kevin, I want to say is a weird, surreal AI video that made me smile when I saw it the first time.

kevin_3_07-03-2024_111829: Yeah, there's one , boss cow in there. And then there's a weird pile of sherbert ice cream on the floor that the two cows start to eat, and it makes a big ol messy mess. 

gavin_3_07-03-2024_111829: And that's it. That's where we go from there at the

kevin_3_07-03-2024_111829: Well, I think, I think one cow is allergic. It kind of sneezes some of the weird sherbert jello off to the side. It is violent, , but it's got reflections in the floor. It captured an animal in a suit. It went with this Pixar esque, almost Cocomelon style for the characters. There is a weird hybrid giraffe, llama thing on the right.

kevin_3_07-03-2024_111829: Like it, it's doing it right. And I've seen [00:59:00] generative cartoon YouTube channels that aren't built with AI with worse animation than this.

gavin_3_07-03-2024_111829: Yeah, I was gonna say, the best thing, freeze frame it at exactly 9 seconds, and you can see the cow's giving us like a rolling of its eyes, cause it's just not thrilled by what we're doing here. There's some pretty good freeze frames you can find at the very end there. We'll make sure to stick those 

gavin_3_07-03-2024_111829: in.

gavin_3_07-03-2024_111829: But so again, this is our test. We wanted to see what it would be like if AIs would try to make these prompts themselves. Part of this is going to be about pathways, right? Part of this whole world is going to be about how do you create a pathway that makes these shots? It can help you make these shots.

gavin_3_07-03-2024_111829: Oftentimes I will turn, if I'm trying to create a shot for even something I want to do in real life, I'll turn to GPT or one of these things to help me kind of create a shot sheet.

kevin_3_07-03-2024_111829: She's late breaking, Kevin. Late breaking. Late breaking. We got a render back. We got a render that we got to talk about. We got a stage five. Bizarro here. This is a last minute add on from ChatGPT. A wide angle shot, the camera zooms into a kitchen, [01:00:00] where a giant banana in a tuxedo is hosting a tea party with stuffed animals.

kevin_3_07-03-2024_111829: Suddenly, a UFO crashes through the ceiling, and tiny aliens in tutus start dancing the can can on

gavin_3_07-03-2024_111829: Whoa. 

kevin_3_07-03-2024_111829: stop it there, but we kinda got what we asked for, Gavin. There's no tuxedo on the weird squash banana.

gavin_3_07-03-2024_111829: is kind of good. And like the dancing in tutus is good. They're not really aliens dancing, but that's fine because

kevin_3_07-03-2024_111829: Who's to say what an alien looks like? Who's to say, Gavin? That's an ancient alien. That's exactly what they look like. It is a tea party with stuffed animals. The UFO comes crashing down. There's a disco ball. This is absurd in the best way.

gavin_3_07-03-2024_111829: Yes. And this is what we hope that we can create. So it's nice to see that we came through on this one at the end. 

kevin_3_07-03-2024_111829: This was ChatGPT4O gave us this prompt. But really, RunwayGen3 is the star here.

gavin_3_07-03-2024_111829: Yes. And I think the big also thing to be aware of is like part of the star is just continually generating these things. And, you know, this is where it gets a little tricky, right? Runway, you have a limited amount , of prompts you can put through [01:01:00] based on how much money you have. I do think the future of this Kev is more likely going to be imaged to video that hopefully we'll be seeing very soon from runway, but as it starts, this is the beginning of AI films in some form, no matter how weird you get aliens with tutus and bananas.

gavin_3_07-03-2024_111829: All this stuff is the beginning of what we're going to see.

kevin_3_07-03-2024_111829: I'm not mad at it at all. I love that we have these toys to play with. I can't wait for in painting and out painting so you can generate a scene and say, Actually, , I love those weird alien tutu dancers. Let me highlight them and say, give me another scene with them and it will keep the characters coherent.

kevin_3_07-03-2024_111829: That's all coming. And I still think, Gavin, you and I have a tendency to over predict the future. But we said, less than a year ago, five years away from Prompt to Hollywood, we might have been off, but in over estimating the amount of time that it's going to take.

gavin_3_07-03-2024_111829: All right, everybody. It's time for this week's five star reviews and we have a lot.

gavin_3_07-03-2024_111829: So thank you everybody out there for writing these. Just to remind you, if you write these for us, it helps us. We get, we feel good, but also it helps see other people, who like the show. So [01:02:00] Go to Apple podcasts to do this. We are going to read through a bunch of these. Now. The first one, Kevin is from Nick Shifty and he says, I love attack of the show.

gavin_3_07-03-2024_111829: It is more useful than a screen door in a submarine. 

gavin_3_07-03-2024_111829: I love that they read this review during the recording to bait me into leaving a review, which I most certainly did not do. Seriously, it's good. They put in a lot of effort, unlike this review. 

gavin_3_07-03-2024_111829: Thank you! Thank you, Nick Schifty. 

kevin_3_07-03-2024_111829: that was like 5D chess. I can't tell if you're actually with us or against us, but we appreciate the five stars. Thank you. , Cocktails and Code writes, Good times with AI. You can always count on Kevin and Gavin giving you great up to date AI info, while at the same time delivering content that 18 year old me would have killed to be able to make.

kevin_3_07-03-2024_111829: I'm okay with leaping that bar. They keep it funny while also giving you all of the essential info needed to stay up to date with the latest AI happening. Listen to it now. So thank you. Cocktails and code for that one. Much appreciated.

gavin_3_07-03-2024_111829: All right, next we have Hawai ari 4n. Sorry, Hawaii ari 4n. I didn't mean to 

gavin_3_07-03-2024_111829: [01:03:00] use my AI voice. 

kevin_3_07-03-2024_111829: Hawaiian reef for Hawaiian Hawaiian Ryan. It's elite speak a

gavin_3_07-03-2024_111829: Oh, okay. Next 

gavin_3_07-03-2024_111829: we have Hawaiian Ryan, writing says, making sense of AI in their own unique way, very consistent, relatable content, making sense of AI news, fun little hacks, little tips and tricks, fun, playful AI generated Q& A and banter.

gavin_3_07-03-2024_111829: All the little segment intros certainly remind me of a little show back in the day where these two were part of and is still one of my favorites. I appreciate all the tinkering and playing around with AI tools that Gavin and Kevin put together as well. Keep it up, fellas.

kevin_3_07-03-2024_111829: That's awesome. Freddie do to you, it's the username Freddie do to you lose weight with this podcast

gavin_3_07-03-2024_111829: this is what we're looking for. Thank you, Freddydoo.

kevin_3_07-03-2024_111829: have been trying to find the right AI podcast for me, and this is it. Very easy to drop right into the world of useful AI developments. And my engagement in the episodes has made it easier to walk longer and farther during these pleasant summer nights.

kevin_3_07-03-2024_111829: We're changing lives, Gavin.

gavin_3_07-03-2024_111829: changing lives. We're changing Thank [01:04:00] you so much, Freddie Dew. And finally, from Mick Merle, this is a longer one, so he'll probably not read the whole thing, but The title is, From Monster Milk to McDonald's, colon, How AI for Humans Made Me Cry. That's an essay I want to

kevin_3_07-03-2024_111829: Okay. This is

gavin_3_07-03-2024_111829: start with I'll start this review with what made me decide to do it.

gavin_3_07-03-2024_111829: It's that for the second time I've been brought to tears by laughing so hard. This time over gash and McDonald's. The first time was Merle and monster milk. Your podcast is one among many. I watch and as new ones come along, I watch the most useful to me. Yours is on my list and we'll probably be there till the 

gavin_3_07-03-2024_111829: end.

gavin_3_07-03-2024_111829: Your podcast makes AI accessible, entertaining to everyone. You have a perfect blend of informative content and humor. I have to say that your Gavin and Kevin or Kevin and Gavin chemistry is infectious. And the way you break down complex AI topics into digestible fun segments is great. So thank you so much.

gavin_3_07-03-2024_111829: There's a much more, , McMurl, but we really appreciate

kevin_3_07-03-2024_111829: That's really sweet. Yeah. Thank you to everybody who has taken time to leave a five star review, whether it's on Apple or on Spotify, that definitely helps us get discovered in the old algorithms. And as we say, every episode, please [01:05:00] engage. We over engage each and every week. So if you leave a comment, if you post about us on X or threads or LinkedIn, wherever, we'll probably see it and we'll probably thank you for it.

kevin_3_07-03-2024_111829: And we will happily answer any questions like we really enjoy doing this each and every week for you. And as Gavin loves to say, he loves you. When you

gavin_3_07-03-2024_111829: when you love us. That's right. , if you're listening to this audio, we are making a small tweak to our view tube situation , this week. So if you've come here angry that you don't have the whole YouTube and the whole podcast on YouTube, I'm sorry, but we are attempting to do something slightly different on YouTube, where we're going to be uploading the video in more digestible chunks for YouTube, we'll see what that means exactly at this point, but this whole podcast will always exist here as audio.

gavin_3_07-03-2024_111829: Every Thursday morning, it'll come out and we're playing around with different ways to See how the YouTube platform works best for podcasts. Right now we're trying something different. Doesn't mean it's going to always be the case, but we think that this is a better version for YouTube. And as we go forward, we think we might try to do more things in different ways.

gavin_3_07-03-2024_111829: So we're not in [01:06:00] any way going away. We're still here every week, but we're just trying to see ways to get more people to be aware of the show and watch what we're doing. 

kevin_3_07-03-2024_111829: Gavin wants to make your life difficult.

gavin_3_07-03-2024_111829: I do. It's all

kevin_3_07-03-2024_111829: Gavin wanted to establish habits for you and then change them all and take away the thing that you love. Email

gavin_3_07-03-2024_111829: might be a terrible mistake. It might be a terrible mistake, everybody, but there's plenty of stuff out 

gavin_3_07-03-2024_111829: there to watch and 

kevin_3_07-03-2024_111829: to be fair,

gavin_3_07-03-2024_111829: to live our lives. 

kevin_3_07-03-2024_111829: exactly what we said about this endeavor when we started it.

gavin_3_07-03-2024_111829: Yes.

kevin_3_07-03-2024_111829: And it so far has proven to be a pretty huge mistake.

gavin_3_07-03-2024_111829: Yeah. True. A mistake. That's fun every week, no matter doubt, but a huge mistake in a lot of ways. So thanks everybody. We'll see y'all next week.

kevin_3_07-03-2024_111829: Bye.