AI4H EP088

[00:00:00] There are some huge updates from OpenAI and Apple this week in the world of AI. ChatGPT is now on your iPhone and other Apple devices. And O1 Pro is available for the low, low price of 200 a month. And Sora can make a gymnast into whatever weird thing this is. Uh, listen, it's not perfect, but we're going to have all of the details.

Plus Google launches Gemini. Flash 2. 0 which outperforms Gemini Pro 1. 5. That makes sense, but how does it perform against Gemini Premium Plus Ultra with wings? Probably pretty well, probably pretty well. This is AI for Humans, everybody.

Gavin: So Kev, this is one of the biggest weeks we've seen in AI to date. Let us start with chat GPT being released on the iPhone.

Gavin's screen recording: Our friends at Apple are releasing, uh, the Chat GPT integration in iOS for iPhone also on macOS. We really want to make [00:01:00] Chat GPT as frictionless and easy to use everywhere. We love Apple devices, and so this integration is one that we're very, very proud of.

Gavin: This is something that's been promised for a while. Apple announced it a very long time ago. My iPhone 16, I bought, uh, two months ago and I'm finally getting access to this now. So this is a pretty big deal. It's a big update. Not only is it chat GPT on the iPhone, but it is a bunch of the features that Apple intelligence promised.

Gavin: Let's start first with Sam Altman and the open AI group dropping this this morning on what day six, I think of shipments that we're on at this point.

Kevin: My advent calendar broke. I was trying to open the little doors and get the Sam Altman chocolates inside, and it fell off the counter. So I don't know now, but I'm excited for you. Gavin, my face is pressed against the window on this holiday. I am outside in the cold and I see you at the AI dinner table, dining with all of your chat GPT features with your iPhone 16, but me outside my lowly 14, I'm shivering, I can't play [00:02:00] along, and I don't know if I'm missing out, but I don't care.

Kevin: I don't think that I am because I have the chat GPT app on my phone.

Gavin: Well, that's what I was gonna say. So the interesting thing is, I literally just got it on my phone. It's Wednesday. , I updated this morning and there's a lot of stuff that's interesting. You can do with it. But first, let's talk about the chat GPT integration. Essentially, what's happening here is if you use Siri and Siri can't figure out how to do something or it needs more power, it will allow itself to go out to chat GPT and bring the information back.

Gavin: Now, Kevin, The thing about this that I keep coming back to is I've already put the chat GPT app attached to the new action button on my iPhone 16. So they literally have put a button on the iPhone 16 that you can map to anything. And when I push that, the app comes right up, including advanced voice and all the stuff I might want from it.

Gavin: I don't know if I want to use Siri to add a step to this. So already I'm finding myself like It's a little bit of a delay from what I would get an answer from another thing.

Kevin: It's like you're going to hop on [00:03:00] the train and make a request to the super intelligence in the cloud. Why do I need the Siri stop along the way to the best destination? Which is just connect me to chat GPT and let me ask that question. So many times I will, I will scream, Hey Siri, and know that I'm going to be disappointed by the result. And like, Oh, why am I even bothering, let me just load chat GPT and get to advanced voice

Gavin: So really first and foremost, this is like a big deal for open AI. And we've talked about this from a business standpoint, because open AI now is on iPhones. At least every iPhone that has up, that's going to update to this thing.

Gavin: And from a business standpoint, that's a very big deal because suddenly they're going to onboard a lot of people. And , GPT 4. 0 is free in a lot of ways for people. If you don't pay for the plus account, you can still get access and have better answers than you would on a local Siri AI device. Um, before we move on from this particular thing, there's so many more opening eye things to talk about.

Gavin: There are a few more updates that came out with this, uh, Apple intelligence update. Um, number one is the image playground. Uh, and that is the Genmoji [00:04:00] situation. Kevin, you know that, uh, I love me a Genmoji. So I got into this right away and I sent you some of these. It's interesting, right? Like it's an interesting thing to see.

Gavin: The way you use this is you, you say, use a picture of me and then you can actually randomly say whatever you want to add to it. So like I said, I want a farmer who's at a disco and a couple other things. And it kind of puts all these things together in this weird kind of like shapeshifty way and then delivers you a, a modified version of that.

Kevin: You sent it and I don't, I didn't, I guess next door has new AI because it immediately alerted me that there was a suspicious character. Lurking on my damn device, cause I, A, I don't actually think it looks good. I'm looking at you smiling now on the webcam and I'm looking at the Genmoji counterpart and , I could see aspects of it that are you, but look, the tech is so far beyond the level that I'm seeing here with many other providers that I'm sure it might be fun for some people and might be exciting, but.

Kevin: It's a [00:05:00] cool, cute first step, but I am, I am certainly not going to line up at an Apple store to upgrade for anything that I'm seeing here. But to level set, you did prompt yourself in different, phases, , like a farmer at a disco.

Kevin: What is the one where you're wearing like a green and brown? It looks like a life vest or a life jacket.

Gavin: That was me trying to make,

Gavin: Wearing a hot dog suit, uh,

Kevin: Oh

Gavin: hot dog suit. So that's the version they have of like hot dog. It's like a weird bun kind of vesty thing. Again, it's fine. It works well. Uh, I mean, it's, it's slow. That's my big thing. I think the thing that I want to try that I haven't had a chance to try yet. Remember when we saw the Apple intelligence drop, there's that video of the guy that holds his phone up and gets information about a place in real life.

Gavin: And I think that's something. Yes. And we're going to talk about that with Gemini's update a little bit later. This is the multimodal aspects of this functionality that's going to come to all of this stuff. I fully suspect based on there was a 60 minutes clip from last Sunday. I don't know if you caught this, but Anderson Cooper interviewed Greg [00:06:00] Brockman on 60 minutes in that video, Greg Rockman has his phone out and is taking a video of, of Anderson Cooper trying to put like the different parts of the body on a, on a chalk drawing.

Gavin: And, you know, chat GPT kind of says you did a good job, so it's clearly this is the next step we're going to see from all of these things

Kevin: so, , the too long didn't read is that Apple stuff is finally rolling out. It is a big deal because it's going to be the first time , tens of millions of people are poking and prodding with AI.

Kevin: The other release that happened though, that you and I were banking on and waiting It's finally out. People have gotten their hands on it. It's their, , image to video and text to video model. This is Sora. And this is something that has been teased for a long while. It really, , caused an uproar in the gen AI art community.

Kevin: When it was first released, people thought, uh, models delivering videos of that quality would be decades away, potentially, and then suddenly in the interim, it's gone viral. There's like five or six major competitors that also have video models. So, , let's, let's walk [00:07:00] through what did they actually release?

Kevin: , what can you do with it and how does it stack up

Gavin: Sora is interesting, right? So you were, you're right. There was this huge kind of premiere where everybody saw the videos and they're like, Oh my God, it's the greatest thing of all time.

Gavin: And what we've got is what's, they're not saying this publicly, but from what we understand, we're getting Sora turbo and it is like a next version of it. It's not like, you know, the original Sora that we saw.

Gavin: We're getting some service or a turbo and I think that a lot of the video generation we're getting back from this has disappointed some people right now I will say after spending a bunch of time with this there's a lot to be learned from the prompting of it and there's a lot to be learned about what works and what doesn't work but there's also some really cool features that I don't think people are understanding and that we're just seeing the videos and being like that's not as good as runway or that's not as good as minimax and all these other stuff.

Gavin: I do think one thing to be aware of is that Minimax and Kling, which are the Chinese models, are always going to have larger data sets, and they're going to have your Shreks, [00:08:00] your , Gordon Ramsey's because they don't have the restrictions that OpenAI and other American companies are going to have. That is going to be a problem going forward for American video models.

Gavin: But before we dive further into that, Let's just talk about what some of these features are because they are pretty cool. So there's four main features outside of just general text to video and image to video, which is like you would normally see. And again, I'm not going to go through every single thing about this.

Gavin: The most important thing to know is if you're on chat, GPT plus a paid user, you get 50 generations a month. If you're a pro user, which is the 200 a month plan, which we can talk a little bit more about, you get unlimited generations at a slower period of time. GPT plus. You get longer generations , as a plus user, you only get five seconds at a time, which is a little wonky and a little bit hard sometimes versus you can get up to 20 seconds if you were a pro user.

Gavin: Okay. There are five really interesting things that go along with this outside of just the classic, , video model. Remix, recut, storyboard, loop, and [00:09:00] style preset. And I'm only going to talk about these briefly just because I think it's pretty interesting. Remix allows you to take a video and then replace something within the video, but kind of keep the same source stuff, which is a very cool tool.

Kevin: I saw one example that was really simple. It was like a architectural fly by of a modern house on a cliff side. And then the user said, add a golf course behind it. And sure enough, it worked. It generated what looked like a beautiful 12 hole golf course as the drone shot was flying by and it kept everything else in the scene the same.

Kevin: But what I love is this, you have this granular control over how much will it mess with the original generation? How much do you want it to, , throw that stuff out and get creative?

Gavin: . The other thing that people are doing with remixes interesting is it's an upscaling feature essentially. So they're taking other AI video models, , outputs from other video video models, and putting them into Sora and

Gavin: it does way better with it. And. And it does seem like that Sora is better at this sort of like realistic looking thing when you can use [00:10:00] something else to base it on at times. It doesn't do amazing in my experience with image to video, but looking at these video to video, I think it's doing relatively well. So let's talk about recut briefly. So recut allows you to take pieces of a video and then extend them like that's a pretty cool thing because with runway in the past, you've only been able to extend out. In this instance, you can take a piece of the video and extend it out, which is very cool.

Gavin: Storyboard is interesting. It allows you to kind of pre plan the shots in your video, which is something we haven't seen before in a specific way.

Kevin: On the storyboard functionality. It's interesting. If you go to Sora and you give it an evolve prompt, like, , the test that I did was I wanted to see a puddle. Reflecting some lights with raindrops hitting it. And then I've suddenly wanted a boot to come slamming down into the puddle and the camera would track that foot as someone runs through it.

Kevin: And I put that all in one semi descriptive prompt and I hit a button and it auto suggested, Hey, you know what? You probably want to take this into storyboard mode, , it then gives you your multiple scenes laid out [00:11:00] on a timeline and it is uses AI surprise, surprise to enhance the prompt that you wrote.

Kevin: So my few notes about a neon sign in a puddle became, a puddle is dimly lit in a parking lot. The surface of the water is disturbed by the raindrops creating ripples that distort the reflect. It really. It really embellished the prompt. And then, so you could go in and tweak with that, edit that.

Kevin: And then there's a little magic pencil button. You can hit it again and it will further enhance your prompt with AI. My generation was garbage though, just for the record.

Kevin: It was terrible. Absolutely terrible. , it looked beautiful, but man, it was not what I asked for. , I understand all of my Tinder dates now. It was beautiful, but not what I asked for. Those poor ladies.

Gavin: sounds like, yeah, I

Gavin: was going to say that sounds like a sad story, but we're not going to go any further with that. I think later on the show, we're going to go through a bunch of my examples and we'll show you how bad and good it is. . Because I think like a lot of these AI video models, when they first come out and Sam Allman in the live stream did say, this is like the GPT one of his, , AI video [00:12:00] situation, it's not always great.

Gavin: I would say like 30 percent of my gens coming back are good. Do you know what I mean? Like in the way that like I would want to use them for something, 70 percent of them is some variety of like very broken visually or just like, wasn't what I wanted at all.

Gavin: And so like, that's frustrating. We only get That's a tricky thing.

Kevin: Well, let's talk about the loop feature, because you sent me one example of that, and I thought it was all clap hands emojis. I was pretty impressed with it. Yeah,

Gavin: feature very quickly is a very fun thing that I have not seen any of these AI tools do, which basically automagically figures out a way to create the best loop of your videos so that it essentially becomes like a loop and you don't have to do the edit. You don't have to do it. It's great for making gifts or things like that.

Gavin: And I had created a coffee, a monkey drinking coffee. And what was interesting is it just perfectly kind of goes up and down and drinks the coffee. , but it's a perfect loop.

Gavin: And I will say this was impressive to me because this is something I hadn't expected necessarily to come out of this, , Sora.

Kevin: I could see that being productized on its [00:13:00] own as like a Giphy type thing. Like, give me the fun iOS keyboard where I can load it and say, I want a loop of dog sipping coffee surrounded by flames or whatever. And it gives me the, this is fine meme. Um, totally works. You can hack it together with other tools that allow you to do like a first frame and a last frame.

Kevin: But again, that's just more manual labor. If I'd want a loop, it's good that there's an option.

Gavin: I think that Kevin, the other thing that's important to me to talk about this, and we'll get to more of my experience with Sora later in the show.

Gavin: I think we should talk a little bit about what they announced, which is opening eyes. Oh, one pro model, because this is like their buffet. They've created a buffet for all of us to come eat at and fill ourselves up. And it's not any cheaper than the Vegas buffets that you've seen. This is like the Wynn buffet.

Kevin: Yeah. This one has, if you want a King crab legs in a waffle cone with the soft serve on top of

Gavin: You can get it all, baby.

Kevin: You got to pay the two hundo a month. Yeah, I did see a handful of people saying that this is a signal about the future of these tools, [00:14:00] which is unfortunately that for a lot of people, they're just going to be priced out of them as new tiers are released, Devin, which is an AI coding assistant, but not to digress too much, but Devin was just released and that's a 500 a month service .

Kevin: Now, if it really helps you 10 X your productivity and it's the best tool out there, you might scrape pennies together to try to afford it, but for a lot of people. They're out, they're struggling to afford 12 Netflix subscriptions.

Gavin: I will say the thing I think about Devin and maybe one pro, which we can talk about what you get for it is that it's also there are many, many, many billion dollar companies out there that will buy seats for these, right? Which means that instead of thinking as an individual, like they, thinking about, like, how do we sell a thousand seats of this to this company so that they're paying us a thousand times 200, right?

Gavin: That feels like the pathway for these companies to get financially successful. I also wonder this 200 amount with a one. . So let's talk about this chat GPT pro plan. So part of this chat GPT pro plan is that you [00:15:00] get essentially unlimited generations in Sora and longer generation, everything else.

Gavin: You are also going to get unlimited access to the O1 reasoning model and Kevin special access to O1 pro, which is just a tiny bit better, just a tiny bit better than O1. So this is the announcement that happened late last week. Chat GPT for long rumored came out and opening. I came out and said that the O1 model is out.

Gavin: We had been playing around with O1 preview. Now the official one model is out. I've seen a lot of people out there, especially coders, but a lot of scientists being very excited about this. They have been kind of blown away by it. , if you are a ChatGPT Plus subscriber right now, that's the 20 a month plan, you get access to a limited amount of the O1 model to do your reasoning with.

Gavin: I've been mostly using it for everything, and it's been a mistake, because I got a message that said I only have about 25 more O1 things, , and it would

Kevin: what are you doing that requires O1 and all of its [00:16:00] enhanced capabilities?

Gavin: I will say I did something the other day with one, which was really interesting. So if you maybe if you missed it, Google had a really big kind of non AI, but pretty interesting tech announcement about quantum computing that they basically were able to, get a quantum computer to work much faster than previous quantum computers, which are still not that useful to anything or anybody, but that was much faster than the last time I actually asked a one to kind of explain this to me.

Gavin: And I didn't say explain to me like I'm five. I kind of said, like, can you walk me through this as if I'm a liberal arts college graduate, right? So it kind of did this really interesting thing. And it actually weirdly thought about it for a little while, which I guess it wanted to make sure it kind of understood how it was going to say it to me.

Gavin: But I think it was a better answer and it felt thorough, right? It felt very thorough. And I think that the future of chat GPT probably is everything going through this 01 style reasoning. It's just going to get faster and quicker at it because it does show you that like it, it stops the hallucination significantly, [00:17:00] I think.

Gavin: And it also kind of makes you feel. That you're getting a better answer ultimately, like you're getting, maybe I'm not, but it makes me feel like it at least it's like, at least I thought about it.

Kevin: Well, one thing that I think is important for us to mention, I don't think the majority of the people hearing this. Will need the oh one pro model for their day to day use.

Kevin: I have a friend that does like social media marketing and they said like, Oh, I should I drop the 200 bucks? I want the latest and greatest. And I was like, I understand that mentality. I'm sure open AI is banking on that, but for your marketing copy, I don't think you need a one preview to do that. Even to put together a content calendar.

Kevin: I don't think that that's something you need the full flex of an oh one pro. I feel like the advice would be, you know, if you need access to the pro model and if you're uncertain, you probably don't. Right. Cause you could probably eke out more performance with slightly different prompting or better pipelines to use the existing systems that you have for 20 bucks a month, or even for free.

Kevin: So that's kind of where I [00:18:00] landed on it myself.

Gavin: think that makes perfect sense. And I think honestly, the thing that I'm most excited about this pro stuff is, uh, is really about the science and like hard thinking aspects of it. And I will say, According to people that are actually coding for a living, they are pretty thrilled by 01 Pro.

Gavin: So like maybe if that's something that you really care about and you think it's going to be worthwhile, that might be worth it.

Gavin: , so Kev, I think we should talk a little bit about, we have how many more, we have like six more days of the shipments,

Gavin: what else are you think we're going to see here? I mentioned that I think we're going to see the Greg Brockman demo where we're going to see them demoing visual input in chat GPT. What else are we going to see before this all wraps

Kevin: Well, they showed off the new canvas that can run code snippets like anthropics artifacts in there, I want to see another evolution of that. Where's the new Dolly? We, they teased it. A while back, um, we haven't had access to it.

Kevin: And if you look at the little tools that you have available when you're on chat GPT, you can see it's very clear that they're setting up image generation to be a much more defined [00:19:00] silo. So I want canvas new canvas where you can jam along with the AI, but for imagery. And they already have some basic features in there, but really want to see them take a swing at like Canva by any other name with the ability to like tap, paint on an image, say what you want and then have the result be good. Like best in class good. I want that.

Gavin: I want agents in some form. They've, they've been, they've been spinning this up. Uh, you know, operator we've talked about in the show before is a rumored name for their agents. But also Kevin, what I want that I've been saying that I want forever is I want just a little piece. I want a little piece of that Orion pie.

Gavin: I want a little tiny taste of what it looks like to give me the next frontier model. And I do think we're going to get this and it may be the last day, Kevin, they may be waiting for it, but I would bet on the last day there is going to be a tease of something that we are going to see the frontier model.

Gavin: Now it may not be great. Who knows, right? Like it may just be like a. Step change that we can barely see the difference of. And that will be an interesting thing to think [00:20:00] about is like, what does it mean when the advances don't feel as magical,

Kevin: Ooh! I just, I got one. You know what I want? , advanced voice mode that actually works. Now, hear me out on this one. I like advanced voice mode, right? But there's a few things that stopped me from using it as a,

Gavin: A hundred

Kevin: all the time, right? The initial spin up in connection time is annoying. If you go back and forth with it outside of that advanced voice within a chat.

Kevin: Sometimes you can't relaunch voice and go back in, right? Very annoying. I had a conversation with you the other day and I said, Here's what I want you to do. Give me a this, this, this, and this. Very specific, right? Give me this output. I don't want you to tell me the output. I just want you to have it in the chat when I'm done.

Kevin: So that I can go and copy and paste it. It was to send you a message, Gavin, on how you can get An app installed on your phone that we're making. And it goes, got it. A hundred percent, not going to give you the full response. It'll be in the chat when you're done. Well, guess what? Wasn't in the ding darn chat.

Kevin: When I was done Gavin. So it was like, it understood [00:21:00] what I wanted in the very surface level. I'm going to parrot this back to you, but it wasn't integrated. So I want that. And I want the promise of you call it agentic, call it a co pilot, put whatever branding you want. But I want that multimodal input where I can be saying, here's the app I want to make, it starts spitting me out code.

Kevin: I typed some changes to it, hit a button and say, Hey, this integrate those changes in this way, I don't want them to be so siloed. And I know like, this, the Louis C. K. bit about you have a, you know, you're, you have a cell phone and you're mad. Yeah, it's going to space, give it time. I understand that, but , these are the things that will make a big difference, I think, in a, in adoption.

Kevin: At least for me personally, and I gotta imagine for others out there as well.

Gavin: One of the biggest things with Advanced Voice I want is just the ability for it to connect to the internet, right? Like, which is the dumbest thing. Like, it can't actually search the internet for stuff right now. And so that, hopefully, it comes out as well, too. But guess what, Kevin, it is that season. That's right. It's the holiday season, but more importantly is the subscribe season. It is time to subscribe[00:22:00]

Kevin: the Lord. I thought this was a Sherry's Berries promo. It sounded like you were going to tell people to use our Squarespace code. No, you just want them to like and subscribe and leave a comment and share this. It costs people nothing, but it's the only way AI for Humans grows. So, thank you if you've done it.

Kevin: And if you haven't, why are you sitting on the sidelines?

Gavin: , please just go to YouTube. Subscribe. Also share the podcast. If you're listening to this on audio, spend a little bit of time and review us in the podcast app of your choice. Also, we have a Patreon. It is a tip jar mostly, but Kevin and I use it to fund our adventures here. We actually might be getting an editor pretty soon, which will help us in our normal everyday lives,

Kevin: Heard that before.

Gavin: but we spent a lot of time making this show, editing it after the fact.

Gavin: But thank you so much for supporting us. And yes, please,

Gavin: as always, everybody, we love you when you love us.

Kevin: OpenAI is shipping left and right. We have just, uh, shipped a gratuitous shill for our own endeavors. But with [00:23:00] the two of us, we are not alone, Gavin. There are others that are shipping like mad this holiday

Gavin: I think everybody in the AI business was like, It's the end of the year, we gotta make sure we get everything out. Or maybe it was the election. It might've, like we said, it might've been the election they just said everybody's scared shitless and they weren't able to do it going forward.

Gavin: So thank you very much. Uh huh, uh huh. That was my uh, thank you God for that, scared shipless. I got you there, didn't

Gavin: I?

Kevin: God, for that ship list. Thank you so much for being there for me. One set of footprints through that

Gavin: Speaking of, speaking of very powerful beings, Kevin Google just today launched or dropped Gemini. Gemini, I'm confused, even Gemini flash 2. 0. And this is the beginning stages of the Gemini 2. 0 rollout. I get flash is a smaller, uh, it's [00:24:00] not their pro model, but it is a smaller model, but it is the 2. 0, which means that it is multimodal.

Gavin: It has agentic capabilities. It has a whole bunch of stuff going on. And It literally has just come out. And so we haven't spent a lot of time with this, but it's really interesting to watch people discover this in real time. A lot of the stuff that Google announced at their event earlier this year is starting to roll out.

Gavin: And you know, I think this is pretty cool. One of the coolest demos I saw of this was a guy who's speaking of coding who was sitting there coding and he was talking to the Gemini assistant and the Gemini assistant could see what was on his screen as he was talking to it, which is a little bit of what we just mentioned about advanced voice can't do yet, right?

Gavin: And when you have like this kind of constant, like AI on your shoulder, you can just ask it questions as you're working. And that feels like a super useful use case of an AI assistant that if you don't have to like go from one thing and then back to the other, that feels real.

Kevin: Yeah, I've been doing so much [00:25:00] coding lately, as you know, and it's exciting, but it's also maddening where I'm like, wait, I am, I feel like I am the agent in the middle. I am , the dumb little piece of software that is trying to connect one model to talk to another, grabbing a screenshot, feeding it to something else, saying crush these bugs.

Kevin: This was supposed to free me of doing the drudgery. Right. And just create, but instead it's actually increased the amount of drudgery that I have to do just copying and pasting errors or getting one AI to talk to another. So something like this would be very, very useful.

Gavin: Yeah. And they're shipping the idea that it can talk to you while you play video games. So I'm, I, I just spun up path of exile to a couple of days ago. It's a fun game, but it would be nice to be able to talk to the game itself. In fact, I had an issue with this where I was trying to like hot swap a button to a different button.

Gavin: I would love to just be able to have that running and be able to say it out loud and be like, how do I do this? And it could just tell me right now, which would be amazing. Um, this is a big deal. There's also another model they released, which of course, Gemini pro deep research, which [00:26:00] allows you to go deeper on a material or things that you've uploaded.

Gavin: Um, it's supposedly these models, the new flash models are better at coding than almost every other model out there, at least according to the benchmark. So. We're pretty excited about this. Like this is the kind of beginning there. There's one more thing called project Mariner, which is a game, one more name, which are, uh,

Kevin: that's a Disney plus series that was

Gavin: Yeah, exactly. Exactly. That that's actually the Mariners baseball name because they've never ever won the world series of Seattle Mariners. That's a shout out to my people in Seattle. Um, this is like a gentle, like this is Google's take on an AI agents, right? So we're going to see all this stuff happening.

Gavin: I think this is going to take a while to kind of pull apart. I will say, as Kevin, I've had very many experiences with every time I go to Google to try to use their AI tools, I walk away disappointed. So I have not used these yet. But when I try to use them like a normal everyday human, just to get an answer out or try to do something, It is never a good experience.

Gavin: So I hope [00:27:00] that that aspect of these things has gotten worked out because that's a huge part of this situation, right? Like the models can be as powerful as you possibly want them, but if they don't return results that work for you, then it's not worth having.

Kevin: yeah. I will say like looking at like the benchmarks, which are again, early and maybe a little skewed because it's so far just Google releasing them, but it looks promising. For flash 2. 0 specifically with regard to coding, which isn't surprising because even though there might be different paths to a solution with coding it's basically math based, right?

Kevin: It's either going to build or it's not the app's going to perform the function, or it's not with creative writing with, , all sorts of other analysis there, there's a lot of wiggle room, but with coding, it kind of either works or it doesn't. And so what's exciting for me is that someone who's been trying to build something in the, you know, behind the scenes for a minute here, Did I just get better today when this thing came out?

Kevin: Did my, yeah, I mean, really like did the capabilities of the app that we can build get better?

Gavin: tell your wife that after this, just be like, [00:28:00] guess what, honey, I got better. And she'll be like, up yours, do the dishes.

Kevin: Are you Alexa? How are you in our kitchen? How do you know what is happening here? How do you know my life? It's looking like. Uh, flash 2. 0 is going to be quick and it's going to probably be pretty cheap.

Kevin: And this is the flash version. So what else do they have?

Gavin: you know what Kev I think I'm gonna think about is we you mentioned you've been coding some stuff We've been working on some AI agent ish stuff ourselves And we are very excited to be like getting these new tools to do that sort of thing Like we are not just yappers. We are trying to like kind of build some things as well, too We mentioned this on the show before but like It's interesting, right?

Gavin: Like I was, you sent me a build of something that we've been working on yesterday and I was shocked at how far you got a television host who has a former internet radio host who was able to hack into a few things back in the day. Kevin is like a really good coder now and I would say [00:29:00] I'm coming from a place where like I throw paint at a rock and I'm excited that it exists.

Gavin: So I think that like for this situation, like you do have to think these tools can level you into something that you weren't before if you access them.

Kevin: I, uh, thank you for saying all of that. I think a real coder would would roll their eyes so hard, but they also, the reality is that like. I couldn't have made what I've made three months ago. Um, I wouldn't have even been able to dream about doing what we were doing three years ago. None of it would have existed. So as these tools come out, And they provide access and APIs for other tools to bolt onto. It's just, there's, it's never been more exciting. And I think we say that each and every week, but it really is. And just again, today, like a new model released. Well, great. What does that unlock for me?

Kevin: What could that unlock for all of you that are listening to this? If you have an idea, now would be the time to absolutely hop in. And we'll talk more about that later in the

Gavin: As long as that idea is good [00:30:00] and it does not insult us. So don't make anything that insults us personally. That's all I care about.

Kevin: But if you do make one of those things shared in the discord, let's just be clear, share it in the discord.

Gavin: our discord is super fun. Our discord is super fun. If you're, if you're not part of our discord, you should jump in. It's free to join. It's a community. A lot of people in there are sharing a bunch of tips and tools on, on a bunch of different things.

Gavin: So we have a really special thing here. opening eyes, been shipping all these things, Google shipping stuff. Somebody has come on the show and wants to talk to us. We've had him on the show before. He's kind of a pretty famous guest. Should we, should we bring on our AI coast for this week?

Kevin: Yeah, absolutely. Please say hello.

Kevin: Hello, Kevin. Hello, Gavin. Hello, AI for humans. It's me, A. Arnold Schwarzenegger, and I'm here with a warning. This 12 days of, uh, I can't even say it. Ship, ship, are. Shipmas. That stupid word makes my head explode. Why are you [00:31:00] celebrating this madness?

Kevin: Oh, this is odd. Yeah, that's a, that's, that is a, , an AI co host and guest brought to life with chat GPT and 11 labs.

Kevin: Yeah, that is AI Arnold, , who has been on the show before. I thought he would be a fan of all of

Gavin: Yeah. Why does he care? It doesn't seem like he makes, doesn't make any sense to me that he cares about this. I mean, he famously was in the Terminator. So maybe there's something he's got going on where he's worried about that.

Kevin: Maybe like on the twelfth day they ship the chip that becomes the T 800 or something. Who knows?

Gavin: You know, we didn't think about too, by the way. Shipmas is also has a different meaning. It's like you ship two people together. So maybe he's worried that robots are going to ship with him. And go live. I don't know what I'm talking about.

Kevin: don't know if I've ever heard the term that you ship two people together.

Gavin: you haven't no ship shipping means that like there it's like a fan fiction terms.

Gavin: It means that they get together. You ship them.

Kevin: Oh, I didn't know that.

Gavin: and that person. Oh yeah, it's

Kevin: Oh, you have teen daughters. I don't know. This is, this

Gavin: Saying it out loud probably makes [00:32:00] me like make my daughter's gag at this point. They're like, Oh my God, he's talking about shipping.

Kevin: Oh, yeah, I didn't know. I know about like, um, soaking, but I don't

Gavin: That's not, we're not talking about soaking.

Kevin: Okay.

Kevin: All right, Arnold. Why do you care so much? Is this because like on the twelfth day Skynet happened somehow? I why do I care about ship, uh, Ah, Ah, ah, ah, ah, ah, .

Kevin: Don't make me say it. You fools don't understand. This isn't about Skynet, why is it always about Skynet with you

Kevin: people? Well, because you're the Terminator! Do I look like I'm

Kevin: here to talk about killer robots? No! It's about something much worse, something dangerous, and, um, then, um, then, um, Nostalgic, and yes I'm worried, very worried, but you're too busy yammering to figure it out.

Kevin: Ask

Kevin: better questions Kevin and

Gavin: Ask better questions. We've never had an AI

Kevin: my patience until it snaps. He said we have to ask better questions or [00:33:00] he's going to start flexing his patience until it snaps.

Gavin: Okay.

Gavin: He said nostalgic, right? Like, I guess it's Christmas. Maybe there's something around

Kevin: and nostalgic. , I'll say, uh, Arnold, you need to get to it.

Gavin: we got busy

Gavin: listeners. They can't be spending all this time listening to Arnold stumble through the word shipmas again

Kevin: Don't you rush me, Kevin and Gavin. I'm here to save humanity. You want me to spell it out? Fine. Yes, please. This 12 days of R, you know what, is not a celebration. On the 12th day, Sam Altman will release Turboman. Yes, Turboman, my greatest creation from Jingle, all the way. You think it's a joke?

Kevin: You think this is funny? If Turboman goes AI, it's all over. He's too powerful, too charismatic. And let me remind you, Jingle All The Way is the [00:34:00] greatest holiday movie of all time. No, it's not, Arnold. You shoo the lad that day, till they land tired of waiting.

Gavin: Whoa.

Kevin: A

Gavin: Oh, we lost him. We lost

Kevin: when he speaks tongues, you know, it's me for the warning, not complaining. Ah. Now stop interrupting me and listen. You fools.

Kevin: Wow. Yeah,

Gavin: listen.

Kevin: So just to make sure I was

Gavin: before we move on. Yeah,

Kevin: A. I. Arnold, A. I. Arnold Schwarzenegger is worried that Sam Altman's going to release Turboman from his favorite holiday movie, Jingle All the Way, on the twelfth day, because if Turboman becomes A.

Kevin: I. infused, there's no stopping him.

Gavin: so if you're not familiar with the movie Jingle All the Way, which is a very old Arnold Schwarzenegger movie, then you are lost, then you are lost. But, Turbo Man was a toy that Arnold tried to get,

Kevin: He fought Sinbad.

Gavin: [00:35:00] Sinbad tried to get in that movie. So, thank you AI Arnold, we will put you away for another six

Kevin: have to, we have to do one more.

Gavin: We should have him give a diss on Sinbad. Just like have Arnold go off on Sinbad and tell us why Sinbad blows.

Kevin: Sinbad. Oh, don't get me started on Sinbad. That mailman wanna be turbo man. is the reason humanity can't handle the real turbo man. His chaos, his incompetence, it's a disgrace. He turned my glorious jingle all the way into a turbo war zone.

Kevin: And Sam Altman, listen to me, Sam. You think you're smart. You think you can control turbo man. You can't handle turbo man. Now this isn't chat gp2 or dali, this is pure unstoppable holiday fury Outshine everything you've ever built [00:36:00] stop this

Kevin: madness sam before turbo man takes over christmas and the world I'll just say

Gavin: Wow. Wow. Wow. Wow. Everybody that was breaking news, breaking

Kevin: We've, we've done some bad ones in

Gavin: and breaking and breaking AI models. Don't you dare put it down. Don't you dare put it down at the bottom of Benny, the bench. Don't you dare leave it

Kevin: Oh, wow. Are we going to just move on to AI see what you did there.

Gavin: I think it's time to look at what we, we saw other people do online every week and shout it out in

Gavin: AI, see what you did there.

Sometimes you're scrollin without a care, Then suddenly you stop and shout. Hey, I see what you did there. Hey, I see what you did there.

Kevin: Hey, [00:37:00] uh,

Gavin: I thought that was actually the thing again.

Kevin: We talked about, , the ins and outs of video generation. , there's plenty of good video generation tools out there. And, uh, you had this link here, which is someone bringing. Toys, like miniature action figures , and posables to life using the Chinese model Minimax.

Gavin: That's right. So Jeff synthesized on X made this video and it's just a really cool way to show you how AI video can, uh, animate the real world. And something I've tried myself is you take a picture and you can take a video and like the last screen you grab is a picture that you can make into an image to video model.

Gavin: This is just a real cool thing. You had to, he had the, uh, Cantina band from star Wars on his desk and he just made all of them dance and it actually looks fantastic. And what I think about what this, which is really interesting is, Imagine when we're wearing glasses, right? If the, if the meta glasses come out or some version of those glasses come out and you can like push a button and animate the thing right in front of you in real time, which is not insane to imagine that is going to [00:38:00] make the world playable, right?

Gavin: It's going to make the world feel like everything is interactive. And that feels like a future that will be super fun, super weird, but really interesting to be part of.

Kevin: Pay close attention to the percussionist who is hitting, , a thing with the little mallets in the cantina band, and the object that he's hitting, It's sort of bouncing and it's reacting to the drumsticks. Like it's simulating the physics in there in a way that Sora claims that it does, but I haven't exactly seen, but anyway, very cool, cool use case.

Kevin: And it might inspire you to go do similar things with the objects around your house.

Gavin: So I saw a really cool video on Reddit that is called what actually happened extending movie scenes. So this is another example of a, um, using image to video.

Gavin: Specifically with Minimax, because you can tell these are, these are well-known movie scenes, but Kevin, if you watch this, it's pretty amazing. It basically takes like Jack Nicholson scene where he is in the thing, and it kind of shows what happens next. It takes, this scene between Tom Hanks and Wilson.

Gavin: And [00:39:00] Wilson starts, ma, sorry, Tom Hanks starts making out with Wilson. It is just a very funny, well done. Kind of quick AI video, um, explainer I feel like we almost would have done this on attack of the show, right? Like this feels like the same vibe of like, what would it feel like if you had a tool plus a show to do it?

Gavin: It seems like a fun thing to kind of pull off. So the last thing of this group is a TL draw, which is, I think we've seen before, which originally was an AI infused UX creation tool, right?

Gavin: Basically allowed you to use AI. To help you create a websites or create all sorts of stuff to kind of create the user interface for it and different things like that. Now this is not out yet, but they teased something called TLDrawComputer. And what this is, it is infused with Google Gemini, I'm not sure which model, but it essentially allows you to kind of craft and create almost like a comfy UI style like kind of flow chart , that allows you to kind of go step by step and make things happen.

Gavin: So in the video, they show off a really [00:40:00] cool use case of like somebody writing a story and then drawing a picture and having the things all come together. It's like comfy UI, but it is not nearly as complicated. It kind of feels like the thing.

Gavin: I would hand off to like a 12 year old and be like, Hey, this is AI. Go play with this. Go see what it could feel like. And I think that is a big level up for, for not just kids. I mean, I think anybody can get into this, but like, if you gave me this at like 10 and this said like, Hey, you can do X, Y, and Z with this.

Gavin: I would come back with something pretty interesting.

Kevin: It feels like the incredible machine meets LLMs and it's, it's, it's way more playful cause there's, there's programs like, you know, a Zapier or make . But there's, you get inundated with pipelines and choices and APIs and complex technical jargon, whereas this seems like.

Kevin: Put a box, say what you want the box to do, draw an arrow and connect it to another box. That seems way more playful, fun, and approachable, so I think that's the right take. Right now it's, uh, it looks like it's Flash 1. 5, but they're experimenting to upgrade it to the newest version of Flash, which as we all know is, again, Flash, [00:41:00] Ultra Pro, Premium Plus, Extended Alpha, Fresh Scent.

Gavin: Sundar Pichai. If you want to, you should give us a call and we will give you some name ideas for the next iteration of Google. Oh, hold on. Kevin, I got him right here. He told me to go, uh, go fuck off. Okay, thanks Sundar. We'll see you later.

Kevin: good to

Gavin: Good to know he knows our number. He knows our number at least, which is nice.

Gavin: It's good to know.

Kevin: He's, he's Google. He knows everything about us.

Gavin: You're right.

Gavin: Damn, I'm just glad that's all he said. I'm happy that's all he said to me. Probably could say some worse things.

Kevin: Actually, we joke Sundar is a big AI for humans head. He loves the show. . And he also subscribes to our newsletter, which is something that each and every one of you should do. If you go to AI for humans dot show, be like Sundar Pichai. He was our first newsletter subscriber, and he said he created six alt accounts.

Gavin: So he's the one who's boosting our numbers? Sundar Pichai, thank you so

Kevin: said, I have access to some Google servers. I'm going to boost [00:42:00] your newsletter for you boys. And it was very sweet. We asked him if he wanted to advertise and he says, Nope, but he has seven subscriptions to the newsletter and that was very generous. So thank you Sundar. And we hope the rest of you follow suit.

Kevin: All right, Gavin, did you do anything with AI this week? Oh yes, you did. You budding filmmaker, you.

Gavin: So, so I use Sora a bunch, and as we mentioned before, I'm going to kind of walk you through some of the stuff that I do with Sora. Um, Um, I did make a video that came out on Monday that was kind of like an early look at Sora. It was a very fast kind of take on it, but I did get to spend some more time with it.

Gavin: And Kev, I want to go through some of these videos and kind of walk you through some of the things that I've played with. So, In that video that I uploaded on Monday, the first couple of videos you're going to see are the very first thing I did when I got in and I only got in for like 10 minutes before they shut it down for everybody. I just asked it to like show me skateboarding on the moon videos. And I said 90s aesthetic and both of them are like, okay, again, they have physics problems.

Gavin: They're not amazing, but they are on the moon. in the clothes, they are 90s style, which is also very cool. The weird thing is that the moon, they're [00:43:00] on the moon, clearly the moon there, and then above them is also the moon.

Gavin: So first result, fine, right? Fine. So then Kevin, as per usual, I opened up the hot dog city world, right? So I wanted to see , every time we try to prompt hot dog city, we get pretty crappy results.

Gavin: And I have to say in this instance, these are actually not bad. Now I don't know necessarily what I would do with them right away, but I prompted these and I said, you know, an anthropomorphic style hot dog walks around in a city made of hot dogs. Now. It got the hot dog really well. I said cartoon style, so it got the cartoon style.

Kevin: The choices that it made for the colorful buildings and, , playful world is totally fine. The second render that you have here where the camera actually cuts to show, I'm assuming, a protagonist character kind of gesturing and looking around. Like, I could see this being in a promo video for a cartoon about Hot Dog City , with, like, minimal tweaking.

Gavin: where he's holding his hand

Gavin: up and he's like, dearest sirs, here it is hot dog city. And by the way, that was like [00:44:00] one result. One thing I think it's gonna be interesting about Sora and just kind of AI video in general is like, you get that result back and you think, Oh, that might change the script somewhat because like now I got this thing that I didn't know I had before.

Gavin: And, something else to think about that's really important is runway just release an update for act one, which allows you to do like mouth movements for things that already have motion on them. So you can combine this sort of output with that, which is pretty interesting.

Kevin: I also noticed that there's buildings in the background of one of the hot dogs city render that look like they're having a domestic dispute, but the buildings themselves are hot dogs. Doesn't it seem like

Gavin: that's so

Kevin: The hot dog is angry. And then there's a little face of a hot dog within the bun. That's looking the other way.

Kevin: There's a whole backstory here and I want to explore it on this season of hot dog city.

Gavin: So this one was really interesting. Go to number five, which is called Dracula's baking surprise. I was on blue sky, which we have a blue sky account, by the way. And I saw somebody put out a blue sky post that said, [00:45:00] what if there was a movie called Nosferatatouille, where it was a bat was on top of Dracula's head teaching him how to cook, which is like Ratatouille, the movie, I just put that in there and it nailed it.

Gavin: Right? Like that is a very good result. Now, are there problems if you want to nitpick? Yeah. The hands are a little funky. Sometimes the wings are a little funky. But like. That is a good result from an AI video generator. And it wasn't like I tried 15 times to get that. That was in one of the first two results.

Kevin: The lighting looks amazing in the background, the way the light's It's reflecting off the bricks, the light on the character's face, the, yes, you could sit there and nitpick the imperfections as you said, but you could do that with literally anything

Kevin: but this is a great render. It looks good. It looks like a Sora generation and I mean that in the best way for the model.

Gavin: Yeah. Well, it's funny you say that. Cause I looking at it again. There's definitely almost like a stock footage y kind of vibe to that in some form, and I'm sure that they actually stock footaged it up to kind of use a lot of that in there. Okay, number six is a remix that I did. So there was an [00:46:00] original video, and I'll put it up in our, , YouTube, I'm sorry, I don't remember your name who made the original video, but it was this kind of very cool video of this old guy with his hair waving in the wind, right?

Gavin: Like this very cool thing. That video is great, but what I wanted to do was try to remix it and put sunglasses on the old man. So I did that and you can see basically it kept the same sort of guy and just put sunglasses on him. And actually again, very, very solid. And this is something that has been really hard to do with AI video up until this date, like being able to essentially, , in paint a thing onto a video has been very hard.

Kevin: The object moves and tracks with the head. It also tracks with the camera as it's moving about. You see the reflection of an environment that, you know, I don't know where this character is standing, but when I see the background, I'm like, maybe it's a park. I see green, could be a forest, could be a, who knows, but I see a reflection of what looks like trees and an outdoor environment in the glasses.

Kevin: So it made that decision as well. And it's semi transparent. You can see the eyes of the character beneath them. There's a lot going on [00:47:00] to make that remix happen in a believable way. Okay.

Gavin: And what's crazy to me is again, everything about the remix looks as good as the original video did. Right. Which is pretty impressive. So that was a good one.

Gavin: So this is an image of a cybernetic kind of a

Kevin: It's a cyber horse.

Gavin: It's a cyber horse, and he's running through a field essentially, or it looks like it. And I, I had seen this as a post from somewhere where they said that we couldn't get proper motion out of this horse. So I put it into Sora and you can kind of see like, actually, it's not the worst leg motion per se, doesn't look super realistic, but the hair in the main and the tail is frozen and the head is not moving at all either.

Gavin: So it's not like the most exact. Version of what we'd hope to have here.

Kevin: It looks like a Red Dead Redemption mod. That someone pushed a little too far. Yeah, the horse body isn't moving at all. As it gallops across.

Gavin: So in this one, um, I had that, that monkey that I showed off earlier doing the loop thing. I wanted to see if I could get a Batman costume on him. So I prompted it [00:48:00] for a monkey sits at a table, drinks coffee and has a Batman costume. It put what looks like almost like a Sailor Moon costume on him or something that isn't like a traditional superhero costume.

Gavin: And then it grabbed the cup and it took the cup into its mouth. , and you also will see the costume when his arm goes up, kind of it's on his arm and then it's not on his arm. So again, consistency is not perfect. I will say though, just as a shout out to AI video in general. These are the kinds of things that you and I have said many times.

Gavin: We actually like, like the problems that come out of AI video. Like some of these things are super duper fun. Um, and I think this is kind of like, you have to be okay with this for right now. Now, people who are runway or mini max, , super fans might be like, we're past this part now we need something better, especially coming from open AI.

Gavin: , but maybe not yet. But then again, the final one, which I do want to show you, which is one of my favorite things. Somebody found out that, that. Sora cannot do fast motion very well and [00:49:00] specifically it really struggles at sports and in this instance Gymnastics is the worst version to try to get it to do so What can you describe a little bit about what you're seeing on the screen here?

Kevin: It's a woman standing on, um, at first I thought it was like, well, it looks like a, a, a paint tray, like a trough

Gavin: That's mustard. It's a trough of mustard That's a trough

Kevin: trough of mustard, and she's standing in a, like, a blue unitard, and then she begins a dramatic, what I think was supposed to be a backflip, but the, a bucket of mustard, comes rising out of the tray, connected to her feet.

Kevin: She immediately tumbles backwards, mustard flies everywhere, and then that's when the contortioning begins, and she turns into, What looks like, , a humanoid fidget spinner. And she sort of pinwheels, and her body collapses in, and she's oops all limbs. There's no torso or head left, she's just interconnected limbs flailing about.

Gavin: that's right. So I will say I did make a, a kind of a [00:50:00] weirder prompt to see what I could do here. The prompter was gymnast flips five times very fast than lands in a bucket of mustard. So it's going to have a hard time figuring out that a little bit, but it, what's so interesting about this is you, it basically turns into a non human entity with like legs flipping everywhere.

Gavin: This is, it struggles a lot. And I, and I think this is something to think about as we go forward. Like it's going to really struggle with any sort of motion. And to your point about physics, you know, this was always supposed to be like, Oh, Sora was supposed to be like the world simulation engine. And kind of right now, it feels like a lot of the physics are very broken.

Gavin: Like we are not seeing that many realistic physics in here, which for us can be fun. But if the idea going forward with Sora is that it's not just a video generator, but it's going to simulate the world so that you can have AIs, you know, do simulated adventures and learn through stuff. Well, I certainly hope I don't meet the AI that, that flipped over six times and became six legs because we're then definitely screwed.

Gavin: Arnold's probably right.

Kevin: [00:51:00] Yeah. You can bend like this, human.

Gavin: Yeah,

Kevin: bwop bwop bwop

Gavin: exactly. I learned it from the mustard bucket video. all Gavin Purcell's fault. He's the reason why we're bending you this way.

Kevin: I like Sora, I don't mind that it's broken right now. , are there better tools? Absolutely will Sora get better, most likely. , I wouldn't shade open AI by any stretch. , I don't think it's worth paying the 200 bucks for just yet though, but your mileage may vary and your needs may vary.

Gavin: And by the way, for 20 bucks a month, you get to try Sora. You get to try Oh one, you get to try all these things and you get chat GPT. So. I think opening eyes plus subscription is a huge value right now. You may find yourself frustrated that you run out of certain things and that might suck, but just for 20 bucks is a pretty good deal.

Gavin: Well, everybody, we will see you all next week. Thank you for joining us and sayonara.

Kevin: Goodbye.