Google’s Potential, AI Money Spigot Shutting?, PHP Bug & Cybersecurity’s “Black October”

0:00 What is Google's potential? We'll get into it after my conversation with Google CEO Sundar Pichai. Is AI's money spigot finally turning off? And is Black October for cybersecurity as a PHP bug and plenty more end up opening the doors to bad guys in technology? We'll cover it all on a Big Technology Podcast Friday edition right after this. Welcome to Big Technology Podcast Friday edition, where we break down the news in our traditional cool-headed and nuanced format. We have a great show for you today. We're going to talk about Google's potential and cover a little bit of my interview with Google CEO Sundar Pichai, which was conducted earlier this week. We're also going to talk about whether the money spigot for AI is closing as companies like Meta say that the demand for money is starting to outpace the supply. And then finally, Alex Stamos is going to join us and talk about the PHP vulnerability that's turning the tech world on its head.

0:55 Joining us as always on Friday to do it is Ranjan Roy of Margins. Ranjan, great to see you. Welcome back. >> Wednesdays with Sundar, Fridays with Ranjan. Just another week at the Big Technology Podcast. >> As it should be. As it should be. And you know, it was really interesting for me to put some of our long-running questions to Sundar, including what matters more, the product or the model. You know, I did tell him, I said, "Hey, listen, people are arguing that you just need standard models and you can put that into action in your products and that is a good strategy for Google."

1:27 Sundar wasn't having that at all. He said that Google's committed to the frontier, that it's always been about the frontier, won't have it any other way. And you can make good products with standard models, but the frontier is basically frontier or bust for Google because the frontier gives you visibility into what's coming. It also helps you improve your models faster. You know, as you develop more models, you can rely on the frontier to help you make them better quicker. All right, we know what team you're on, Sundar.

1:54 >> We know what team you're on, Sundar. >> He's on team model. What do you think about that statement from him? Does it make sense? Does it make your thinking about how the model is more important sorry, how the product is more important than the model in today's age of AI? Does it Does it shift that thinking at all? >> Okay, it does not, at least the first part. The second part I do think is interesting around like the more at the frontier you are, the better you can actually train future models and it starts to give an edge overall. I think there is something to that. I think in terms of like overall progress for a company that being at the frontier does mean it can move faster. And I think anyone I mean, the speed and velocity with which Anthropic and OpenAI actually just launch, everyone feels it, everyone sees it, and I think that is kind of validation of that part of it. But in terms of I still more firmly than ever, and I think anyone who uses, and I will say this, Google's suite of AI products and how disjointed they are, and we've talked about this a lot around like Gemini and Workspace versus Gemini standalone. Like you can feel that lack of cohesion in the product within the entire Google ecosystem. And yes, I know it is a big, large, sprawling, massive company, but I think actually a little more focus on the core product itself, Sundar, I'm going to say it, I think would be valuable for Google.

3:21 >> Okay, so that is another interesting point that we can bring up about the interview. And by the way, if you're new to the show, you came in after seeing the conversation, just a bit of housekeeping, we do these news breakdowns Ranj and I every Friday. And then we'll have a flagship interview like the interview with Sundar typically every Wednesday. So next week, for instance, we're going to have Wharton Professor Ethan Mollick talking all about the productivity gains or the invisible or non-existent productivity gains. We get into a bit of a debate that we've seen after the AI era has kicked off. So, this is kind of how the show works. Really happy to have so many new viewers and we appreciate you being here and listeners. all right.

4:01 So, so Google's product priority. this to me was actually one of the more interesting and subtle takeaways from the conversation with Sundar. and we're going to of course get into the company's potential very quickly, but I think it's important to go over some of the highlights. So, I asked him, I was basically like when I mean not even basically, this was the question straight up is when is search within Gmail going to work as good as Gmail being plugged in to ChatGPT, right? Very interesting answer from Sundar. as opposed to saying, "Yeah, we're working on to getting AI into all of our products." You know how he answered? He said this. He says, " we're trying to bring this all together in a unified agent first for enterprise and then coming for consumer." he says, "You can address this agent whether you're in workspace, search, and Gemini. We're putting a lot of time and effort into making sure as we build out our agentic experience that unification and that capability works well across all these services."

4:57 You know, and then I said, "Well, that's a good answer to the interface question." cuz I asked him what the interface of the future looks like and he goes, "It is." So, I think I I and you tell me if you're reading this in a different way, but I I thought this was very telling. I almost read this as, you know, in a way Google's going headless where it's instead of having separate product areas, which is kind of the way that it operates now, everything is going to be unified through the agent and their priority is building those integrations within the agent as opposed to building the integrations within the product themselves. That sounds smart to me. let me turn to you. What do you think about that strategy?

5:31 >> I think that's absolutely what they need to do. Again, the idea of having Gemini as like this little button at the top right of your Gmail and your Google Sheets and going and staying in that kind of being constrained to that traditional product layer and AI becomes an add-on to AI is the core UI and you're chatting with it. You're asking it to go through your email. It's the way so much of AI has already moved and I think it's the right choice. I will say knowing how siloed a lot of different parts within Google are and even I think that reflects in the product. It's interesting to me and actually we've joked in the past that Google's McKinsey background makes them uniquely suited to recognize Sorry, sorry, sorry. Yeah, yeah, Sundar's makes them uniquely suited to actually pursue this organizational change that is required at a company like Google, but who would own that product? Is it Google Cloud which owns Google Workspace? Is it would DeepMind is no longer DeepMind, right? If I remember >> No, it is. Google DeepMind.

6:39 >> Google DeepMind. Is it the Google search engine like who actually owns that at a company like Google? Well, it to me that would require some massive internal transformation to actually make that successful. >> But isn't it pretty simple? Like don't you just create a new team new team to own it and you then change the way that you evaluate the other products, right? So let's say you have the Gmail product group. you're going to say you still work on Gmail, but as opposed to let's say engagement or user numbers being your North Star, your North Star is now going to be, you know, how many times people, you know, repeatedly query Gmail through the agent.

7:21 >> You That actually sounds perfect and I think that's exactly how it should be. Now Now, come on. >> It's a hard It could be tough to swallow because it's a lot of centers of powers within a big company. >> Exactly. Centers of massive amounts of powers and hundreds of billions of dollars of revenue and like I mean, this is to just say, "Oh, by the way, your worth is now number of queries rather than you have been evaluated forever and your entire department's worth is based on daily active users and total like utilization, too. Oh, yeah, and you're just an API call now or not necessarily an API call, but you're just some queries to this other new shiny product." Again, it's interesting to me because a company like Google, I think more so than I mean, actually Microsoft, it's the same thing and I think we see that disjointed nature across a lot of their product offering.

8:16 So, that for for the giant hyperscalers, that is the bigger challenge to me. And actually, as we're saying this even more now, Sundar, team product I'm going to double down on because I think if you can solve that, you have the every user in the world sitting and using your product or vast majority of them like make that work well and just being around the frontier should be good enough. >> And and you know, you're you're hitting on an interesting point here, which is that Google really is this company with so much going on and yet many dilemmas, right? Another dilemma is where to allocate the compute.

8:56 And you mentioned Google Cloud and I think there is there is a well-documented and obvious clear conflict of interest between AI research and cloud compute within and cloud yeah, cloud services within Google. you let's say you have a bucket of compute, you could give all that compute to cloud services and because of the demand for AI compute, chips, etc., you could make massive profits. We'll talk about this in a minute, but Google Cloud Platform grew 82% this past quarter. And that's with a a lot of the compute capacity going to AI research, right? So, if you were to put even more capacity to cloud, I wouldn't be stunned if they took if they overtook Azure and maybe even AWS at some point in cloud computing. But basically, you know, I spoke with Sundar about this and he what he said was everybody is short compute. He said today when you look at everything, everyone is short, not just us, other companies, and everyone wishes you had two times what you planned for because these decisions that you have today in 2026 were made in 2024.

10:06 and this is probably the toughest part of his job is allocating the compute between cloud profits and research, which is a cost, but can put it in in place to be able to lead the AI game. And of course, like, you know, as much as we might clamor for the product, it's always like, well, where's Google's latest model? And they finally have one with Argon that's performing quite well on the benchmarks. >> I I love this cuz actually that decision, where do I allocate the compute, is the ultimate expression of team product versus team model. It's where are you going to push it to the research side and the actual like frontier training side or you going to push it to Google Cloud, which is going to be the much more application and product-heavy side of things. Again, it's not pure product, but it's still in the much more kind of like general utilization of that compute. So, so I like it, Sundar, and he's going to show us which team he's on based on where that compute gets allocated and it sounded like from the interview that it's still going to be leaning towards the research side. Is that Is that a fair understanding?

11:11 >> I think basically what he was trying to say was research is going to eat. Here's the quote, "Our cloud business is at any given moment in time forgoing short-term revenues because we are making compute trade-offs to support frontier AI development." So, very clearly, cloud is sacrificing money. And then he said something else, which I thought was interesting and I don't think the world has picked up on. So, what he talked about was that some constraints are good. Even our AI researchers have some constraints which are also good. That's what inspires creativity. That's what helps you come up with the more efficient algorithmic breakthrough.

11:49 If you were to run that logic by, let's say, the you know, the AI researchers at Anthropic or OpenAI, I think they'd have a heart attack. So, I I think it would it is very interesting to hear his perspective that like, yeah, I'm going to give you the amount of compute I think is necessary to advance the frontier and we're committed to the frontier. But some constraints might be good for you. And that was interesting. That is a very different philosophical shift that no one's picked up on yet.

12:17 >> No, I that's it's great to call that out because I actually think that is very relevant. Again, to go back and forth though, if he's saying on one side the entire industry is short compute and my biggest challenge is allocating that compute. But I do like this idea cuz again, there's a lot of kind of talk around how it was actually a lack of access to abundant compute that actually pushed Chinese innovation on more on the algorithmic side. We've seen innovations with decision models and Jev recently and like like actually doing more with less. Certainly, that kind of constraint forces innovation versus like you have infinite access to compute and that's going to be where you kind of how you approach all these problems. It I think that is interesting that he's saying that again, what does that actually mean for his what what do you think those meetings look like? Do you think they have like a meeting where all the most powerful people at Google sit and then wait to be told what which pile of compute they're going to get access to? It's like >> >> Can I be out here?

13:23 >> one chart goes up and it's like, all right, sorry cloud, research is research gets this many. >> I do think that there's a version of that. I mean, I I I'm not privy to the details of the meetings. >> We're just hypothesizing. This is fan fic, Google fan fic. >> But I I mean, it it would not be stunning for me to, you know, think that there are people with projects within the company who are like, I'm going to need this much compute or I'm leaving.

13:51 And that those are the decisions that he's faced with. I'm sure that happens. I mean, Noam Shazeer, for instance, who's been in in and out of Google and founded Character AI in the middle, he left. He went to OpenAI. Why do you think that happened? I mean, I could just imagine the conversation. And they spent a lot of money bringing him back. >> Yeah. >> Yeah. >> Could have just invested in some Well, I guess they couldn't have just invested in some more GPUs.

14:16 >> Right. >> Hence the short compute, but >> But they're making TPUs. The problem is that the the decisions that takes 2 years in terms of build out and probably even longer, honestly. but yeah, and then on the cloud side, it's probably just like, you know, I could see the cloud. I could see Thomas Kurian making the argument, "Listen, we are in a rare position where after lagging as the number three cloud computing company, cloud computing service, we can make a a legitimate push for, you know, at least number two and potentially number one." And I mentioned this before.

14:51 And Google Cloud Platform, 80 almost an 82% growth rate this past quarter year over year. Their revenue last quarter was 24 billion, 24.8 billion. Azure's revenue last quarter was 29.4 billion. AWS's grow revenue was 42.2 billion. AWS 37% growth, Azure 42% growth, cloud Google Cloud 82%. Sorry, Azure 42% and cloud 82%.

15:22 They have a meaningful shot here at at at least passing Azure. I don't think people are recognizing this. You know, if these numbers continue a pace for maybe another year or two, they're at the solid number two. And if you're running the cloud business, man, it's like you you make that you make that pitch and it's hard I mean it's company that's been struggling to build a cloud business for a long time or really, you know, clawing at it. this is the moment to capitalize, but of course it comes at the expense of research.

15:48 >> What is your decision as hypothetical Sundar? >> Flood Flood the cloud, man. >> Flood the cloud. >> Cloud's got to eat. No, I don't know. I don't know. It's it's I wouldn't want to be in that job because it's so hard. how about you? >> I think it again, I love it. It comes back to do you believe the product or the model is going to be the >> I'm giving the cloud the money. >> I'm giving the cloud the money. I'm giving the cloud the money. I'm telling my researchers do more with less. Come up with innovations that actually make this more compute efficient and again, they have the distribution base. They have the like every whatever billions of people will be interacting with their products. That to me I just more so than ever most people don't need to be at the frontier. Most people do not to be need to be on the frontier model for most tasks. Not all of us are doing not everyone needs to be doing 3D modeling and whatever else like it should be fine for them to focus on creating the most again, like the Instacart of the world. We we've talked about this with news. No one even cares what model it's actually running on at any given time for a given task. All everyone cares about is that they are magical product experiences.

17:10 And to me if Google where's your agent? Where's the personal agent? >> I know I I highly disagree with you on this one. I think that if the unified agent is going to be the product experience that people are going to be competing about, having the smartest and most capable one is going to matter. Because right now what you've seen is Muse. I mean, just imagine you built Muse, but the model underneath it was 10 times smarter. You would obviously use that one. So, if you get >> But what What What does that actually mean? Cuz cuz Opus 5.5 a lot of the times does not give me what I needed to give me. It like over thinks, it over does things, it for simple things, it's not necessarily the right answer.

17:51 >> Well, I'm going to So, this is what I'm saying like I'm trying to say is like with model innovation, you know, you won't be saying it doesn't give me what it needs to give me. You'll be saying, remember we talked a lot about how important it is that a model understands the intent of the query and routes it the right way. And so, if you have one that's incredible at that, that thinks just the right amount for when you have a sort of low intensity task and a lot when you have a high intensity task, and you can trust that it gets it right.

18:17 that's and it has the EQ to know when it should interrupt you or not. That I believe will be the winning product. I mean, otherwise, what are you competing on? Your mascot. >> Your computer >> >> Certainly the mascot and What would Google's be? Let's start naming Google's personal agent Or is it just Gemini? >> Don't let Alexander Wang get any any near the branding. >> Gemini alone. Leave Gemini alone. Do not sexualize Gemini. >> >> That's my platform.

18:47 >> I'm voting for that. >> Yeah, I still disagree. Again, I think like the majority of use cases and ideas that like people will be interacting with to constantly get that product layer better and better and better at answering it. Even again, right now with Muse, like when should it respond quickly? When should it wait? Even tiny little things. I think Instinct, one of the things I love it does, is a little emoji reaction just to show you like it it registered your query even if it might take a little longer to actually come back to you. Like there's so many ways people can actually these products can try to help guide people along the way versus just sheer model intelligence. Are you still using dots?

19:29 >> I am using dots. I'm liking it. I think that like we should we should definitely make time to talk about just the potential of Google because every time I speak with Google, it's just it's clear to me that that you know, if they're able to get all their ducks in a row, so to speak, they are you know, so well positioned. probably better than anybody else. So, think about it. I wrote a little list about, you know, Google's Google's potential if it hits everything right. So, it could have an agent that list. The The list is this. It could have an agent that works seamlessly with its services, right? Which by the way, since so many people a billion 13 products with a billion users. that agent can be extremely valuable if it's working across your Gmail and calendar natively. it can have an AI for information retrieval, right? Which is search.

20:21 it can license out its models via the API, so make a licensing fee there. it can resell or sell compute and potentially even chips via Google Cloud Platform. It has Waymo. And then of course, it has tens of billion dollars either invested or committed to be invested in Anthropic. So, it'll have have a huge chunk of that company. Name me a company outside of Google that has the ability to hit on all of these fronts from unified agent to model licensing, autonomous driving, and then of course, the investment. I can't think of one.

20:56 >> No, I I completely agree. And I I kind of love this list and and but again, to me this is like what we have seen to date is all of those potential channels also present potential complexity or not existing complexity that actually make things difficult for them to execute. Again, why when I ask Maps in Google Maps, do I get a completely different answer that's worse than when I ask Gemini the same question? Why did Google Maps integration again? I'm asking like very pedestrian things that should be solved.

21:32 And that's where each one of those I I I mean, when you said it 13 products each with a billion users, they know everything about all of us. They should be able to serve us all better. The entire search like better search experience, they should own. shopping. Actually, you didn't even have shopping here. I actually think they're incredibly well positioned in agentic commerce to actually make a dent on Amazon. but that presents the challenges, too. Who owns what? Who what power centers are you kind of fighting against? So, to me and again, if Sundar if he can figure this one out and the organizational structure and that gets them to the greatest potential on this, if anyone can do it, he can. So, I I'm I don't disagree.

22:25 >> Okay, that's a good way to wrap the segment. I we have 10 minutes before Stamos comes, and I want to talk to you about this concept that the AI money spigot may be running out. remember that these companies have been funding AI infrastructure through VC, through their own free cash flows. I'm talking about OpenAI and Anthropic, but also the public companies like Google and Amazon and Meta. And then the free cash flow ran out. And so now what do they have to do? They have to like get creative.

22:53 they're using debt. We've talked in the past about off-balance sheet debt. they're doing equity sales to be able to to fund this, including Meta which just split its stock and you know took away even more voting rights so it's able to sell that stock I think and invest it in building compute the market's had it. Meta reported these earnings and it's down 9% on the week and this is from the Wall Street Journal a regulatory filing from meta noted that recent significant capital raises from peers like alphabet and space x alongside anticipated fundraising from anthropic and open AI have created an increasingly challenging fundraising environment.

23:39 Oh as a result the company would more proactively raise funds before competitors absorb the markets available capital. This is the first time we're hearing honestly of the capital potential running potentially running out for companies like meta Google open AI and anthropic so there is a limit here to the amount of money that can be raised and so ranjan to you is compute has been the constraint all along basically it's been as quickly as compute can come along can come online it will be bought and used but the bottleneck has been the amount of compute that you can build is the new bottleneck the money because if meta is running into these problems you know what what what is the potential for this entire AI build out can to get stopped in its tracks by the simplest thing of all the amount of cash you can have to build it out.

24:36 >> Well I I I think we we talked about this last week and one thing that I'm actually kind of happy about is we're actually entering a period where there is rationality being applied to any kind of capital request capital raise like when there is space x this week trying to raise 40 billion dollars of debt and actually seeing that the actual yields they would need to pay were much higher than expected. even on Meta, that was a I think they're supposed to raise the capital commitments now yet are have raised risen to a $825 billion up from $700 billion in July. Like the market is saying, "Okay, it's going to cost you more to get that money."

25:19 Which is good. It should. I mean, just from like a capital is finite anyways, and I do think there's but but there it's going to we're going to see more of that. Then you have the whole Neo cloud story with CoreWeave and others. And then, I mean, obviously there's like a great deal of potential turmoil there. But I think to me is there is the reason capital is becoming more constrained because people don't buy the compute story or that they don't they've seen that it's actually very difficult to build these data centers and that it's not going to happen as quickly as possible.

25:55 Do you think And going back to Sundar's point as well, like do you think the market as a whole has said, "Actually, this idea that the entire world will be short of compute it is actually validated" or do you think people are just like, "Actually, I'm not going to give you money to fund data centers cuz they're hard to build"? >> I I believe it's it's neither of these things. >> Okay. >> So, I have two other reasons.

26:18 One is the investors are starting to do the math on what it's going to take to make these these products profitable. This is a little item from a Wall Street Journal story that I read, which actually did the math on what Muse would need to generate to pay back some of these investments that Facebook is making. Remember, Facebook raised its guidance from 700 billion that it's going to spend on AI infrastructure to 825 billion. This is the amount of money they anticipate Muse building in one of the good scenarios. If Muse skyrockets to 100 million users next year paying $20 a month, it would only add 24 billion to Meta's annual revenue, about 12% of next year's anticipated capital spending.

27:01 associated advertising fees could add more to the pot, but probably not a ton. Meta Meta made about $67 of revenue per daily active user from at mostly from ads from in the year end year to end of the third quarter. For 100 million users, that would add another 6.7 billion. Again, this is a company that's spending 100 billion. No, sorry, 825 billion on on AI on the AI build-out. So, basically, in order for to make this work, company needs to get Muse to a billion users. And even then, we have questions.

27:38 >> I think trying to come up with what is the scaled business model of personal agents like Muse. And normally, I'm like very skeptical when people try to avoid that question. For a company like Meta, I still think it's still a bit early. Again, trying to apply the would you pay $20 a month? Are you trying to trying to extrapolate out the existing ad revenue per daily active user? I still think like we don't know what the business model around personal agents is going to be or it will there be a sustainable one, but I mean agreed like if the market starts asking those questions, it's a huge problem for a lot of companies, especially startups, cuz I think like to date, especially on personal agents, the assumption is whoever just starts getting people draining tokens and using it non-stop and getting completely habitual to it, the money will come. So, if people start asking that, that is a problem.

28:36 >> So, that's that's one for me is people are actually doing the math here and they're like, "Hmm, how does this work?" And the other side of it is I think they're fatigued. They put the The itself has put so much money into these companies and it's still experimental and the belief was there but eventually that hits a wall. That's from the Financial Times. OpenAI has cut its valuation target for its latest funding round after facing resistance to a 1.4 trillion price tag from some investors. It's going to be 1.25 trillion now.

29:06 Deeper in the story, this was the rationale. Multiple people with knowledge of the Morgan Stanley led process said demand from clients was weaker than in the past. There has been zero clamoring, said one of the people. All the prior times OpenAI have been on, there's been a frenzy. This time it's a bit of a thud. Some investors were also suffering from fatigue or indigestion after having invested heavily in prior rounds. OpenAI raised 40 billion in March 2025, 122 billion in March this year and Anthropic has raised close to 100 billion this year. And that might be the most simple and obvious explanation here, it's fatigue.

29:45 >> And I am happy if this is the case. You know what, everybody? I hope you all have a little bit of indigestion. Let's all just take a moment. Even the fact that that there was zero clamoring, that in the past there was much clamoring, is a reminder that everyone has been way too kind of intense about it cuz again, the fact that we're calling it a thud when the jump in valuation is going to be almost 50% higher than its last funding round is crazy. Like the the extrapolation, the expectations is still I mean just maniacal. So the idea that like that is a thud, I think is it's healthy for the markets overall. So if everyone can take a breath, pause to start moving forward again, I am happy.

30:34 >> So do you think that this means OpenAI briefly, do you think this means OpenAI is no longer on track to a successful IPO or is it just sort of I mean usually these things once these things stop going up they start going down in a real way. >> I think it all depends on Anthropic and what happens. I mean it is kind of crazy to think about like you're sitting at you're invested in Open AI heavily heavily.

31:00 All that matters is how the market receives Anthropic. Any kind of like let's say try to evaluate the financials on a comparable basis none of that is going to matter. If Anthropic gets hit there's no way Open AI is going out. >> Ranjan before we move over to Alex Stamos I just got to ask you one more question. like you know the financial markets you know the systems where you know people raise money and people invest it having worked again on trading floors in the past.

31:32 is it possible money just ran out like it did they just take all the available money? >> Well I mean if you look it is UAE investors and Co 2 that were coming in on this so it's still we've talked about when is the where do the deepest pockets live? I mean but but there is like the sovereign wealth funds are the the final boss basically. Yeah we've reached him. Short of you know what? Where's the next government treasuries that's your next your last bastion.

32:02 >> Yeah no I've been saying for a long time that the Gulf states are the final boss of fundraising before IPO and Open AI >> Here we are that's the end of the game. >> Yeah. >> All right. Look when when we come back we're going to have a great discussion. I think people are largely under appreciating how intense the PHP vulnerability has been and along with a number of other security vulnerabilities that have emerged this month people are calling it black October for cyber security.

32:33 And if that doesn't make sense and there are still things that I am trying to learn about it. Good news is we are going to unpack it with someone who really does understand this world and is able to do it in a way that's accessible and and hopefully help us wrap our heads around how big of these vulnerability how big these vulnerabilities are that AI is finding in systems like like PHP and what it means because we talked with Alex basically as the hugging face hack happened. He said it was a big deal then it obviously proved to be a huge deal.

33:08 He and I just texted this morning and I was like I want to talk to you about PHP and he goes not just PHP. It's been an absolutely insane couple of weeks. So we'll speak with Alex about the implications of the insane couple of weeks and what the ripple effects are going to be when we come back right after this. And we're back here on Big Technology Podcast Friday edition. We have of course Ranjan Roy of Margins with us as always on Friday and today we bring in our guest for when the proverbial excrement hits the fan.

33:39 Alex Stamos is here. He is the Chief Information Security Officer at Cognition. New job, same Alex. Alex, great to see you. Welcome back to the show. >> Yeah, thank thanks for having me. I'm glad that I am the Grim Reaper of this podcast. >> >> Well, the last time you were here on the Friday show we were talking about the hugging face attack. Basically as soon as right after it happened before the the report was released and you're like guys this is you don't realize how bad this is. We certainly didn't. Ranjan was still calling it marketing.

34:11 Then it turns out that he thinks he still is. Then it turned out that hundreds of bots had autonomously decided to hack this hugging face company in a in a fairly unprecedented attack that has basically you know driven the AI anxieties through the roof. Ranjan, I'll give you a second to defend yourself here. >> No, no. I the severity of the situation I will recognize. I definitely have some questions on like the actual how this vulnerability was found, exploited, and what's that mean cuz I'm still going to push back that that they autonomously went out on their own and started doing nefarious things. Like definitely trying to understand is this kind of like targeted cybersecurity hacking? Is this people who know they want to exploit things and are doing that and then we'll get into it, but >> into it.

34:59 >> wrong that it was just marketing. I I throw my hands up on that. >> This is Alex. You're here for a seminal moment here on the show. So, Alex was spot on last time and now, you know, as we're talking, you know, Alex's belief is that this what we're about to talk to you about is the next big thing. and as I mentioned before the break, I was like I got it. We got to talk to you about PHP and he said it's not just PHP. This past few weeks have been insane. So, I'll I'll just read the story and then and then Alex, you could take it away. This is the headline from the Wall Street Journal. AI just found a bug that puts up to 70% of the world's websites at risk. The creators of PHP, a technology that powers as much as 70% of the world's websites, disclosed a critical security issue that could be leveraged by hackers to take control of any system running its software. That would allow an attacker to steal information or launch a cyber attack on anyone visiting a hacked website.

35:52 good time. 70% of the web. Not a big deal. so, Alex, just talk to us a little bit about how this was found. It was found with AI and what this has led to and what it presages for what comes next. >> Yeah. First to set the stage, we'll talk about PHP first, but this has been about the craziest 30 days or so in the history of our industry, of cybersecurity. and so, PHP is what's catching the headlines. but for people who do this professionally, there's actually lots of stuff that's happened just in the last couple weeks. so, the PHP bug specifically, like you said, PHP is a very popular language for writing websites easily.

36:31 So, very few kind of enterprise quality websites are written are written in PHP. the interesting counterexample is Facebook, although Facebook doesn't actually use real PHP. They use a typed version of PHP called Hack. but other than that, it is very hard to think of like a big company that uses PHP for a banking website or a big application or something. That being said, it's extremely popular for companies to make side projects, right? Here's my marketing site. Here's a a a smaller application. It's extremely popular in a number of frameworks and hosters like WordPress that host lots of sites. And so, it is still very widespread.

37:14 the bug was found by a in a a project that was being run by OpenAI called Hack the Planet, in which they have been providing >> Make name. >> Yeah, exactly. right. the that is marketing. I'll agree with Ranjan on that one. But there's been, as we talked about actually on stage at your conference, there's a lot of controversy about the access to the best cyber capabilities from the two big AI labs, OpenAI and Anthropic, who at differing levels restrict the ability for people to use their software to do vulnerability research. And so, to as a response to that, they both companies run these programs where approved people have access to use their models to go find bugs. This was part of this where they were actually giving this away to free to bug finders. a company called Kaliff, which is a kind of excellent security consultancy that does a lot of AI-enabled vulnerability research, they used it to to find the PHP bug. and then that was actually several months ago, and there's been a coordinated effort by a bunch of companies to try to get ahead of this issue of what's called coordinated disclosure. It went kind of off the rails in the last couple days, however, before the release and that whenever you do these coordinated disclosures, you start obviously with a small circle and it gets bigger and bigger and bigger and it started to leak out and we now have evidence that bad guys started exploiting this well before the public release.

38:41 There was a controversial dump by the CEO of Chain Guard, which is a company that will make their own patches and push them to customers. But looking back, he might have been in the right. It's it's it's a little bit controversial. There's a big discussion. Anyway, the bug is a big deal because it is a pre-authentication remote code execution. So, means you do not have to be part of the web app, right? So, there's you know, there's been a bunch of web app vulnerabilities where you need to be logged in or you need to be accessing some kind of functionality.

39:09 This just works on the front end and it's remote code execution. It is not an incredibly easy exploit to write. It turns out to be quite a complicated issue, but people have figured it out probably with AI. And so >> So, that just means that I just visit the site and my stuff could be could be jacked. >> What it means is as a bad guy, you could just connect up and attack the system without having a login and without having special access. So, even if the PHP site the front page says login here, you can't access anything else, you're still vulnerable and you can't fix the bug without patching PHP, which is under your web code.

39:47 They only released a patch for the latest family of PHP and there's a lot of PHP sites on older versions and so upgrading that breaks your site. So, it's not just as easy as going in and saying, you know, run run your update program, whatever your operating system is. For a lot of companies, they have to actually refactor their code to be compatible with the latest version of PHP 8 because it was not back ported. There there turns out to be some like unofficial back ports and patches that you can get but that those are not as widely available.

40:19 >> So what what does that what what does that mean in terms of the vulnerability of every website that has been built with PHP in terms of the hacker can just take it down, they can access actual underlying databases, they have like full access to whatever is in terms of the in their whole stack. Or >> They can take over the computer at the same level as the web server is running which by definition has access to all of your data, right? So what has been happening since just a little bit before the announcement is when you have a bug like this, you have a bunch of different bad guys go out and try to break into as much stuff as possible and then they'll figure out later what they actually care about. And so what we've been seeing is automated exploitation of hundreds of millions of attempts to break into millions and millions of websites that are going on continuously. So these will be Russian ransomware actors who will like to take these things over, install malware, and then figure out who they want to actually ransom.

41:17 It is probably what is called the Chinese cottage access industry. So there are within China there's effectively like an eBay for hacking and so there's there's providers in China that will break into a huge number of sites. We've seen this with other bugs. And then they will later sort through and then figure out who they want to sell access to inside of the PRC. there is probably the Iranians who are like >> eBay is is vintage sweaters and their eBay is ransomware on your computer.

41:42 >> It's not quite like a a full eBay site from my my understanding but like there's basically an ecosystem here and it's quite smart because in other countries like Russia you have this problem where if there's a desire to hack something everybody rushes in and they all step on each other's toes. So the PRC has the ability kind of dedupe taskings for their private access industry. So anyway, I expect that those people we have seen this in the history like there was a very famous SharePoint bug in Microsoft where these Chinese access vendors broke into something like 80,000 SharePoint sites that are on the internet and then sold them later to Chinese companies. so and then these guys break in, they plant malware and then sometimes what they do is they actually fix the bug so somebody else can do it. What we have seen in the past is you'll have them fighting over control of these systems. So whoever gets there first, part of one of the things they have to do is close the door behind them. Otherwise, other people will break in, remove the malware from the first hacker and then patch it themselves. And so that is effectively what's going on right now is you've got dozens or hundreds of hackers of hacking groups attacking tens of millions of websites and trying for control and then in the long term what you'll see is they'll then have their list of this is what I control and they'll search through it and like, oh, there's a government websites, this is a hospital, like what is the interesting stuff that now that I have control of it and I have malware there, I'm going to actually steal data or or do a ransom.

43:04 >> Wait, so so by control, just so I understand it correctly, it's you control as a users are entering information into the website, you're receiving all of that, but does it but does it also mean you then have access to anything else like in the back end or it's it's both? >> You will have access to what is happening live but also probably everything in the database. and so and then it also gives you a foothold inside the organization. So you're now behind the firewall, you're in their production network and so you can you've got your first foothold inside of their network, you can use that to maybe break in deeper. So that that will this is just the start for the PHP bug. This is the initial access vector. There will be some of these attackers are probably breaking in and then just dumping the entire database out so that they can ransom they could just use the data that's probably exactly what they're doing. Yeah, yeah, it's just like you just copy it all and then you figure out later what was interesting. 95% of it is going to be useless, 5% of it will be gold.

44:06 and then some of them will say, "Okay, great. Now that I have a foothold inside this company, I can use this to scan the rest of the systems, find other vulnerabilities, and go out of back." The other thing that I I I don't know I don't have any good statistics on where we are, but in some cases they're also using AI to do the attack, which means the traditional I have to wait doesn't really exist because you can just have your AI agent go do the rest of those steps automatically. That from what I've heard is not as widespread, but that is going on in other situations that we can talk about. For example, a Chinese group broke into a bunch of South Korean banks with completely automated AI attack chains. and so in this case, if you have that that attack system set up, you could use this to pivot inside of the network to go to different systems.

44:54 >> Alex, so just going to give some stats that Matthew Prince from Cloudflare gave. In the 10 hours before it was publicly announced this PHP vulnerability, across the Cloudflare network we saw thousands of attempts to exploit it. That jumps to tens of thousands in the 45 minutes post-announcement, hundreds of thousands within 2 hours, and millions now. So this is certainly leading to, you know, a ton of hacking attempts. just just explain it for us like if you're not like cybersecurity brained, what do you think the next couple months are going to look like, you know, once the you know, obviously the damage is being done as we speak, but this is one of those things that it'll be latent until it starts to emerge. So what do you think the next month, 2 months, 3 months, 6 months are going to look like as a result of what we just saw?

45:38 >> So first off, it is now basically impossible to get a instant response company to respond to you. So anybody qualified was already booked before this. So you'll have a bunch of >> response team. >> Yeah, what's instant instant response? >> Instant response. So like like a forensics firm to help you do this work. They were already basically completely booked because of everything else going on before this. So if you are a big company and but you don't have a team that can do your own incident response, you're in real trouble here because it will be very hard to get a Mandiant or CrowdStrike or SentinelOne or any of the other companies that do this work to respond quickly. So, first off, you're going to have lots of people trying to either do their own forensics or to recover by themselves.

46:21 we will see the breach notifications are going to start happening for the companies that actually have good security teams because they will hopefully have detected that this happened, and then they will be able to do their own forensics. But, that is going to be spread over a significant amount of time because there's going to be a lot of people who patch it and don't realize that within the 48 hours it took them to patch, somebody got a foothold. And so, then we'll see the secondary breaches over the next months as attackers now use that foothold to go deeper and deeper inside these companies. for, you know, ransomware actors, they want to get paid. So, in those cases, they will contact those companies and ask for money. For the government actors, we won't hear anything unless there is some kind of interesting research that finds their attack servers or something like that. And so, what you'll see is this a huge amount of data is leaving these companies, a huge amount of customer data.

47:13 we're also going to see a huge problem with everybody's passwords just got stolen, right? So, the the number one way any individual human is hacked is that they use the same password on multiple websites. And what we're about to see is in the dark webs where these are sold, you're going to see these dumps of tens of millions of passwords being sold over and over and over again. And for a a disturbingly large number of people, that is going to that password's going to work for their email. It's going to work for their >> Their bank. Yeah. Especially Especially if you get access to somebody's email, their life is over because then you can use that to reset almost all their other passwords. and so, we're going to see a ton of kind of individualized fraud, spam, that kind of stuff is all going to hit a new high over the next 6 months.

47:53 >> What do we do as everyday simple folks who are just logging into our bank accounts and emails and what do we do? I mean, use one password? What what what do you recommend? >> Yeah, so for for normal folks, there's nothing you can do to actually stop the breaches. So, what you need to do is you need to make sure you're using a different password on every single website. The easiest way to do that is a password manager. One password is one I like. There are other ones as well.

48:23 so, you need to install password manager and now if you've got that you know, the name of your cat 1 2 3 was your password, then every site that you're using that on, you need to now change it. >> my my Pebbles is now exposed. Goodness gracious. >> Yes. Yes. There you go. so, you've got to do that. you should just be very I think what's starting is we lived through this era where people just kind of assumed things were secure.

48:53 That was never true, but it kind of worked because the number of attackers that >> was finite, basically. >> What was finite. And so, if you just kind of blissfully walked down the street, through a bad neighborhood, you just got lucky over and over again. Well, the neighborhood's gotten really bad. we've gone from like, you know, a bad neighborhood in LA to like you know, Somalia 1990s, right? Like it we have it is completely the threat profile is completely changed. If What is the likelihood something bad is going to happen to you if you are walking down the street? And so, I think people are just going to be much more paranoid.

49:30 Obviously, there's the password thing. They're going to be much more paranoid about what websites they use. Like people just throw their personal information everywhere, log in everywhere, and you're just going to have to You can't really do what we call vendor risk management as a normal person of asking them lots of questions, but you can get a feel of like, is this fly-by-night forum the kind of thing I want to put my personal information in? And I think what even normal people will start using sock puppets, right? So, people will start creating secondary Gmail accounts for all the crap stuff they do, and then they'll have their important account for their bank and all that.

50:03 And you're going to want that secondary thing to be as disconnected from your real identity as possible. And I'd be looking out for frauds and scams, right? The number of spam is going to go way up. You're going to get way more texts and emails from people you know asking you to click something. People will be getting phone calls because all this directed graph information about who knows whom and their phone numbers have all been leaked. And so, you're going to get a lot more of the bad texts and the phone calls of like that are all AI driven now of you know, your grandchild's been kidnapped and all that. So, like people are just going to have to just be much more paranoid going forward. And and I think we talked about this, but I think unfortunately, this is probably the new normal for several years where the pace of crazy things that have happened in the last 30 days might be this might be up here, but we're not going back to the baseline. It It might drop a little bit, but it is possible we are now at a a heightened level of kind of operational tempo for bad guys and for defenders for at least several years.

51:03 >> And and briefly, what's it going to mean for corporations and governments? So, the consumer level we got down for the for the big guys, what what's going to happen to them? >> Yeah, so on this I'd like to expand a little bit cuz the PHP bug's a big deal. But just to make it clear on the same basically within 24 hours of the PHP bug, there was a a large number of node flaws. So, node.js is also a popular web application server framework and is much more likely to be used by enterprises. Now, the fortunately, the bugs there are more complicated and to exploit, but they are significant.

51:36 We've had a bunch of breaches over the last couple weeks. There was a certificate authority that had their certificate stolen. So, kind of a a not so great certificate authority. These are the people who the little lock icon in your browser, they're the ones that make that work. And if somebody steals those certificates, they can create certificates, they can create an Amazon certificate or Google certificate that is also trusted. it's a little complicated than that. >> It's yeah, it's PHP, Node.js. This is from X, so you can tell us if one of these are wrong. Java, GitLab, Railway, Signal, WordPress, Light LLM.

52:10 they're calling it Black October. >> Black October, yes. It is It is it is spicy. I mean, >> >> this is what we talked about in Sage. Like, this is This is the start of the takeoff of what the new normal's going to be based upon just the number of vulnerabilities that are being found, but then also the operational tempo that attackers are able to stay at going forward. those All those breaches you're talking about, so like Railway, Firework, those are almost certainly not PHP. So, that is just attackers being good at their jobs, and that being enhanced by AI.

52:44 >> And finding API keys for everything you built on Railway, which I did insecurely myself on some side projects in the past. So, I went back and yeah, yeah. >> See, with Firework, so there's a lot of attacks against infrastructure ingredient companies, where you see and that is why I expect those attacks are professionals. That is not like a 19-year-old. That is probably somebody working for a commercial like a a commercial vendor who's doing state-level work because folks are breaking into people who are important in the AI ecosystem, Neo Clouds, you know, hosting providers. And then once you have those API keys, you can turn around go back to the cloud. so, you guys are enterprises. So, enterprises are dealing with PHP right now. They're dealing with Node.

53:27 they're are asking all of their vendors what they're doing, right? So, I have to I keep on having to fill out these send these emails saying we do not have PHP at this company. but we did have Node. Everybody does, and but we fixed it as quickly as possible. what you know, the companies are like kind of panicking for their vendors for themselves what this is reminding them is they probably have a lot of stuff they didn't know about. Like a bunch of these PHP sites are like somebody set up a website for a conference they held 2 years ago and it's still up.

54:03 >> 2011 or something. Yeah, yeah. >> Yeah, exactly. And and if you architect the things correctly, then if you pop that, nothing bad happens. For too many organizations, once you're there, you're in a DMZ with a bunch of other servers that you can now compromise. or there was a bunch of data there that now you have to do forensics because you had the registration lists for everybody who went to your conference, that just got downloaded, you're going to be ransomed for that, or it was downloaded for a state actor who's going to use it for, you know, future whatever use, and now you're going to have to do a breach notification. So, there's a bunch of companies that are realizing that their attack surface is actually much larger than they expected because of all of this random crap, a lot of which is actually in the cloud, that makes it hard for them to pull together and say, you know, this is our perimeter.

54:48 >> And governments, like I saw the NSA? The NSA was talking about this? >> Yeah, I mean, NSA published, CISA published something. so, yes, it is a big enough bug that you have the US government. unfortunately, the the number of people who do defensive cyber in the US government has gone significantly down in the last couple of years because CISA was kind of decimated by political you know, political appointees who don't like the idea of CISA doing election security stuff. and this is showing now the outcome of that, which is we really need competent people in the government to help coordinate response to things like this.

55:28 >> Okay. Even though I am absolutely terrified right now, I'm still going to ask one level above that I'm I'm wondering about. So, everything we've described so far is still, again, purposeful, coordinated attacks to exploit leveraging AI to increase the velocity of these attacks. I still then there's still the entire world of And then there's reports on banking, like unsupervised agents potentially acting autonomously. Obviously, the hugging face thing, the scandal, seemed to be more around agents going rogue as opposed to people controlling them in nefarious ways. Like, is that yet another layer we need to worry about? Or do we have Yeah, that's just something to worry about, yeah.

56:09 >> >> Yeah, that's just I mean, so those are two totally valid but completely separate issues. You've got the >> Yeah. >> agents escaping during evals and training. That is going to be I'm not going to say solved, but the industry has done a lot to reduce that. A lot of things you've been hearing announcements are stuff that happened in the same same time as hugging time frame as hugging face. It's just it's all coming out now. still, it's all kind of leaking out.

56:34 you know, it maybe that will happen every once in a while, but there's been a lot of changes in the way people do these evals and training. That is not like an actual I think that's not really an actual like OpenAI's models going crazy and hacking you is not actually the threat that people should worry about. the other side is yes, we we are people using agents and then being like, "Hey, here giving Instinct or Muse, here's my entire 1Password. Go like handle my finances for me. Go file my taxes." is totally insane.

57:05 >> I I'm banging my head in shame. Yeah, I I did it. >> But people are doing that. >> Yeah. >> Right? People are absolutely doing that. And and so, that's what the banks are talking about is that they now see all of these the the these interactions with them that are are authenticated correctly, so they're not stolen credentials. but are clearly bots doing interaction and and one of the reasons Instinct has a ridiculous valuation from my perspective. but one of the things they did that that made them popular is they actually figured out ways to defeat all a bunch of the automated bot detection mechanisms from these companies and that's why Instinct is useful because it will effectively bypass the safety protections that are in place at these companies to keep you from doing exactly what you're doing, which is to have your bot interact with the most important parts of your life. so that is you have this you have this crazy tension where you have like the banks and big tech companies and you know, financial institutions and folks who are like, "I am going to do everything I can to prevent automated access to my systems on behalf of customers." And then you have this big demand from customers of, "I want my life to be easy. So I'm just going to turn over all my my logins and personal data to a company that's existed for 6 months."

58:18 >> I just want to end with this. there was a Nikita Bier tweet who he said former head of product at X, I said there's nothing to worry about, nothing important is run on PHP or old software except the water and electrical grid, a few government services like our missile defense systems and a handful of electrified fences at the zoo specifically for the lions, tigers, and the cobras. So folks, if you do see a lion walking in your neighborhood this weekend, just understand that the origin was OpenAI's hack the world program.

58:46 >> >> Yeah, hack the planet. And okay, THE PLANET. WHICH IS A REFERENCE to the the Hackers movie from the 90s. I don't know. This is another reference. I I can't make these references work anymore because now I work with a bunch of 25 to 30-year-olds and I can't make any 90s references. literally I had I mean there's like multiple employees at Cognition who were students of mine at Stanford and one of them called me professor and it was like the scene from you know, Indiana Jones where you know, he becomes the crypt keeper immediately.

59:18 Yeah. >> >> but I can make it with you guys. You guys are closer in age to me. But yeah, it is a reference. >> Angelina Jolie was in Jolie was in that. Yeah, I remember. That was like what computers were supposed to be in the >> Yes. >> when hackers were, yeah. >> Yeah, and they're hacking mainframes. >> Counterculture, yeah, yeah, yeah, yeah. >> There's a lot of neon. It's pretty fun. It's a fun movie. A lot of people watch it like in parties at Black Hat Def Con.

59:39 But, okay, the opening ice credit, like the the truth is is this bug has existed for a decade. A bunch of the bugs that Anthropic and OpenAI are either fixing themselves directly or are facilitating the fixes of are issues that have existed for decades that have always been waiting there. And so, there are people I I just want to push back on this cuz there's people on X who are like blaming Anthropic and OpenAI. And the truth is is these bugs were there, and it is very hard to fix an open-source product like this that is so widely distributed. This was handled as well as it possibly could be. It was always going to be bad. And if OpenAI and Anthropic were not doing this work, these bugs would be discovered. So, I've got my M5 Studio Max finally came. I'm running a obliterated quantized version of GLM 53, and wow, like the stuff I feel like a much younger man with the reverse engineering I can do, the exploits I can write, the things I can do now on a Mac Studio that leaves absolutely no logs. And so, these bugs were going to be found by the open-weight models, the Chinese models.

60:42 Somebody was going to find them. We have to fix them. And the only way through this of the 2 years or or 3 years or 5 years of dark ages we're going to go through is to find bugs and fix them, and then also we're just going to have to rewrite a huge amount of software. That is it we can't have these applications written in like type-in memory-safe languages languages by humans. We're going to have to refactor the whole thing. And the good thing here is that would have been absolutely impossible 5 years ago. Now, it is totally pluggable, right? Like that's actually a big part of our business at Cognition is helping big companies refactor stuff.

61:16 you know, and there's all these examples of like some old SAP-based software that was rewritten in big days and such. And so, you could do that, but it takes money, it takes time, it takes access to the best models, and it takes kind of a a willingness on behalf of the entire open source community to throw away the old stuff and to replace it with something new. And so, I think that is one of the things that might come out finally. This is something I've been calling for actually for a while is like we just need to rewrite a huge amount of the software that underlies the internet.

61:46 maybe finally there will be the billions of dollars necessary in both money and tokens thrown into a pool here so that that can get done. >> Right, last week my biggest worry was the honeypot. So, it turns out I was not anywhere prepared for where we would be this week. >> The good old-fashioned human honeypots actually. We're going to look back nostalgically. And so >> Exactly. Exactly. >> Yeah, well those are hard to copy with with AI for example.

62:11 >> AI. For now. Alex, it's always great to speak with you. you know, you've been here with us through thick and thin through the year and as the the stuff keeps hitting the fan, we'd love to keep speaking with you. So, thanks again for coming on. >> Yeah, feel like this won't be the last time we chat. >> >> So, unfortunately the great report will be back. >> Oh god. All right, everybody. Well, have a very comforting weekend. Thank you, Alex, and thank you, Ranjan. We'll see you next time on Big Technology Podcast.

62:37 Stay safe.