Section Insights
Choosing an Assistant: Intelligence vs. Familiarity
What factors should be considered when choosing an assistant?
The choice between an exceptionally intelligent assistant with no internet access and a moderately intelligent one with full knowledge of your history and internet access highlights the importance of contextual understanding and resource availability.
- Intelligence alone may not be sufficient without context.
- Familiarity and access to information can enhance effectiveness.
- The evolution of AI and self-driving technology is rapidly changing our expectations.
Google's Evolution in the AI Landscape
How has Google's role in AI and information discovery changed over time?
Google revolutionized information access 20 years ago, but its growth in query volume has slowed, indicating a need for adaptation in the AI landscape.
- Google's initial success in information discovery has transformed how we access knowledge.
- Current growth rates suggest a plateau in user engagement.
- AI advancements may require Google to innovate further to maintain its leadership.
Evaluating Company Performance and Valuation
How do growth rates and valuations compare among major tech companies?
Analyzing growth rates and price-to-earnings ratios among Microsoft, Amazon, Nvidia, and Google reveals that Google is expected to grow the slowest, yet its valuation reflects market expectations.
- Understanding growth rates is crucial for investment decisions.
- Valuation metrics can indicate market sentiment about a company's future.
- Investors must consider both growth potential and current valuations.
The Future of YouTube and Google's AI Development
What are the prospects for YouTube and Google's AI capabilities?
YouTube's future looks promising with improved content targeting and ad capabilities, supported by Google's strong AI research and development.
- YouTube's business model is expected to improve with better targeting.
- Google's AI advancements position it well for future growth.
- Incumbent businesses face challenges but also have significant resources.
Labor Practices and Global Manufacturing
What are the implications of labor practices in global manufacturing?
The discussion highlights the complexities of labor practices in manufacturing, particularly in countries like Mexico, where workers may choose demanding jobs for better living conditions.
- Labor conditions in manufacturing are often influenced by local economic opportunities.
- Cultural and economic contexts shape the perception of labor practices.
- Balancing ethical standards with economic realities is a significant challenge.
Transcript
0:00 Would you rather have an assistant with the intelligence of like Einstein, but they have no access to the internet and they don't know anything about your history? Or would you like to have an assistant that's just above average intelligence, knows everything about you, and they can use the internet? Okay, you would choose that.
0:31 Hey, great to have you here in person. Good to be here. I remember when you were right up this hill. Yeah. You guys were over here. So, I I had a couple thoughts this morning. First, I got to take a ride in full self-driving 12. How was that? It was mind-boggling. I think this is going to be a bit of a chat GPT moment for full self-driving, but what it really just reminded me of the magic of this moment.
0:56 Tesla rebuilding their models for how they do self-driving around imitation learning and all this interesting stuff going on over there. Like it you know, I think they probably made more progress in the last 12 months than in the last 7 years. Wow, that's a big thing. in terms of what's going on there. And And it's going to be rolled out here. It's already rolled out to I think 5,000 people. And so, like people are going to start experiencing that. And I think we're having more and more of these moments Right. because the substrate we're going to talk a lot about today, AI, Yeah. and just the compute like what it unlocks.
1:27 The second in prepping for this pod was how bad you make my head hurt. All right. the you know, I was thinking about this. I you know, what I love about this pod is like it's a forcing function. You know, you and I talk all the time. You're always challenging me. We're always comparing notes. But now with a little bit of structure around it, every couple weeks we have to think about some topics. Today we're going to talk a lot about think AI and compute and chips and its impact on big businesses and honestly, it it it I liken it to an athlete, you know, and they say in order to be at the best I can possibly be, maybe Kobe, I want to practice against the best. Oh, yeah.
2:05 And And no, but it's like listen, I I I the reality is it's like running 10 miles a day to get ready for a big game. Like it's like if you're in this business and you're not exhausted with the analysis you're doing, the thinking you're doing, particularly at moments like these to try to gather this data and try to gather edge, then you're probably not going to end up on top of the heap. So I agree. And I I think that having a a topic or an idea that you want to fully flush out and be able to talk about causes you to place a few phone calls, you know, read read a few PDFs. And And before you know it, you actually realize you've learned something you didn't know, you know, 5 days earlier. It's a you know, I think the the little, you know, pull the screen back a little bit.
2:47 I mean, you and I've talked, you know, interacted 5 10 times a day over the course of last week on these topics. And then we turn over a rock and we find more data, more information. We share that with one another. It leads to another conversation. You know, and the combined networks allow us to ask a lot of the smartest people in the world the questions we need to be asking to try to figure out this moment. So, it's been a lot of fun. But But it does give me a bit of a headache.
3:12 Hopefully a good one. So, so we remain we remain kind of in earning season. And And so, what what what's happened in the past few weeks that you think's super important? Yeah, well, we have a lot of we have a few stocks that have run a lot. Meta, Nvidia up 30 40% even with the pullback that we had today. But the truth is the Nasdaq hasn't really moved that much. I mean, I think we're up 3 or 4% through today. if you look at the median stock, I think it's up about 1%. In fact, I think we have a chart here just on the dispersion that we see in the Nasdaq. You know, and so remember last year was was like this risk-on moment, a mean-reverting moment for all of technology. And this year we're we're we're really starting to see the winners and the losers. We have some software companies that reported after the bell to tonight that are down a lot because they're not seeing the AI pull forward that maybe an Amazon or a Microsoft. So, that's my first takeaway. My second takeaway is, you know, against these higher prices for some of these companies, you know, the backdrop looks a little bit more challenging.
4:21 So, we had a CPI print that came out last week that ran a little hotter than people expected. The 10 years back up to 4 3. Remember, at the end of the year I think it had gotten down to 3 5. And then we had what I thought was a really provocative tweet at the end of the week from Larry Summers where he said the next move by the Fed could be higher. Now, why is this so provocative? Well, the market is betting for sure. The only debate about the soft landing has been when is the Fed going to cut, right? And so, you have Summers come out and say, "Hey, I think the next move could be higher." That would be a shock to the market.
4:54 Was he being provocative or do you think there's real data that suggests that that the soft landing isn't a foregone conclusion? Well, listen, Larry was was spot-on right in 2022. Okay. I think last year he he he he was a little bit too aggressive as to where he thought rates were going to have to go. at the end of '22, I think he said maybe they could have to go to 6 or 7%. But I'm humble in the face that the future is unknown and unknowable. Like what we don't know. That's the truth of the matter. So, as investors we have to try to distribute this these probabilities. And so, if I go back and look at this, real rates, right? So, real rates, this is the restrictiveness that we have in the economy. So, this is effectively the interest rates we have less the expected inflation rate in the future. They're as high as they've been since the fall of 2007.
5:50 And the last time they were higher than that was in the summer, August of of 2000. Okay, now, what was the what was going on August of 2000 and and the fall of 2007? Well, the the the economy was on a heater and the Fed was trying to slow it down. Okay. So, that's the level that the Fed currently has its foot on the brakes. And every month that inflation comes down, if it does, okay, then the restrictiveness goes up.
6:16 Right? So, the Fed if inflation is coming down, then the Fed does nothing and its foot goes harder on the brake. So, that's why Powell has said we have to cut rates just to stay equally restrictive. So, for Larry to be right, we would really have to see a reversal in inflation, which I don't think many people forecast or see. But I think the important takeaway is this. As investors, I know, and you're already probably saying, "God, how did Brad sidetrack me on macro? I don't I don't want to talk about this." You know, I I often think about that famous saying, "If you don't do macro, macro does you." Mhm. But when I think about when I think about it this moment, it's just to say stocks have run up a bunch at the start of this year.
6:56 Okay. The backdrop has gotten a little less predictable. There's now this tug-of-war that's going on. So, I think we're going to have to see both of those things play out. And then of course this week, the monster that comes tomorrow, Bill, is Nvidia. in in fact, I you know, CNBC is screaming every day, whichever way Nvidia goes, so goes the market. Now, I don't think it's quite like that. But one of the things that I was thinking about in regard to this is because we we're making a bet that AI was for real, that training workloads were going to be large, and that these inference workloads were going to kick in.
7:32 And as investors, we often take what we call this private equity approach to the public markets, which is, you know, let's get the big trends, the phase shifts, the super cycles right. You know, I think about you had me over to Benchmark. This is years ago. And you said, "Brad, will you come and talk about booking.com and the case you do at Columbia Business School in the old Graham and Dodd class that I that I teach with Chris Beg you know, on occasion." And And the thing I tried to teach the students in that class is why did all the analysts on Wall Street miss booking.com? Right? Miss Priceline. Now, remember Priceline was a billion-dollar company in the public markets. Today it's 120 billion.
8:12 A 120 bagger in the public markets. I mean, there aren't many venture capitalists that ever get a 120 bagger, let alone a public market investor. And the takeaway in the class is everybody all the analysts on Wall Street were so focused on how many hotels were they going to add in the quarter, right? And there'd be a lot of volatility around the number of hotels added in the quarter. Nobody really took the time horizon to say in 5 10 15 years, how much more of the offline world is going to book their hotels online? And how much bigger that's going to be. So, often the short-term trading, they would get the long-term conviction right, but they would end up trading out of the position. So, I look at Nvidia tomorrow and the honest-to-god truth is we have no edge on a quarter or on day-to-day trading of these things. I think we do believe that the amount and we're going to talk about this later. The amount of compute that's going to have to be built in the world is way bigger than than people than consensus estimates, you know, currently forecast.
9:08 But I think tomorrow it's going to be really interesting. what could really move? I mean, they're sold out, right? And their production's known. So, it's just pricing that could be different, correct? Well, I think there's so every every hedge fund, every long-only person, they track all this data, right? So, the CoWaS data, you know, the order books, the H100 data. And I think what people are seeing, and there's been some tweets about this, is that the lead times on Nvidia H100s are going down.
9:36 So, what might you think if the lead times are going down? You would say, "Oh, the demand must be going down or the supply must be going up catching up with demand." And you know, we've all been trained that every supply constraint is ultimately met with a glut, right? So, everybody's just the wall of worry around Nvidia is when does the glut come? We've pulled forward all this training demand. Is dark fiber like in the year 2000? I think those things are not accurate. but of course I have no idea what this means as to tomorrow. So I think there's just tons of questions about AI chips, inference, how much of it's going to be going on. I know we're going to hit on a bunch of that today. So you know, we stirred the pot last week a little bit or 2 weeks ago by questioning the consensus view on Google which is that they're going to be a big AI winner. I think we called it the $2 trillion question. I tweeted about it.
10:31 Yeah. you know, Mark Suster chimed in and said, you know, I'll take the side that they're going to be an AI loser. you know, but why don't we dive in a little bit? You had this good idea. Hey, let's look at these large cap tech companies through the lens are they winner or they a loser from AI? Yeah. So let's we may as well start with Google. You know, and I wanted to back up a little bit and and borrow a framework from one of my one of my close friends and and someone that I think a lot of people have listened to and learned from around investing, Mike Mauboussin.
11:04 And years ago shortly after I first met him, he was teaching a class at at Columbia and they start him and this guy Paul Johnson started talking about an acronym they titled CAP, competitive advantage period. And what they would do is they would take a company's market cap and they'd look at the trends in the company and they would back into the number of years into the future that Wall Street was telling you this company was going to have a competitive advantage. And by by by basically counting the number of years it would take in free cash flow to to build into the market cap.
11:42 Yeah. And what the point that he made is that, you know, different businesses have different amount of durability. And so you know, Coca-Cola might only have a 3% growth rate, but it might have a 40 or 50 PE because everyone is willing to bet that 75 years from now you'll still see Coca-Cola on the shelves. Yeah. Right? Whereas you know, you you look at a company that all of a sudden faces the innovator's dilemma or faces disruption and this CAP can close super fast and it has dramatic impacts on the market cap of the company. I remember when BlackBerry first got in trouble the the valuation just retrenched so aggressively that many people got fooled into thinking it was a value play cuz it was trading at 10 times earnings.
12:33 Yahoo same way? Yeah. And and and what was happening is the people in the know were saying this company's competitive advantage just became quickly undurable. I'm not sure undurable's a word, but you you understand the point that I'm making. Oftentimes because we have a lot of high growth stocks in Silicon Valley and so they get assigned big multiples. Multiples are a byproduct of a couple things. How fast you're growing because we're trying to forecast those free cash flows into the future. But also to the second point, the durability because we have to assign a discount rate. What's the probability that we're actually going to be able to collect those annuities sometime in the future? And so the less confidence we have about the future, the higher the discount rate.
13:12 And so even though you may have high growth, we have to discount it a lot. And Mike has gone on I think to talk about optionality especially around tech companies. Sometimes you have a platform position that increases the optionality you're going to be able to move into other fields and therefore that would also be a positive. But other people have questioned why these tech companies have high multiples at all because they're so susceptible to tech disruption in which case you could argue the other side. But anyway, the reason I I thought this would be an interesting way to talk about you know, some of the large companies and AI. We I don't think there's a single person out here that is arguing that AI is not some kind of fundamental phase transition Clay Christensen's disruptive wave or whatever. And and in fact I think the number one way you could probably commit harakiri as a as a public company would be to to on your earnings call say, we we think I AI's full of Like we don't want anything to do with it. And so everyone's forced to have an answer. and I and I think, you know, one one example that's pretty obvious to everyone is Microsoft. I think it became very clear to a lot of investors when they learned about an LLM and what it was capable of and the fact it could help write code and then it could help you write a paper, you know, and it could help you with creative endeavors. People looked at the Microsoft portfolio of assets especially where they make money around the office suite, right?
14:42 Mhm. And said and and the developer community where they also, you know, control a lot of the the IDEs that are used to program. And they said, oh, this is easy. Microsoft will be enhanced by this. And I we should also add their their adeptness at moving quickly with the Open AI relationship and being they weren't they were in front of this early. Absolutely. And so all three of those things you go, oh, this they're a net winner. And lo and behold, you know, their stock went up and they had multiple expansion.
15:11 Yeah, I mean I I I think that the first question we ask as investors is is this thing real? And what do we mean by real? What I mean by is the juice worth the squeeze. It cost me something to have AI if I'm a customer, right? And is the productivity gains that I'm getting as a business worth it, right? So, you know, I was talking about Tesla you know, start off the conversation. Well, if if this model and this compute and and all of this capability allows me to develop full self-driving and to win the automotive market because of that, then of course the juice is worth the squeeze. I think if Copilot allows my engineers to be 30, 40, 50% more productive, then I'm replacing human beings with machines. Of course that's worth the squeeze. And so I would say that as we sit here in the early Well, I would even say that another way in the Microsoft case, if you're not using their tool and you're programming without it you're falling behind. Right.
16:02 And so it becomes, you know, a tool that you have to have to remain competitive. Yeah. And so you know, to me I we really try to look at it through the lens of is this company like if we look at their existing business, is their existing business enhanced or attacked because of AI? And then what new business opportunities do they have? And and if we go back to Google for a second here because I think we it's kind of this iconic study because the consensus view was that they were going to be a a huge winner in AI. And let let let's step back for a second here.
16:39 20 years ago right? The idea that you were going to be able to ask any questions, immediately get information for free like Google gives us, right? was just beginning and the gains to humanity caused by the the revolution that Google really led around information discovery and how efficient and how quick they provided information discovery. It really just it changed the world in every respect. It moved humanity forward back to Ridley's idea of ideas having sex, right? Like it just allowed us to have more ideas, collect more information, exchange more information.
17:12 I asked the team to do a little analysis. Like as investors like where what do we think the right multiple should be for for Google and like what what are the things that are inputs into that? So if you think about this, Google does about 10 billion queries a day. Right? So, you know, a couple a couple queries are more than a query for every human on the planet and it has the most efficient system in the world for doing that. I think if you pull up this tweet from Vivek, it'll show that that the number of of of queries that are asked of Google has slowed down a lot, right?
17:42 So they're growing at about 4% a year. Monetization is up a lot, 13% more ads on the page. We've talked about that. Yeah. And so you have a 17% CAGR around search. And so the first thing that we just say is that the basing engagement even before AI had slowed down a lot because you're already at 10 billion queries a day. So next we took a crack at a chart that says how many of those queries are going to become chat GPT-like queries?
18:12 Okay? And so the black line here is is kind of the number of queries that are information retrieval queries on Google. And the blue line is the actual and the forecast by us for the chat GPT-like equivalent queries that are going to occur. Now what where do we get that information? Well, first we know a little something about the number of queries on chat GPT. Right? And we know that Open AI and Google are working on these search integrated experiences. I think they call it SGE where they're going to have answers like perplexity in line with search. I think that Microsoft is now doing this with the rebranded Copilot.
18:51 So a lot of the information retrieval searches are going to be replaced with these chat GPT-like searches. And this is where it starts to get interesting. Because two things kick in, Bill. Number one, it costs a hell of a lot more right? To provide answers than it did to provide 10 blue links. So if you say like what's it cost to provide 10 blue links, it's about a third of a penny or less per query. Now what does it cost to do that for 750 tokens today? And of course this will go down over time, but it's 10x more, right? It's 4 cents per query. And then if you look at the refinement of queries that's really going on. So a lot of times, Bill, what they do is they they'll send back these 10 blue links and then they'll use that as their prompt, right? To re-query the engine. This could be up to 50x more expensive to serve an answer, a high quality answer to the consumer versus 10 blue links. So your cost goes up a lot.
19:49 Well, what about revenue? So I asked the question on the other side, well, we know that revenue goes down. Why? Because I'm not clicking on all these ads on the page, right? And so, revenue per search likely goes down. I think if you look at that in terms of what the gross margin is to Google, right? The cost of serving going up, the revenue coming down, I don't know, you may take a 95% margin today on a business where you have 99% share. Your share likely goes down over time because you have people like Chat GPT who have to compete with, but worse yet, your margin on each of those queries goes down over time. I don't know what it nets out at, 50% 50% 60%? Now, mind you, for Perplexity or Co-pilot or Meta, etc., that's a great business, a 50% margin business. And, you know, it reminds me what we've all said so many times, Google's margin is their opportunity. So, the problem for Google is they have to do this because their competitors are forcing them to do it, okay? But, it definitely is going to be a lower margin business, and they're unlikely to have the 99% share. So, everybody, you know, has texted and emailed me, yeah, but they've got YouTube, and they've got Gmail, and they've got Gemini 1.5, and they've got all this stuff. And, I stipulate all of that is true, okay? But, the business that today produces the vast majority of profits for the company, What percent do you think? I mean, listen, I think that search and YouTube produce over a hundred hundred percent of the profits because they have a lot of money-losing units in the business, but it's over 80% of the profits in the business. And, so when you think about that, Now, listen, they've got great management, they can cut costs, there are lots of things they can do. I'm not saying this is going to occur overnight, but if you and I were talking with Clayton Christensen about the innovator's dilemma, and we were analyzing this business, this would really be case exhibit number one. Now, the irony of the innovator's dilemma, Bill, is most of the companies that face it, they know they face it.
21:46 They know they face it. So, the question is, why don't they do anything about it? I think some don't, but but but in in this case, you I think there's no doubt that Right, of course they know. Of course they know. So, the question is, they're trying to thread the needle, right? Can we somehow modify this in a way where we continue to grow our quarterly earnings because just setting the platform on fire and retrenching in the public markets and doing all of that, very, very difficult to do.
22:11 one thing that that that the searches that are going away first are Wikipedia-like searches that don't have much monetization. So, it doesn't it doesn't the revenue doesn't come apart right away. Even though the Even though you might be losing search volume, and and and and more importantly, like people start getting addicted to the the answer right away, Right. which is very different from 10 blue links. I think like the horse is out of the barn on answers, right? Like, once consumers experience the magic of an answer, they're not going back to hunting and pecking for a roster for an athletic team through 10 blue links.
22:45 Like, you're just going to use it. And, all of this just reminded me of lastly of Somebody tweeted out a Grantham quote this week that I thought was pretty interesting, but it it's this if if you pull up this tweet from from Charlie, it says the S&P profit margins moved down to 10.6% Q4 '23, the lowest since Q4 '2020. And, then there's the quote from Grantham I love. Profit margins are probably the most mean reverting series in finance. And, if profit margins don't mean revert, then something has gone badly wrong with capitalism, right? I mean, what's happening here with Google?
23:19 It's not that this is anomalous, right? When there are big pools of profits like exist in Google search, capitalism has a way to redistribute those people had given up. Like, like I think Apple and Microsoft had given up prior to prior to this new reality. that's why Satya says, you if you're in technology, if you run a company like Microsoft, all the money is made in the two to three years around a phase shift. You cannot miss a phase shift. If you miss it, then you miss all the value capture for the next decade. And, I might argue with AI, it's going to be even bigger value capture and disruption, and it's going to last longer than a decade.
23:57 One other thing we don't know yet that I I I just be interested in your thoughts on is, what's the business model for this? Cuz right now, the premium versions of Perplexity and Chat GPT have a dollar amount. There's a subscription. This kind of looks like the the Netflix type situation. So, is it subscription, or is it is it free? Do you want ads around your your answers or not? Well, I I mean, listen, remember the disruptors, they don't have to generate a lot of margin on this because they earn no money on it today. So, what do they have to do? They have to cover their costs.
24:34 Yep. And, these disruptors want to see Google dance, as Satya said. So, the problem surprised when he said that. I was, too. But, listen, listen, the fire in the belly is exactly what you need. I think Satya has founder-level fire in the belly about this moment in time. And, I think he has it not just because he wants to see the stock price go up. I think he has it because people like Satya, they're post-money, and what they care about right now is moving humanity forward, and they understand that they've worked their entire careers to get to this place where we go from computers acting like calculators that are modestly beneficial to now computers helping us answer and solve the most perplexing and fundamental questions that we face. And, so I suspect that they're going to underprice this. If I were Perplexity, I would I wouldn't have any ads in the thing, right? No need to put ads in it, and I would attack, and I would try to get share, right? And, so it would be surprising to me if we don't see Meta AI and Microsoft and ByteDance and Perplexity and all the others who are providing answer engines, Chat GPT, coming at them below margin, okay? Now, let's ask it let's answer the question that I'm talking about the shorter term while everybody is fighting to gain share. They'll price it so they cover their costs, or maybe not. Maybe Microsoft's willing to eat it, you know, here for a while. And, I continue like I as of right now, and I've played with all of them, on the consumer side, I don't think anyone has a Perplexity came out as a lot faster.
26:09 That was pretty cool. But, when I just look at the quality of the answers, I don't I mean, on different searches, one might be better than the other, but I don't see anything that's so holistically notable. Like, I remember when Google search came out, like, where I was. I remember trying it versus AltaVista and Yahoo, and it was like, you could tell, like, oh, this is better. And, I don't see that right now. that I did have that feeling of Chat GPT versus a traditional Google search. Oh, yeah. I mean, I mean, now you're saying among the answer engines.
26:40 Among now, you have you have four or five Right. highly highly backed, you know, companies competing in this consumer AI space. And, there I don't see anyone yet. Now, I as I said on our last pod, I think if you get this memory thing right, it could change. And, since we did that, OpenAI published a a release that says, we're working on it, we're working on it. Here comes memory. but, the promise is where I think pretty thin relative to explain to people again because I think this is so important. You and I are in agreement that this could be the next 10x moment with GPT-like experiences for consumers. So, just double-click again on on what your understanding is of memory and why you think your sensibilities are that it's so important.
27:23 think there's two elements to this, and one of them is a is a user expectation thing, and then the second one is a technical observation. On the latter, well, let me let me get to that in a second. But, on the user expectation thing, you know, it's funny, I keep always go back to the movie Her, which I thought was just incredible. But, like, you I think want to be able to talk to this thing and have it remember everything that that you ever told it.
27:51 And, if you had one that knew all of your emails, all of your contacts, could remember your to-do list, could when you're about to meet someone, they could bring up the last four times you met with them, and the reminders you left yourself at that point in time. Like, you're talking you know, you we talk about the the programmers 30% productivity increase. This could be a human 30 or 40%. Like, if you have this thing in your head that just remembers everything. so, that's that And, by the way, and I said this last time, I think most people have just extrapolated AGI into infinity and think it's going to do all these things. But, it's not doing it right now. And, and you know this cuz you and I have been talking about this for a couple months now. If you talk to the people that are at the tops of these firms, and you say, "Hey, why can't this thing remember everything I I want?"
28:43 They go, "Ooh, that's that's a hard problem." Exactly. Exactly. And, it turns out that just because of the way this thing works, it would literally have to retrain every night on each every individual user, and training costs are super expensive. Right now, it's trained on the internet, it's regurgitating the internet. It's not training on everything in your database. And, so there are people, including OpenAI, and all I think everyone This is another one of those things. I think they're all aware of this.
29:13 But, they don't know how to do it technically. And, and and, you know, I invite anyone to come on the show that thinks they know how to do it technically. If they'd like to correct us or whatever, I'd love or or if there's a startup that thinks they know how, please come see us. We can both fund it. And, and you you and I talked about this. I mean, and listen, I I think OpenAI opened the kimono a little bit. I think they're further out in front than they've revealed. but, you know, again, I come back to this idea that I'm really lucky out here. My my assistant, Brit, she's been with me for 15 years. She knows me longitudinally. My likes, my dislikes, my family, everything about my kids, everything about hotels I've stayed at, rooms I want to stay in, etc. So, my expectation of her is that she can take offload a lot of that because she has all that prior history, right? And But very human had that.
30:08 Exactly. You think about the productivity unlocked for humans if you give that for free to every human in their pocket. And I'm convinced it's going to happen, but one of the things I would suggest I had a really interesting conversation with some friends about Apple, okay? Because this is the giant, right? This is the thing in everybody's pocket. Nobody's talking about them, but they they have so much information about me, okay? They have my contact list, they have my emails, they have my texts, they have all these applications. And so one of the things I'll just drop out there, I think a little provocative about what they may be doing.
30:44 Because I've I've read a bunch of stuff on Twitter about how they're building their large language model of their own. My sense is they're not doing that, okay? My sense is in fact that if you think about it in the context of my assistant, right? So here's the metaphor I give to you. Would you rather have an assistant with the intelligence of like Einstein but they have no access to the internet and they don't know anything about your history?
31:09 Or would you like to have an assistant that's just above average intelligence, knows everything about you, and they can use the internet? Okay? You would choose that, right? You would choose the And so think about what Apple's going to do maybe more like a small language model. Like really understand all the language, really understand everything about me, really understand how I interact with all these applications, and then when I have a deep problem I need to solve they can sub agent it out, right? They can send me down the path of chat GPT or send me down the path of Gemini or send me to Meta AI for an answer engine if I want to go down that path. But I think that there's this layer on the top that's just a different architecture, a different way of thinking about this that's going to be more like my assistant Brit that's just steering everybody in the right directions. I think Apple is superbly positioned to do this.
32:00 But of course you don't want it to just you also want to be able to tell it things that you just to remember this or or mark this down or attach this to a note. And and we we've talked in the past about how an LLM could be a user interface disruption. And so you could imagine a small business starting with a CRM that is only voice. Right. And you say this customer this, you know, and you just talk to it and you want it to remember. But but but that has to be architected by this like you know Bret Taylor's new business Sierra. We're looking at a bunch of businesses in the space. Again, you and I are talking about it in the consumer landscape. Remember everything longitudinally about me, but what is a CRM? It's remembering everything longitudinally about your other your your your customers. Well, one thing I want to do just to to wrap this up because I think that you and I are analysts and you know I think often times in our business people talk about it, is this company good or is this company bad? And I think one of the things you and I think about a lot is distribution of probabilities and is it reflected in valuation? So if you pull up this chart we did, which is the MANNG comparison, it just shows the growth rates and the multiples applied to Microsoft, Amazon, Nvidia, and Google. And here all we did was take consensus numbers. So these are not Altimeter's numbers. Our numbers are higher for some and lower for others, but one of the things I just want to point out is at the top this is the '23 through '25 expected growth rates. 14% for Microsoft, 12% for Amazon, 42% for Nvidia, and 11% for Google. So Google's already expected out of those four to be growing at at the slowest rate. But then what's interesting if you come down here to the price to earnings ratio, right?
33:45 You'll see that Google is trading at the lowest PE, right? 21 times '24 and 20 or 18 times 2025 expected. So all the things that you and I just talked about Bill about growth rate and durability of free cash flows into the future, I would argue a lot of these are already discounted in the stock, right? People are already placing those bets. And so one might take the other side of that and say yeah Brad, yeah Bill, I know all those things to be true, but they can cut a lot of costs and do a lot of things and that could cause the multiple to go up. But if you go to the the line under that to the PEG ratio because this is one a lot of people want to ignore on a on a price to earnings multiple for example, Nvidia is a lot higher. But if you actually look at it on a PEG ratio this year it's it's it's a much less expensive company. If you look at it on '25 PEG ratios, it's just a little bit different. So there are two ways in which to look at future price to earnings multiples. One's growth adjusted, right? That tries to take growth out of the equation and just look at it in terms of strict valuation. So my my big takeaway from this Bill is we're not here to pick on Google. We're just to say this is an important case study to watch about innovator's dilemma. And it's clear to me that investors are already discounting it that they have some of these headwinds coming.
35:05 And I think there may be an opportunity some you know, I said the other day if they manage to thread this needle, trust me, I'll climb on board that bus because I think they're tremendous costs they can cut out of that business. There's a lot of fitness they can drive into that business. And the real question is how are they going to drive down the cost of serving these inferences and how are they going to monetize this in a way that And by the way we we you know, it's funny because I think they have other assets. Like you when when you talked about Apple, you said they have the handset. Well, you know, Google controls the entire Android market, which is a big market.
35:39 They have a a competitor to Microsoft's Office Suite. Now they have historically not invested a lot in that. It's not a big driver of their revenue. They could they could all of a sudden triple down. You know, they were ahead in type ahead if you remember. Like I I I my kids use those products and I was always on the Microsoft and I can remember like it was finishing sentences for my kids. I what was that? That was inside of of Gmail first. And so they have assets that that they could bring to the bear. And I and I and I think, you know, everything you said about Apple is true. Like having the physical control of the physical device seems real to me. Like Meta like the notion that my AI would live in my WhatsApp as a person I like that doesn't feel intellectually perfect to me. Like it being in the phone feels perfect to me.
36:37 Like this thing's with me all the time. But let's talk about two things in that regard. So we talked about you you talked about memory being a 10X chat GPT moment. So you said GPT was one of these 10X moments to you compared to Blue Links. If we got memory, that would probably feel 10X like And by the way, while you're there, I have to say one thing that relates to to valuation. One thing that drives durability going back to our competitive advantage period is switching cost. If I start relying on one of these things as my memory and and I don't have a way to pull that out and jump to something else, I'm stuck. Like I am hooked, locked, stuck.
37:18 Right. Which means higher multiple. very positive for the person that gets there So so I think I'm looking for memory as a 10X moment. The other 10X moment I'm looking for here Bill is actions, right? Going from answers to actions. And so let's talk about that for a second. Yeah, you know, this company Rabbit's been making some waves. They have their version one out. I saw I think Tony Fadell tweeted the other day he can't wait to get his hands on one. There's a bunch of cool demos online. We spent some time with the company. And now the thing that they have or that they talk about as a huge differentiator is what they call a large action model. Not a large language model, large action model. And basically think of it like cursor control Bill. So if I say and in fact we did this demo upstairs when they were visiting, I said book an Uber going from but it was able to do it. It literally had trained on the behavior cursor behavior of people using these apps and it was able to book that without any other intervention by me. So I took to doing some research and said could Apple do this? Because Apple knows exactly what pixel I'm using on the screen to hit a book button on booking.com or on Uber or whatever the case may be. Now remember, Kaparthy talked about this when he went to OpenAI the first time, he worked on a project that he called World of Bits. And World of Bits, the iconic thing he tried to do there and I think this was maybe five or six years ago was to book a hotel. Could he get an AI to book a hotel? And he said at the time it was damn near impossible. He had to write all these very specific algorithms, had to try to figure out what every booking page looked like. And he said recently on Lex Fridman maybe a year ago, he said I think if I tried to do it now using the general capabilities that exist today, it would be a lot easier. So I think that Apple's working on this. Clearly startups like Rabbit are looking at working on it. I think that is another 10X moment that's in front of us, which is we go from answers where I'm just asking it for information to actions.
39:21 And once it can start booking my hotel, booking, reserving my restaurant, and then I just say same thing. Do it again. Right? Because it it has a little bit of memory about my prior action. Those are really powerful on that. There's a there's an element of this that's just a fancier version of screen scraping, right? There's a there's a hackiness Yes. to this to this notion. And I I've often said, you know, why in the world are we writing in in the self-driving world are we writing, you know, millions and millions of line of code to infer the state of a of a traffic light? Like, why don't we just broadcast the state of the traffic light? And it would be It would be three orders of magnitude less code. But but but guess what? I think we we literally are going to bypass. I think if we had done that, that also would have been intensive, right? Because then we would have had to wire everything up to be golden. Well, here's where I think the world's going. We met with these robotics companies. We meet with Tesla, etc. Imitation learning, okay? They're not even going to know what the stop sign is or the traffic light is or the dog in the street. They're not going to write C++ for every one of those specific incidents. They're literally going to watch the behavior of the five-star human drivers for enough hours and they're going to imitate it.
40:38 but you're missing my point back on the on the on the internet side, which is is telling having the having the AI like move my cursor around and click and fill out things is is not the most No, of course. efficient way to do this. You would You would have APIs with these different services and and and a way to interact. And that's going to be a an interesting evolution. And there's a number of startups working on this, too, on different ways to try and drive action and to you know, some of them will will sit on top of browsers and do that or some of them might try and sit on top of your phone. Of course, Google and Apple will stop them from doing that. I totally agree with that. It's funny. I was asking our analyst, right? 10 billion queries a day on Google today. I say, "Do the number of queries in the future go up or go down?"
41:31 Right? And I had somebody If I say Arvin at Perplexity, he said to me, "Well, the number of queries probably goes down because you don't have to ask it so many times. It'll just give you an answer." And I say, "What about the positive reflexivity? Once I get the answer, I've got more questions." Right? Like, as long as it's fast and it's producing the that information, I actually think actions and memory will unlock more interactions because it's so much more valuable to me. I'll start using it more and more for these future things. And I don't know. It'll be interesting to see there you know, for a while we've had the Alexas of the world or whatever, you know, do integrations, right? And so the maybe the possibility existed if I'm an Uber customer and an OpenTable customer that that that eventually I will tell them my favorite LLM front end and they'll come to some agreement there so that they can pass my registration information through and that that all happens seamlessly. but there's a lot of work to do to make all that happen.
42:29 Right. I mean, I I think there's a lot of agent-to-agent interaction that will go on. An AI agent representing both of these parties. But what's interesting about the action model, you know, the hackiness that you talk about, right? We're I imagine this will get solved by startups in some pretty hacky ways to begin, but then it will ultimately likely be solved at scale in more elegant ways, whether it's APIs or agent-to-agent interactions, etc. But we're starting to see real experimentation and I've had some of the early prototypes of actions actually coming to pass. And that feels to me like the next two big breakthroughs are going to be this memory and action.
43:09 I I I I said this last time and and and I it's a subtle point, but I don't think Google You know, it's another issue in the in the disruption. I don't think Google has treated its partners well in the search ecosystem. And so there's a lot of of angst there and a lot of mistrust. And so if OpenAI or Perplexity came along and said, "Would you integrate and pass tokens?" They might say yes. I I I I think they're going to be more reluctant to do that with Google. I mean, at at a minimum we know they would probably like more competitors in the game of sending them leads, right? So, I mean, I I think just the fact that you're a smaller player that you can be another source of competition and they're not so dependent on Google for upstream traffic is probably an advantage to you. Well, I know we're going to want to move to to the topic of chips here in a second. But before we get there, we touched on Microsoft, we touched on Google, we touched on Apple. Just by way of comparison and people have heard me talk about Meta a little bit in this quick. in in this regard.
44:16 So, again, the way we approach the analysis for all large-cap tech, we said, "Is their existing business get better or worse because of AI? And then do their new business opportunities get bigger?" Okay? So, in the case of Meta, unlike Google, Google has this massive super profitable business that's under assault by answers and and actions. In the case of Meta, we've seen their core business get better as a result of AI. Why? Because you're targeting videos now on Reels, you're targeting And that happened pre-LLM. That was already happening.
44:52 It was starting to happen, but the big difference really, I think, between ByteDance and Meta was that Yiming at ByteDance adopted an approach around AI and GPUs before Meta did. And I think I think Mark really made that transition about 3 years ago. You can see it in their CapEx But the big question was Obviously, he had to spend the money before he got the results. And so investors like us, we're kind of holding our breath and we're saying, "Would this lead to better engagement?" Well, now we know. This lead led to massively better engagement and I'm not talking just on Reels. This is on the core big blue Facebook product. This is on WhatsApp. This is on Instagram. So, they have these big platforms that are benefiting from both more engagement and the targeting of ads. Remember, this stock was at 90 bucks and everybody said Facebook's dead because Apple attacked Apple pushed through their changes that that disabled their ability to really track people in the way And basically because of AI, they've been able to backfill that monetization completely. Nobody thought No investors thought that was going to be the case 18 months ago. So, their core business got a lot stronger.
46:00 Now, as we look ahead, think about the new business opportunities that are in front of them. And I'm just talking about the things that Mark's talked about on the call. Number one, they've got tens of millions of business customers that now they're literally creating these customer service agents for AI agents for every single WhatsApp business. Now, we don't see that as much here in the US even though WhatsApp is the fastest growing messaging platform in the US. But if you go to a place like India or Brazil, people are transacting. Some of the biggest AI engines, right? AI bot companies are being built on WhatsApp as a platform in Brazil and in India where they have tens of millions of customers already using them. So, these have become platform companies that are enabling vertical and horizontal bots and they're going to build their own.
46:45 They're going to build it for celebrities. They're going to build shopping agents that assist me buying things on Instagram. You know, I always see all these things I like on Instagram, but it's a pain to actually buy the things on Instagram. The one-click never got that easy. Now, I think you're going to see shopping agents that assist in doing that. And then just think about this, content creation, Bill. Whether you're an advertiser, just think what we saw this week with Sora.
47:09 text to video. I mean, now think of this in the context of an advertiser trying to drive emotions Or a creator, right? So, my sons are creator creators on these platforms. This is going to unleash monster amounts of creation in the world at lower cost. And so all of that I think benefits their core business. You have these new businesses that they get to move into that I just mentioned. Then of course, I thought another interesting thing from Morning Brew, I think the pod that Mark was on last week, he talked about the Meta AI glasses that all my analysts have, right?
47:48 He said, you know, most people they looked at Mark taking the video reviewing the Vision Pro from his couch and they you know, that got a lot of clamor on Twitter. But the fact of the matter is Mark said the way you ought to think of VR and AR really is as your desktop or your laptop. But the Meta AI glasses, he said, think of as your phone. Right? Because I'm going to be able to text, I'm going to be able to call, I'm going to be able to listen to music, I'm going to be able to order my Uber, I'm going to be able to do all these things from those glasses and I don't have to pull out this rectangular thing or I keep it in my pocket or whatever. I think that's why you're seeing such incredible demand for those. And of course, the form factors will change and it'll evolve over time. But that's an entirely new line of business. So, this is a company that's spending $20 a year on these other businesses that haven't been generating a lot of return. And I think now the market's starting to assign some value to those businesses.
48:45 we should be fair, right? Like, cuz YouTube benefits from those same dynamics that you talked about. And if you're talking about units of of being the the the the phone or the like Apple and and Google already have 100%. huge install base. Like, what? Four orders of magnitude to the number of Ray-Ban glasses? Yeah, no no no, for for for for sure. But I think the question is from where you are today, right? And so like I'll stipulate YouTube will be a better business in the future. Content targeting will be better, ad targeting will be better, right? And as long as Google is able to backfill the the core of search like we just discussed, then it's going to be worth more in the future. There's no doubt about it. And of course, in terms of just their basic research and development around AI, what they did with Gemini 1.5, etc. I mean, like these they have incredible talent and resources. The only liability is they have an incumbent business that is a monopoly business with monopoly profits.
49:45 so that we can move on, let's do a fast drive-by. I'm going to do one on Apple and then you and then you do Amazon. As a reminder to everybody, just our opinions, not investment advice. So for me, you know, Apple you you could argue they have the best asset in the world in this phone. And it And if you look at the user base of this compared to the Android user base, you know, it's just perfect, right? And they they've been doing Siri for a while. And so you what you connect those two things, you say, "Shit, like they put a LLM on top of this, they could get to all the data."
50:18 Whether I sure you could give it permission to read your email. So you could literally get to all the data. So that's a massive positive. Now, the negative is they haven't been known for internet services. You look at Spotify relative to Amazon Music. Siri's kind of been It's been terrible. Not evolving, right? Like it's very much like it was the day it came out. Yeah. And so it would almost require a pivot of like like Mark did on cost. You'd almost have to see Tim come out and say "We're making a massive pivot, like 180 degrees. We're going to be all in. Like like we're putting our best engineers on this." And And until that happens, I think it's a doubters camp. Mhm. That's what I would say.
51:07 Yeah. Well, I mean, clearly it's been an underperformer this year. I Mostly related to China market. Yeah, yeah. You have China market, but you have all these concerns in the market going just as to what's the durability of revenue going to be in the future. You clearly have But they have the assets. Imagine if you took like five of the top AI people at one of these companies and and and they were there. Like they were there the way Tony Fadell was there, you know, early on for the iPod. Like if you had that You know, listen, for the first time they have real challengers, whether it's a Humane, a Rabbit, a Meta AI glasses, these other things, right? Like I'm just saying the door has been cracked on the ecosystem.
51:47 Siri has not evolved, right? So they they I think they're the first to acknowledge that. I think they are going to try to disrupt themselves about that. I'm not sure whether we'll see a big breakthrough moment this year. I think we'll definitely see announcements this year about AI on the edge running on the phone and and and all these other things. We'll start to see they'll start to crack the door on this. To me, the big breakthrough on Apple is if they can run a 5-10 billion-dollar parameter model on the phone, on the edge without consuming all of my battery, which, you know, there's a lot of talk that they're going to be able to do that. They can maintain some memory about me, and then they can show me the early part of actions on this device, it will unlock a huge new device cycle, okay? And that's what drives this stock.
52:32 I was the one supposed to do to do the Amazon you do Amazon. no, I'm going to I'm going to ask you quick question. So on the e-commerce side of the business, does AI help or hurt? Amazon. Yeah. Okay. And how much? Yeah, I think I think on AI there there two When I think about retail e-commerce, I think about it from two directions. First is Apple has been in the business of AI from a merchandising perspective, just like Alibaba has been for a long time. Think about the largest retailer in the world, right? Think about the way Macy's used to work. There was somebody at the store who would say, "We're going to show black t-shirts today at the front of the line." At Amazon today, nobody knows why they are targeting Brad Gerstner with certain things. It's a black box, okay? So they're using it.
53:19 But here's the thing I I think that is happening a bit to them on that front. And And by the way, Andy Jassy is getting fit. They are tightening the screws on cost and all the other things. But look at a company like Temu, okay, that Pinduoduo in China owns, that quickly became the largest advertiser on on Facebook. It's e-commerce sales are through the roof. Now, what they're doing, I mean, it's so incredibly clever. It's full stack AI.
53:42 So they don't even have inventory or merchandise. They literally go out and they they collect data from customers about what they think they will want. They can assess how many of those things to build, and they literally are building it for themselves. So they vertically integrated this AI e-commerce business, and then they're pushing it out the other end. And so I think there have been a lot of people in the US who have been dismissive, but they've been shocked how big that business has come become in such a short period of time.
54:09 We're starting to see this out of out of TikTok as well, where they're turning into an e-commerce business. I think this opportunity sits in front of Meta as well. So I think there are some orthogonal challenges, but in terms of the core, I think their core continues to get better because of better targeting and and AI reducing cost. Think about their customer care cost bill. We do have to move on. Hit hit AWS as quickly as possible.
54:32 Yeah, so I would I would say AWS, at the end of the day, these companies are in the business of renting AI services to end enterprises, right? And as much as we talk about Azure and Microsoft running the table today, here's the truth. We've seen almost no share shift from AWS to Azure as a result of OpenAI. And if you would have asked me 12 months ago, I would have said jury's out as to whether or not that's going to happen.
54:58 It didn't happen. Amazon responded quickly enough. And here's the other thing, you know, and Sullum and Chamath talk a lot about this term, data gravity, right? It turns out all my data's in AWS. So long as they have a decent AI solution, I'm going to stick with them because I don't have to move anything, and I think they delivered that solution. podcast and Jassy was talking about the fact that they have proprietary chips for both training and inference. And obviously, as the AWS stack grew up, they had moved into networking chips. They'd moved into a lot of technologies people wouldn't have thought about Amazon owning or designing. Do you give them And this would be a good transition, but do you give them any chance of being competitive in it from an AI silicon perspective?
55:43 So I think the right way to think about it is not will they build a better GPU than Nvidia. The right way to think about it is can they supplant part of the supercomputer, right? The entire system. Are there pieces that they can pull out and plug in Yeah. or workloads specific workloads that they can serve with a lower cost infrastructure because they're doing hypertargeting silicon all the way to model, and I think the answer to that is yes. But I still think they'll be one of the largest buyers of Nvidia GPUs in the world because it doesn't replace that for a lot of really important workloads.
56:21 One thing he also said that that I think would be good for the listeners to to hear. And and, you know, I I don't want to overstate you know, where Alexa is, and we talked about Siri earlier. But he said that as Alexa got bigger, that the the training costs are tiny compared to the inference costs. And he suggested, and and maybe this is me interpolating, that that the inference market over time is going to be much more susceptible to you know, things that are lower power, lower cost, all the all the things in that that aren't just performance from a from a silicon perspective.
57:01 I I And I totally believe that to be true. And And And with that, we can move to the biggest headlines of the week. We finally got here. which is this debate over the future of the compute build-out needed to support AI. You know, to to to your earlier point about valuation, how unique is this revenue? How long does it last? And so we have a couple of charts just to bang or tweets to bang through here to kind of contextualize this. First, Nvidia stock's up a lot, but it's because the revenue and the profits have greatly exceeded expectations. So this chart just shows what their data center market share has grown to in the year, right?
57:38 the world is shifting toward AI as a compute infrastructure, and and and they've benefited. One of the areas I think I tweeted about this that I think has been greatly underestimated is idea of sovereign demand. and I tweeted this week, you know, I think Jensen was over in the Middle East meeting with with several of the GCC countries over there. And I think what people still don't appreciate is there probably dozens of sovereigns who are trying to get into the Nvidia order book, and that they view it as one of their top three national priorities to build out AI capabilities. And I think the size you're talking about for some of these GCC countries is going to be competitors competitive with the hyperscalers itself. So in that context, right? When Sam Altman suggested and blew everybody's mind that he was going to raise $7 trillion to, you know, build chips and I don't know if he ever said it. It was it was inferred and repeated over and over again.
58:35 he he he he threw out a big number. but I do think that we're talking trillions of dollars over the course of the next four to five years as we rebuild the world's computer infrastructure. And then finally, Masa did not want to be left out, and so he came out and said that he's going to raise $100 billion to build fabs and chips to compete with Nvidia as well. You've watched the semi industry for a long time, okay? And And more importantly, just the dynamics of supply and demand. So just step back for a second, right? What do you make of all of this?
59:10 Well, I have some cynicism, but but but but that comes naturally to me. The first thing I would say is they're they're all talking about raising money from the exact same people. Right. So if I were those people, I would just be a little careful because I think to a certain extent there's a there's a smell of loose money or that's how I would interpret it cuz they're not they're not saying they want to raise this money absolutely. They're saying they want to raise it from a very specific group in the Middle East. So so that's one thing.
59:48 Two, I was struck when I read about sovereign server stacks. You know, there needs to be a reason, right? It would have to be about, you know, wanting to have control over certain amounts of information. It could be proprietary information to your country. Could be wanting to control how LLMs operate in that country. servers typically depreciate a bit like fish, you know, and and and and that's been true of DRAM and storage and all these other fish, right? Fish, okay. They they last a day. They yeah, I mean it's it's I'm being provocative obviously, but people have talked about with that with those like you would you wouldn't want to hoard any because what happens is, you know, the next generation comes along and and it goes down quickly. So I I would just, you know, there was a time at which Microsoft was trying to convince the world that we'd all need an NT server for every employee.
60:45 And you know, when I heard that the first time I was like trying to get my like twist my head there. So I don't know. I don't know if countries need server stacks. Maybe I like I said it'd have to have those particular frames in mind. The second thing that just struck me and this gets more to to the Altman and the the Masa quote is you know, the idea that we're just going to go compete with Nvidia like is pretty radical. There there already people competing with Nvidia. AMD's competing with Nvidia. Like like there other people that have somewhat of a head start.
61:23 Like decades. Yeah. So you're just going to go do it. Like that's bold. Like it's not like chip design bends. Oh and oh yeah, and Intel obviously, but like it's not like chip design bends to disruption or like software does. Like this is hard stuff. And then some of them and I once again I don't know that there was an exact quote, but the idea that you're going to build a fab and compete you're going to compete with TSMC and Nvidia at the same time. Like no chance. Yeah. Like like no chance.
62:00 Cuz like let's say let's say you got a I mean we all know how the math works, but say you got a 20% chance of competing with either of them. Like then you're down to four. Like a pulling this off. And by the way, the time scale that you're going to need like it I mean just read well, we'll get into it in a minute cuz we'll talk about like what it means to have a competitive fab around the world, but TSMC is far far ahead of the competition and one of the reasons AMD has a higher market cap than Intel today is specifically because they got out of the fab business and bet on TSMC.
62:35 So think I think it's really important to tease out those two things, right? There's chip design, right? And obviously Nvidia is already designing for two to three generations ahead. I mean the series B is already taking orders in the order book likely to launch in Q3 of this year and you know, is order of magnitude better than the H100s that are out there today and then you're they're already designing what comes after Blackwell. And so it's not as though they're standing still and anybody who knows Jensen, he's an animal and that that company is is playing for the future. And then if you look at TSMC and and and I shared with you a a video maybe just pull up a little bit about kind of the findings from that, but this is from the founder of TSMC and the CEO for decades Morris Chang talking about the competitive advantages and Bill because this really gets to the fab.
63:26 Like why are all the world's fabs in Taiwan? Okay? And why aren't the fabs in Texas anymore with Texas Instruments or why aren't the fabs in other parts of the world? And what does that mean for the future of this build out? And I think the implication of these of these releases is that we're going to start building a bunch of fabs in the Middle East. I think we know we're trying to build fabs in Arizona. There's some talk about building fabs in Mexico, but maybe just let's deconstruct that one. What does it mean to build a fab outside of Taiwan to make next generation AI chips? You shared this link with me and I it's a talk that Morris Chang gave at MIT. I think in November, right? Very recently.
64:08 He's over 90 and the first it's like an hour-long talk and the first 60% is a history lesson. but then the last 40% I would encourage everyone to go watch. Like everyone including every politician in the United States of America because Morris makes the point that the reason Taiwan is competitive has to do with the labor model that exists there and the type of work people are willing to do and your ability to retain them. And he walks through his history of hiring in Texas and other parts of the US.
64:51 Yeah, interestingly enough he ran a fab plant for Texas Instruments in Texas and he explains why Taiwan like why Texas could never possibly compete with a fab plant in Taiwan. And and he even I he he he he admits that that US was a manufacturing prowess in the 50s and 60s, but but the social requirements that we put on labor at that time are different than they are today. And so whether you look at TSMC and it turns out the same thing's true of a Foxconn factory in in Mexico. You have people working longer hours, sometimes living in dormitories and he mentions that in his talk. And he says the country must more likely to disrupt Taiwan would be Vietnam or India. Yes.
65:41 Not an advanced culture and to think you're going to re-onshore a fab and ignore Morris Chang is just kind of crazy to me. And I look at the requirements once again that we put on companies around labor and say to myself it's not going to happen here. And and the people will quickly react to that and say, "Oh, you're in favor of of forced labor or like super hard labor."
66:13 But the people that are choosing that at that point in time are choosing a better life. Right. And to deny them that opportunity like the the the the individual that lives in Juarez that's commuting to this Foxconn plant is getting a better life. That's right. With even with his four nights a week in the dorm. Right. and then to deny him that and insist on our circuit 2023 social norms on that country is unfair from my point of view.
66:45 Right. And and and I think them their chance at disruption. So when you unpack and we'll put the link to the video here. When you unpack that message, it's really that Taiwan thrived because these operators and technicians would spend their life working in the same fab on the getting getting better and better at the same thing and he talked about a 12% churn rate I think when he was at the fab in in Texas and he said the problem is the second a better job would come along they would leave for a better job.
67:16 was it was 12 during during a recession. during a recession implying that it was much higher. It was went to 25 when when when the economy was good. And he said you just can't run a fab plant with 25% churn among the operators. You you produce really bad product. And I think the point is it's not just better life. It's also kind of these cultural norms. And so that's why he said, you know, in Vietnam and India they have cultural norms he believes that are more consistent with with loyalty and staying with something longer. And on top of that that it would be an improvement in the quality of life for the people who would take these jobs.
67:52 and these are neither right nor wrong. Like I I you know, I'm not not Provocative. Like yeah, it's provocative because it says that if America's really worried about the concentration in Taiwan, they should probably be trying to help build semiconductor plants in Mexico or Vietnam or that kind of thing versus bringing them here cuz the odds of operating them here in a competitive way, globally competitive way are low. So I guess does that make you skeptical of the Chips Act? I mean I see that Intel is back in Washington looking for another $10 billion to subsidize the work that they're doing. I mean I get the US national security concern particularly considering that 100% or virtually 100% of these advanced chips are being manufactured in a place that has risk, has political risk associated with it. Bill, let me ask you this.
68:43 By the way, I am I am somewhat skeptical of the Chips Act and and then the other thing I would say to you is like China's probably in a really good place. Yeah. They're really smart. They have all the the the the intellectual capability of being competitive and they probably still have this opportunity for them, you know, over time in in terms of the willingness of certain part of their their population to be willing to work in those types of situations.
69:15 Yeah, I I mean I'll take the probably the under on that. I think that the opportunity like now there is a global imperative to diversify the source of manufacturing. And I think Morris Chang was having this conversation at MIT recently because he understands the global imperative. I think you are going to see plants that get built in places like Vietnam and Japan. I think you are going to see them get built in India. You're probably going to see some attempts in the Middle East.
69:42 Obviously, we're trying to do some of this stuff here. I think from a United States interest, both in terms of wanting to maintain leadership in AI and wanting to diversify our political risk associated with Taiwan, it it's not so important that everything is produced in the US, right? That shouldn't be our goal or objective for all the reasons that Morris Chang points out. But I do think it would be better if we had four or five places around the world that were load balancing the manufacturing of these chips.
70:12 a fair That's a fair point. And I think the whole re-onshoring argument conflates the national security interest with a with a interest in American jobs and that kind of thing. going back quickly to these new chip companies that are going to miraculously compete with Nvidia. I would I would I would tell you if if and this is maybe you know, an older venture capitalist talking and one who's watched different partners sit on the boards of of startup semiconductor companies.
70:47 It ain't easy, you know? And you know, the the first silicon that comes back doesn't always work. Yeah. And you might be 50 million the first silicon. You might be 100 million the first silicon. Right. You've got to get in line at TSMC. Right. How you going to break that door down? How are you going to out compete Nvidia for TSMC's time? Right. Like Like how are you going to get on that place? And it's hard, you know? And And by the way, once you do get working silicon, your yields are probably crappy. Yeah. Like that's what happens.
71:23 Like this is this is physical material science type stuff. It's not software. Right. And you're going up against again two companies that are run in pretty exceptional ways by exceptional founders. In the case of Jensen, he's been there for three decades. He's devoted his life to this. TSMC seemingly has similar types of leadership. But But one of the things I wanted to to to pivot to on this bill because it begs the question, why is Sam throwing out this really big number? Right? Why is Masa throwing out this really big number? And I think the answer like one of the things I I want to talk about is this, which is just what is the size of the market opportunity that we're talking about here? And so I have a slide. We had Jensen when he was in the Middle East, he mentioned and the quote was And this was just from Feb 24th. He said there's about a trillion dollars worth of installed base of data centers around the world. And over the course of the next four to five years, we'll have two trillion of data centers powering software around the world and it will all be accelerated compute, okay? And so I asked my team to break that down a little bit. Like what you know, how does that look like per year right to get to this number? So of course, I'm doing this from outside in. We take a swag at it and pulls up this next line bar chart. So this is the AI data center buildout. In blue is the new accelerated compute. Right? In green is the replacement data center that we think will go to accelerated. And then in gray is the replacement that's non-accelerated compute. So this would be more like you know, X86. And again, I'm certain this is wrong specifically, but that's what we're in the business of doing, trying to build a forecast based upon folks who are providing this information. The line running through the center that starts at 55% and goes down to 26%. That is Nvidia's share of that global compute buildout based on current consensus numbers for Nvidia.
73:34 Okay? So the consensus forecast that has the stock at $700 a share assumes, if you believe this TAM to be accurate, assumes that their share will go from 55% today to 26% in 2028. Now, I think if you just step back and you say, "Okay, do we think we're going to go from a trillion of data centers to two trillion of data centers?" Just ask that at a high level, okay? Well, you and I just spent an hour plus talking about how a 10 billion queries a day are likely to move from information retrieval, right? To inference as we as humans expect to get answers rather than a card catalog. We talked about enterprises, whether they're doing their engineers in code generation or whether customer service centers or whether Tesla and full self-driving or whether it's sovereigns who are taking on national security issues, you know, drone fleets or whether it's proteins and life sciences or material sciences. There isn't going to be a single industry on the planet that's not employing accelerated compute in order to solve the problems of their enterprise. So if you said to me with that as the backdrop, a year ago, I think the big question Bill was, is there going to be enough productivity gains in the world to justify this compute buildout? Remember, people thought, "Oh, we're pulling forward all the demand for Nvidia. This is like dark fiber in 2000. We're going to be way oversupplied. We're going to have a glut." I think the evidence on the field is that that was wrong.
75:09 I think the evidence on the field is that in fact, just like we talked about on the last pod, we tend to underestimate the size of these super cycles because when you have these phase shifts, everything changes. You have positive reflexivity in the world. More begets more because it's better, right? And so I think the bigger question when I look at this chart and what I push my team on, what I'm certain of, you know, what I the the rumored pricing of H100s to B100s is that B100s are going to cost even more than the H100s.
75:45 And so I say to my team like these margins have to get competed down. Right? But the feedback and something I think that's really important is that although the B100 is more expensive, it's so much more powerful. Right? It's like this. If If you had an employee Bill and you were paying them $100,000 and I said, "Hey, you ought to hire this other guy. He costs $200,000." You say, "Well, why would I hire him if he costs $200,000?" I would say he does 10x the work of the guy who who you pay $100,000 to. You would pay him $200,000 in a second, right? And I think that's why Nvidia today is getting those margins. In the future, I expect that there's going to be more competition, whether it comes from this custom chips that you're talking about, whether it's from other competitors like AMD, whether it's from, you know, new startups that from Masa or Sam, etc. But you and I just talked about the challenge to build a fab and the challenge to design those chips is non-trivial. And you know, the probabilities are somewhat low. And so it's going to take time to get there.
76:45 I mean, if you're starting today, like when would you have an impact? But one question I would have for you on this is you know, if you're right about this, I wonder about TSMC's capacity. Right. You know, and that is a limiter to this. Right. So you're looking at the chart and saying, "How do we get to two trillion of replacement and new if TSMC is gated in their ability to produce these?" Now, Jensen gave this number.
77:14 He's intimately familiar with TSMC and their ability to produce. So I said I I think he has a sense in his head about what they can get done. I think that the other limit limiting factor we're going to run up against here pretty quick, it's not going to be capital, right? It may or may not be TSMC, but the power consumption. So even for the B100, the data center designs, like you're talking about liquid cooling, custom design data centers, they're going to consume massive amounts of power. And I think part of the reason you're hearing about this sovereign demand from the Middle East Bill is they understand that their chief competitive advantage is low-cost energy.
77:54 Right? And I don't think they're talking about building all of this just to service the needs of their country. I think they're smart enough to understand they're trying to equitize all their petrochemical wealth into technology wealth in the future. And if I was running one of those countries, I would look at this phase shift as an opportunity to become the supplier to the world of of of computer-aided intelligence, right? And if they can do that because they have lower cost energy and because they can recruit the likes of Sam Altman, they can recruit the likes of TSMC to their countries to set up shop there, to design chips there, it's not all that different than digging wells, right?
78:38 Think about digging a well. You have to spend a lot of money, a lot of time, a lot of research. You're hoping you get your payback 5, 10, 15 years into the future. And so I think this is a rational decision by them to build out this capability. But to your point, it's a non-zero and non-trivial undertaking to try to get it done. Now, if they do that, it's going to put them in competition with some of the hyperscalers, right? From CoreWeave to AWS to others who are in the business of renting AI capabilities out. But I think it's good for the world because what we want to see is a lot of competition.
79:13 We want to see the price of AI compute fall over time. That's going to lead to a lot more consumption. And because of the productivity gains from the end applications again self-driving cars are coming up with vaccines or solving complex problems or just allowing consumers to have answers instead of 10 blue links you know we need the cost to come down on all this stuff. If you and maybe this would be a good way to wrap but if you if you bring that attitude to the table I mean it sounds like and I I don't want to put words in your mouth but there's no there's no reasonable end in sight from where you sit. Like on this way we're we're at the very beginning and it's going to go for a long time. I said last week and I I think we had a little video that that went out and I said we are going to hit a zone of disillusionment. Well, I don't know whether it's this quarter I maybe tomorrow with Nvidia when it starts right? We're going to hit a zone of disillusionment where you have a mismatch between supply and demand and then all the skeptics are going to say I told you so the internet's a fad AI's a fad mobile's a fad I it happens in every super cycle.
80:19 I we're going to use that as a buying opportunity because we are absolutely convinced that the runway is longer and wider and the impact of on humanity is going to be greater because the end applications are so compelling that are using AI to assist them in everything that they do but that's really where the tug-of-war is in the world today Bill and that's what makes a market right? You're going to have those people who are skeptics about that demand that's what creates a wall of worry you know why does Nvidia 20 times earnings?
80:52 Right? I would say because there's a lot of skeptics and there's a lot of worry about whether or not these free cash flow is durable into the future. Yeah I I I bet you the worry's more on pricing than volume. Right and I by the way and it's it's unknowable like I don't know nobody who follows this knows so you have to assign some probability to that future outcome but I think you're right it it is a good place to leave it I wish you could be here I I know you're you're you're anchored down there in Texas speaking of Texas fabs but this is fun to have you here in person.
81:23 Good to see you. like old times and and I think we're going to be talking and debating this for as long as we're doing this pod for sure. No doubt no doubt good to see you man.
Summary
- The choice between an exceptionally intelligent assistant without history or internet access versus an average one with personal knowledge and internet access highlights the value of contextual understanding in AI.
- Tesla's recent advancements in full self-driving technology are seen as a significant leap forward, paralleling the rapid developments in AI.
- The hosts emphasize the importance of rigorous analysis and continuous learning in the tech industry to stay competitive.
- Earnings reports indicate a disparity in stock performance among tech companies, with some benefiting greatly from AI while others struggle.
- The discussion highlights the potential for AI to enhance productivity across industries, suggesting a substantial increase in demand for computing power.
- Concerns about inflation and interest rates may impact market expectations, particularly regarding the Fed's monetary policy.
- The conversation touches on the competitive landscape for AI, with companies like Microsoft and Meta adapting their strategies to leverage AI effectively.
- The need for significant investment in semiconductor manufacturing and AI infrastructure is underscored, with potential geopolitical implications as countries seek to establish their capabilities.
Questions Answered
What factors should be considered when choosing an assistant?
The choice between an exceptionally intelligent assistant with no internet access and a moderately intelligent one with full knowledge of your history and internet access highlights the importance of contextual understanding and resource availability.
How has Google's role in AI and information discovery changed over time?
Google revolutionized information access 20 years ago, but its growth in query volume has slowed, indicating a need for adaptation in the AI landscape.
How do growth rates and valuations compare among major tech companies?
Analyzing growth rates and price-to-earnings ratios among Microsoft, Amazon, Nvidia, and Google reveals that Google is expected to grow the slowest, yet its valuation reflects market expectations.
What are the prospects for YouTube and Google's AI capabilities?
YouTube's future looks promising with improved content targeting and ad capabilities, supported by Google's strong AI research and development.
What are the implications of labor practices in global manufacturing?
The discussion highlights the complexities of labor practices in manufacturing, particularly in countries like Mexico, where workers may choose demanding jobs for better living conditions.