Transcript
0:00 If you invested $25,000 in Sandisk [music] class gear, you'd have a million dollars today. Memory stocks have absolutely skyrocketed and the reason behind that is simple. It's AI. Memory has become the core component behind GPUs, [music] CPUs. It actually makes up 50% of the materials cost to actually build AI models today. And just [music] 6 weeks ago, a new memory ETF launched giving you exposure to the top three memory manufacturers, SK Hynix, Samsung and Micron. And just under a month from launching, it is up over 100%. It took in over $6 billion in assets in the first 5 weeks of it operating. In fact, Goldman Sachs referred to it as the fastest growing ETF that they've seen with $1.1 billion worth of inflows in a single day. So, this begs the question, is memory stocks or AI memory specifically a good investment to make right now or has the bubble grown too much? If we look historically at memory, it's gone under very volatile boom and bust cycle. So, in this episode we're going to explore whether this makes sense at all. And I think I would personally argue that I think this time is different. Memory has undergone a significant shift of demand where AI is just consuming all available supply. So, maybe to take a step back before we get into why, we could talk about what memory is as it is referred to around AI, which is basically high-speed chips that's it physically next to the GPU and they hold the model weights and the data that the chips need in order to access during the inference and training run.
1:27 So, this matters because these large models are bottlenecked by not really how fast can do the math, but how fast it can pull data from that memory. So, the speed and capacity of that memory directly determines how big and how fast a model can run. So, if you want to publish AI tokens, if you want to generate tokens, memory is the single critical kingpin. And this is different than anything we've ever seen before because for the last 40 years of time, memory was the pretty much textbook example of a horrible business. There are three suppliers that make these chips, there's Samsung, SK Hynix, and Micron. And they make identical products, which are essentially a commodity. And it turned into this thing called a pig cycle, which is basically high prices, and then everyone builds the same fabs, and then there's oversupply, which results in price collapse. And this cycle has kind of run itself every couple of years since the 1980s. But E just like you said, this time is different. There are these two key traits that are converging that make it different this time. So, the first one is the demand sink that comes from AI >> for memory has vastly outpaced any other demand sink that memory has had before.
2:29 So, if you look at pre-AI memory stock charts and post-AI, it looks like completely like a penny stock. It's just gone parabolic, right? And so, the question everyone's asking is, is this real? Well, the answer is it's true. If you look at Nvidia specifically, when the AI cycle really kicked off, their GPUs were in incredible amounts of demand. Now, back then, the models used a significant chunk of memory, typically around 30 to 40% of the bill of materials cost for GPUs back then for Nvidia's early models was went to memory, basically. Now, if you fast forward to today, it's 50%. And if you look at every future iteration, including Rubin, Rubin Ultra, and Feynman that is going to be launched later in 2028, it doesn't just require the same amount of memory, it requires two, three, and four X the amount of memory for every single iteration. So, the point being is there is an insatiable amount of demand for memory, and there are different types of memory.
3:25 In fact, AI has created a completely new novel type of memory structure known as HBM, high bandwidth memory, which functions above the status of local genuine DRAM, which is like your your standard DRAM, which a lot of other consumer devices use just for AI specifically. So, the point being is there very limited amounts of memory available, and AI is is eating up pretty much the majority of it right now. Yeah, so we have the network effects that are occurring just from AI demand, but the high-bandwidth memory is a key structural difference that I think a lot of people aren't really aware of. If you imagine a single traditional stick of RAM, something that you might see plugged into a computer, you could think of it that's like a one-story warehouse.
4:07 What these AI chips require right next to the GPU is this thing called high-bandwidth memory. And that is a warehouse bisected vertically. Mostly right now it's about 8 to 12 stacks high. Soon there's going to be 16 stacks high. And that requires a lot of very precise materials, a lot of engineering, a lot of resources that make these chips far more complex, but also constrain the supply far more. I mean, each GPU or each stick of memory is now approximately 8 to 12 sticks. So, you have this convergence of a few things.
4:35 One is just the need for them in order to generate tokens, but specifically the need for that high-bandwidth memory that makes a huge difference. So, now not only do we have the supply constraints coming in terms of the actual structural advantages that HBM has, but you also only have three people that actually produce this. There are three manufacturers, and the constraint is so tight that they have actually some of them have stopped making commercially available RAM because they're so focused on building purely me- memory for AI. Yeah, and there's also a a recent shift that has happened within AI in general where previously it was very focused on AI training, and so it was very GPU heavy.
5:14 That's why Nvidia is now like the most valuable company in the world. Now, that recently shifted towards inference. Inference is like where you prompt or call on a model and you get an answer back. Instead of humans doing the majority of the inference, we're finding that AI models themselves or AI agents specifically are spending a lot of time thinking, talking amongst each other, coming up with a better output at a better answer. That's what a lot of cutting-edge models and AI products today actually do behind the scenes.
5:43 That requires a lot of inference. Now, if you want to do all that amount of inference, you need not just a little bit more memory, you need a load more memory. So, the argument that's being made right now is in a future where the entire economy is facilitated or propped up by AI agents, you're going to need like 10 to 50x more memory than we have available today. And Ben from Stratechery did an amazing breakdown and I kind of like summarized it here where basically the value of the opportunity is like 10 to 50x from now and we don't currently have enough memory to do that.
6:15 And it immediately reminded me of another company which was Nvidia back when they were building out GPUs for gaming processing, graphics processing specifically, and then they stumbled across this AI thing where they were like, "Huh, this it also needs parallel computing." And now like the demand thing was crazy from AI. The same thing is happening with memory and these memory manufacturers are going to benefit the most. So, we're going to get into what companies are best positioned for memory. But, prior to that, it it's probably makes sense to explain why this time is different, why the clock is ticking, where there's a perhaps a limited opportunity before the market starts to realize this structural change. Now, we mentioned the problems that are occurring in terms of just supply side due to the invention of HBM and just the requirement of that in every single GPU. But, there's also a software side demand vector as well, which is the rise of agents and we've mentioned this in a previous episode, but I think it's important to double down on is the idea that you're not just talking to a singular chatbot anymore.
7:12 And when you send a query to an LLM like ChatGPT or Claude, you create this thing called the KB cache and that uses a lot of memory. It stores a lot of the context inside of this narrow window. Now, what happens with agents, which is the new paradigm, which is what a lot of these companies are shifting to and a lot of people who are doing productive work are actually using, those agents, each one consumes their own KB cache, which means it needs if you have 20 agents, you need 20 instances of memory.
7:36 And there is no sign of that trend slowing down where there's more instances or more demand for agents, which means more context that needs to be remembered, which means significantly more of that HBM, which is already supply constrained. In fact, if you want to get some memory now, lead times are extended currently to the end of 2027 because there's just this inability to scale production. And I think when we answer the question of why this time is different, there are these unique structural changes both on the hardware demand side, but also on the software supply side that both point to a pretty far out window in which you should start to worry about demand because there is just a very clear trend in one direction and a very clear under indexing of the ability to supply all of the memory required to fulfill that trend. So, I think that's that's something worth noting is that there are demands for this coming from all these different areas. There's a physical constraint to building memory.
8:30 The top three providers cannot physically build out more capacity. In fact, I was reading a story earlier this week where apparently a bunch different AI customers have been offering Micron and the likes of Samsung and SK Hynix to help them build out or purchase equipment in exchange for guaranteed capacity or supply in 2027 and 2028, right? You're not exaggerating that like currently where where they're booked up until the end of 2027. And so there's a physical constraint there.
9:03 Typically in a bubble, whether it's a memory bubble or a tech bubble in general, you have some version of these companies faking demand. And they're like levering up to like create a supply which ends up becoming an over supply. So, there's too much of the product out there and so prices kind of like crash, demand kind of like sinks. That isn't the case here. If you look at every quarterly earnings report from each of these three manufacturers who are all public by the way, you can see that these back orders, that these bookings are not only legitimate, but they're already paid for in advance, which typically doesn't happen with any of these contracts. So, you have legitimate cash on the books that you can then use as a cash projection or a forward projection for a lot of these companies. In fact, if you look at Micron, their forwards earnings right now is under 10, which isn't definable within a bubble where if you look at it in like past historical cycles, that typically hits around 30 to between 30 to 50 forwards earnings ratio. So, the point is it's legitimate as far as we can say. Now, skeptics are saying, "Hmm, maybe it's the the earnings that is the bubble." So, the earnings that they're reporting isn't actually real, but it that's harder to to pick apart than what we're seeing right now. Yeah, I was actually going to mention, I think that's such an important point. The idea that although these companies are trading so much higher, SanDisk is up 1,500%. The forward PE ratio, which is the price to earnings, basically what premium it trades for on a relative basis versus what it's worth today, is only 9 to 12x.
10:32 And it's lower for Samsung at 7x. And it's even lower for SK Hynix at 5 to 6x. So, they're not really trading at a premium relative to what they're guiding to their estimates and revenue to be. If you take a company like Tesla, I think that's currently trading at 40 to 50x. And companies like Microsoft or Amazon are are like 15 to 20x. So, these memory stocks on a relative basis are actually valued pretty in line with what you'd expect for a industry that's doing very well. And that's noteworthy. So, let's get into the actual stocks, the companies that people can participate in or at least look at if they're interested in participating in this.
11:07 There are three large players. There is SK Hynix, there's Samsung, and there's SanDisk. I'm seeing another ticker here, which perhaps you could walk us through, which is MU up 864%. Why is that up so much? >> Yeah, I mean, Mike, Mike, it's Micron. Micron is up over 8x over the last year. The primary reason for that is the other two companies, the biggest memory manufacturers, which is SK Hynix and Samsung Electronics, are based in Korea. So, if you're in the West or if you're in America specifically and you want to get exposure to these stocks, it's not as easy as going on to your Chase stock account and purchasing these. You can't exactly do that. There's a few more hoops to jump through and most people aren't willing to to do that. So, um another way of getting exposure to this thing is to buy the main American memory manufacturer and there is one clear leader, which is Micron. So, their stock has absolutely set and to be fair, in Micron's defense, they produce a really good product and they are one of the advanced supplies. But, if you want to talk about who the king is, it is SK Hynix. They have been the sole and main provider for memory uh for Nvidia uh and all their future GPUs. In fact, um in the same way that Nvidia has booked out the majority of capacity for TSMC to build their GPUs, they have done the same with SK Hynix. So, the reason why those people that I mentioned earlier are trying to like pay off SK Hynix for guaranteed supply in the future is because Nvidia owns the monopoly on all capacity for SK Hynix going forward. So, SK Hynix is like the strongest. Samsung Electronics is next. Samsung Electronics does a ton of other stuff, which is why it's not a pure concentrated bet on memory. And then you have Micron, which is like the American bet. Now, what I want to speak about is um that ETF I mentioned earlier, Josh, that launched six weeks ago. That is like the fastest growing ETF. I think it's like $5 billion worth of inflows over the last five weeks or $6 billion. Um it's this thing called DRAM. It's a fantastic ticker and it's a memory ETF. And the reason why it's so unique is two reasons. One, it's accessible in the West, but two, it's a basket exposure to those two Korean companies that I mentioned earlier on. It owns SK Hynix shares. It owns Samsung Electronics shares, but it also owns uh Micron. In fact, all three of these companies, I think make up around 70% of the entire basket. So, it's a very concentrated play on memory, AI memory specifically.
13:26 And then it also owns smaller stakes in the likes of SanDisk and Westgate, which is a different type of memory that is still equally important for the AI trade. We have a great visual on this. I think this is probably what most people will be interested in participating in. Just showing the holdings within this. I mean, this is the access that you want if you want access to the Korean companies. It has 24% SK Hynix, 25% Micron Technology, 5% in WD, 6% Seagate.
13:53 Uh Samsung is 20%. So, this is probably the most balanced basket of exposure. This is personally what I'm most interested in if you don't want to think about it too much. You just set it and forget it. Uh Elish, you mentioned this to me a little while ago, and since then it has gone absolutely nuclear. This seems to be the singular place in which people are converging on if they don't want to do all the hard work of picking winners and losers. In fact, this has recently gotten enough attention to where they have leveled it up even once more. So, now there is a ticker that goes by the name of just RAM instead of DRAM, which is the ETF that covers basically the entire memory market. And this is a 2x leverage long memory ETF that is going to be launching very soon.
14:32 So, if you really want to go risk on, if you really believe in the memory trade over a long period of time, there are tools available to be able to enable you to gamble on this to the full extent. I'll probably just stick with the regular DRAM ETF, but for those ambitious, this is probably the best way to get access to those individuals, particularly if you listen in the United States like most of us do, and you want access to those Korean powerhouses. Uh this is a pretty good way of doing it.
14:56 Now, I'm sure what a lot of listeners are thinking as as you're hearing what we're saying is, "Okay, well, all these stocks are up five to eight X. Um we've completely missed the trade. Why on earth would we potentially want to invest in this? Is this a bubble? Is this going to pop?" And you know, there is feasibility to argue that that might be the case. This time that this time isn't actually different. In fact, if we look at the historical context of these memory suppliers, on the left here in 2000, there were 11 main manufacturers of memory. And it's important to understand that memory has gone through boom and bust cycles for the better part of the last two to three decades. And with every boom and bust cycle, you end up with fewer players, which brings us over to the right over here. Which This is funny. This is in 2013, Josh. So these three have have kind of stuck it out. Um you have three companies which basically dominate memory manufacturing in its entirety. So the question now is um is this going to happen in the same way?
15:58 Now there's two sides of this argument. The side that argues against this thesis is um AI has created a demand sink for the reasons that we mentioned earlier, agentic AI, the fact that you need it for all successive GPUs in larger quantities than we've seen in any other technology shift. And that is the case. AI is pretty pervasive across every single industry. So if you assume that every single industry is going to have some form of AI model that changes the way that the industry works or AI agents that can automate, say, I don't know, 10 to 40% of a working roles there, you can then extrapolate to think, well, okay, that's going to need a bunch of memory, a bunch more GPUs, a bunch more CPUs, a bunch more agents um to be able to facilitate that. So you can then kind of mark up the amount of memory that is required. And that's why these stocks have probably a longer way to go. Now the skeptic would argue, okay, that's the case for now, but what if we launch an AI model or GPU which requires much less memory? Won't that mean that memory oversupply will happen? What happens when Micron's uh fab gets launched and we have a heck ton more memory? Will that decrease prices and demand? You could argue yes and no. Jevons paradox, people will just maybe want more of the thing, so you may need even more amounts of memory, but those are both sides of the opposing argument.
17:13 Okay, so I guess I have something that I I'd want to challenge you on in in kind of supporting why this time is different. If you think this time is truly different because when we look at the historical patterns of what these memory cycles are like, they generally last about 18 months and then experience a pullback of anywhere from like 40 to 75%. This happened in 1995, 99, 2017, 2023 and now this current cycle started actually in the fourth quarter of 2024.
17:38 So, we're about month 18 now, which is where things should be either taking a turn for the worse or changing for the better. So, if you're thinking about how you allocate personally and how you believe this to go, this is a pretty pivotal time. If you're looking at it as if there's like resistance on the chart, we're at that resistance right now. We're in month 18. Does it seem like it's more probable that this actually is different or is this the natural cycle? Cuz it I mean, all the signs point to it being different this time, but you mentioned, I mean, the ETF it doubled in 5 weeks.
18:08 So, a lot of that like easy beta that people had is gone. Is there still opportunity for the upside and and what time scale are you thinking about? If you ask me personally, I do think that there is long-term a lot more upside, but it wouldn't surprise me if we see a short-term retrieval from stock price charts. Like, we have had like, I think, 6 weeks of constant uptick in this DRAM ETF and then just memory stocks in general. And that has been on the basis of these quarterly earnings and a bunch of other partnership announcements. That can't keep happening every single week.
18:42 At some point, we're going to run out of news to kind of push prices up further and I think we're going to see a recession. I think people are kind of overthinking it. Now, the argument against that would be, well, forward's earnings ratios are still quite low and, you know, some people might see that, but I just don't think we can see a chart go up exponentially every single week. I think we're going to have some some back pull.
19:02 The thing that gives me optimism is those backlog of orders that I mentioned earlier that aren't just signed, sealed, Um, before they even delivered, people have paid for it up front. Um, there was a recent deal that was struck between, I believe it was Google and, uh, Micron for their TPUs. Um, and they paid 40% up front. Um, so, the point is, like, these companies, uh, really want memory. And the companies that really want memory are not unknown companies. They're the Mag 7 who have the cash flow and free cash flow to pay for it and back it up.
19:39 So, if you have some of the smartest, most intelligent companies, most valuable companies in the world putting up money in big, uh, like, risks like that, you could argue that this time is different and more legitimate. Now, of course, there is the non-zero chance that all of this blows up, that the demand is actually fake, that Anthropic and OpenAI, on their demand side, actually end up inflating their numbers too much, and that could lead to a waterfall cascade of all these things crashing, but I don't see the structural context for that happening right now. 12 months from now, higher or lower?
20:07 Higher. I think higher, too. Yeah. That feels like the vibe. There is, like, very clear trajectory, and sure, there will be a bit of volatility along the way, but higher feels like, uh, feels like an optimistic version of the future that we have enough information to go on that, um, I could feel comfortable about about betting on. So, I think that's probably most of the the case for memory. That's why it's important, what unique market structures are now available that weren't in the past version of these 18-month cycles, and where the opportunity lies if you were interested in participating. I guess the ask for you, the person who's listening to this, is what do you think on that 12-month timescale, or what is the best way for you to get exposure? There's this chart that really devastates me personally, Ejas, as someone who loves to create my own custom PCs and build hardware. The cost, yeah, if you scroll down all the way to the bottom, even, the cost of these memories or memory systems for consumer products is through the roof.
21:05 And that that's been a little disappointing, because if you want to just go buy a PC, if you want to get a new Xbox, even the new Steam machines, they've all been delayed or the prices have been increased. In fact, if you want to go buy a PlayStation 5, it costs now today than it did What was it? 5 years ago when it first came out because of these supply constraints. So, we're starting to see it permeate out into the general broad consumer market. And that feels a little discouraging. I wonder how high that can go. I wonder how much tolerance the consumer market has before it starts to bend. So, that's something I'm going to be looking at. Also, is following these prices as it relates to just general consumer hardware. Is the iPhone going to suffer? Are those prices going to go up? The average smartphone cost. Things of this nature are also on the watch list to see if they could if they could bear it. And if they can, then we're probably good. If not, it's something to just take some note of.
21:51 Personally, memory is going to be one of the biggest bets in the same way that GPUs won and it saw Nvidia, you know, breach above $5 trillion market cap. And the same thing is going to happen in memory this time and we have three concentrated players. One in America, Micron, that is going to do the same thing for memory. So, I'm excited about it. I am slightly nervous about the boom and bust of these different cycles, but I guess we'll see if this time is different. The fundamentals Yeah. Things are going up. Well, well, at some point it's going to break, right? Like I I'm looking at this like consumer PC memory chart and I'm like, at some point people are just going to throw their hands up in the air. Like it's going to be too expensive and something will need to shift. Whether it is these consumer device makers like Apple pushing back and saying, "Listen, we're just not going to do this or we need to find an alternative." I don't know what that is, but one thing is for sure is the demand for AI models, the demand for AI agents is just going up and to the right. It's If it's not coming from consumer, it's coming from enterprise. So, I just don't know how this conundrum is going to be fixed. Maybe we create an alternative type of model, but either way, we will be tracking it and I'm bullish memory at least for the next six to to 12 months.
23:05 Um but that is it. Um I'm curious whether the listeners of this show have any other takes. Um we've released, I think, two other investment-themed episodes over the last week and a half, and the feedback has been tremendous. Both uh uh comments telling us uh why we're right and why we are explicitly wrong. I want to hear from both sides because it helps us uh kind of like figure out where we're going next and what to cover next. Um Does anything that we miss on the memory side of things? Also, let us know. And finally, um we heard you on wanting to talk about or unpack the layers of uh substrates and infrastructure that we covered on our previous episode. We are going to plan and deliver that episode fairly soon. But this week, later on, we're getting Leopold's files.
23:48 >> Happy Leopold week. This is huge. >> week. It's huge. >> our last two episodes, those were those were among the biggest ever because it was covering Leopold. I don't want to say I don't want to take any credit, but if you search up Leopold's post oil or if you go on X, we're very much at the beginning of the Leopold narrative. And now it is the next chapter in that. So, Leopold's uh fund situational awareness has gone from 1.5 billion to like 6 billion in the course of 2 years, and they publish these things called 13F filings every quarter that reveals the new set of positions. That 13F filing is going live sometime by the end of this week. It's due by Friday. So, we will be very ambitiously monitoring this, and as soon as it releases, we'll have an episode ready to go to talk about all the new investment thesis around the own situational awareness for the next quarter. So, stay tuned for that. We are we are locked in and ready to go as soon as that one drops. Yep, [music] exactly.
24:36 Um but aside from that, I think that is it, and we will leave you guys until the next episode. [music] Um but see you then. >> [music]
Summary
- Memory stocks have surged due to AI's demand, making up 50% of the cost to build AI models.
- A new memory ETF has gained over $6 billion in assets within weeks, marking it as one of the fastest-growing ETFs.
- The demand for memory is driven by the need for high-bandwidth memory (HBM) for GPUs, which is critical for AI processing.
- Historical memory markets have been volatile, but current demand driven by AI may indicate a structural shift.
- Major manufacturers like SK Hynix, Samsung, and Micron dominate the market, with limited capacity to meet rising demand.
- The shift from AI training to inference requires significantly more memory, potentially increasing demand by 10-50x.
- Skeptics question the sustainability of this growth, citing historical boom and bust cycles in memory markets.
- Despite high stock prices, forward earnings ratios for memory companies remain relatively low, suggesting potential for continued growth.