transcribe

Two Labs Are About to Take Half the World's New Compute - Dylan Patel

Dwarkesh Patel · 1m · transcribed 19d ago
More from Dwarkesh Patel Business
𝕏 Share ▶ YouTube 📥 PDF 🤖 .md

Section Insights

# 0:00

Centralization of Compute Resources

What is the trend in compute resource centralization among major AI companies?

Anthropic and OpenAI are rapidly increasing their share of compute resources, currently accounting for 40-50% and continuing to grow.

  • Anthropic and OpenAI are centralizing compute resources.
  • Their share of compute is accelerating rather than slowing down.
  • They started the year with significantly lower compute capabilities.
# 0:14

Incremental Compute Growth

How much compute have OpenAI and Anthropic added this year?

Both companies have added significant compute resources, with a 30% increase in incremental compute this year.

  • OpenAI and Anthropic have seen substantial growth in compute resources.
  • The growth trend indicates a dramatic increase in compute capabilities for the next year.
  • SpaceX is contributing to this growth by building and leasing compute resources.
# 0:28

Leasing and Building Compute

How are OpenAI and Anthropic acquiring compute resources?

They are leasing compute from SpaceX and also building their own infrastructure with proprietary chips and TPUs.

  • OpenAI and Anthropic are diversifying their compute sources.
  • Leasing from SpaceX indicates a competitive market for compute resources.
  • Both companies are investing in their own hardware to enhance capabilities.
# 0:42

Future Compute Distribution

When will OpenAI and Anthropic dominate the incremental compute market?

By the end of next year, it is projected that half of the world's incremental new compute will be controlled by OpenAI and Anthropic.

  • A significant portion of new compute resources will be concentrated in two labs.
  • This trend indicates a potential monopoly in AI compute resources.
  • The timeline for this shift is within the next year.
# 0:56

Dominance in Compute Ownership

What is the long-term outlook for compute ownership among AI labs?

In the next one to two years, it is likely that most of the world's compute will be owned or utilized by OpenAI and Anthropic.

  • OpenAI and Anthropic are on track to control the majority of usable compute resources.
  • This centralization could impact the competitive landscape of AI development.
  • The dominance of these two labs raises questions about innovation and access.

Transcript

0:00 Anthropic and OpenAI are taking as much as 40 to 50% of compute next year. This centralization doesn't look like it's slowing down or stopping. In fact, it looks like it's only accelerating. You know, the beginning of this year, Anthropic and OpenAI started at two for OpenAI and less than two for Anthropic. End of this year, they're both above five. When you look at the incremental compute added, that's about 30% of the compute added this year. And as we step forward to next year, given what's already been signed and penned and inked, you've got something even more dramatic, right? For example, SpaceX is building a ton of compute. And they're actively going to lease quite a bit of it to Anthropic and OpenAI most likely cuz they're the ones who have the marginal capability to pay the highest price. In addition, OpenAI and Anthropic are also starting to build their own compute. OpenAI with their own chips, Anthropic with TPUs that they're purchasing from Google and deploying with Fluidstack. And so, when you ask, "Hey, when does half of the world's incremental new compute go to just OpenAI and Anthropic?" I mean, it's it's really by the end of next year, it's already half of the incremental compute is going to Anthropic and OpenAI.

0:55 >> This very soon, you're saying maybe within a year and a half or two years that most of the world's compute is owned by two labs or at least are serving the demand from two labs. >> You've got them just controlling most of the usable, you know, flops in the world on their own.

Summary

Anthropic and OpenAI are rapidly centralizing compute resources, projected to control 40-50% of the world's incremental compute by next year. Their growth is fueled by significant investments in their own infrastructure and leasing arrangements, particularly with SpaceX, indicating a trend towards increased dominance in the AI compute landscape.

- Anthropic and OpenAI's compute capacity has grown significantly, from under 2 to above 5 this year.
- They are projected to account for about 30% of the total compute added this year.
- SpaceX is building substantial compute resources, likely to lease to Anthropic and OpenAI due to their financial capability.
- Both companies are investing in their own compute infrastructure; OpenAI is developing its own chips, while Anthropic is acquiring TPUs from Google.
- By the end of next year, it's anticipated that half of the world's incremental new compute will be directed to these two labs.
- The trend suggests that within 1.5 to 2 years, a significant portion of global compute resources may be controlled by Anthropic and OpenAI.

Questions Answered

What is the trend in compute resource centralization among major AI companies?

Anthropic and OpenAI are rapidly increasing their share of compute resources, currently accounting for 40-50% and continuing to grow.

How much compute have OpenAI and Anthropic added this year?

Both companies have added significant compute resources, with a 30% increase in incremental compute this year.

How are OpenAI and Anthropic acquiring compute resources?

They are leasing compute from SpaceX and also building their own infrastructure with proprietary chips and TPUs.

When will OpenAI and Anthropic dominate the incremental compute market?

By the end of next year, it is projected that half of the world's incremental new compute will be controlled by OpenAI and Anthropic.

What is the long-term outlook for compute ownership among AI labs?

In the next one to two years, it is likely that most of the world's compute will be owned or utilized by OpenAI and Anthropic.

© transcribe · For agents Built with care and craft by Gokul Rajaram