transcribe

Databricks CEO: We're hosting open source models like Kimi and running out of GPUs

CNBC Television · 3m · transcribed 5d ago
More from CNBC Television Business
𝕏 Share ▶ YouTube 📥 PDF 🤖 .md

Section Insights

# 0:00

Introduction to Databricks and AI Valuation

What is the significance of Databricks' valuation in the AI landscape?

Databricks is currently valued at $188 billion, indicating its strong position in the AI sector. This valuation reflects the company's growth and the overall acceleration of revenue across various regions and product lines.

  • Databricks is a leading player in the AI industry with a high valuation.
  • The company's growth is attributed to increased demand for AI services.
  • The AI race is intensifying, with significant investments flowing into the sector.
# 0:46

Revenue Acceleration and AI Adoption

Why is Databricks experiencing accelerated revenue growth?

The acceleration in revenue is due to companies effectively doubling their operational capacity through AI agents, which are increasingly utilizing Databricks' services. This trend has been consistent over several quarters.

  • AI agents are enhancing productivity across various sectors.
  • Databricks benefits from a consumption-based revenue model.
  • The demand for AI tools is driving significant revenue growth.
# 1:32

Funding Purpose and AI Gateway Product

What prompted Databricks to raise funds recently?

The fundraising was primarily driven by the overwhelming interest in their newly launched Unity AI Gateway product, which allows users to manage AI spending and utilize both open-source and proprietary models.

  • The Unity AI Gateway product has gained significant traction among users.
  • Companies are eager to control AI costs while leveraging advanced models.
  • Databricks is positioned at the forefront of AI budget management solutions.
# 2:19

Competitive Landscape and Cost Control

How do companies perceive the threat from emerging AI models?

Companies are increasingly concerned about the rising costs of AI, which are not matched by revenue growth. This has led to a focus on cost control and the exploration of open-source models as a viable alternative.

  • Cost management is a critical issue for companies utilizing AI.
  • Open-source models are seen as a cost-effective solution for routine tasks.
  • The competitive landscape is shifting as companies seek budget-friendly AI options.
# 3:05

Demand for GPUs and Funding Needs

What is driving Databricks' need for additional funding?

The demand for GPUs has surged due to the influx of requests for open-source models, necessitating additional funding to acquire these resources. The company is facing challenges in meeting this demand across various regions.

  • There is a global shortage of GPUs, impacting AI service providers.
  • Databricks is responding to high demand for open-source AI models.
  • Funding is essential for scaling operations and acquiring necessary technology.

Transcript

0:01 FABLE OR GPT SOL. IS THIS ANOTHER DEEP SEEK MOMENT FOR AMERICAN AI LABS? LET'S GET INTO IT. IN TODAY'S TECH CHECK, ALI GODSEY'S, THE CEO OF DATABRICKS, WHICH IS CURRENTLY FUNDRAISING AT A $188 BILLION VALUATION AND KATE ROONEY IS PROBABLY WORTH SOMEWHAT IN THE NEIGHBORHOOD OF $188 BILLION AS WELL. KATE I TOSS IT OVER TO YOU. >> JUST BELOW THAT CONTESSA. WELL ALI IT'S SO GOOD TO SEE YOU. PERFECT DAY TO HAVE YOU AND GET YOUR TAKE ON ALL OF THIS. THANKS SO MUCH FOR BEING HERE.

0:32 >> MY PLEASURE. >> GREAT TO SEE YOU. SO WE DO WANT TO START WITH THE FUNDING ROUND THOUGH. THIS IS BIG NEWS. YOU GUYS ARE FIRMLY ONE OF THE MOST VALUABLE COMPANIES IN SILICON VALLEY. $188 BILLION VALUATION. NOW WHAT DOES IT SAY ABOUT WHERE WE ARE. MAYBE IN THE AI RACE. YOU GUYS ARE A LITTLE BIT DIFFERENT THAN THE FRONTIER LABS. AND WHERE ARE YOU GOING TO BE SPENDING THAT NEW CASH. >> YEAH. SO YOU KNOW WE'VE BEEN SEEING ACCELERATION OF REVENUE IN EVERY REGION, YOU KNOW, EUROPE, ASIA, AMERICAS, AND EVERY PRODUCT LINE THAT WE HAVE.

0:59 SO, YOU KNOW, AND THIS HAS BEEN GOING ON FOR 6 OR 7 QUARTERS, YOU KNOW, ACCELERATING REVENUE, ACCELERATING REVENUE. SO I THINK THAT'S WHY THE VALUATION LOOKS THE WAY IT DOES. THE QUESTION IS WHY IS IT ACCELERATING? AND YOU KNOW, IT'S ACROSS THE BOARD. AND IT'S REALLY WHAT'S HAPPENING IS THAT IT'S BASICALLY YOU CAN THINK OF IT LIKE THIS. EVERY COMPANY ON THE PLANET DOUBLED THEIR HEADCOUNT. THEY JUST DON'T KNOW IT YET BECAUSE THEY HIRED ALL THESE AGENTS. AND THE AGENTS ARE DOING STUFF. IT'S NOT ALWAYS PERFECT, BUT THEY'RE STARTING TO USE MORE SERVICES.

1:25 THEY'RE STARTING USING MORE TOOLS. AND ONE OF THOSE MAIN TOOLS THEY USE IS DATABRICKS BEHIND THE SCENES. SO THEY'RE JUST THE AGENTS ARE ASKING MORE QUESTIONS FROM DATABRICKS. WE'RE CONSUMPTION BASED REVENUE. SO THEN OUR CONSUMPTION ACCELERATES THANKS TO THAT. SO THAT'S KIND OF BIG PICTURE WHAT'S HAPPENING. BUT THAT'S NOT WHY WE DID THE FUNDRAISE. THE REASON WE DID THE FUNDRAISE IS THAT THIS JUST, YOU KNOW, THIS SUMMER WE HAD OUR BIG CONFERENCE DATA AND AI SUMMIT.

1:45 WE HAVE 30,000 PEOPLE THAT CAME TO IT LIVE AT MOSCONE CENTER. AND THERE WE ANNOUNCED SOMETHING. WE DIDN'T THINK IT WAS GOING TO BE A BIG DEAL. WE TOLD THEM THAT, HEY, IN OUR UNITY AI GATEWAY PRODUCT THAT WE LAUNCHED, YOU CAN CONTROL THE SPEND OF AI. YOU CAN USE OPEN SOURCE MODELS, YOU CAN USE PROPRIETARY MODELS. WE ACTUALLY GIVE YOU CAPACITY FOR OPEN AI, ANTHROPIC, GEMINI, GROK AND OPEN SOURCE MODELS. AND THIS EXPLODED. PEOPLE WANT TO USE THIS GATEWAY TO SET BUDGETS AND THEY WANT TO USE OPEN SOURCE.

2:13 AND SO WE'RE JUST YOU'RE. >> YOU'RE ON THE GROUND FLOOR AS WE'RE TALKING ABOUT OPEN SOURCE. SORRY TO INTERRUPT YOU, BUT IT'S SUCH A BIG HEADLINE TODAY WITH KIMMY. I WOULD LOVE TO GET YOUR TAKE ON WHAT YOU'RE SEEING. YOU KNOW, YOU'RE SOMEBODY WHO IS OFFERING ACCESS TO THESE CHINESE MODELS IN SOME CASES. WHAT DO YOU MAKE OF THE CAPABILITIES OF KIMMY, AND HOW MUCH OF A THREAT IS THAT TO THE FRONTIER LABS? AS WE NOW LOOK AT ALMOST TRILLION DOLLAR VALUATIONS?

2:37 >> WELL, I MEAN, LOOK, I THINK FRONTIER LABS ARE AMAZING AND THEY'RE GOING TO CONTINUE DOING GREAT. AND BUT WHAT HAPPENED BASICALLY IS THAT EVERYBODY WANTS TO DO COST CONTROLS AND THEY WANT TO CONTROL THEIR BUDGETS BECAUSE AS ONE EXECUTIVE OF A FORTUNE 500 TOLD ME, HIS COSTS OF AI ARE INCREASING EXPONENTIALLY. HIS REVENUE IS NOT INCREASING EXPONENTIALLY. SO IF THIS CONTINUES, HE WILL GO BANKRUPT. SO HE HAS TO DO SOMETHING. SO THEN OPEN SOURCE IS HOW THEY WANT TO, YOU KNOW, FOR THE REALLY DIFFICULT QUESTIONS, LET'S ASK THE FRONTIER AMERICAN MODELS AND PAY A LOT FOR IT.

3:11 BUT FOR MOST OF THESE MUNDANE TASKS THAT YOU'RE DOING, LIKE, HEY, TAKE THIS FIELD OUT OF SALESFORCE AND, YOU KNOW, SUMMARIZE IT AND ENTER IT INTO WORKDAY, USE A CHEAP OPEN SOURCE MODEL. SO THAT'S WHAT THEY WANT TO DO. BUT WE'RE RUNNING. SO WE ARE HOSTING THESE OPEN SOURCE MODELS LIKE KIMMY. WE ACTUALLY OFFER IT TO OUR CUSTOMERS AND WE'RE RUNNING OUT OF GPUS EVERYWHERE. WE RAN OUT OF GPUS, YOU KNOW, ALMOST IN ASIA. THERE'S LIKE EVERY COUNTRY WANTS THESE GPUS, JAPAN, KOREA, YOU KNOW, UNITED STATES, INDIA. SO, SO WE JUST, YOU KNOW, NEEDED TO GO GET A LOT OF THESE.

3:41 AND THAT REQUIRES A LOT OF FUNDING. SO THAT'S ACTUALLY WHAT TRIGGERED THIS FUNDRAISE FOR US BECAUSE, YOU KNOW, WE JUST WERE INUNDATED WITH THESE REQUESTS. WE NEEDED TO GET GPUS. GPUS ARE COSTLY TO GET, YOU KNOW, PEOPLE ARE EXPECTI

Summary

Databricks CEO Ali Godsey discusses the company's recent fundraising at a $188 billion valuation, highlighting the accelerating demand for AI tools and services. He emphasizes the shift towards open-source models as companies seek cost control amid rising AI expenses, while also addressing the challenges of GPU shortages.

- Databricks is experiencing accelerating revenue growth across all regions and product lines.
- Companies are increasingly utilizing AI agents, effectively doubling their operational capacity without realizing it.
- The recent fundraising was driven by a surge in demand for Databricks' Unity AI Gateway, which allows users to manage AI spending and access various models.
- Open-source AI models are becoming popular for mundane tasks, while companies still rely on frontier models for complex queries.
- There is a significant demand for GPUs globally, leading to shortages and necessitating additional funding for Databricks to meet customer needs.
- Executives are concerned about rising AI costs outpacing revenue growth, prompting a shift towards more cost-effective solutions.

Questions Answered

What is the significance of Databricks' valuation in the AI landscape?

Databricks is currently valued at $188 billion, indicating its strong position in the AI sector. This valuation reflects the company's growth and the overall acceleration of revenue across various regions and product lines.

Why is Databricks experiencing accelerated revenue growth?

The acceleration in revenue is due to companies effectively doubling their operational capacity through AI agents, which are increasingly utilizing Databricks' services. This trend has been consistent over several quarters.

What prompted Databricks to raise funds recently?

The fundraising was primarily driven by the overwhelming interest in their newly launched Unity AI Gateway product, which allows users to manage AI spending and utilize both open-source and proprietary models.

How do companies perceive the threat from emerging AI models?

Companies are increasingly concerned about the rising costs of AI, which are not matched by revenue growth. This has led to a focus on cost control and the exploration of open-source models as a viable alternative.

What is driving Databricks' need for additional funding?

The demand for GPUs has surged due to the influx of requests for open-source models, necessitating additional funding to acquire these resources. The company is facing challenges in meeting this demand across various regions.

© transcribe · For agents Built with care and craft by Gokul Rajaram