Section Insights
Introduction to AI Developments
What are the recent developments in AI and open models?
The segment introduces recent advancements in AI, particularly focusing on open models and their implications for businesses. It highlights new releases from Reflection and Mistral, as well as Door Dash's drone delivery service and AI agent.
- Open models are becoming increasingly significant in AI development.
- Door Dash is innovating with drone delivery and AI chatbots.
- The naming of AI models can be influenced by internet culture and memes.
Sovereign AI and Cost Efficiency
How do sovereign AI models address data control and cost efficiency?
Sovereign AI models allow companies to maintain control over their data while providing cost-effective solutions for highly regulated industries. Mistral and Reflection are focusing on cost efficiency to enable enterprises to perform tasks at a lower cost compared to traditional models.
- Sovereign AI offers data control for businesses in regulated industries.
- Cost efficiency is a key selling point for new AI models.
- Open-source models are not competing directly with major players but are focusing on affordability.
Door Dash's Competitive Edge
What distinguishes Door Dash's drone delivery service from competitors?
Door Dash's competitive advantage lies in its established marketplace network, which creates a compounding advantage that is difficult for new entrants to replicate. Their new chatbot feature also encourages consumers to explore new dining options.
- Door Dash's extensive network enhances its drone delivery service.
- The new chatbot feature promotes consumer exploration of restaurant options.
- Established brands have a significant advantage in rapidly evolving markets.
Consumer Trust in Personal Agents
What are the implications of integrating personal agents into group chats?
The integration of personal agents like Instinct into group chats raises concerns about privacy and spending. Younger consumers tend to be more comfortable with technology, but there is a need for broader acceptance among diverse user groups.
- Consumer comfort with technology varies significantly.
- Personal agents can influence spending behavior, often leading to unplanned purchases.
- Trust in technology is crucial for the adoption of personal agents.
The Future of AI in Investing
How might AI change the landscape of investment practices?
AI is expected to enhance investment practices by acting as a personal assistant, allowing investors to focus on relationships while automating analytical tasks. The recent pullback of Aura's IPO raises questions about market dynamics and the challenges new companies face.
- AI is transforming investment practices by providing analytical support.
- The IPO market is challenging for new entrants due to competition from larger firms.
- Understanding revenue models is crucial for evaluating a company's public offering potential.
Transcript
0:00 you know, they just kind of leaned into the internet meme and now it's true. Today's frontier tasks are tomorrow's open-source workloads. From open models to open skies, we've got drone delivery from Door Dash. It's like you have a bunch of AI interns. It turns out for IPOs to happen, market conditions really do need to be perfect. Bot traffic has now exceeded human traffic. Is this our deepseek of the West?
0:32 We're back with another big week and this time we have Shia Agrial, a partner on Lightseed's growth team, joining us as a guest co-host. Reflection and Mistral each unveiled a new openweight model. Door Dash unveiled its own drone delivery and an AI agent that you can text. Meta and Sierra announced an open standard for how personal agents work with businesses and Aura called off its IPO hours before pricing. Plus, two updates from across the Lightseed universe. Let's get into it. Shia, welcome to Light Work. Thanks for having me on, Josh. It's great to have you in the studio.
1:13 So, we have so much to cover this week. There was a lot in AI and specifically for open models. So this week on Monday, Reflection introduced Beam and then Tuesday, Mstral announced large 4, also known as Lonk. Have you seen some of the internet memes around like all of the history on Lonk and why they wound up going with this like fat cat as the name of their newest model? I think it was their logo at some point in time. And it sounds like they've really leaned into it now.
1:46 Yeah, it's it's kind of started as like a meme this summer where like people were saying that they were going to announce this like fat cat with all of these parameters and it was this massive like model and it turns out that you know they just kind of leaned into the internet meme and now it's true. Own it. Both of these models are very exciting. Beam is 501 billion parameters. Only 23 billion are active per token. It's a sparse mixture of experts model. It's built primarily for text, coding, reasoning, and agentic work. Lechunk on the other hand is a trillion parameters model, 49 billion active with a million context window. It's in 160 languages. The API is in preview now.
2:33 Both of these models didn't publicly announce their weights, but though both are coming later this month. What does this mean? like that they didn't announce the the weights right away and also like what do these two open models mean overall for the AI industry and how they maybe relate to you know the frontier models. Yeah. Well, I think the weights will come with regard to how this impacts the AI race. I think this is the first attempt from the west to really battle and compete with the Chinese open source models that are the majority of open- source token flow today. I mean they're selling the same thing. You can see inside the model, you can adapt it and control it. And this has tons of utility for regulated industries, industries where you have private information and also just for those that are costconscious because we know the the gap between the cost per token for for open source versus closed source is is massive. What does seeing inside do for you? Does it allow you to do more with the model? It does. It allows you to change certain actions, behaviors, steer the model in certain ways, and you can also then sort of RL and post- train on it and and build your own version that's specific to your enterprise and your workflows and your knowledge. Shia, explain to our audience why do you pick one of these openweight models instead of the frontier models? Like when do you use one of these? It comes down to two things. control, visibility, and then cost. So today's frontier tasks are tomorrow's open-source workloads. And open weight models are maybe 6 to 12 months behind what the frontier model capabilities are. But that also means in 6 to 12 months they'll catch up and at a fraction of the cost you pay a frontier model today. So even today things that frontier models released 6 to 12 months ago they're able to do at a fraction of the cost. So running a thousand support tickets, it just makes more sense to run that through an openw weight model versus something that's extremely complex like a drug discovery task or a very long running agent that helps you complete a coding task. Those are things that are going towards the closed source models and I'm sure it makes a lot of sense for control because if you've got private customer information that you don't feel like you want to share with one of the large model firms, there's this great opportunity for you to control all of your data, have it hosted by you, and still be able to do the things that you'd like to do from a frontier perspective. That's sort of the pitch for sovereign AI. So Mistral is going after three to four very highly regulated industries whether it's industrials, financial services. We know reflections partner with the department of energy in the US. These are critical industries where this stuff matters a lot. One of the interesting things I saw in kind of both announcements where they were both pushing cost efficiency.
5:36 It seems like both are quite a bit cheaper on a token basis. Why are they pushing cost? I think this is the the value of open- source models. today these companies are are not really trying to compete with open AI and anthropic on the the frontier model race. What they're trying to do is push the paro frontier of intelligence per dollar. And what this allows enterprises to do is have some sort of equation that they're thinking about for these tasks. the openweight models are able to intelligently perform it and do it at a fraction of the cost. So why would I route it through Fable or some high cost model? Sure. And you get to continue to control your data like you were saying, right? So it's like it's cheaper and like as we've been learning on the show, it feels like there are more and more tasks where you don't necessarily need like the bleeding edge to accomplish the task you want to accomplish. Totally. Sha what does mixture of experts mean in regards to these kinds of models? So when you look at like the total parameters that's the the sort of initial memory bill that's hosted on servers and think of the mixture of experts as a way to reduce your compute costs in runtime. So you have 501 billion parameters and 23 billion are active for beam. And what that means is only 5% or those 23 billion are actually leveraged.
7:07 And one analogy I can make is you know you have a group of a thousand scientists but you pick the the 5% that are best equipped to handle that specific task and instead of getting all thousand scientists to do that work, let's choose the best. And that's actually something we're seeing converge throughout the industry and certainly from the Chinese open models but also reflection and and withdrawal sh so reflection has been cooking this model in stealth for a very long time and people were wondering when this was coming how good it would be. Is this our deepseek of the west? We certainly hope it is. today open- source models are dominated by China and Reflection Mrol's releases are giving the West a chance to to compete on the open source front as well. From open models to open skies, we've got drone delivery from Door Dash, which is really exciting. Door Dash Air is a custombuilt in-house designed six propeller aircraft that Door Dash says actually doesn't sound much louder than a another car passing you on the highway. They're starting with restaurants in Northern California. They've got Chipotle and Popeye's as foundational partners. Talk to us about the state of drone delivery. Why is Door Dash entering this area and and why is this important to them in terms of their focus and last mile Logistics like it's been for, you know, as long as Door Dash has been around? I think it's a continuation of the trend.
8:47 You know, Google Maps enabled Uber and Door Dash to actually begin where you have drivers now able to go from point to point very easily. That was the mobile era. And now with you know increasing developments with drone delivery, it's natural for Door Dash to want to be able to increase access and get people access to the food that they want to deliver. And whether that's lower cost or simply being able to reach people that otherwise wouldn't be able to serve, that makes a ton of sense for Door Dash. I mean, yeah, it's also like a lot of the cost of their business is is delivery, right? And so if you can have this drone fly across your yard and drop your food on a winch or your your groceries or anything else that Door Dash has access to, it's pretty gamechanging for their business model, you'd have to imagine. Certainly impacts consumer appetite.
9:38 What makes this different? There are so many drone delivery startups. What's Door Dash's edge in this area? I think Door Dash's edge is their network. You know, they're a true marketplace business. they have a a very strong flywheel where more consumers bring on more restaurants that create sort of a compounding advantage and it's very hard for a a new drone delivery company to to replicate that. Yeah. How are they going to get all of the businesses that Door Dash has spent years getting online so quickly? Yeah. Door Dash didn't just announce Door Dash Air, they also announced almost an Instinct competitor. It's a chatbot that is in preview now and you can sign up if you'd like access. And basically now you can go and have a conversation with Door Dash around the food that you might order. And I think the interesting thing for me here was that Door Dash actually has a a bot that's is part of the app called Ask Door Dash. Door Dash says that nearly half of restaurant orders through Ask Door Dash from June to August went to places that customers had never tried before. I think this is cool because it's sort of showing that, you know, their version of a muse or an instinct is creating consumer behavior where they actually try new things. And I feel like for most people, and I don't know about you, but my lunch order from Door Dash is pretty much the same. I eat the same thing every day. I do too. So, I wonder like does making it conversational make you try new things? You know, I haven't tried Door Dash's experience yet. just came out, but I really want to, you know, I think this is something that I've actually always struggled with. I feel like the the interface always presents the same options you're already used to seeing. So something that actually can search the entire breath of their inventory and serve up things that might be interesting to me. I'd be curious. Yeah. I And I do think that's a little bit by design. Door Dash says that more than 30% of recent grocery orders are just routine restocks, right? They're just like, "Hey, this is the thing I want. Get it to me." which is you could imagine why the drone delivery would be even more helpful. But I think what's interesting here is just like that they could shift this consumer behavior a little bit. I mean I certainly now with Muse and Instinct have this dialogue of a conversation that I might not have had with Door Dash. I would have just like pick the thing that's the easiest. But now maybe I'm going to say, "Hey, what's a Chinese food I haven't tried that I might like?" based on my past preferences and Door Dash probably knows a lot about me. I'm sure it knows a lot about you. I think it could change a little bit of consumer behavior around this. I think they need to because they're they're facing a bit of a risk from the instincts and muses of the world. How do you view Door Dash's risk different from we've talked a lot on this show about Amazon's risk, right? Like they've blocked Muse. They have this massive ads business that is built on the friction within its app that you kind of almost get frustrated and just take the one that they're advertising, right? And that is a big piece of their business model. What's Door Dash's moat in this equation? And and how much of a risk are Muse and Instinct and all of these other agentic platforms? I think there's somewhat of a risk and this is somewhat of an offensive but also a defensive move from Door Dash. If they can deliver a better consumer experience and truly lead to the best order or the best meal experience, whatever the consumer is solving for, because they have more data, more knowledge, they're willing to expose more data to their own agent versus Muse or Instinct. That could drive consumer behavior.
13:24 But there is a world in which, you know, you ask muser instinct about food choices and you don't go to Door Dash, you go to a restaurant's own delivery service, you go to Uber Eats, you go to some other service. So consumer attention and sort of being able to actually have the connection with the end user is so important and I think that's what Door Dash is trying to do sort of end to end. Yeah, I think it's kind of the way we were saying that like you know maybe people aren't going to cut off Salesforce because everybody uses it as their CRM and it's like but for Door Dash all of these restaurants have such slim margins. Like are they really going to be like, "Oh man, and we love using the Door Dash platform." Like if these agents can kind of go around that and cut out some of the costs that they have with delivery, you could see that maybe their mode isn't as as as thick as it used to be. Door Dash also has been doing more on the restaurant side, too. Like they've like launched reservations. They launched reservations. They launched like a whole platform for restaurants. Yeah, it does seem like they are building the tools to stay as sticky as possible. 100%. In other personal agent news this week, Instinct announced that it's allowing you to add it to a group chat. Shia, how do you feel about adding your instinct that now probably knows so much about you to a group chat with your friends? And what happens if like your friend says, "Book me the hotel room." Does your instinct go and book a hotel on your behalf? You know, I think consumers have different levels of comfort with access to to to private information, with spending money on your behalf. I found that, you know, people in my cohort, younger people, a little bit more tech forward, we're more comfortable and we trust technology a little bit more. Obviously, there's a large part of of the country in the world that may not feel that way.
15:20 And I think Instinct will have to traverse and figure out a way to get everyone on board. But I at least personally am I'm I'm a fan. Me too. I mean the fun thing is the CEO Noah Shin said that 40% of users connect a personal credit card within 3 weeks. And I know that I've experienced I right I think I did it in seconds too. But I feel like I'm I'm feeling what what they're actually talking about, which is that people are spending a lot of money on agents. And I know that when I got my first credit card bill after a month of Muse and Instinct, I was like, "Wait, I bought all of these unnecessary things because I was having fun having these conversations with these agents and buying things that I didn't necessarily need." But I think the average person who joins Instinct, then gives us this credit card, is spending $1,300 a month, which is a lot of money. That's a lot of consumer spend being captured by this new agentic workflow. What do you think this is is going to do when it, you know, hits the masses? I think this is going to continue. I don't know what the average spend is for a person, but I think of more as a mix shift.
16:34 You know, if you spent $1,000 a month clicking through different items on your cart and on Amazon or Door Dash or other platforms, now it's just being directed through some of these agents. Now, certainly there's a an element of fun and discovery and you might be increasing your spend, but hopefully we're still being very thoughtful about how we're spending our money. Yeah, I think that is definitely the key here. But it certainly makes it a lot easier to shop.
16:59 I feel like this has been such a game changer for how I get things done and I every person who's either tried meer instinct has that same kind of an experience but I do think the missing link has always been that it is still this bot going out and doing this stuff on your behalf. And I've had relationships with both platforms where they've almost gone a little too far and I've had to be like no no don't buy this. Muse announced that it was partnering with Sierra to announce a personal agent protocol to make this a little bit more above board and actually create an authentication experience where it isn't just an anonymous bot. This is you. Then you confirm that you're signing in as you and you're authorizing this agent to act on your behalf so that it's not just booking you a flight without you having an option to cancel it. What do you think about these? There was both the Sierra announcement and then Instinct also made a partnership with DecaGon similar. What do you think about these sort of personal agent frameworks? I think we're going to see more of these. you think about Decagon, Sierra, they're serving the businesses and Muse and Instinct and maybe even Door Dash's agent. They're they're serving the consumer. And how do they they connect? How do they talk to each other? Today it's a a bit of a wild west out there and we've seen you know Amazon actually block Muse. I think in the fullness of time this is how the majority of the internet traffic will will continue to trend. In fact actually I saw it I think today or a few months ago that bot traffic has now exceeded human traffic on the internet. So this is going to continue to proliferate and we need to figure out the rails with which agents for both consumers and businesses can can interoperate. Yeah, it does feel like this is every other cycle, right? Like first the wild west happens and then we build the structures around them to make them work. I mean, obviously you're not using instinct and muse today for growth investing, but I think we will. I mean, I think the future is it's like you have a bunch of AI interns, you know, and right now like I feel like I have three or four cloud analysts working for me and I'm able to do so much more than I used to a couple years ago. And even then, I still have to be present in front of my desktop and prompt and iterate and like wouldn't it be so cool if I had a personal agent that was then interacting with a Frontier model to do that. And I'm just checking off, signing in. And I think, yeah, over time as an investor, what like makes a mode is personal relationships, sort of actually having instincts, let's say. But some of this analytical work, it's commoditizing, right? I mean, venture has always been a a thin business in terms of headcount, but it does feel like we all have gotten superpowers with AI and have these bench of interns. Shia, this was a surprising one. So, last week, Aura and Aura Ring, which many people know as the ring that monitors your sleep and your health, pulled its IPO last week. It was a pretty shocking thing because Bloomberg reported that the book was 4x overs subscribed. Forune cited that it was 5x. And either way, that demand was really substantial. Help us understand like why didn't this company go public last week? You know, it's a bit of a mystery, Josh. I'm I'm scratching my head a little bit myself, especially so close to an IPO because I think this was only pulled a day or two before. Are the behemoths just sucking all of the air out of the room in the public markets to allow new entrance? I think that's what the rumor mill would suggest, but there's there's probably it's not just one thing. It's it's many things. That's definitely part of it. I think there's been some debate about Aura and how much of their revenue is like one-time hardware revenue versus recurring software. And it's still growing very well as a business.
20:58 They're profitable. They have very strong metrics. But I think that is a concern and impacts the valuation of the business. So you know one can say four or 5x overs subscribed but the question is at what price? How do you feel this changes your feeling about you know growth investing? Obviously you know as a growth investor you care about the public markets and there being an opportunity for IPOs. Does this change the way you think about companies with how hard it's been to get out this year? I think it impacts latest stage growth investing if you're if you're looking to do a crossover round and you know solving more for IR. I think early investors in Aura and even early growth investors in Aura are still probably quite content. Very happy. Yeah. And I think that the reality is this is a great company with great numbers. It can get out when the time is right.
21:47 It's just a matter of felt like maybe the market conditions weren't perfect. And and I think that's an interesting thing to just digest is that it turns out for IPOs to happen, market conditions really do need to be perfect. It's almost like, you know, going out for a day on the water, you need to be sure that like all of the things are looking really perfect before you go out and sail. Avara, which builds AI avatars that train and coach sales teams, raised a $17 million series A. Avara says annual recurring revenue grew more than 400% year-over-year with customers including Elastic, Proof Point, and Netcope. Lightseed is proud to have led Avara's seed round in 2024 and participated in this series. Today, Robco, the industrial robotics company, is now valued at more than $1 billion, doubling its valuation in just 9 months. Robco sells more than a dozen robots designed to automate logistics and manufacturing tasks. The company's flagship system is a two-ear armed mobile robot called Alfie. It's capable of automating tasks that can't be performed by a traditional robotic arm. For example, an automaker could configure Alfie to stabilize a car part with one arm and use the other to apply paint. Lightseed led Robco Series B in 2024, co-led it series C earlier this year, and we participated in this route. Shia, thank you so much for joining us while Claire was out. You make a terrific Claire's out. Thanks, Josh. Try my best.
Summary
- Reflection introduced Beam, a sparse mixture of experts model with 501 billion parameters, while Mistral announced Lonk, a trillion-parameter model.
- Open-weight models are positioned as cost-effective alternatives to frontier models, allowing enterprises greater control and visibility over their AI applications.
- Door Dash launched its drone delivery service, Door Dash Air, aiming to enhance last-mile logistics and reduce delivery costs.
- The company also introduced an AI chatbot to improve customer engagement and encourage users to try new food options.
- The episode highlights the growing competition between AI personal agents and the need for frameworks to ensure secure interactions between consumers and businesses.
- Aura's IPO was unexpectedly pulled despite high demand, raising questions about market conditions for new public offerings.
- Avara, an AI training platform, raised $17 million, while Robco, a robotics company, achieved a valuation of over $1 billion, reflecting strong growth in the tech sector.
Questions Answered
What are the recent developments in AI and open models?
The segment introduces recent advancements in AI, particularly focusing on open models and their implications for businesses. It highlights new releases from Reflection and Mistral, as well as Door Dash's drone delivery service and AI agent.
How do sovereign AI models address data control and cost efficiency?
Sovereign AI models allow companies to maintain control over their data while providing cost-effective solutions for highly regulated industries. Mistral and Reflection are focusing on cost efficiency to enable enterprises to perform tasks at a lower cost compared to traditional models.
What distinguishes Door Dash's drone delivery service from competitors?
Door Dash's competitive advantage lies in its established marketplace network, which creates a compounding advantage that is difficult for new entrants to replicate. Their new chatbot feature also encourages consumers to explore new dining options.
What are the implications of integrating personal agents into group chats?
The integration of personal agents like Instinct into group chats raises concerns about privacy and spending. Younger consumers tend to be more comfortable with technology, but there is a need for broader acceptance among diverse user groups.
How might AI change the landscape of investment practices?
AI is expected to enhance investment practices by acting as a personal assistant, allowing investors to focus on relationships while automating analytical tasks. The recent pullback of Aura's IPO raises questions about market dynamics and the challenges new companies face.