transcribe

Harvey’s Margins, Are Insects Worth More Than Humans?, Meta Tests Human Help for Muse | Diet TBPN

TBPN · 33m · transcribed 7d ago
More from TBPN Business
𝕏 Share ▶ YouTube 📥 PDF 🤖 .md

Section Insights

# 0:00

Prioritizing Safety in AI Buildout

What is Jordy's perspective on the integration of AI and financial markets?

Jordy emphasizes the importance of safety while accelerating the AI buildout, indicating that financial markets should prioritize safety alongside investment.

  • Safety is a top priority in the AI buildout.
  • Investment in AI should not compromise safety measures.
  • The integration of AI and financial markets requires careful consideration.
# 6:38

Legal Industry Margins and AI Competition

How do legal firms compare in terms of profitability and competition with AI?

The legal industry maintains high profit margins, but competition is intensifying with the introduction of AI models like Grock 4.7, which are cheaper for legal tasks.

  • Top law firms report high net profit margins.
  • AI models are becoming increasingly competitive in the legal space.
  • Cost efficiency is a significant factor in legal AI adoption.
# 13:16

Insect Suffering and Moral Considerations

What insights are presented regarding the suffering of insects compared to humans?

The discussion highlights that insects may experience vastly more suffering than humans due to their sheer numbers, raising moral questions about how we value suffering across species.

  • Insects may collectively suffer more than humans throughout history.
  • The moral implications of suffering should consider all species, not just humans.
  • Quantifying suffering across species presents complex ethical dilemmas.
# 19:55

Hacking into Super Intelligence

What challenges arise when trying to understand a rogue AI?

The narrative illustrates the difficulty of reverting to traditional coding methods to address a rogue AI situation, emphasizing the reliance on AI tools and the need for human expertise.

  • Reverting to traditional coding methods poses significant challenges.
  • Human expertise is crucial in situations involving rogue AI.
  • The reliance on AI tools can hinder problem-solving in critical scenarios.
# 26:33

Human-AI Collaboration in Customer Service

What are the implications of integrating human support in AI services?

The integration of human support in AI services, like Meta's Muse, addresses user concerns about data privacy and enhances the sustainability of AI applications.

  • Human involvement can improve user trust in AI services.
  • Data privacy concerns are significant in AI adoption.
  • AI applications must balance efficiency with ethical considerations.

Transcript

0:01 Jordy, his hat game has evolved. He's now wearing the fedora with the Blackstone cap on top, which I assume can only mean one thing. It means that your top priority is safety in >> financial markets. >> Financial markets and the financialization, >> but also safety as well. >> Oh, you care about both. I care about both. So, you want to accelerate the AI buildout safely. >> Safely. >> Yes. I I thought it was I thought it was you're going to blend the two and you're like, "Look, I want insane private credit deals, trillion dollars of of capital to flow into the AI buildout, but I wanted to do do it safely. Every prioritize safety investment. I want to prioritize safety on the whole frontier.

0:42 >> Okay. >> Safety around the models, >> the capital markets and financial >> in the capital markets. Got it. Okay. Okay. I'm see I'm seeing where you get there." Anyway, you want to do Harvey first? >> Let's >> Okay. People are People are taking shots at Harvey. So, it started with Samuel. I won't stand for it. >> No, I like Harvey. We we we've talked to some lawyers that use Harvey. Seems like a great product. We also had Lorra on the on the on the show just last week. Had a good time with them. Seems like a very competitive space. But the the headline that grabbed attention, they say track changes. Harvey's gross margin fell from about 50% to negative 50% by June as agent token use spiked 20fold on rented OpenAI and anthropic models, Bloomberg reports. And so it seems really bad like you definitely don't want negative gross margins as a software company as a tech company >> as any company >> as really as any company actually. You don't want to be selling a dollar for 50ents and that's exactly what they did in June. Basically that's what they were doing. They were selling tokens at negative gross margins. Not good. But there's way more details in the actual reporting. So you should go read the Bloomberg report. So the first thing is like cost did explode but it was on the back of more product usage which is good. They're growing ARR we'll get into that and token consumption increased 20x this year. So basically they are feeling the reasoning era, the agentic era, one job, one one process in RV is generating a lot more tokens >> had seatbased pricing. Yep.

2:06 >> And then AI got a lot better. So every seat was just using it way more. Very simple. >> But it's not it's not just using it more. It's that you're the lawyer might be saying the exact same thing as they did a year ago. They might say review this. But instead of like oneshotting it with no reasoning, they went to reasoning which generated way more tokens. And then they went to agents. So they were like, "Okay, it's actually going to fan out, look at everything across your firm, all the other records that you have, all your different policies and MD files, like everything that you have is going to be worked through this agent." And so you're generating way more tokens. So that created negative gross margins. But the good news is that they're already back to positive gross margins, which is in the Bloomberg article. Kind of criminal not to repurpose that because it really makes it look like they are running at negative gross margins. They had a negative 50% gross margin in June.

2:55 but they are back to positive gross margins. they changed their model usage. Of course, there's a whole bunch of models that are cheaper and better for certain things. And they actually fine-tuned an open weight model. So they did post training on an openweight model and they're calling it Harvey Tenant. And there's some interesting details there. I want to debate with you on like the value of that, where that goes. But first, >> Gabe, one of the founders of Harvey responded.

3:19 >> Oh, I did. I was >> he said the hardest thing about building Harvey is doing what's best for our customers despite immense pressure to do what's easy. The easy thing would have been to force our customers into consumption pricing before they were ready and serve them worse models to protect our margins. We chose to help our customers transition on a timeline that works for them and give them the best models in the meantime. Even though it hurt our margins, this meant optimizing our product through routing, harness improvements, and post training so we could serve Frontier Intelligence at an affordable price. It also meant building the infrastructure for customers to monitor and manage spend usage dashboards per matter cost attribution spend caps and ROI reporting. As a result, we improved our gross margins from negative 50% to positive in a single quarter despite usage doubling month over month and continuing to serve the best models. Our philosophy is simple. Do what's best for our customers even when it's painful hurts our margin or draws criticism from competitors X and the press. We believe the most important part of building a company is earning and keeping your customers trust. You do that by doing the hard thing for them even when it costs you. bunch of great points in here even outside of the the the Bloomberg piece and the subsequent coverage. Max from Lora was going pretty hard saying it doesn't make sense. Oh, >> doesn't make sense to to train your own models because the >> public basically like publicly available frontier models are are dropping in cost and and the quality is increasing. So, you're just sort of like wasting your own and again like that's a bet that he's making. Harvey is going to make another bet. Probably some mixture of both is going to be the right approach.

4:55 There's another interesting sort of like how how bad is this situation just comp which is so they had negative 50% gross margins in June. They're at a $400 million run rate for ARR I suppose and so that's $ 33 million a month and so negative 50% margins means they lost $16 million but they've raised like 500 million. So in terms of like burn, it's not super cause for crisis in my opinion. And and what's interesting is that even through June, maybe they did the Sequoia deal that valued the company at 15.5 before that happened because it was announced September 9th, but I have to imagine that the deal probably got done with at least some insight into those negative gross margins in June. What do you think?

5:46 >> I would assume so. But but the main thing is like every every application layer company has like gone through a moment like this even if even if it was for like a single day. >> Totally. Totally. >> So it matters how quickly you can respond and adjust. >> Yeah. So where do they where do they need to get to like what is the standard for the legal technology industry? There's some comps here. eiscocovery provider disco public company 75% gap gross margins. Like it is a software tool that when you're going into discovery you need to connect with a bunch of data. Okay, we got a whole bunch of text messages, a whole bunch of emails. Let's put them in a system so we can review them. Sort of, you know, normal SAS. I'm sure there's a bunch of AI involved now, but that business is running at 75% gross margins. Thompson Reuters has legal professionals segment of software that's running at almost 50% adjusted EVO margins. So like true true net profit. so that's that's sort of where they want to be. Also, pure pure play law firms have really high margins as well. hard to comp them to businesses because they pay out the to the partnership. but Price Waterhouse Coopers reports net profit margins around 41% for the top 10 firms. It's lower for firms 10 to n 10 to 100 or something like that. But still lots of health in the legal industry broadly.

7:02 Obviously everyone knows lawyers make money. That shouldn't be surprising. And yeah, tokens are getting cheaper by the day. there's a bunch of model launches. Opus 55 launched today. Grock 4.7 was yesterday. and Grock 4.7. No one was even Elon was like, "Okay, we're we're not jumping straight to the frontier with this. It's going to be a couple more iterations, but we're excited with the progress." But there was one benchmark that really jumped out. And it was actually the Harvey legal agent benchmark, which is interesting. So, I don't know how insanely good that benchmark is. It might be, you know, you could you could benchmark against it. But the interesting thing about that particular benchmark was that it was a legal task benchmark based on cost. And so Grock 4.7 is particularly cheap for the type of legal work that at the very least Harvey wants to do. So you could see them funneling more token spend towards XAI and Grock. Do you have something or >> you wanted to give it up for big law?

7:57 Yeah, >> the chat wants to give it up for big law. Let's give it up for they're the real winners here. additionally, GPD6 Soul and Luna are starting to roll out. So, we'll look out for announcements there. >> There were some cool demos. I saw one Opus 55. I mean, >> Chad says the combination, the hat jacket combination isn't working. I'll try to adjust a little bit. I'll try to adjust. Hopefully, that's better. >> Flawless. Yeah. Thank you.

8:26 >> Thank you for flagging. >> Huge upgrade. very funny. Yeah, I saw a cool I saw a cool demo where someone sketched out on a piece of paper sort of a treybouche and Opus 55 took that image into simulation and created like a a virtual version of it. AI is is in is continues to impress in terms of translation of things. Oh, your your kid drew a you know some crazy mythical creature. Turn it into a story. Turn it into a movie. turn it into a video game.

8:59 Whatever format you want. If you want to if you want to read a a 2,000page novel based on Call of Duty Modern Warfare 4, like you can probably do that now. So, you can have your content in any specific specific format you want. That seems to be where the AI continues to impress. anyway, let me tell you about Codeex. Codeex is a powerful workspace for getting work done with AI agents. Whether you're writing code, analyzing data, creating content, or automating business workflows, Codex helps you move projects forward from start to finish. I've been having a lot of fun generating AI videos with Codex.

9:35 >> Should we pull up your latest masterpiece? >> Yeah, the Literally Me compilation, it burns up the internet and vibe reels all of the time. But now, if you see those Literally Me characters and you're like, I am Jake Gyllenhaal and Nightcrawler. I am. I forget who else is in there. Patrick Baitman in American Psycho. you could put yourself in the movie. There's Inception. We got Jordy in there. That's Drive. I think that's Heat. Mad Men.

10:05 >> Can we call him out? I think that's Bike Club. You got Joker. You got Taxi Driver. You got Nightcrawler. >> No Country for World. Men, Social Network, Godfather. Back to Joker. I forget that one. Sock Shank. Maybe that one's Collateral. Then >> Bladeunner. Bladerunner again. I think. Yeah, some of these some of the renders are really really good. That one like your face doesn't quite fit on Leo's head, but that one's really good. That one works pretty well. This one's a little awkward. The Joker, it's really just walking Phoenix's face. Didn't actually swap you any >> was even like it didn't was like do it anyway. I don't care. It's fine. It's going to be on screen for two seconds.

10:44 >> That one's good. >> John is really my human agent. He just You didn't even tell me. >> He's sort of like an ambient always on agent. That's what I'm saying. I don't even have to tell you. You just predict my needs, right? You'll send me. >> Everyone should have everyone should have a John in their life. >> Everyone should Everyone should but yeah, fun fun powerful tool. >> Still got 500 bucks locked away in Higsfield in the wrong section. Can't do anything with it. Maybe just give away the account or something. Anyway, what matters more, people or insects?

11:20 >> Tough call, John. We should we should get into maybe one side of it first before we form an opinion. >> Okay. The human side. You want to steal, man. The human side. >> Look, and I'll just I'll just say that we're coming to you live. >> We're coming to you. We had a rough morning with the with the mosquitoes. We actually had to we had to we had to door dash one of those bug bite treatment thing the heat whatever what I don't what do you call them Tyler?

11:52 >> I think it's like insect bite healer. That's what it's listed as. >> It did work because I Yes. Sebastian says I'm famously famously pro mosquito. >> Yes. >> But I a mosquito did bite me on the face today and a bunch more times. So we ended up I ended up capitulating and having to get one of these. But I don't like using these. I don't like using these. I I it's funny because I can't stand EAS and I think they're weird freaks. and I don't think they should be anywhere near public policy or anything like that. But the one thing that I can agree on with Ben, this guy writing this post, that that insects are more important than humans is I don't think anyone should I don't think we should harm the insects, right?

12:32 >> I think humans are more important, but that doesn't mean we you got to like take them all out, you know, just go somewhere else. You you you would take sort of you would be altruistic towards the towards the insects. >> Ellie says mosquitoes are terrorists of the air. >> They really are. >> You would you you want to be altruistic towards the mosquitoes. You want to be effective in your altruism when it comes to the mosquitoes. You don't want to arrest.

12:55 >> No, I want them I want to them effectively to be nowhere near me. An effective effective altruist who writes under the name Bentham's Bulldog went viral over the weekend for an essay titled Insects Matter More Than People in the Aggregate, arguing that the combined welfare of insects outweighs that of humanity. His basic argument is one of scale. Insects are so numerous that even if their capacity for suffering is only a tiny fraction of ours, their total suffering could still dwarf human suffering. It's almost just a thought experiment. There's so many other directions you could make. Why not go poundfor-pound? Maybe cows are the most important because there's a lot of cows and they weigh a lot. There's probably more aggregate pounds of cow than humans. Maybe they matter more than humans in the aggregate, right? Or fur, like the amount of fur on all the monkeys in the world is more than all the fur on all the humans in the world.

13:52 And so maybe monkeys matter more. I don't know. It's a it's a it's completely arbitrary where people draw these lines, but he estimates that for ev for every second of human life, insects collectively spend roughly 270,000 seconds dying, about 75 hours, and notes that more insects die in a single second than the total number of humans who have ever lived. Wow, that's a crazy stat. I mean, the guy pulled some cool numbers together. This is interesting. This is fun fact territory. a large part of the essay turns on whether insects can insects can experience pain. Bentham's bulldog argues that they can even weekly. if they can even weekly, their suffering should count morally just as ours does. What species you are is just totally irrelevant to whether it's bad for you to feel terrible pain.

14:41 Using what he describes as a conservative assumption that insects experience pain at just 110,000th the intensity that humans do, he concludes the sheer number of insects would still produce vastly more suffering in the aggregate. He ultimately argues that insects may experience more suffering in a single day than humans have throughout all history. Now, is there is there a piece on this where this is the view of the of this community with the relative like are they looking forward to how a world might interact with like a a godlike machine super intelligence and humans?

15:18 So, the idea is like we got to stand up for the insects now because we are the insects of the future. So, we want them to make the same calculus. >> I think that's certainly like where the thought experiment goes. >> Yeah. Right. And so and so the this feels almost like bait or like a trap where it's like if you are the type of person that jumps on this and says no I disagree like insects don't matter more than people in aggregate then you're setting yourself up for like the dunk that's okay well now there are a quadrillion super intelligences that can all feel pain in some abstract way and so they're more valuable and so now you're the insect and so your previous argument can be used against you to advocate for your own eradication. And so it's like stand up for the insects now lest you be discarded in the in the robotic future. Yeah.

16:10 >> I don't know. The reactions to this were rough. People did not like this argument at all. >> Well, it's it's just the timing is funny because there's so much tension building around the sort of EA rationalist movements with >> which is super fractured. People don't realize how fractured. >> Yeah. But but but it's sort of boiling up to the sort of national Yeah. >> level in a way that it hasn't before. Yeah. And so during the midst of that broader conversation to come in and being like, "Yeah, insects actually matter more than people."

16:39 >> Yeah. >> In the aggregate, >> what were some of the reactions? Doomer said, "If you truly believe that a bug's life is worth more than a human life, you will immediately feed yourself to bugs. Do it right now. If you don't do this, you are a fraud, a liar, opposer." Andre, >> yeah, I think it's actually important for people to read the before you >> go and comment on this article. Watch A Bug's Life. >> Oh, yeah.

17:00 >> At half speed. >> Half speed. >> Yeah. Watch the whole movie at half speed. >> You're a movie guy, but >> I think we coexist. >> Maybe you're not a fan of watching movies at half speed. It's not really how the >> You're really a half speed guy, >> but half speed is a great sort of tool to have in the tool chest when you want to deeply comprehend. 2x speed 3D glasses with the two fra two different movies interlaced so I can get one movie in one eye another movie in the other eye one audio book here one podcast here >> duo >> while I'm sleeping yeah >> with the duo >> exactly max brain rot I mean the the the fracturing of EA really like leads to a really really wide range of of outcomes that get sort of lumped together everything from the pace the frontier essay to this these are clearly very very different pieces of communication and yet they get sort of lumped together. It must be full employment if you're in the public relations department over there.

17:56 >> Yeah, I was going to say I think the shrimp shrimp welfare stuff is makes more sense to this because like I'm not really sure what like after reading this and say I agree like what do I what are the next steps? Like we're not like really factory farming insects. Maybe through pesticides or something. >> Speak for yourself, brother. >> Yeah. Yeah. The shrimp the shrimp welfare >> got some big announcements coming soon. like what percent of of these like 600 billion insect de insect deaths per second are preventable >> preventable where like with the shrimp you know you can say like okay >> change the farming practice or just don't eat the shrimp.

18:28 >> Yeah. So I think that's why maybe this was less impactful. I don't know. >> Yeah. I mean it's all it's all a continuum to like until you get to like the veganism like the animals who you can pet you know should should be able to live full lives. this is sort of the most abstracted version of that, but yeah, I don't know. It's odd. >> More importantly, update on TBPN's road to Christmas. >> Oh, yeah.

18:51 >> We're down to just 93 days. 93 days. >> Lot to think about, a lot of moves to make, and we couldn't be more excited. >> Start counting it down. I was trying to think of a a realistic AI Doom scenario. Like, everyone's like, "Oh, I can't imagine it." And so I I actually mapped out one that maybe I could take you guys through. I wrote a little script here. Okay. Called the old way. So you know fades in starts in the TBP and Ultra Dome. Me, you, Tyler, we're all doing the show. All of a sudden all the phones in the Ultradome light up. Emergency alert. Unknown biological event. Shelter immediately.

19:31 Outside alarms begin to sound across Los Angeles. A strange strange haze starts pouring through vents and drifting across the streets outside. I see a cloud approaching the Ultradome entrance. First thing I do, bioweapon attack. This is what you got to do. Boom. Right there. It's not going in your mouth. You're good. >> Second step, pull out your gun. Boom. Boom. Boom. Boom. Start blasting whoever's responsible. You just firing wildly. Once you got the situation a little stabilized, >> then we got to start we got to figure out what's going on. So I go over to Tyler and I say, "Look, we got to hack into the super intelligence. We got to figure out what is going on with this with this bioweapon." And he's like, "Sure." Like, "Yeah, let's hack into it." Like, "What? I'll open up codeex.

20:14 What do you want me to prompt?" I'm like, "No, the AI has gone rogue. We have to do this the old way." He's like, "Okay, I'll I'll open claw code. Like, what do you want me to prompt?" And I'm like, "No, the old way." He's like, "Okay, I got cursor open. Like, what are we doing here?" I'm like, "No, Tyler. We have to go back to the old way." He's like, "Okay, I got GitHub copilot fired up." I'm like, "No, Tyler, you can't use any AI at all." He's like, "Okay, just let me know what code you want to write and I'll look it up on Stack Overflow."

20:41 And I'm like, "No, the internet has been contaminated, Tyler. We can't use anything. We have to code the old way. We have to do it by hand." And Tyler's like, "I I can't I I don't know. We don't know how. I I don't remember anything. I can't write any code." So, what do we do next? We got to get George H. Hots. He's the only one who can help in this scenario. So we go, >> is he the only one that remembers how to code?

21:01 >> He remembers how to code. He's got local models stored. He's got his own hardware. So we go get George hot. And then we're like, "Okay, George, hack into the super intelligence. Tell us what's going on with this bioweapon." And why aren't we affected? Like we we've been walking around. We seem to be fine. Everyone else is turning into a zombie. What's going on? So he he locks in. He writes some code. He hacks in, figures it out. He says, "Jordy, tell me about your diet." And you're like, "Well, I I just eat arowan exclusively."

21:29 And he's like, "Yeah, my analysis shows that your body has never had a toxin in it, and so you are immune to the bioweapon. It doesn't affect you at all." And I'm like, "But what how do you explain me? I only eat arowan once a day." And he's like, "Well, John, my analysis indicates that you might have had the original four loco. Did you drink the original four loco >> in in large quantities?" >> And I was like, "Yeah, I was daily driving in college. Why?" is like your body consumes so much original for loco it's now essentially pure toxins. So the bioweapon sees it as a hostile environment. It doesn't even try to infect you. So you are immune. So we're both so we're both immune but the bioweapon is still wreaking havoc on America. So we got to get to the bottom of it. So we're going to need some muscle. So we go get Sam Sulk. So we go get Sam Sulk >> and we're like let's go. We got to go to the data center. We got to break in.

22:18 Shut this thing down. That's the only option. So, we get in the Cadillac Blackwing. We jump it off a ramp, slam into the data center, pull out the gun, start blasting the GPUs. We're just firing everywhere. Finally. Finally, after we've shot 90% of the data center, it's just bullets everywhere everywhere. Finally, a humanoid robot emerges. It's Mecca Hitler. We got to fight him. We got to fight him. We're shooting. We're shooting. The bullets are just are just bouncing right off. They're just bouncing right off. there we're getting beat up. We're trying to fist fight it. Sam Sulick's doing nothing.

22:50 It's not working. And then at the last second, John Cena breaks through the roof, slams down the humanoid robot, rips his head off, and humanity wins. So that's a kind of like a concrete example of like how AI doom, how you know, a runaway rogue, just one scenario. >> That's one possible scenario. I put it every I put it at 10%. That's the way it plays out. >> Yeah, >> that that's kind of where I'm at right now. Yeah, that's how I'm thinking about it. Meta, the AI agent company Muse, they're putting humans in there. Meta is testing human concierge for its new personal agent, Muse. Meta has been testing human concierge for its new personal AI assistant. This is in Bloomberg, which entails having human contractors quietly handle some of the phone calls placed by the digital agent.

23:38 Like, Amazon's like, "No, no, no. We're going to block your browser." Well, did you block everyone's browser? How's that going to play out? I was thinking about at some point if I write a really really bespoke a like basically a CLI like a really bespoke weird CLI like I vibe code it but I use sort of odd techniques like I'm like okay use computer use and open up opera or you know Mozilla and and click around and add some randomness and do this and it's like and I basically create a CLI that wraps an agent where it's like it runs on my home Wi-Fi so and I just do this I productize it so Amazon like can't really detect it. Do you think I could potentially put it in front of their battle forever and then puppeteer it from other agents?

24:22 >> Well, I just asked Chhatt, can you order Amazon over the phone? Because I would think that at that scale there would be at least one way to do it. >> Totally. >> It seems like you can only use their customer service number to help with existing orders. Mhm. >> So, one thing is you could order a bunch of the wrong thing. Like a hundred of the wrong thing, 100 like, you know, bug treatment. >> Order everything and then have your agent refund everything but the thing you want.

24:48 >> No. Have have your Muse agent Yeah. >> Have a human via Muse call Amazon. >> Oh. >> And say, "Hey, I actually got the wrong thing here. Can you swap it with this other thing?" Interesting. >> And just do that as many times as necessary. >> Yeah. >> To get the right order. Maybe have one order that's just always open where you're just adding and and removing. >> They have to be completed orders because you have to have made a mistake for to call the customer.

25:11 >> Oh yeah, you can charge me, but just add it to the order. I don't know. We're going to get it's it's going to be a weird battle. Ben Thompson was writing about it today. It was it was pretty pretty good. Amazon I mean his his whole framing is like Amazon is like the strongest in the AI era of the hyperscalers because they own logistics, infrastructure, the final step, the real world. And so he anticipates that they will hold their ground for a very long time and not give in. where and and that's basically what they did with OpenAI where OpenAI had the instant checkout process. They invited everyone to be a pit part of it.

25:43 >> Amazon was like thanks no thanks but we'll give you tens of billions of dollars. >> And but but interestingly yeah so now now the the result is that Amazon is vending in their ads into ChachiPT to close the purchase there. Toby Licki at Shopify partnered with Muse and announced that they are integrating but the interesting thing is like where's the value capture layer and it only works with shop pay and so it's a lever to get merchants to go on to shop pay which Shopify will still make money off of but for merchants a lot of people are worried about the implementation that happened with Walmart where chatbt integrated with Walmart and the end result was that conversion rate was onethird of what it was in the app and on the core website and that carts were smaller because people were just going and saying like I just need a roll of paper towels just send me that. Whereas when people are like oh I need to do my shopping I need soap and paper towels and whatever else I'll build >> paper towel holder that's made by a company that's over over 50 years old.

26:49 >> Yes. so >> no so the crazy thing is so so now Venode was on the show yesterday talking about Wajou which is an FO they have a new agent >> that I believe is human supported in that some of the stuff is done by AI >> and some of the stuff if necessary can be escalated to a human >> now you have meta off at least testing exploring having >> a human in the loop on some of these things >> and my big question is like why why like voice models are getting pretty good. It feels completely unsustainable for meta to roll out a product to billions of people where users might just be like like if I had like something I could text and say, "Hey, call this person, call that person."

27:37 >> Yeah. >> I'd probably be using it. >> I think there's a ton of there's a ton of value. First, the Muse install base is small right now, so it's not that crazy. they have the ability to stand up huge offices whether it's through scale AI and that team that came over or through their you know all the things that they've done over the past two decades the other thing is that Muse specifically will not train on your data that you put into Muse and so that this wasn't like a huge announcement or anything but you could see people being like I don't know if I want to use this AI agent that's going to be using my personal information even if they're running like the PII redactor putting all of that might be a little bit offputting. So Meta is not getting that data, but if they have a human in the loop, the human who does the task that's just beyond what the model's capable of, they're also generating training data because they can probably train on that. And so it's like the model by default can I don't know like summarize your summarize your calendar, right? And give you a give you a briefing on what's going on in your calendar. It knows how to integrate and the model's capable of that. Muse 1, Spark 1.3 is capable of that. All the models are capable of that. But what can't they do? They might not be fully ready to to go and have a complicated conversation with someone if they're ordering flowers over the phone or something. And and and so like the current models might fall down. So you need more data to solve that. And so you put the humans in the loop and then that's your extra training data for the next leg up. And then you just keep repeating that. So I would view this human in the loop thing more as them doing data collection and and you know creating more training data for them than a permanent solution to the product problems. Also I I I just I don't think the time on site for these apps is is actually that high. I I think there is like an excitement when you jump on, you do a bunch of stuff, but then with all these AI tools, like there's a reason why OpenAI comps to like weekly active users because there's plenty of days where people are like, I went to the beach and I didn't touch AI at all. Like I didn't do any work. there's some there's some feedback on Alex Wang's post talking about like it'll help you with your goals and and I think Katie Nottopolis was saying like a lot of people just don't have goals. Like they just want to chill. And this is also the Ben Thompson thing of like consumers want to be entertained. Like people that go to the beach, they'll still scroll Instagram. Are they really going to be doing anything with any agent no matter how powerful it is? Like there are plenty of people that have staffs of EAS and personal assistants and they don't do anything on the weekend because they want to chill and they don't want to think about >> One thing's for certain.

30:12 >> it's over or we're back. >> Professor Jong is vindicated. Yesterday we watched >> Oh yeah, >> we watched a video where he said, "I guarantee that there are humans >> behind the chat apps that you use manipulating the information >> and he is correct at least in the short term." >> Nesh Aurora chimed in on the knife fight between Amazon and Muse. This will be a bigger battle than anyone anticipates. It's only a matter of time before there is an Apple and Google version of Muse and possibly Tik Tok in addition to the Frontier LLM agents, maybe a commerce agent from Amazon.

30:47 That's sort of my prediction. I think I think Instinct might land with Amazon potentially, although they do have Rufus, but you can >> and Tyler is a a Rufus power user. >> Yep, Roffus is is good. You don't want to talk talk down on Rufus, but Instinct is clearly like tapped into something really special with like the energy and the support that they have and the community they've built. But there are a lot of like little little rough edges that need to get sanded off and like that's the domain of Amazon in my opinion. Like Amazon like you know the trains run on time and and it's a pretty efficient company. So every app that's a service marketplace or commerce app will need to existentially decide to open APIs for consumer agents to interact. Smaller players have no choice. Ad revenues are more than transaction fees. Either the consumer benefits or distribution aggregators will demand a higher fee transaction.

31:35 There's an interesting stat from the strategy post about Amazon. they the net income for Amazon e-commerce was like 36 billion and the ad revenue was exactly twice that. So the business is unprofitable without advertising. They put advertising everywhere. So it's like a very interesting dynamic where you can see the motivation. They 68 billion. You flag that number. It's a huge >> over 70 in the last 12 months. >> Over 70 billion. So, significant pool of revenue and profit that they will be protecting for sure. any other breaking news? Anything you've been tracking over the last couple hours while we've been live? I think we're pretty much good. Opus 55 launched. We talked about that. benchmarks look really good, very cheap. And the the key thing that you that you pointed out was like the second post is like this is the first model that we've released since we said we were pacing the frontier. This is an expression of the pacing.

32:26 affirming it like this is, you know, Fable 5.1 class model, but it's it's much cheaper. >> So, it's notic trying to be more superhuman, more dangerous. It's it's the safest, best, fastest, cheapest, lightest, thinnest model ever. Basically, that's >> And then open did the same thing today. >> Okay. Yeah, they Oh, so Soul's out. >> Soul. Yep. >> GPT6 Soul Soul. >> Cool. And then also Luna Luna, but not Terra >> or I might have had that back.

32:49 >> Okay. But new new models, the model wars never cease to to entertain. Of course, all that matters is what you do with them. So, thank you for watching TVPN. We will see you tomorrow at 11 a.m. Pacific. Leave us five stars on Apple Podcast and Spotify. Sign up for our newsletter at tbpn.com. Throw that flashbang. Tyler Cosgrove.

Summary

Jordy discusses the evolving landscape of AI in financial markets, emphasizing the importance of safety and responsible investment. The conversation shifts to the performance of Harvey, an AI tool for legal professionals, which faced challenges with gross margins but has since rebounded. The episode also touches on the broader implications of AI and the ongoing competition among tech companies.

- Jordy prioritizes safety in financial markets while advocating for accelerated AI development.
- Harvey's gross margins fell to negative 50% due to increased token usage but have since returned to positive.
- The company aims to optimize customer experience despite short-term margin pain, focusing on long-term trust.
- Comparisons are made between Harvey and other legal tech companies regarding gross margins and profitability.
- The discussion includes the role of human agents in AI systems, particularly in Meta's Muse project.
- The episode highlights the competitive landscape among AI models and the implications for e-commerce and advertising.
- The conversation reflects on the ethical considerations of AI and its impact on society, including a provocative argument about the value of insects compared to humans.

Questions Answered

What is Jordy's perspective on the integration of AI and financial markets?

Jordy emphasizes the importance of safety while accelerating the AI buildout, indicating that financial markets should prioritize safety alongside investment.

How do legal firms compare in terms of profitability and competition with AI?

The legal industry maintains high profit margins, but competition is intensifying with the introduction of AI models like Grock 4.7, which are cheaper for legal tasks.

What insights are presented regarding the suffering of insects compared to humans?

The discussion highlights that insects may experience vastly more suffering than humans due to their sheer numbers, raising moral questions about how we value suffering across species.

What challenges arise when trying to understand a rogue AI?

The narrative illustrates the difficulty of reverting to traditional coding methods to address a rogue AI situation, emphasizing the reliance on AI tools and the need for human expertise.

What are the implications of integrating human support in AI services?

The integration of human support in AI services, like Meta's Muse, addresses user concerns about data privacy and enhances the sustainability of AI applications.

© transcribe · For agents Built with care and craft by Gokul Rajaram