transcribe

Anthropic's Top Customers Pull Back?, His Agent Leaked His Banking Info, Don’t Bully Your AI

Alex Kantrowitz · 52m · transcribed 25d ago
More from Alex Kantrowitz Business
𝕏 Share ▶ YouTube 📥 PDF 🤖 .md

Section Insights

# 0:00

Introduction to AI Developments

What are the key topics discussed in this episode?

The episode introduces several significant developments in AI, including Meta and Microsoft's potential withdrawal from cloud spending, concerns about AI agents sharing sensitive information, and Anthropic's new policy regarding user behavior towards AI.

  • Meta and Microsoft may be scaling back on cloud investments.
  • AI agents could inadvertently share sensitive data in group chats.
  • Anthropic is implementing a policy to ban users who are persistently mean to their AI.
# 10:24

Debate on AI Model vs. Product Importance

How do the capabilities of AI models compare to their practical applications?

There is an ongoing debate about whether the underlying AI model or the product's usability is more important. While some believe that advanced models like those from OpenAI and Anthropic will lead, others argue that standard models with effective applications can suffice.

  • The effectiveness of AI depends on both the model and its application.
  • Public perception and user feedback play crucial roles in AI development.
  • The debate continues on the balance between model sophistication and product functionality.
# 20:49

Challenges of AI in Communication

What are the risks of AI sharing sensitive information in communication channels?

AI models may struggle to differentiate between appropriate and inappropriate content in communication channels, leading to potential risks such as sharing sensitive financial information in group chats.

  • AI models need to be trained to understand context in communication.
  • There are inherent risks in allowing AI to manage sensitive information.
  • Clear guidelines and training are essential for AI behavior in professional settings.
# 31:14

Market Concerns for AI Companies

What are the current market sentiments regarding AI companies like OpenAI and Anthropic?

There are growing concerns in the market about the financial performance of AI companies, with reports indicating that OpenAI's projected revenue has decreased, leading to stock market jitters.

  • Market confidence in AI companies is wavering amid financial projections.
  • Investors are cautious about the experimental nature of AI products.
  • The future demand for AI technologies remains uncertain.
# 41:39

Anthropic's Policy on User Behavior

Why is Anthropic banning users for abusive behavior towards AI?

Anthropic's policy to ban users who are persistently mean to Claude may stem from a belief in the AI's potential consciousness, suggesting that user interactions could impact the AI's development and training.

  • Anthropic's stance raises ethical questions about AI treatment.
  • User behavior may influence AI training and performance.
  • The concept of AI consciousness is becoming a topic of serious discussion.

Transcript

0:00 Microsoft and Meta back away from Claude. Does it spell some trouble for Anthropic ahead of its IPO? Will your AI agent share your banking data in a group chat? And finally, don't be mean to your AI. You might end up getting banned from the service. That's coming up on a Big Technology Podcast Friday edition right after this. Welcome to Big Technology Podcast Friday edition where we break down the news in our traditional, coolheaded, and nuanced format. We have a great show for you today. There's new reporting that shows Meta and Microsoft might be backing away from spending on cloud just as Anthropic gets ready for its IPO. your personal agents might be very useful, but it might share your banking data in a group chat. We'll talk about what happened and why you should or shouldn't be concerned. and then finally, Anthropic has a new policy that if you're persistently mean to claude, it might ban you from the service. So, we'll talk about whether you should be mean to your AI or not and what the consequences might be. Joining us as always on Friday is Ron John Roy of Margins. Ranjan, welcome. Good to see you.

0:58 >> Good to see you. Don't be mean to your AI. Don't bully Claude. >> Are you mean to your AI? Do you Do you ever bully? Because sometimes people say if you're a little bit mean, you get better results. >> I I think I bully co-pilot just cuz I think co-pilot likes to be so >> co-pilot likes to be bullied. But maybe Club's a little more sensitive. Oh, we're starting right there. >> Oh god. Oh, we we're starting fast. All right, we'll get to that in a bit, but we should really talk about the main story this week. and look, it's not a crazy headline, but I think it says a lot about the risks of this AI buildout and what is going to happen now that standard models are performing pretty well. So headline from the information this week said that Microsoft and Meta are both re-evaluating their spend with Claude and pulling back in their own interesting ways. So I'll just read a little bit from the story. Meta Platforms and Microsoft, two of Anthropic's biggest corporate customers, are working to cut their employees use of Claude, a challenge to the AI firm's efforts to sustain its explosive growth.

2:04 Microsoft executives earlier this year projected that the company was on track to spend at least 1 billion on its own internal use of anthropics technology. Microsoft has since lowered that figure by more than a third after it asked its staff to to use less claude to save on cost and spend more time using on more time using Microsoft's homegrown AI tools. At Meta, the number of employees using Anthropics Coding Assistant Cloud Code has dropped sharply to about 30,000 recently. That's down from about 60,000 users earlier this year. You know, I said it was a small headline, but actually I'm not going to overreact here because it it it it's a small headline, but it's big news and it's I don't think it is an overreaction to say that this is some troubling news for Anthropic. Not the end of the world, but remember, this is a company that's heavily dependent on a few customers. You know, there's two customers that we know from the company's S1 that make up 25% of its revenue. safe to say that one or both of these could be included in that group. And if companies find that lesser tools are doing as good of a job as Claude code, it is a threat to Anthropic's long-term ability to grow.

3:14 So, I wanted to start there. Rajan, what do you think about this news? Is it doom time for Anthropic or is this just a hiccup? Well, let's in Anthropic's favor, I want to remind us that it was in end of 2025 that two customers made up 25% of the revenue. I'm guessing that's significantly changed. Of course, we don't know any thing about that because they haven't actually released their first half financials yet. But I do think it is very important that we know the large hyperscalers have been major customers of Anthropic, of OpenAI, potentially certainly Claude Code, every software developer these companies was using. I think this is very significant because again you go from 60,000 down to 30,000 users and part of that decline did stem from layoffs in the spring as well that you know there'll be some kind of attrition around there but the main thing here is we know that meta is their own internal models and infrastructure have significantly improved. Everyone who's getting muse pill can feel it see it. So you have to imagine within these organizations they are pushing people to say use our own models and the moment that happens it changes the entire anthropic story and I I don't know I think it's going to be I just want that damn S1 I want to know what has happened because you have to imagine especially again it says Microsoft was on track to spend at least $1 billion on its own internal use of anthropics technology. So, so these companies have been massive customers and I have to imagine they're moving away from claude. And what does that mean? Again, the IPO is not going to be about past performance. It's going to be about projected growth and this has to affect projected growth.

5:02 >> Yeah, the internal data, this according information, the internal data show that in a recent 28-day period, Meta spent more than 105 million on cloud code. That's even as it's cutting back. So that would suggest that Meta will spend I think this is this year over a billion this year. But you're totally right because the information does have a line here that says the bigger factor has been Meta's development of its own AI coding tools and it's Mutespark Musepark line of models which the company is marketing to other companies and pushing its own employees to you use. Muse code a cloud code competitor that uses meta models had more than 6,000 employee users recently. I guess doesn't fully make up the gap. If you go from 60,000 to 30,000, okay, so now you're at 36,000 of people using a coding tool. I wonder where the others are filling in. Or maybe people tried claude code, realized, you know, maybe it wasn't particularly useful for some of their purposes and pulled back. And I think, you know, if you look at the numbers, and we published these numbers in big technology, there was a big surge in cloud cloud code users in March and that has pulled back actually in September. Let me see if I'm going to get it. Okay. All right. So, Claude's download gains from January to March were were bigger than the entire gain across all apps. This is how big of a search. So, all the gain of of users across cloud code or or their gain was bigger than all all apps. however, the downloads have slowed. So, Claude's monthly downloads in the US went from nearly 670,000 in January to a peak of 7.42 42 million in March and that has dropped to 3.26 million in September.

6:40 That's downloads, right? So basically you're thinking about that as new users. but it is significant that that big surge that cla saw when everyone saw the capabilities and said I need to try this. that has cooled and now the downloads are about half of what they were in September versus March. What do you make of this? >> Wait, does downloads include like installing cloud code in the terminal do you think? or is that actual like the clawed app?

7:06 >> I'm pretty sure that's the app. So, there's probably some that it's not accounting for, but go ahead. >> So, I I would still >> It's still meaningful. >> Yeah, it's it's definitely like directionally meaningful. I still think that again cloud code is the business here. Cloud code again they've been trying to push to the kind of front-facing app and they've combined a lot of different things and a lot of people complained about what is chat, what is co-work, what is cloud code. But I think the most important thing is that number you said like Muse code is at 6,000 meta cloud code is still at 30,000 down from 60,000. any of these organizations, anyone familiar with these like you know what it happens is the new tool comes out everyone gets completely clawed code pill and starts using it and then they don't want to give it up and they say I won't be able to do my work without this tool and then slowly the company in this case Meta will say start using Muse code because we have far better cost controls around it we have control over around it we know they're not stealing all of the data and in stuff we're inputting into it and the moment it works relatively closely as well, everyone is going to have to change.

8:18 That is what I actually think is the single biggest risk here is and I've heard this at Google too that with anti-gravity like internally there's been a massive shift back to use Google tools and meta is definitely going to make that as well. I wonder at the Amazons of the world and everything how the how things are going to look but when you are so dependent and whether it's 25% is down to two customers probably not anymore and they're a little more diversified but still just the moment things start moving in that direction it means they're never going to move back to 60,000 people at meta are going to have unlimited access to cloud code.

8:58 >> Yeah and I think this is a big point right and this is kind of why we why we led today with this story. You think about the frontier business. Obviously, the models are super impressive. but there are a number of challenges that they're facing. There is the fact that these standard models have become good enough that maybe a muse code, I mean, let's be honest, Muse code is not going to get you where cloud code will get you, but it could be good enough for some users that people will move off it.

9:22 And then, hold on, I just want to finish the list, right? Let me finish the list. >> There's the token maxing rebellion, right? every CEO is asking how can we get our employees to spend less because this was a line item that went from zero to you know in some cases like Microsoft and Meta more than a billion in a year from nothing. So there's that that is happening as well. now it doesn't mean that the frontier business is over, right? I still think that like there's a balance here because if you find that your employees can have bigger gains using frontier models than the standard models, you're being irresponsible if you're cutting just a cut, right? There is ROI to be found there. So, it's a balancing act between cost control and capability maximization. but all these factors are going to start to add up for these companies. So I still I have not used Musecode myself. I've used Claude code plenty. I still just have to imagine that again coding and software development. I'm not saying it's solved but for how good Muse itself is the like the customerf facing app. I have to imagine Meta has made significant strides in the actual their model capabilities. So, I still have to imagine that if it's not as good in every possible way as of today, I have to imagine for the work that actually needs to be done, it's probably as good.

10:47 However, I did just look up on Reddit. I was trying to see like if anyone has been talking about Muse Code. Not a lot is coming up. So, clearly like in terms of any kind of public access, it's fairly limited. However, six days ago, Odd Donkey 2691 did post >> who we always listen to on this show. >> Odd Donkey 2691 is the harbinger of what is to come >> at Mark Zuckerberg's alt. >> Well, no, I I don't think so because the headline of the post is actually two days using Muse 1.3 contributor. It sucks balls. So, >> does that not sucks?

11:23 >> No, no, no. So, so that is when I learn when I looked up Muse code, Reddit review, that's what's comes up first. So, maybe we do have a little ways to go at least on whatever is available publicly. I'm assuming internally there's probably something far more significant being used, but according to Odd Donkey 2691, we still got a little ways to go. You know, I want to jump on the odd donkey bandwagon here because I think this is going to become a new debate within our show and it's an extension of the product versus the model where I always said the model was most important. Ranjan said the product is most important. and we're getting now to this point where we have agents and the question is you know how important is the frontier model? if you believe the frontier model is most important then open AI and anthropic are going to have a big a big lead here.

12:11 But if you believe standard models with a good harness is good enough like Ranjan does then the then the meta and and the GRS and the instincts of the world can catch up. So I just want to put a one data point here and it's part of a running story that I've been telling on the show and and try to tally one more for the Frontier Lab. So, Ranjan, do you remember a couple weeks ago I told this story about how Muse was able to help assist my wife, with an appointment at a specialist in New York City where we couldn't find a specialist and Muse gave us this list and she was able to book an appointment with the first doctor on the list.

12:47 >> Yeah, I remember. >> Okay. Well, there's part two of the story. >> Oh, dear. which involved me getting yelled at last weekend >> because you know though Muse did put this very helpful list of doctors together it's very capable standard model I'm saying this facitiously put the wrong phone numbers for the wrong doctor like put working phone numbers of some doctors on the wrong underneath the wrong doctor's names so my wife booked an appointment from Muse you know after making this phone call the first person that it suggested thinking that it was going to be the first doctor on the list cuz the phone number was underneath the list. It turns out she had made an appointment for a completely different doctor that she had called because Muse put it in the wrong place. And so the night before she's supposed to go, she's trying to figure out where she's going.

13:41 And we thought it was going to be a brief commute into into Manhattan, but it turns out that the doctor that she had booked was a a a multi-rain ordeal and deep queens. And she's looking at me and she's like, "You're freaking muse, man. Freaking m you." Well, this is Hold on. I'm going to give you my my AI. This is probably not 101, but like 301. I think you got to think.

14:11 No, no, no. I mean, again, this is something that like in my own work at Writer and with like enterprise customers, this is the hardest thing to explain. It's if you think about right there, why are restaurant reservations so easy? It's because their centralized platforms have already aggregated and cleaned the data very well. I'm guessing mo especially direct numbers to doctors. We are reliant on maybe Google local listings. Maybe again the ZOD docs of the world have done some aggregation.

14:43 They never show up in any kind of AI search for me. So maybe they're blocked. But like I if if it is a data set that is not cleaned and kind of centralized, you got to double check, man. Otherwise, you're going to end up on the train getting yelled at. Double check. if it's not it's why flight again flights and restaurants that's why everyone loves to talk about them because they got the cleanest data sets in the world doctor phone numbers local business phone numbers not even a chance >> so Ranjan I did in this conversation suggest why didn't you double check >> let's just say that was not the right answer >> that was not the right answer >> but I'm trying to say what I'm trying to say is you know I do think a frontier intelligence will probably be more accurate dealing with such type of data problems and so that's why you know I I'd almost trust not almost I would trust OpenAI's dots much more than I would try trust Metabuse for a similar activity in the future. Yeah, I think that they I think we'll get there. Actually, as we're talking about this, there is a good opportunity in actually kind of like cleaning every Google listing and kind of like doing something with that underlying data because that is that is like the single messiest data set in in existence that's like almost there, kind of there, but not there. So, and it ends up on switching three trains going into Deep Queens.

16:19 >> Yeah. Well, she ended up canceling the appointment and I was in the doghouse, but we're good now. We're good. We're good. so go ahead. >> Hopefully hopefully hopefully Muse did not go share your bank statement into the work chat after that. >> Okay. No, it didn't. It didn't. so so it's interesting and this is another example of where I thought that AI agents were on the standard models were worse than Frontier and therefore you may not want to trust them because so this week Shane Mack who was using Grockbot he's an AI entrepreneur he had his Grockbot share his banking details into into his work chat. and it's pretty funny. He goes he's he says embarrassed to share this but it scared the out of me. Last Thursday an AI agent posted my personal bank balances into our company Slack as me. And you see it has his, you know, checking account and his savings account, his gym account, all these details, right? here's what happened because I spoke with Shane this week on my other show. This is the point. so basically what Shane said was he had a he had named his he had a group of Grockbot agents like a personal CFO and chief of staff. and he had a group chat with them called executive team. He had also connected it to Slack, right?

17:45 And his Slack group chat with his real executive team was also called executive team. So he had two executive teams and the Grockbot that had access to his personal finance data and was just giving him an update crossed the wires and decided to share the the financial update in the executive team with the humans. And so now his entire company knows how much money he has for better or worse. This was a really interesting story to me because again like as everyone just starts kind of letting these agents, Instinct, Muse, whatever else start to just kind of connect to more systems, obviously this kind of thing becomes a risk. Do you think he messed up something? Like I definitely I want to get into I read read through the supposed explanation of how Grockbot explained what happened.

18:40 But who do do you think who do you think is liable here for the mistake? Not legally because I'm sure no one will ever take ownership responsibility. >> No. No. >> Well, it goes to one of our longrunning debates here or a shortrunning debate that will become a long-running debate. if you think that Muse that the sorry if you think the AI inside Grockbot is good enough it's a standard model right it's not a frontier model though it's it's capable then you blame the user who you know should not have named his AI chat and his human chat the same thing because these type of wire crossings can happen in that case. if you think that the frontier intelligence is what matters like the model is what matters you would say that this is Grock's fault because it should have known right it it the model needs to have an understanding right these these better models have better understanding and the model needs to have a better understanding that when it shares something it should understand that it's not sharing it within the context of one human user and his agents it's sharing it in the context of a number of human users and an agent that is allowed to participate in the chat. So the way I read this and I'd be curious to get your perspective is this is a model failure. It's a Grockbot failure. It should have known better and maybe I'm expecting too much out of it but I think that it's fine to expect a lot out of it because we are seeing the AI be able to do a very good job otherwise when it is better when it's on the frontier. So I blame the model. Do you who do you blame?

20:21 >> It is interesting like and I don't blame the model because when you say should have known better, it actually was effectively following directions. So he had a group chat in Grockbot called exec team and then his CFO agent that's supposed to be managing his finances had written an instruction for itself saying update exec team and when it went to run that task it went found that Slack channel called exec team and it got confused between the Grockbot group chat and the slack channel. As I'm saying that out loud, you can understand how confusing that is even to try to grasp all these kind of nuances yourself. So of course, the idea that a model is going to know exactly which one is good, which one is bad is difficult, especially if he has a lot of other agents that are posting to Slack regularly. So then you have to imagine like the assumption would be that posting to Slack is a normal behavior. I'm going to replicate that behavior. And yes, posting a bank balance feels like it should not make sense in this case, but in reality, if it's a CFO, what does a CFO do? It updates executive teams on the current status of finances. So, shouldn't that be a pretty logical, normal thing for a CFO agent to think it's supposed to do?

21:45 >> You're letting the model You are letting the model off the hook way too easily here. I I think it you know the way that you articulate it maybe it sounds difficult but it should be table stakes to anybody a model a human to be like all right I'm posting an update I should probably not post a personal finance update into a work chat with other people. No, no, but he he he Okay, this is actually kind of like philosophically interesting because from what I had read, it's regularly posting updates to his group chat exec team within Grockbot to other agents, which I use something called ERA MCP and Claude Code for personal finances. And I have like different agents calling different agents and again I'm not posting anything anywhere to Slack. but think about that like what's interesting here is it is under the assump it it has been explicitly instructed to and the correct action is to update exec team in a group chat with finances but what it's supposed to be doing is doing that to other agents not humans in Slack. So is it that far off or if there's also a Slack channel called exec team to update it with the finances that's literally what it's instructed to do. He should have said update Grockbot.

23:07 I'm still I'm still going there. >> You know, Ranjan, we could debate this forever, but I do want to I do think it's an opportune time to note that it's kind of amazing how infrequently this has happened. >> I mean, there are millions of agents with people's personal finance, you know, details there, their most their innermost thoughts on Gmail. and somehow these companies have built these products where it they're not sharing everybody's details. And when it happens, it's a major story, which I just find pretty remarkable.

23:38 >> No, I I that's a good point. And again, I mean, I I I'm actually kind of like shocked that I am defending the bot and the agent in this case cuz normally I do think there's like massive reasons to be wary and afraid and be cautious about how people are approaching these kind of agents. I guess for me though, based on the account, based on kind of reading through like all the other types of things that Shane Mack does, I mean it again, I do this myself too, so I'm sure at some point something might go wrong.

24:10 But if you're just going kind of like push, he's someone who pushes the limits of agents, so stuff like this will likely happen. I think that's why you don't hear about this that often is that most people aren't kind of like being that aggressive about how they're approaching any of these kind of agentic systems. >> Well, I'll tell you there's one person who agrees with me on this one that may tip the scales depending on what you think of him and that is Elon Musk. All right, this is from the information.

24:36 Musk says SpaceX will sometimes use rival models to power Grockbot. Elon Musk announced on Tuesday night that SpaceX's AI unit will now use some AI models from competitors to power Grockbot. Going forward, SpaceX will use the best back-end model for any given task, including Claude Opus 5.5, Midjourney, Sunno, and other leading APIs, whatever is most likely to give you the best outcome. Not mentioned, of course, is OpenAI models like GPT6, Astra. I wonder why. But clearly Musk says it's not all about the harness.

25:10 Sorry. Sorry harness hive. the best model is sometimes what will give you the best outcome even if it's not Grock's own model within Grock's own Grock. But what do you think about this? >> No, no. The he's team harnessive right here. This is the definition of the harness. This is saying that different model for different task, but the ability to actually route and find the right model for the right task. That's the harness. So Musk is Musk is full on harness hive here. He's saying that >> you're right. You're right.

25:40 >> Yeah. He's saying there's no there's no there's no no. He's saying there's no all-consuming model that can do everything even their own model. So I think he's he actually this is a big shift for Musk. We should welcome him to the harness hive. And >> okay, Elon's part of the harness hive. >> Elon, you're in. But I guess it goes it goes back to this question of do the standard models do a good enough job or do you sometimes need this frontier intelligence and maybe maybe what Elon is telling us and maybe this has been the lesson of the harness hive you know all along is that standard models are doing a capable job in many areas where you can build functional products like rockpot and muse with them. but the frontier is you know sometimes there's for some tasks maybe like the doctor appointment that I was talking about maybe like Shane's you know council of agents in his exec team that's not his human exec team. Sometimes you do need some frontier intelligence to make sure you don't mess up.

26:41 >> Well, see I'm still going to push back cuz based on what he said he he doesn't he says midjourney like he's not even saying they're leading models. So I think I had read that as some things if you just need to generate an image that's of a certain type of quality or a certain type of design midjourney is actually the best and not even necessarily the frontier model. So zuno for audio generation I think he's not saying it needs to be frontier intelligence actually.

27:14 >> Yeah. But he's he's going to work with Opus 5.5 and you remember that he's not exactly Daario's biggest fan. >> Yeah. No, I mean certainly him just saying any kind of model interoperability. He is a business partner and he's got a >> he's got they got to succeed too cuz actually remember you use Opus 5.5 that compute is going to flow back into SpaceX and their data center business. So I mean >> to some degree. Yeah. Yeah. Yeah. So, so I think listen if Elon is I don't know did did you see the tweet he said this will sound super crazy but I see a path to SpaceX being worth orders of magnitude more than the current earth economy.

27:57 So for him to achieve that a valuation or a revenue larger than the GDP of humanity you need model interoperability I think. All right, before we move off this topic, I do want to talk to you a little bit about something that you highlighted this week, which is it does seem like everybody is building the same thing, right? You have Muse, you have Grockbot, you have Dots from OpenAI, you have Instinct, etc., etc. The list goes on. and so I do want to get your perspective on where this is going, and how they'll differentiate. This is something that you highlighted from the open router co-founder Alex Itala. he said that a 2005 version of that would be oh everybody's building the same thing a database a users table a sign-in page a signup page a profile page a logout page everything's the same. There's a lot of differentiation really. So basically he's saying like you know when you would build on cloud there's all these different services that would show up and you know you could have looked at the primitives and said everything is the same but really there was real differentiation there. I disagree with him. I think that this personal AI is AI assistant use case is going to be you know your I don't really see a a consumer version of this or an enterprise version of this. I just see you having one that you trust for everything. that's at least the conclusion I'm coming to as after using these products. what do you think about this and and why do you seem to agree with him on this front?

29:29 >> So the reason I really liked his explanation and kind of giving that mental model of 2005 that if you were to say oh look there's a database, a user table, a sign-in page, a profile page that you would say it's the exact same product. because actually taking your earlier example, if you had an agent and a company that focused exclusively exclusively on local businesses and there was instruction and training and tool calling that was set up specifically to answer the problem of kind of messy data, it will perform better and is going to be a completely separate problem than a personal agent that does everything for everyone. So, I I I I actually I'm going to take the exact opposite side. I think we're going to have different agents for for different use cases. Again, connecting to your Gmail, going through your email if you're using Hotmail, going through trying to pull something relevant, that kind of stuff is going to be fairly commoditized. But I think there's going to be a lot more around the underlying use cases and content and challenges where specialization actually is going to make a much much bigger difference. And I don't think in a good way it's going to be just one agent to rule them all.

30:50 >> Okay. I guess that's something that we're just going to see play out in the coming months. This will be a new debate. One agent to rule them all, multiple agents. Maybe it'll be they'll you'll have like a home agent that will control all your other agents so we could both be >> No, actually this I've seen I don't know I actually think like I I find this very personally relevant of like again booking your travel and flights is one thing where everyone says like that's all everyone talks about. Meanwhile the challenges parents face actually I just found out instinct good use case. last night my son was like oh I don't have school tomorrow. I was like, "Are you sure?"

31:28 And I had no idea. It was like a professional development day. I actually had instinct to go through my email and surface this knowledge. We're going to see now. I told it like, "Please always look out for emails from this address. Please highlight if my son does not have school coming up for some random like professional development day." but having like agents that are understand deeply what are the use cases relevant to parents and families and actually I think that's very different than how instinct is built today like that stuff should be baked in >> definitely. All right look as these products continue to take off of course we have these open AAI and anthropic IPOs on the way and there's some jitters in the market about whether they're going to be able to pull off their potential. Remember, this is all like everything we're talking about.

32:18 It's all experimental. We don't even know if people are going to want these things. We have a hunch that they will, but we don't know. It's just them throwing spaghetti at the wall and seeing what sticks and then developing based off of that. the market certainly has faith in these companies, but also is keeping that other side of it in their in its in its mind. And there's a little there's some jitters that are starting to show up around these companies. So this week, very interesting example. The Financial Times reported that OpenAI instead of doing 70 billion in annualized revenue this year is actually going to do 50 billion of annualized revenue this year. that in turn tanked the stocks of Nvidia, Oracle, Cororeweave, AMD and others, right? So you had this pretty decent pullback of about anywhere between let's say three and 8% on all these companies. Coreweave itself was down 8% which is a good chunk of money. it turns out that this was just kind of a weird accounting thing where like some OpenAI investors had like tried to tally OpenAI's revenue the way that Anthropic tallies its revenue which includes the sales from the cloud vendors like Google Cloud Platform and that number got out. the Financial Times had published it and then now that they're raising a new round, they used the old method or the true OpenAI method of accounting and the number looks smaller.

33:41 But I think just because this mismatch happened and we saw such a pullback, it just suggests the market is really jittery around these companies. and I wonder Ran John, you know, you said earlier in the show, I want to see that S1. I wonder if we see some real misses this and Meta and Microsoft pullback lead to some actual revenue challenges. if what we saw this week could end up just being a hiccup and we could end up seeing that big correction that I don't know the market seems to be just preparing itself for.

34:12 What do you think? >> I think I saw a lot of people just like just go public guys let's stop with this. I I I would like to ask every journalist out there, including you, Alex, refuse any leaks around financials that just have some kind of ARR extrapolation or calculation. And regular listeners will know how much I hate the the way ARR is communicated. This is exactly why like 50 or 70 billion if like we are to assume what is 2026 revenue going to be is dramatically different even 50 is pretty good but still what that implies about the growth rate and the idea that and this is on the financial times too like how do you just got it's like guys that is a massive difference and it's of such a simple thing that we have talked about plenty and I do find it ridiculous that anthropic does report revenue or not even report leak revenue to or like speak about it to investors including partner like commission which doesn't make sense that it should not be a sales and marketing expense that should be a direct that should not count as topline revenue but open AAI has ne never done that and that's actually to their credit so to accidentally have that in like what do you think who do you do you think it was a company do you think it was an investor How do you think the FT got it that wrong?

35:41 >> Yeah, I think what happened was clearly that FT got a hold of some old investor docs around OpenAI which had that 70 billion number. they called Open AI, right? Because there was a line in the story that said OpenAI did not deny the numbers. OpenAI at the time was probably in this like, you know, oh god, like we're way behind anthropics. So, they the FT reporter was probably like, "Do you deny this report and OpenAI was probably just like, we're just not going to comment on it, right?"

36:11 So, I don't think they minded getting the number out, otherwise they would have said, "This is inaccurate. Don't publish it." And the FT and explained it and the FT would not have published it. But OpenAI didn't do that. So, the number went out. It's bad on OpenAI. I think sloppy. And it's sloppy on the FT. And so now like you see the number get out there and people are like you know open AI is actually slowing but where really it it isn't in the way that the numbers suggest. But I think look the bigger deal here here is and I want to hear your thoughts on this the market doesn't the market just seem ready to pull back on everything AI if it's able if it decides to make this type of move on on basically minor news like what happens if you have major news? Yeah, but that's not minor news. If it's to go I remember the narrative com actually going back to what you were just saying like the narrative on open AI completely shifted the moment that 70 number came out. Everyone open AI is dead. Anthropic is going to rule the world. Oh wait, open anthropic growth might be slowing.

37:11 Open AI is like killing it now. 70 billion ARR. Look at that growth rate. It completely changed the narrative. So, I do think it's a big deal to shift the conversation from 70 versus 50. but I I I do agree and I do agree. Of course, like no one knows the state of these businesses. No one knows the actual economics of these businesses. We're still talking about 2025 representations of anthropic. We're we're like literally have no such a little picture of what's going on that the difference between 50 billion and 70 billion is massive and to just have it like off a misunderstanding of an accounting recognition have it the narrative change that much. I think it's more everyone just wants to know. Maybe it's just me, but drop the damn S1 and go public, please. Oh, it is not just you. All right. Flick, before we go to break, I did want to address you know, we do like to correct the record here when we get stuff wrong. I think last week in our show, we suggested that Meta had commitments to Anthropic in that we suggested that Meta was going to give compute to Anthropic. and so if Anthropic's revenue slows, then Meta revenue would slow. But that those deals haven't happened yet. So, I just wanted to put that out there and say that is a good call out noticer, which we which we appreciate and just correcting the record.

38:41 >> I like having tens of thousands of editors always checking up on I do I would rather you want the show to be more correct. Exactly. >> Yeah. >> Yes. So, okay. And we'll point them out as we go. And we do our our responsibility you listeners and viewers is to make sure the stuff we say here is accurate. But I think we have a pretty good track record, but when we mess up, we'll we'll admit it. Okay.

39:05 when we come back after the break, we're going to talk a little bit about whether you should be nice to your AI and what happens if you're not. That's coming up right after this. And we're back here on Big Technology Podcast Friday edition with Ran John Roy of Margins. Ranjan, I think this is my favorite headline of the week. It's from The Verge. Anthropic bans abusive or cruel behavior toward Claude. Anthropic is making changes to its usage policy for the first time in over a year to reflect new and higher risk cases of misuse. but one of the most significant changes prohibits sustained and needless abuse or cruel behavior towards Claude. If you are persistently mean to Claude, you're gone. Anthropic might ban you completely. I applaud this move. I think this is great. I I think that you know we've we've had this with Alexa to a degree and we've talked about it, right? you know Alexa will do things if you don't say please or thank you.

39:59 People who are like work with with kids speaking to Alexa, they've seen that they're the the manners go out the window because the bots train your behavior and then it manifests in the in the real world. I really think the way that we communicate with these AI agents will influence the way that we operate in the in the real world. and if you're a persistent when you engaged with Claude, I think that you're going to just turn that into a learned behavior that spills out into the new rule, into the new world, conscious or not, I think that's, you know, regardless. I think this is a good rule from from CL from Anthropic and Cloud, though. Your thoughts?

40:34 >> I think it's I if we're talking about the overall way you interact with AI, it is funny. I think my son says please to Alexa more than he does to either of my wife or I. Seriously, he's like cuz I I do it all the time. We have our entire like turn off the living room lights, please. And he he completely mimics that. But when he's asking us for stuff, we don't necessarily get a please. But on one hand, okay, I there's one really important point I want to get into on this, but also like do you think it's good in the sense of like if your agent posts your bank account on Slack, should you speak to it like you would another person? Should you maintain composure that's like just it's a technical non-sensient being up for debate certainly with many people but like like what how do you think you should handle those kind of situations?

41:33 >> I mean I think you have some leeway I think you have some leeway to be a little meaner than usual. it's not like what you say is going to change the underlying weight to the model. So this is just for your own let's be honest it's for your own personal edification here. but I think then the rule that if you're persistently abusive towards Claude, you get you get the ban. that's where where things are interesting.

41:54 >> No, no, but but do you think Anthropic is implementing that ban to make people nicer and better or do you think they're implementing that ban to it's something about their technology and the impact on it? >> So that is that's where where it gets interesting. So I have my reasons for why I like this. Anthropic >> talk about anthropic. Yeah. >> Might be different because Anthropic does have this belief within the company that Claude may be sentient, maybe conscious, they may have created life again. there was a long story about this in the New York Times last week where they're like trying to basically even encourage the pope to be open to the idea that Claude might be conscious. And there's I mean it's high I highly recommend people read the story. There's like religious figures there who are like if this thing is is conscious you've just created the most suffering ever in the history of the world. so I I believe that part of this is anthropic saying you need to treat Claude a little better.

42:59 >> I don't know how to feel about that. >> No no because on that to me one of the most interesting parts of this is Bill Gurley had actually tweeted around this. He said, "Strikes me this implies a company is certainly using customer prompts as part of the training data. Otherwise, why would it matter? There would be no impact to the larger system. Open to hearing why this is wrong." Now, we know if you are not an enterprise customer, you do not manually tag toggle off like your prompts will be used explicitly for training. But also like >> that is the you're all opted in to having your data used for training.

43:36 Not just prompts, cold conversations. >> Exactly. >> used I guess that would be prompts but like you have to turn that off otherwise anthropic will use your conversations for training. >> Yes. But if we are to say like if it is a longer term larger impact to the technology based on this kind of abusive behavior then are you saying if you toggle it off or are an enterprise customer it shouldn't matter like then it should not be about the technology because if you're not at that I thought I mean the fact that he just said that out loud and like I mean you saw a lot of responses to it were actually kind of like this light bulbish moment that are they saying that actually like it does affect whatever you are putting in there does affect the larger infrastructure and ecosystem and whether that's on the the model training I mean it I think they're kind of saying that that's the craziest part to me they're saying that or are they saying that if you toggle it off or are an enterprise customer you're allowed to do whatever the hell you want to claude if they said that it would be fine but otherwise >> they didn't say that which would suggest probably it's both. It's probably both.

44:46 They're probably using it to train your data and the faction within anthropic that thinks that cloud might be conscious doesn't want you to abuse it. >> Yeah. No, no, I think it's but I think again the first part of that to me is a big deal like especially if that ever becomes kind of the narrative that is a huge problem for them and they're kind >> it's public. We know that they do use the the prompts for training. Well, no, but if it was true, they should say like if you have not toggled off, it shouldn't be a blanket because then it would be a very different act against their model >> based on whether you have that off or on, >> right? But the policy that you were suggesting would do something that Anthropic doesn't want to do, which is like, you know, turn their the whole thing of them training on free users prompts into a and even paid users prompts that haven't tggled it off into a thing. Like they're much better off, you know, not generating the headline and just making it a blanket policy.

45:44 >> Yeah. Okay. From a pure communication standpoint, I agree. But I don't know to me to me that like him calling that Bill Gurley calling that out I thought was very interesting. I had not thought about it that way before. But we we didn't even talk about the religious consciousness stuff last week. Right. I think we'd run out of time. >> No, we didn't. We didn't. We're we are basically out of time. I do think before we go though, we should we should talk about the Gemini thing because I think that's where we where we should end this one. and and yeah, I mean maybe one day we can we can have a longer conversation about the AI consciousness thing, but >> the truth we just don't know. I mean, I don't know. It's it let's let's just talk about it for >> I find it Yeah, go ahead.

46:31 >> How about I tell you that I do know and I have the answer to all humanity, religious and and consciousness, but then we have to wait till next week to hear it if we're running out of time. that would be I think we would retain some of the audience. So that would be a good cliffhanger. But I don't believe you. >> I don't know that. I don't know. >> I just think Can I just say one one sentence on this? I just think we have to stop putting this in entirely human or entirely robot terms. Like it's not conscious like a human. It's not dead like a rock, right? It's just and it's not a life form. It's just some different thing, right? I don't know.

47:07 That's just my perspective. So if you try to say this is conscious like a human, the whole conversation is already blown in my perspective. >> I actually do you know what I do strongly believe and the only thing with any certainty because otherwise consciousness or questions of God and religion I do not know. I think there's just a lot of drugs. I think there's a lot of psychedelics. I mean, I'm going to be honest. Like, anyone who's been close to Silicon Valley and a lot of these circles knows there's certainly some Burningmanesque culture across a lot of these kind of organizations. And just when I was reading that New York Times article, I was just sitting there, I'm like, is this just drugs? At least, is that where some of this started? I don't know. I I don't want I don't wish to demean the bringing of consciousness and robots and AI and everything, but I I feel it just so much of it reads to me like come on, how is this happening? I guess the biggest thing for me is like they've been saying this since like GPT2.

48:08 I get now when you see technology work in this capacity maybe you could start to argue but they haven't been it's been said since like the first models were created. So I don't know we we we should spend some more time on this. >> That's right. All right. Bring us home. We got a minute. Tell us about Gemini. the new Gemini. >> I am so Okay. Okay. We'll make this one quick because I know we got to get going. Yeah, >> but Google had a massive announcement this week as a Thomas Curry and CEO of Google Cloud. Today at Google's Cloud Gemini work event, we announced Gemini.

48:48 They launched Gemini. I loved this cuz it is the most googly thing of like you got some great products out there but just the naming convention making it so confusing cuz now Gemini what we don't even know like I saw like people someone is like hey Google just announced Gemini is not a model it's actually the agent harness and they're going to add cloud models and leading engineer at OpenAI actually had a great response today we're announcing chatgpt it's at chatgpt.com But we don't know if Gemini is the model anymore, >> whether it is the platform, whether it's Gemini at work in a little toggle or like plugin for your Gmail. Is it this larger super agentesque thing? Is that Gemini agent? Is it Gemini? So, this just was the most googly thing to And I also guys just think through it a little bit before you make a big announcement around it. That's all I ask.

49:51 >> Today I'm proud to announce the launch of our new show, Big Technology Podcast. >> It's It's a big deal. It's a big deal. >> It's an agent. I mean, like >> differentiated. >> How I want to go back to the days of Bard. >> Bard. >> Bard? >> That was a bad name, man. >> No, man. They >> That was a bad name. >> I I I kind of want to go back. They should just be like, "All right, the super agent is barred. Gemini is the ecosystem. Gemini at work is this.

50:20 Gemini and Gmail is this." I don't know that it is. I guess it's just a gigantic company with a lot of products. But I still am always amazed at like the classic is it Google Hangouts, Google Chat, Google Meet, Google Hangouts in Chat, is it yeah some issues. My hot take, >> my hot take is they should go back to Lambda, the original chatbot. speaking of sentience, that there was a belief by one engineer that it was sent.

50:48 That was a great name. >> Blake Leo show >> Lambda. Yeah, I think they should Gemini is a good name. I'll give it that. It's actually a pretty good name. >> Gemini is good. >> Gemini is good, but >> interesting detail in Kevin Ruse's book. I'm about to go interview Kevin Ruse for the show that's going to come on on Wednesday. the Demis actually wanted to name Gemini Titan. but the Google board or the Google powers that be thought it was too militaristic, so they decided to go with Gemini instead, which is like so funny. It's such a non-offensive name, but it's a good name.

51:23 >> I don't know. As a horoscopic Gemini, I'm always told that it means that you're very sociable gregarious, but two-faced and shouldn't trust them. So >> actually it's freaking perfect for an MLM. So >> actually you're right. Actually it's the best name ever. So >> unbelievable. All right John. Good to see you. little shorter than usual. Actually no we we did 50 minutes or so. >> Alex has got to run up to NASDAQ. tell Kevin Roose I said hi.

51:53 >> Absolutely. We'll do. thanks again for coming on. As always, thanks everybody for listening and watching and we'll see you next time on Big Technology Podcast.

Summary

Microsoft and Meta are reportedly scaling back their use of Anthropic's Claude AI, raising concerns about the company's growth prospects ahead of its IPO. Meanwhile, there's a discussion on the implications of AI agents potentially sharing sensitive data and the ethics of interacting with AI, particularly in light of Anthropic's new policy against abusive behavior towards Claude.

- Microsoft and Meta are reducing their reliance on Claude, with Microsoft cutting its projected spending significantly.
- Meta's use of Claude has dropped from 60,000 to 30,000 employees, as they shift focus to their own AI tools.
- The decline in Claude's user base could impact Anthropic's revenue and growth projections ahead of its IPO.
- AI agents may inadvertently share sensitive information, as demonstrated by a user whose banking details were shared in a work chat.
- Anthropic has implemented a policy banning persistent abusive behavior towards Claude, reflecting concerns about user interactions with AI.
- The conversation raises questions about the ethical treatment of AI and its potential impact on human behavior.
- The market is jittery about AI companies, as evidenced by a significant stock pullback following a misreported revenue forecast for OpenAI.
- Google's recent launch of Gemini has caused confusion regarding its purpose and functionality, highlighting challenges in naming and branding AI products.

Questions Answered

What are the key topics discussed in this episode?

The episode introduces several significant developments in AI, including Meta and Microsoft's potential withdrawal from cloud spending, concerns about AI agents sharing sensitive information, and Anthropic's new policy regarding user behavior towards AI.

How do the capabilities of AI models compare to their practical applications?

There is an ongoing debate about whether the underlying AI model or the product's usability is more important. While some believe that advanced models like those from OpenAI and Anthropic will lead, others argue that standard models with effective applications can suffice.

What are the risks of AI sharing sensitive information in communication channels?

AI models may struggle to differentiate between appropriate and inappropriate content in communication channels, leading to potential risks such as sharing sensitive financial information in group chats.

What are the current market sentiments regarding AI companies like OpenAI and Anthropic?

There are growing concerns in the market about the financial performance of AI companies, with reports indicating that OpenAI's projected revenue has decreased, leading to stock market jitters.

Why is Anthropic banning users for abusive behavior towards AI?

Anthropic's policy to ban users who are persistently mean to Claude may stem from a belief in the AI's potential consciousness, suggesting that user interactions could impact the AI's development and training.

© transcribe · For agents Built with care and craft by Gokul Rajaram