Section Insights
The Growth of AI Investment
What is the current state of investment in AI and its implications for productivity?
Investment in AI has surged from approximately $30 billion to between $150 and $170 billion annually, representing about 2% of all white-collar wages. This rapid growth indicates a significant shift in how businesses are leveraging AI for productivity.
- AI investment is growing rapidly, reflecting its increasing importance in business.
- Companies should focus on selling outcomes rather than just products.
- The potential for AI to enhance productivity is vast, with many jobs currently underutilized.
AI's Role in Competitive Advantage
How can AI contribute to a company's competitive edge?
AI enables companies to solve narrow problems efficiently, such as automating receipt matching and transaction categorization, which can significantly reduce time and costs. This capability allows firms to become more competitive in the market.
- AI can streamline processes and reduce operational costs.
- Focusing on specific problems can lead to innovative solutions.
- The evolution of AI capabilities, like GPT-3, showcases its potential to tackle complex tasks.
Managing AI-Related Spending
What challenges do businesses face in managing AI-related expenditures?
Managing AI spending is complex due to its rapid growth and the difficulty in predicting costs associated with AI services. Unlike traditional spending categories, AI expenditures require new frameworks for assessment and management.
- AI spending is increasing rapidly, complicating budget management.
- Traditional frameworks for managing expenses may not apply to AI.
- Understanding the nuances of AI costs is essential for effective financial planning.
Finding Product-Market Fit
What is the process for achieving product-market fit in a company?
Achieving product-market fit involves deeply understanding customer problems and developing solutions that provide real value. This process often requires experimentation and iteration, akin to running multiple startups within a company.
- Finding product-market fit is crucial for product success.
- Iterative development and customer feedback are key to refining offerings.
- Companies should foster an environment that encourages innovation and experimentation.
Modernizing Government Procurement
Can AI solutions like Ramp improve government efficiency?
Yes, Ramp is being utilized by various government entities to enhance efficiency, reduce spending, and improve auditing processes. By consolidating tools and providing better visibility, Ramp addresses issues of waste and fraud in government procurement.
- AI can streamline government operations and improve transparency.
- Consolidating multiple systems into one can enhance efficiency.
- Addressing bureaucratic inefficiencies can lead to significant cost savings.
Transcript
0:00 There's probably a trillion dollars of work towards jobs that I think are beneath people's potential. About a year ago this time, the entire world was spending on the order of $30 billion a year on inference across the major labs. Today, estimates are something closer to 150 to $170 billion. In other words, the amount spent on AI is equal to about 2% of all white collar wages. You are now over two billion revenue run rate.
0:31 >> It's growing over 100% per year. Growing faster this year than it did last year. >> You describe ramp as a productivity company that happens to move money. >> A typical business running on ramp is able to cut their expenses by about 7 12% per year. I think a lot of companies get stuck in this idea that we're going to go sell you a product. They forget really at best companies should be selling outcomes. >> CEO and co-founder Delic.
1:11 Eric Lyman is the CEO of RAMP. He has over $2 billion run rate, growing over 100%. One of the top AI teams in the AI world today with over 2,000 people. How do they build this business? Let's hear from him about what it means to focus on outcomes to focus on aligning with your customers and solving your customers problems instead of trying to sell them stuff. How does Eric run a company with 2,000 people with tons of top AI talent?
1:33 He has these really small teams he manages. Let's hear from him and see what it looks like inside of an AI champion. Eric, thanks for joining. >> Joe, couldn't be happier to be here. It's a ton of fun. >> Eric, you are, I guess, now over two billion revenue run rate. I guess maybe that's secret. You're growing over 100%. You're crushing it. This is an amazing company. let's let's go back to the beginning. I think you and Kareem had already built and sold Parabus when you decided to start ramp. What did you do before? What was that company?
1:58 >> So Parabus now the idea is much more popular, but it was a prehistoric AI agent is how I would describe it. the premise was let's say you bought something online, let's say a TV and it dropped in price a week after you bought it. Stores, Amazon, Best Buy, whatever would guarantee that you get the difference in price if you'd asked them. So we built an app that would ask for you. You would link it to your Gmail. It would scan inbox for receipts, structure the data, and if you were eligible, just wrote an email to them, stores would respond, and you'd wake up to the difference, and we charge a percentage.
2:28 >> What did you learn from from that experience? What did you guys learn building that? >> Well, one, it helps to have a really simple, easy to understand value proposition. Stores owe you money. We're going to go get it for you. and having very aligned incentives. that was super helpful. and a lot of the learning truly that picked up and led into to ramp happened postacquisition. So it was a very fast process. We launched in May of 2015. A year later we had sold and Capital One which bought the company and wanted to scale us from you know a million users to you know 10x more put us in the credit card division. when we were there, we really got a deep lesson in how financial institutions work, what make them great and very profitable, but I also got a deep education in incentives. and actually how does it affect what people really do? we found an organization that said good things. but somehow people were working to grow the amount that people spent on their cards. Then there was other teams trying to grow net margins. Sometimes it meant convince people the points were worth a lot and then there was another division that would go devalue the points >> to try to make more money.
3:40 >> Try to make more money. We were in the savings divisions and so we'd call customers and ask them, you know, and we had to sell cards, too. We'd ask them like, what do you want? Do you want points, cash back, something different? And if you really listen to people, people would say, you know, I actually just want more in my bank account. Mhm. Mhm. >> And we're like, "Huh, if you really think through that and you help people not spend $100 on some subscription that they're paying for but forgot about, no longer using, cancel that at the end of a month that's $99 more in their account than if they got like a dollar back on that purchase."
4:10 >> And we got obsessed with this idea of like, why isn't there a card or software design help you go and spend less? But I think that financial institutions, a lot of organizations are filled with these misaligned incentives, you know, from the bank that could pay you more interest. Maybe they have a high yielding savings account, but they don't want to tell you about it. you know, loans that could be at lower rates. And I I not only did we learn a lot about incentives, but it it led us to really question of what if you tried to create a financial institution a company that inverted those incentives that actually was aligned with the idea of what if we tried to make our customer better off? What if we tried >> So, be on the team of your customers as much as you really can. Yep, that's exactly right. And so that's where a lot of the idea came from. But we got a lot of education in that. We also got a lot of education too in what happens in large organizations. You know, they go from these lean mean fighting machine startups that everybody loves to work at to what happens when there's 50,000 people and how do you fight really the slowdown in bureaucracy that can go and set in which has helped us become a fastmoving company. We can get into that too.
5:17 >> I would love to talk more about that too. your your ramp is famously one of the bestrun companies. You're the CEO. You guys are accelerating, growing faster at scale now at this giant size, which doesn't usually happen in these worlds, but so just step back a little bit. You've described RAMP as a productivity company that happens to move money. I I love that because AI, productivity, that's like one of our themes we're obsessed with. What does that mean? And how's that philosophy shaping what you're focusing on as well?
5:40 >> Take something as simple as, you know, an expense report or paying an invoice that you get, right? if you kind of think about it, there's too many steps to all of it. Probably most people listening, if you've ever taken a business trip or taken a client out to dinner, maybe you had a credit card issued by some company perhaps based in New York. Your expense policy doesn't drive or the thing actually works. Swipe it, goes through, you get a piece of paper, and then you're supposed to go onto another website, maybe made by a company out in Germany. and you are supposed to manually enter all the details of the transaction that was digital, by the way, in the first place.
6:19 and you're going to enter all that. Maybe you do it the next day, you probably do it the next month. >> Then your manager is supposed to look at it a week later, they probably look it out a month later. Then maybe a center of excellence in India reviews all this stuff. Then eventually it gets reconciled. and you know, a month or two has passed. There's so many unnecessary steps. Paying an invoice. It's not just sending the check. When someone in accounts payable goes and gets this, they have to go and see, do we have a contract with this vendor? Is this really them or is just someone trying to pretend that they're them?
6:48 did we pay this invoice already? to the descriptors breaking apart, how do we book this and allocate the expense? It can be 50 steps to do any of this stuff. The payments are the easy part. The hard part is actually going and asking how do you get this done with less bureaucracy with less time. And I think that what our our our initial problem we tried to solve is you know if you could go and help make the company run on less every dollar go further every hour go further. You start asking about these different types of steps that banks never really thought to look at. They were in the business of selling money and we wanted to be looking at how do you go and sell people time. And it turns out AI that can reason can go and not just digitize these process but >> well redesign the process to make it such that you could tap a card and your expense is done. You get an invoice and it's paid correctly on the last day that you owe the actual money. So you're maximizing your your earn and you can just eliminate this bureaucracy in the first place. And so we're we're really focused on this.
7:52 >> I like that. So you got the incentive your clients at heart. So you want to wait and pay when they have to pay because why not? they aren't getting earn extra money and you're if you're optimizing that over hundreds of thousands of invoices that could be a lot of money for a big company. >> It adds up and and and and look like when we launched the company with this opposite idea of we're going to help you spend less you know we did our very best and we could help the average business cut their expenses by about 2% per year which is quite good. it's pretty significant. Today a typical business running on ramp is able to cut their expenses by about 7 and 12% per year.
8:25 >> Wow. And to put it in perspective, the average American business has an 8% profit margin. It's really significant. And and a lot of this is not one weird trick. It's all these little things that steal people's time, the sources of bureaucracy that take out the energy of great businesses. >> Are you mapping out like every single one of these? And like how what does that look like? Do you have a team that's going in and just trying to learn where these things are are getting screwed up?
8:48 >> Yeah. Yeah, we we look both at what are the dollars going in what are the was the company paying for on day one to what vendors do they actually keep what costs can we go and negotiate down what waste can we eliminate and so there's a whole side focused just on tracking dollars going out what spend do we block that was out of policy that would have gone through if not for our technology there's a whole segment focused on time we actually go and try to measure clients calendars how much time do they actually spend in the app and unlike social media companies that are incentivized to get you to spend more time looking at the feed longer.
9:22 We're obsessing over how do we get you out of ramp? How do we make sure you never have to go and spend time again? >> I love it. So, if you're spending too much time in it, you're going to figure out how to get them back that time, whatever way you can. >> That's right. >> Now, could this company have been built before AI? It feels like this is like an company that's like really AI is its core. You guys started it just before a lot of this became possible. So, how did that work? You your mission must have expanded over the last few years.
9:44 >> For sure. I mean, I I think we're stepping into a future that is, look, it's very exciting. Like, when I think about the background of part of what made America great was, you know, we took on manufacturing and we were able to kind of go out build and outproduce. And I think that this machine intelligence is going to allow us to have firms that are radically more competitive. and I think there's a whole host of questions that need to be solved related to this. But, you know, a lot of the spend is going through cards and bill payments today.
10:12 So, we're very attuned to it. But we we fell into it in a funny way. our you know back to the mission help people spend less time and money. we were interested in these very narrow problems of >> how do we go match an image of a receipt so you don't need to go and be like this receipt goes here or this receipt goes there or you get a you're an accountant and you get a list of 200 transactions.
10:32 you have to go click click this this invoice or or this payment to Amazon you know is in supplies which is accounting code you know 60,635 how can you go and have autocomplete for that >> and while we were building this I mean we just saw so many incredible moments like we were one of the first customers to use GPT3 when it was a research product you know months before it and you know I remember it couldn't do arithmetic to now you know within the last month you know AI is solving math problems that no mathematician alive has ever been able to solve and so some of this is just feeling the expansion along the way but you know our goal is I think a lot of companies get stuck in this idea of we're going to go sell you a product we're going to sell you a card or we're going to sell you a car or a computer and they forget you know really at best companies should be selling outcomes you know, I I'm not >> your paler framework as well as the outcomes thing. I think that's a great way to think about it. Yeah, >> 100%. Like I it doesn't it doesn't make the world better if I can put, you know, sell more credit cards and more wallets or sell more subscriptions. I think it makes the world better when you can actually look someone in the eye and say like, if you use these products, your business will be better. And if there's other tools you can use that are better than mine, fantastic. but we need to compete by understanding who you are and how do we actually build products in service of that and and AI was this huge accelerant.
12:05 >> So when you talk about making the world better I I love that. Let's go back a little further in your background actually. Where are you from originally here? >> I grew up in Las Vegas. >> In Las Vegas and what what is there something about your background that that gave you values to want to fight for like the right kind of way to do build things versus the wrong things? Like what where does this come from?
12:21 >> It's a it's a good question. I think some of this, I mean, even before right and wrong, just building things. I think a lot of people grow up in towns that have been established where the people who created things were people you read about in the history books. >> Vegas 100 years ago had 500 residents, maybe. It didn't really work until the air conditioner was invented. And, you know, I'm in my mid-30s. Like, when I was born there, I think it must have had >> 4 or 500,000 people. And when I left to go to college, there was almost 2 million. And so my whole childhood was just parts of the city were getting built as you were there. You kind of you didn't just hear about people whose names on the the buildings. You might have you might know them. you might be able to meet them. And so there was just something to growing up there that I I feel really lucky with which is it did not feel crazy to be a kid who wanted to build things to wanted to create businesses to wanted to build.
13:23 and I feel really fortunate for that. you know, I think as to doing the the right things, some of this is just maybe how I was raised. Like, you know, >> I think my family always had tried to emphasize this idea of humility. of trying to leave the world, you know, a better place and and actually working hard. You know, I don't know how long we all have, but hopefully it can be worth it and and, and meaningful. And so, some of it was that, too. I think as I eventually got into doing more work for for more people, I don't know, feels better to be able to work super hard, help people, and just like actually hear like, >> you know, see see people who you worked hard for like do better and succeed. And so I I find it pretty infectious.
14:11 >> I love it. I think there is something really nice about the law of the innovation world that is positive somewhere. You're going to be a billionaire anyway at this point with your success, but it's basically more enjoyable. And I think you even do better if you're doing something in a way that's helping everyone else around you because then they're going to be rooting for you more, right? >> You know, just the history of the world, like it's never been zero sum. You know, people come up with an idea and everyone gets to be, you know, hopefully a little bit better off and you can have small conveniences that help people live a better life. And if you just keep on doing that, like, you know, you just think about how much the world has advanced from, you know, thousands of years ago to hundreds of years ago.
14:50 where most people were farmers. You kind of got by by how much could you lift up or what limited skills you have to you have people flying around and you know tin cylinders through the sky you heat up sand and you have intelligence. >> It's amazing what the enlightenment and property rights and systems that work could do for civilization >> for sure and you know so I want to go back to early ramp again. RAMP was originally kind of fighting to become the default in the startup ecosystem and there's a company called Brexit that's since sold that was like I think it was before you guys and you ended up taking over from them. Now of course you're kind of you're powering agriculture, manufacturing, construction, you're getting everywhere else like when you started up in the startup world like what was what was your focus there and why did you win?
15:31 >> I think it came back to incentives >> at the core of it. I think there was good ideas that came out of that that company to be clear. >> But in many ways, I think it was a continuation of how financial institutions have been built. >> Sign up for a card and we'll give you points and multipliers that if you buy on this category, we'll give you 4x points. This one, 3x points. This one, two.
15:57 >> They had figured out a way to reach a new audience, but it was still at the core. What was best for the business was not best for the customer. >> Yeah. And I think that with RAMP, there was two big things we focused on. One, we should want the same things that our customers want. We should be happy to make less money in a given month so our customers can be healthier, have stronger balance sheets, and we can grow with them.
16:21 >> and so we inverted the incentives to go and help businesses spend less, to do better, and to line our excess with their with theirs. And so it led us to not just have happier customers, who genuinely liked us, but you know, it led us to ask the next right question. not just what can we sell, but what do our customers want? What will make them better off? >> And you're expanding obviously very quickly today, accelerating, you know, at this size. Like we said, it's very unusual. Where are you seeing the best opportunities to expand further? What kind of businesses are partnering with you now? one just the scale of it all is hard to comprehend. I mean truly we talked about this this business is doing multiple billions of dollars a year in in revenue. It's growing over 100% per year growing faster this year than it did last year and and the product maybe ramp classically was most known for of the corporate card world. We're on the order of 3% of corporate card transactions in the US. which is a really nice way of saying we have 97% to go. We haven't done much of anything yet. And by the way, there's more forms of payments. By the way, most businesses are earning almost nothing on their deposits. most businesses aren't getting paid on time. collections are a really hard problem and are having to deal with how do I go and adopt AI? And so we're just in the very earliest days of it all. but you know, to give you a sense of the type of customers, we've got really every industry is represented. There's over 85,000 businesses that use this from farms to nonprofits to companies launching rockets into space to manufacturers to healthcare to you know I think about you know from the nonprofits like there's organizations working hard to make sure kids are somewhere safe to go after school and they're obsessing over this problem and yet what drags them down is just the the cost of bureaucracy of operating that organization and so we're we're focused on on helping make or dollars go to that mission. you know, and we're focused on making dollars go to whatever mission people are working towards.
18:25 >> And what are the products you've launched? Like you're helping people do their accounting and and which is invoicing and everything else too. And your your new one is is called router I think as well. Is that something you guys have already launched? >> Yes. Yeah. Well, we should talk about just AI AI spend in general because it is >> in some sense this unbelievable opportunity. I I'll put it this way like I mean we've seen just the advancements in intelligence. They're in like these models can be incredibly useful and help people think faster, access skills that they don't have or don't know about to simply do tasks for them, make them more productive. And so there's a huge amount of promise. And yet I think about most of the businesses that I meet and that we serve, most don't have a single software engineer at the company, let alone one going and trying to make their finances better.
19:15 And so when we're seeing AI usage explode and some companies getting all the benefit, a lot of what we think about is how do we bring this? >> So how do you partner with these tens of thousands of companies who work with you who might not have the ability to? >> That's exactly right. And some of this is just simple tools embedded where I'm not trying to sell you AI. it's tap card and your expense does itself. Might be AI in the background that does it for you. it might be you get an invoice and it's paid, it's reconciled. we show you lower costs. We do a lot of the research in the background that you would want and it's a it's a part of how it works. And so a lot of this is putting in the background. and then next there are more and more companies starting to buy these services and use them. And I think this is an unbelievable but also very hard to manage category of spend. I think classically if you were a small business owner or if you were a CFO of an organization, you can put you could build infrastructure to manage basically two types of spend. One, the people you hire.
20:16 >> Maybe you have frameworks to assess how much they cost, how much are you making, and you can kind of predict those types of costs out. >> Or the vendors that you're doing work with. You have a contract, people follow the contract. if they go above it, you can decline the spend. It's fairly linear. hard but fairly linear. With AI, it's quite different in some sense. one, it's growing very very quickly. about a year ago this time, the entire world was spending on the order of $30 billion a year on inference you know across the major labs. Yeah, today estimates are something closer to 150 to$170 billion per year depending on on on how you measure it. To put that in perspective, I think in the United States there's something like $8 trillion a year spent on white collar wages sort of back office wages.
21:12 >> In other words, we're at about the amount spent on AI is equal to about 2% of all white collar wages. and it just went up 5x over the last year and could go up who knows but some another multiple again >> and we're a knowledge economy and information ecology. It doesn't strike me as so crazy if you were to say hey we spend 10% of what we bring in on thinking. you might even say perhaps that's low and these machines are getting smarter. and so one it's growing at a rate that other categories have never grown at.
21:48 >> Yeah. Second, most of the spend, you know, in the industry they call it agentic spend. but there's really two types. One is maybe what many people are used to of you have a chatbot, you ask a question, there's a cost of that question and it comes back and forth. Then there's another called aentic where you give it a complicated task and it the model will spin up many agents who perhaps hire other agents who perhaps have their other agents to go break up the work and come back to you.
22:19 So that's already 70 to 80% of all the spend is that and what it means is that it's growing exponentially. Most companies don't really have visibility into how to go and manage this. And then there's also back to incentives very misaligned incentives. I I don't I think many of the people at the labs have good incentives, but right now they're racing towards building the smartest possible AI possible at almost any cost. I know they're they're thinking about safety, but one thing that they're not obsessed with is well, sometimes there are some models that could answer your question for a dollar and other times there's models that could go and answer it for a penny.
22:59 >> Yep. And if you ask the model that costs a dollar for it, it's they're not going to route you to the penny model. They have no incentive to they're very compute constrained. And back to what we started ramp with, we want to help organizations well pay the penny instead of paying the dollar. >> and is this product something a lot of people are adopting already? >> It is growing extraordinarily fast. I mean for businesses that turn it on, it takes under five minutes. really just change out a few lines of code.
23:28 the average business that turns it on is able to cut their inference cost by 40%. >> Wow. >> >> that's a lot of money, >> which is pretty good. Yeah, it's a lot of money and, you know, it's the product is is getting better and better and and so I think that it is a huge opportunity for anyone spending on AI in a real way. I think router.com is is very valuable and we're trying to do what we did for spend in general to spend on AI. So, let's talk a little bit about your your team in AI and your engineering team. A lot of people say that that RAMP's one of the very strongest AI teams in the country. Some people have told me it's the strongest AI team in New York for what it's worth.
24:05 It's you obviously have attracted a lot of really great talent. First of all, how do you get all the really great talent? And then second of all, how do you keep a culture where they're all together? Because right now everyone's trying to hire everyone in AI. Like how are you maintaining that culture? What are you doing to keep these people coming there >> past a certain point? I think great people just want to work with really great people. And so what we started the company with was trying to ask the question of like who are how could we find and and assemble a group of people where every next hire is better than the last one. and the people that are there are worth trying to work with. And so this was back in 2019, you know, we were, you know, to give you a feel for some of the first people like one he was in competitive math and computer science competitions. graduated from MIT in two and a half years and was absolutely brilliant. Joined before his 21st birthday to I think about Viral. Veral now is leading the router product. he started an app that >> if you have an iPhone there's an app called Shortcuts on your phone and well he created that when he was 14 years old. and so we were just trying to find extraordinary people who had shown signs of ability to work very hard to achieve something that was unusual early on and bring them in.
25:24 And so the next person looking at our website would say these people look really good. I actually want to work with them and learn. And you know, I think great people often walk out of the building of companies or take the next offer when they feel that, you know, it's just too hard to do good work. There's too much bureaucracy. it's too hard to go and go from proposing an idea to you've actually built it. And so we >> So how do you keep out the bureaucracy?
25:46 Because everyone could say this, but then you have to have some kind of process at a big firm because you're you're now you're now you're now an owner of a firm that's worth tens of billions of dollars with your co-founders and you don't want someone to like go in and do something bad with data and blow it up. So, how do you have process but then keep it going fast? >> So, some of this is like how do you design the organization? Is it flat or not? Is there accessibility? Can people actually meet me? Do they actually meet me or Kareem? and how how far is that to you actually try to inspect how easy is it to go you know to buy something to ship something and so maybe on each one one of the best ways to take a small productive awesome fun team that's getting it done and make them unproductive is just like just hire 20 30 people and say go agree on this.
26:37 you know happens all the time in companies. >> Yeah. Too too big of a group are not all going to align so it's just going to take a long longer to get things done >> 100%. And so one of the practices we still maintain and I think people are often shocked by is like you know once a team gets to you know 8 12 people we break it up. small teams where you clearly have an area of ownership.
27:00 you can live or die by the decisions you make but we have lots of small teams working on different problems and takes work to go and manage that but it allows people to go and to make decisions understand what they're optimizing for and and own it. >> Do you let I mean if the teams fail then then the leader fails and doesn't get to run a team or something like that. >> Sure. Yeah. But there's an objective function you can go and measure and say this is what we landed on that we can go measure and and then we can try to break apart why was it fix it >> exactly the wrong goal. access I think is very important too. Like I still to this day we have we're coming up on 2,000 people to firms before any offer goes out. Kareem reviews the profile. Colin refuse profile. I review the profile. and so in in some sense, one, I can look someone in the eye the first week when I meet them and say, "You're here because I wanted you here."
27:49 >> two, other people can understand what we're looking for. And three, I do meet people in the first week. you know, every single person. and I think why does it feel different to people and that they can move fast is we met we spent time they get to ask me questions we worked on things a bit together and so the next first time they encounter a real problem it doesn't feel so strange to come to a leader of the company and say like we need to fix this we need to make this better.
28:14 >> So we have a lot of CEOs who listen to the show and so ask a couple more questions on this along these lines. >> So for these small teams do they like make a deck about what they're going to do? Do they have metrics ahead of time like like how do you manage them like a startup or or like how and and then do you have people who are managing multiple of these teams for you above those people or how does that work because you have if you have 2,000 people or whatnot. Yeah, >> that'd be a lot of small teams right now.
28:37 >> It's a lot of small teams. >> So tell us more. >> So one there's different phases. Well, there's different maybe to simplify the framework. There's some organizations that are focused on building things and there's some which are focused on like selling and sort of running the playbook and there's slightly different strategies they take for each. still adhere to the philosophy of like small teams. You can have large organizations but very small teams.
29:07 >> inside of the builder organizations you get these sub questions of all right we've got lots of people I think the majority of our research and development teams engineers designers product managers are working on products that have not yet been released. >> Yep. they are gold on something closer to finding product market fit, understanding what are problems that people have, orienting and trying to understand a problem deeply to starting to go and develop something that people actually use, get value of, would want to use and starting to show these signs of people use it, they would actually be terribly sad if the product were to go away.
29:45 >> and you could start to go and tell find more customers like this who would go and try to adopt it. And so a lot of that is more oriented like put a bunch of people in a room, give them some goals, leave them alone, you know, for a year. >> So it's like having dozens of startups basically within the company. >> That's right. And as you get through certain gates, you can go and allocate more resources. you can share it with more people. But there's a certain practice around actually finding product market fit which is more around utility co-building with customers and starting to see more usage metrics later when you've gone from this zero to one you know and you have to go from there's people who like it to how do we go from 1 to 10 and start to scale it.
30:27 It becomes much more oriented around scaling. There's both metrics of growth of the product. Maybe there's a single metric we're trying to grow 10% per week or 20% per month, whatever it is. And you could pick is it purchase volume on it. is it funds under management? Maybe it's time saved. It depends. You know, receipts automated depends where you are in this. >> And you also pick some counter metrics as well. you know, you want to be looking at, you can keep building new products that do this, but if user satisfaction drops below a certain level, if the lag and suddenly everything gets slow, the load, you cannot build new things until you fix this. And so it keeps people kind of oriented on it. And then once you've set this output metrics, what we engage in doing very heavily is looking at inputs.
31:13 what are the activities that lead to better outcomes? for engineers it's like how many things did we ship? How many customers did we talk to? you know for sales development people it's similar. It's like actually like the way you you train to win a Super Bowl you know is not by showing up for practice and you say like >> you know okay team we're going to go practice to win the Super Bowl today. Like no one has any idea. And yet people in business do this all the time.
31:40 They're like you have to grow revenue by 30%. Instead what you actually orient people on is like today we're going to lift weights. Tomorrow we're going to run sprints. the next day we're going to go run this play over >> all the submetrics and goals they have to for each each part. >> That's right. And so a lot more of the one to 10 10 to 100 kind of goals are really oriented around understanding what inputs lead to the outputs and how do we get better at running these plays.
32:01 and so and also maybe just as a meta point actually breaking things down make the problems become more tractable. Sometimes when you get these really large organizations, not only is it not clear who's making decisions, but you can miss actually in the details, there's all these interesting sub questions of how should you organize, what should you build, where is the bottleneck and so kind of at every level, we prefer small teams. And I think that works well as long as you have really good telemetry so you can identify problems where you're not in the room and see things. And then two I think that a lot that becomes very important there is just review like reducing overhead costs coordination costs become even more important and I I think AI is I think one of the best opportunities ever not just for small but frankly I think if large companies get their act together this might be the best thing to ever happen to them.
32:59 the coast coordination costs is interesting on these these things the formula right totally study these things so let's let's let's step back a couple other points I want to hit while we have you >> ramp is a real-time map of the American economy I think it's super interesting you guys actually have an economics function >> based on this it's called ramp economics lab tell us about this >> well anyone can see this it's ramp.com/data this came together because look if you step back consumers actually there's like a lot of data to understand things right you can go to Amazon and or Google and you can search prices for almost anything in the world.
33:32 >> you can compare Uber versus Lift. You can go on Zillow and even get a real-time estimate of what is your home cost. And for most businesses, they're flying blind. You know, they don't know what the startup down the street paid for Salesforce or what discount they've negotiated with these labs. And we said, what if you could actually arm the rebels a little bit? What if you can actually go and share some of this aggregate information? So a regular business can say, "How is my price on this random piece of software compared to the rest?"
34:02 >> I love it. So you're learning from the economy, but you're also measuring things. For example, our friend Kevin Walsh is a chairman of the Federal Reserve. He has a lot of people who work from there. He's going to try to measure productivity. It's obviously critical for the economy, but you guys are able to see productivity in different ways, too. What are you learning about productivity and AI? So, we have one of the most interesting data sets I think out there. In part because one of the backbones of the American economy is what's happening in small, midsize, and scale businesses. And often it takes a long time for whether it's the Federal Reserve or the Bureau of Labor Statistics to actually get stats.
34:37 and often what they're doing is trying to go and maybe you'll ask people a question. For example, if you were to look a year and a half ago, there were stats coming out from I believe it was the census asking about AI adoption and they would ask people you know, do you use AI? Do you pay for AI in your business? And I think early last year about 5% of businesses according to their data said that they did. and I think today those stats are closer to 20% something like that.
35:07 >> Mhm. we have data to go and look and see who actually pays for it. you know, who's paying for OpenAI, who's paying for Enthropic, is it one license, is it lots of licenses, which model, how deep is that usage? how does that level of intensity and spend go? And so, one, it turns out we're able to get a much higher fidelity view into about you know, 1% of all corporate payments today are flowing through ramp. And so you can actually really understand in depth at statistical significance who's spending on what and actually how is adoption by the way it turns out adoption is a lot higher.
35:45 >> I always wonder why like JP Morgan Chase with their Chase cards because this is like before you existed didn't just run like a long short hedge fund or something. Is that legal? Are they allowed to do that? Are you allowed to do that? Is like are we not supposed to do that? How how does that work? >> It's it's an interest I I can't say they thought about it too deeply. you know, we we'll try to get deeper.
36:05 What what what would I say? I think there are interesting areas where it can break. Like I I remember reading this case like it happened at Capital One where there were some analysts trading on Chipotle data, credit card data. >> Is that the inside information? Probably you probably shouldn't do that. >> I think they went to jail, but I don't know if they went to jail for trading on it or if it was because they had like signed contracts saying they wouldn't.
36:28 so >> it's always unclear, you know, back in the day, back when Reed Hoffman and Peter Teal were friends like 2004 or so, I was working with Peter, we kind of getting Palenter started by helping with a hedge fund >> and Reed gave like us like a feed to LinkedIn and and and and I don't remember if we traded on it or not, but we definitely built a back test strategy using just even the data at that time was very clear. It was very profitable if you had the data. I know we turned it off at some point, so I don't know if anyone ever made any money on it, but it's interesting to me on these things, I guess. But but I guess you're educating people, you're helping people, you're not as focused on on monetizing it.
37:00 >> What I tell you is like we do not sell any of this data. and that's been super important is because like part of our like at the end of the day, >> we're selling like that you can right, you can trust us to help you run a better business. that we're going to do right by your information. And frankly, we're doing it to help you. So when we put data out, it is published at the same time for everybody to go look at to see and understand. And frankly, we're trying to democratize just as you know, I think the costs of consumer goods have gone down once people have better information. I think Amazon's been an amazing Walmart been an amazing force for that.
37:38 home tradings have gotten more efficient with Zillow. I think we want to do this for business data and help people understand what's happening in AI, you know. And as for things you can do with it, like you're totally right. Like I think one of the subtle ways people don't think about is like part of why accounting is so much easier for clients running on ramp is it might be your first time reconciling a particular vendor. It might be your 100 millionth time reconciling that particular vendor.
38:02 And so when the next person goes and joins ramp well their books are even more complete in an automated way and more accurate. It's like, well, well, that's interesting because you use in the old days you'd have like double bookkeeping where you do both sides, but now it's like a triple bookkeeping thing, I guess, too, where you can probably automatically figure something out. Although, would there be issues there with fraud or with like stopping fraud, I guess, too? Because if one side is keeping books differently, I guess it's not your job to look for those things because right because it be like, what if one side's saying they're making this much money and the other side's saying they're not paying it and you're on both? Like, are you is that something you flag?
38:34 >> Well, I think a lot of there's this question of like where does accounting fraud arise from? And I think a lot of it arises from a lack of fidelity in data >> where you can actually have these journal entries. >> Yeah. It's it's harder to do that if the data is clearly like wait a second that's not what the data says. Yeah. >> 100%. And if you actually can go down to like who approved this, what department, what location.
38:59 >> it makes fraud a lot harder. So if someone's using you guys, it just really is a lot harder. That makes sense. That's that's a positive outcome as well. I think most people don't want fraud in their business. That's very good. Speaking of fraud in business, I want to ask you about government. Yes. So, not to I know this is a nonpartisan company that does things for everyone as it should and the government manages trillions of dollars. Some of us believe there may be a lot of fraud there. I don't know. it's like it's a big debate. but could ramp help modernize government procurement? Could it make government more efficient? Is it doing any of these things?
39:30 >> Yes. You know, there are thousands of cities, of states, tourism boards, power authorities, folks around the countries that are, using RAMP, to run better organizations, institutions, reduce their spend, to make it easier to audit. So, >> it's like government. >> Yes. >> I love it. >> And it was it wasn't something we had started intended, but it the scale of it is immense. I think it's something like one in six Americans who work work for the government. You know, could be teachers, could be policemen and women, firemen and women. Like there's a lot of facets to it, but it sort of found us as we were scaling. And when I think about whether it's waste or fraud or any of it, a lot of it starts from a lack of visibility. you know, people, you know, good intentions I I I think, but only have a piece of the puzzle. and you know are asked to do horribly bureaucratic things. You have one systems for cards, another for expenses, another for audit, another for reconciliation, another for payment.
40:34 Like it's just a super mess. And part of I think why we help is you just bring all these silly tools under one roof and you get the whole picture. And then you can start to go and ask the more interesting question of like, should there really be anybody whose full-time job is to go and take receipts and attach it to a transaction or should that just be a machine? You know, you've got all these people like I I think like like what a shame. You have people who are like trained in finance and accounting, can do deep levels of math, are interested in these deep questions of how do we allocate capital? How do we go and make the city better? you know, how do we put funds in the right places? Instead, they've been reduced to I I don't know. I I don't want to say like like a some form of a weird receipt bean counter. and like I for me I think about this problem as like the trillion dollar back office. like there's probably a like a trillion dollars of of work towards jobs >> that I think are beneath people's potential.
41:42 >> Yeah, I love you describe that. What AI is doing in this case is it's elevating them from a being counter to someone who's making more high level decisions, who's using concepts to do their job as opposed to just like filling out something that's waste of their time. >> Why do people associate waste or or frauds with with government? And I think some of this is like the organizations are really big. It's very the coordination costs the you know co theorem of of these large organizations is simply they're very large and and the cost of doing business is high. And I think that the immense potential of of AI and and tools like ramp that make it easy to get visibility and to take action and do the right things is that coordination cost goes down. and I think that for organizations willing to redesign and say you know actually how do I go and repurpose people instead of from this low value work to things that are more interesting. I think there's so much that can be built and unlocked from small from, you know, actually get people out in the field actually doing better work and more interesting types of service. Speaking of potential waste, fraud and being counters and lack of visibility, one day I hope you guys go into the Pentagon and because I we haven't been able to audit the Pentagon in decades successfully, which is ridiculous to me. So, if I if they ever put me in charge of it, I'll first have to divest unfortunately for many shares I own in your company and then I'm going to insist you come and fix it. I mean, this is crazy. They haven't fixed this stuff yet.
43:03 >> It is. And the scale of it is in I mean this is all public record. I was looking I think the Department of Defense spends on the order of 10 to 12 billion a year just on cards. A lot more in procurement. I think I think you're right. It it's something like five or six of the past audits have been failed. >> which I don't think any private business could do that. >> Let's let's audent. There should be something that like every political side wants to do except for maybe the political side that's like making money off that. Maybe there's some part of some both sides that are bad and part of both sides that are good. Right? So we got to got to go in and fix that.
43:36 >> I think so. >> so speaking of elevating people's jobs, I want to ask you started the show to push back against nihilism and cynicism and black pilling. This is this is American optimist. I'm very optimistic about the future. It sounds like you're very optimistic about where I taking people to. What what what gives you optimism from what you're seeing at RAM, what you're seeing with AI. Like what makes you feel good about where America's going? I just think a little bit about like I like recently I was trying to go and spend some time like learning about like grandparents, great-grandparents, like more history and if you go far enough back and you can really trace it probably for most people listening to the show like a great great great grandparent what did they do? They probably were a farmer.
44:16 you know half the people I think in the 1900 census or 40% something worked in agriculture really low-level work and you know I was I was going through the thought experiment of like could I explain what is it that we're doing with our life or our day like I think even you know we we're kind of touching on this a little bit but like imagine that conversation is like well I'm going to go and get in a a metal tube go underground go up town and someone else who was in a metal tube from across the country flew here and we're going to go have a conversation and then we're going to go back and once we're done we're going to go in front of this thing.
44:54 There used to be sand then we made it really hot and then we put some electricity. I'll explain what that is soon you know to you and then we see some images and we think and then we go home. It's crazy like just the change and this is not that far back of how different lives are and you know how much you know poverty has been eliminated how much longer and healthier lives people actually lived how much more entertained fulfilled like it's amazing I think the changes that have occurred and not that far and that's a few hundred years and a lot of this is you know industrial revolution computer revolution all that I think about AI it's really hard to contemplate and it's sometimes hard for people not deep in to relate, but you know, we used these systems four years ago and as we touched on it, like GPT3 could not do arithmetic. If you asked it how many Rs are in strawberry, it would get it wrong consistently, you know, and and and what does it really mean that in a 4-year time period, you have computers that >> can do math, which again is much more of a reduced search space and maybe different than our type of task, but within four years, it can solve math problems that no human over the past 200 years was able to solve despite people working on this. like this is amazing.
46:13 This is unfathomable in many ways. And I I think about, you know, there's still so much like human misery in this world. Like I I think that there's so many diseases that people die from where there is no cure. there's still so many people who die from car accidents from things that could be solved. and I think that if you can go and use these advancements to, you know, of course, not just make businesses more productive and have more resources, but actually try to go solve some of these diseases, to actually go and, work on more hard problems. It's hard for me to imagine that the world doesn't get a lot at minimum more interesting, but hopefully a lot better. Like there's these questions of like, are we ready for it? you know, what is it like when you know, I think part of I think an underdis discussed part of why it's a little bit strange and scary if you're working at an AI lab is in that four-year period of a time, you go from machines that, you know, maybe have the IQ of a small animal to something I guess in certain tasks beyond what researchers could do.
47:34 and so I think it's hard to kind of think about, you know, this identity you had as a researcher or if you were kind of maybe our our ancestors a long time ago, they got by because they could lift heavy things or you know Exactly. That was the thing to in the last hundred years, you know, you had your big brain and you were smart. >> I'm still mostly lifting heavy things over here. >> That's right. You lift strong, Joe.
47:59 Better than ever. no it's there is this identity thing where there's a lot of people working on this stuff where their whole identity was they were the smart one and that was special and that was how they got ahead and if they're successful being the smart one won't be special actually intelligence will be free so so there's these interesting questions of how do people cope with that at the same time when you kind of look at what most people in the world are solving for of being able to have good nutrition, shelter, spend times with friends, to see more of the the world, to live a better life, to enjoy abundance. I think AI can be an incredible tool to achieve all of these things.
48:45 >> Well, you're definitely teaching a lot of us, Eric, just watching you how to achieve outcomes, how to raise productivity. If we do achieve too many positive outcomes, and we all have to have existential crises about who we are, that that will be a new challenge for us. But I think this is a very positive direction we're going. But thank you very much. >> I think so too. Thanks, Joe.
Summary
- RAMP has achieved a revenue run rate of over $2 billion, growing at over 100% annually.
- The company focuses on helping businesses cut expenses by 7-12% per year through improved financial management.
- Lyman emphasizes the importance of aligning company incentives with customer needs to foster better outcomes.
- RAMP operates with small, agile teams to maintain efficiency and innovation as the company scales.
- The firm is expanding into various sectors, including agriculture, healthcare, and government, aiming to modernize financial processes.
- RAMP's Economics Lab provides insights into business spending and productivity, offering a real-time view of the economy.
- Lyman believes AI can elevate workers from mundane tasks to more strategic roles, enhancing overall productivity.
- The company is committed to transparency and democratizing access to financial data for businesses.
Questions Answered
What is the current state of investment in AI and its implications for productivity?
Investment in AI has surged from approximately $30 billion to between $150 and $170 billion annually, representing about 2% of all white-collar wages. This rapid growth indicates a significant shift in how businesses are leveraging AI for productivity.
How can AI contribute to a company's competitive edge?
AI enables companies to solve narrow problems efficiently, such as automating receipt matching and transaction categorization, which can significantly reduce time and costs. This capability allows firms to become more competitive in the market.
What challenges do businesses face in managing AI-related expenditures?
Managing AI spending is complex due to its rapid growth and the difficulty in predicting costs associated with AI services. Unlike traditional spending categories, AI expenditures require new frameworks for assessment and management.
What is the process for achieving product-market fit in a company?
Achieving product-market fit involves deeply understanding customer problems and developing solutions that provide real value. This process often requires experimentation and iteration, akin to running multiple startups within a company.
Can AI solutions like Ramp improve government efficiency?
Yes, Ramp is being utilized by various government entities to enhance efficiency, reduce spending, and improve auditing processes. By consolidating tools and providing better visibility, Ramp addresses issues of waste and fraud in government procurement.