Your AI Isn't the Advantage. Your Judgment Is - Sid Pednekar

0:12 >> Good afternoon everyone present here. It's It's been a It's been a great day and an absolute pleasure to be here. The topic of my talk today is everyone has AI who has the advantage? I'll be talking about what the orgs that are doing that are leading in AI with the implementation and adoption what are they doing differently?

0:43 And so before that who am I and what's my POV? So, I'm Dr. Sid Patnekar. I am an AI technology and data exec in asset management. I've spent most of my tenure in hedge funds and investment and academic research. what I've done and focused on is lead strategy and build specialized teams towards three main verticals, optimizing efficiency driving P&L and reducing costs.

1:19 So, I'll be following the discussion along with two hypothetical companies, company A and company B right at the slider below. these are hypothetical, you know, with with made-up workflows, but we'll be following their journey along the rest of this presentation. So everyone has AI, who has the advantage? before we get started there, first let's see what the lay of the land is and recent studies have shown that only about 37% of enterprises that surveyed are showing a positive contribution to their EBIT.

2:06 And only about 6% of those would be qualified as high performers. So, that's about 5% contribution to their EBIT. Other studies earlier in the year have shown that about 66% are saying they're having a productivity increase, but only about 40 and 20% are actually seeing cost reductions and revenue growth. So, as we know, access of AI is widespread, yet the impact remains uneven.

2:40 So, >> >> the question I would ask, or how I think about this, is really in terms of three verticals. And the way I think about these three verticals should apply to organizations and individuals alike, and it should apply to functions regardless of where you are in that organization. So, the three main vertical pillars that I think of are number one, design the right problem.

3:15 Number two, build shared capabilities. And number three, compound the advantage. Now, before we dive into each of these pillars, there is an idea that I think goes through all these verticals. And I think the best leading firms are taking advantage of that and capitalizing on it. As we know, throughout time, the only constant in this world has been change. What's different in the AI and superintelligence era is that intelligence has become cheap.

3:52 Regardless of what your unit of intelligence is, whether it be software, analytics, recommendations, reports, AI is creating an abundance in all of it. And as we know, more answers don't necessarily create more value. So, what is scarce? What is a scarce resource in an abundant world? What what are companies taking advantage of, the leaders at least?

4:22 It's judgment. What is judgment? Judgment is choosing what matters and how to act when there's no single obvious answer. It's the creativity that lets you explore what possibilities are worth exploring. It's the taste that tells you what good looks like in your given context. It's the decisions where you can weigh what trade-offs are worth making. Judgment is ubiquitous. It exists throughout your organization.

4:54 On a daily basis, your C-suite The C-suite is asking questions, taking advantage of judgment judgment all the time. So are the software engineers, the AI leaders, the portfolio managers, and the data scientists. So, the question that they're focused on is given judgment is a finite asset, a limited capacity, the main question becomes where is our best judgment worth spending?

5:25 Like for you to hold on to that thought. With that, we'll dive into our first pillar. Design the right problem. So, questions a question that the leading organizations are asking all the time is they're obsessed over what is the right problem to solve? Right? It's tempting to start with the tool. Today we're surrounded with better models, harnesses. We're surrounded with all these AI tools. We're surrounded with co-pilots.

5:55 But that isn't the way about, is it? At least that's not the way the leaders are approaching it. Now, let's go back to our hypothetical two companies. Let's say they're from asset management. Let's say, we're tracking the workflow of two research analysts in these hypothetical, organizations. Well, let's say organization B starts with the tool, the co-pilot. They're asking, "Where can we add AI to the analyst work?" They're looking at the current existing process to say, "Earning transcript comes in.

6:31 I discovered a summarization workflow. Let me pass all of this in through my fire hose. Analysts get earning summaries faster. Win-win, right? Well, not so much, at least not compared to the guys who are leading. And such a workflow of of being a faster horse introduces one key, nuance. That is, you are losing context as you have information, I guess reduction as part of your summarization.

7:01 So, what What is the hypothetical organization A doing in this? Well, they're obsessed with the right problem to ask. They could be asking, "Why are our material signals reaching us too late? Where do we focus the attention, the AI, the bandwidth, the capability on? Where is our bottleneck, right?" And so, it becomes this redesigning of the workflow or at least the reevaluation on what to focus on. That's what they're doing different. Now, this consideration isn't particularly defined finance, it's across the the realm and function. You know, you're asking the same question on what to focus on, whether it be research capacity, decision speed, quality of your data, latency, reliability.

7:47 It it it traverses all of that. And studies show this. They show the leading studies, on average spend their attention on fewer, higher-quality decisions than the other cohort. So, leaders are being more selective in where they focus their attention and what they focus their attention. So, it's great. The leading companies have an idea of what the right problems are. Where do they go from there?

8:17 Well, they also concentrate their investments in the highest value workflows. I get it, and I've been I've been culpable of of something similar where, you know, AI is almost creating too many opportunities. And experimentation can be a good thing. but one needs to separate experimentation and the resulting innovation theater, or worse, the productivity theater, with actual value generation.

8:48 Going back to our two hypothetical companies, what does this mean? Company B is looking at how do we launch the most number of AI pilots? And what that ends up looking like is a document summarization bot here, a co-pilot there, a a data retrieval bot here. It's scattered all over the place. Whereas, what company A is focused on in their investments is potentially use cases like end-to-end workflows on the research on the research pipeline. They're focused on aligning engineering, analytics, AI capacity, and judgment towards a singular focus.

9:29 And research has shown that the leaders spend more than 80% of their investments on these high-value use cases. Transforming key business functions and creating new offerings. Perfect. We We know they're focusing on finding the right problem, and they're also spending deep investment in select workflows. Well, they're also doing something different.

9:59 They're reimagining how work is done. I think this is this is key. And it goes back to what we discussed previously, which is judgment. They're redefining and reorganizing functions, roles, capacities around this key element of judgement. What does that mean for our hypothetical company? Well, company B might be focused on as we discussed I'm getting my earnings transcript, I'm getting my research my research reports. How do I summarize it? Maybe I make that faster.

10:32 Maybe I update my financial models faster. Maybe I send my recommendation to my PM faster. Company A is focused on an entirely different ballgame. Hypothetically, they could be asking the analyst to define the investment thesis. And they're watching and gathering evidence that could refute that thesis or support it. They'd be monitoring continuously. They'd be investigating exceptions. And they could be deep diving on you know, select examples that could lead to actual generation of value.

11:09 So, the winners just don't just automate, they redesign. And studies show that the cohort of high performers are 75% more likely or in practice, they actually do redesign their workflow versus 25% of the cohort that doesn't. So, where does this leave us with our two hypothetical companies and designing the right problem? Company B adds AI to existing workflows. They're completing individual projects and then moving to the next initiative, whereas company A is rethinking how work is done.

11:43 They're redesigning processes around AI and they're obsessing of the the the right problem. That's that's the difference in how organizations put AI to work. Great. So, they've picked the right problem. What what happens next? Well, we all know in order to actually enable that capacity, you need to build shared capabilities across the org. And what's what's a trend that's seemingly emerging for for some time now is that the lines between technology and business are converging.

12:16 And we're seeing this everywhere. We're seeing engineers that are moving closer to business outcomes. We're seeing business professionals that are building tools and automations. And as you can see and imagine, you can have forward deployed engineers, you can have forward deployed product managers, but you could also have the inverse, which is forward deployed portfolio managers. And it's really this combination of getting the right people in the room by breaking down organization silos that the leaders are really leaning on.

12:50 Studies have shown that more and more of the large enterprises are viewing their technology arm as a business growth function. And that's creating an edge for these for these companies. So, the other sort of vertical inside building shared capabilities that is probably a personal favorite of mine. It's standardizing the core and personalizing the edges. And this is something that isn't new to the technology world. We've we've built infrastructure, we've built, you know, shared modules and system design. But what's interesting here today is that's taking a very different shape with the capabilities out there and with the org and the breaking down of silos.

13:34 And this could look very different depending on where you sit. You could be building shared cores for you know, a team that looks very different with analysts and and clients. You could be doing that with you know, a bunch of analysts or you can do be doing that for software engineers or data scientists. With the data scientist example in particular, that could look very interesting where instead of having one-off workflows that that is really common in the industry, you could build a shared core of the data sets, their semantic layers, the tradeoffs of what worked, what didn't, what you know, what what some data sets do good off, where are the gaps, and and so on and so forth, such that each new personnel becomes almost a plug-and-play module in the system where they can then stand on the shoulder of their predecessors.

14:31 So, what should the next person not have to rebuild? >> >> Now, what's also interesting is, you know, the enterprise wasn't really built for agents. agents, they they work across workflows and applications, they they take contacts, they deliberate, they take actions, whereas really the enterprises are focused, previously on single human or a collection of them interacting with the single application. So, the leaders are cognizant that something needs to change and that they need to modernize, their infrastructure, and they're very self-aware of where they are in their journey.

15:14 And so, studies show that, you know, 75 71% of the orgs are modernizing their core infrastructure to support AI. And, you know, 6 to 10% or 23% of them are investing 6 to 10% of their annual revenue in in core system modernization, to take advantage of this. And a common complaint here or a common challenge here is, you know, data quality and and the ability to reuse data. so, great. We, you know, we we have the right people in the room, we, have you know, we have the right knowledge there.

15:51 What is What do we do next? And then comes the concept of, "Hey, how do we make this knowledge reusable and accessible?" And that's where we have, you know, depending on on the adoption and where where they are, you can have different types of team agents, where you can have expert agents being subject matter experts, you can have workflow agents that work across streams like Slack bots that are creating and opening tickets, they're closing them, and what have you, and then you can have really chief of staff kind of agents that keep a tab on what the state of the organization is and what needs to be done.

16:26 So, you know, going back to our workflows, A again is looking at this very differently in terms of shared capabilities. >> >> Now, the last pillar here that I want to draw your attention to is well, when does this system really compound? What happens when it's deployed? Well, the leading companies, what they're doing is they're actually thinking about it slightly differently. What are failures that can give us an edge that we can learn from? If if there's a success, how do you make it part of the system?

17:00 And the way they think about this is, you know, the individual learned, but did the system? Is there a way perhaps, when they've encountered something where they need to make a correction, that that knowledge is fed back into the org, either through a new tool, a context, or or or what have you. And what's what's key here is preserving the evidence along with those learnings. So, really the last vertical here is AI frees capacity. Where does it go?

17:32 Being cognizant that you need to redesign your system and really focus it on key metrics that you're evaluating, you're monitoring, and you're creating a fly flywheel off. So, where does this leave us for companies A and B? You know, company A has their entire work redesigned. They're building capabilities that compound, and they have shared capabilities built. So, I want to leave you off with one final question.

18:02 Everyone has AI. Who has the advantage? Thank you. >>