In the News

“The high cost of computing power, cloud services and proprietary tools is inhibiting the democratisation of AI today. But we know and believe with Kompact AI, this will change".

It's really, a privilege for me to be part of this, ceremony, you know, to talk about the rise of cost-effective AI unlocking exponential Opportunities. The key thing that I'd like to share with you, which I believe someone also mentioned, is that we stand at a pivotal moment. For years, AI's potential has been talked about but often accompanied, by concerns about high cost and complex implementation. But now the landscape is shifting, especially with the introduction of Kompact AI. We're entering an era where AI will become increasingly cost-effective, and this evolution is unlocking truly exponential opportunities. So let's talk about some relevant issues here. First, efficiency and optimization will be driven across different industries. Cost-effective AI has the ability to revolutionize industries. We know in manufacturing, it can optimize supply chains, and it can enable predictive maintenance, drastically reducing waste and downtime. Healthcare is another example where we have cost-effective AI accelerating things like drug discovery and personalized treatment that will lead to better outcomes at lower cost. In finance, I was at HSBC for well over 16 years. When we talk about detecting fraud and automating customer service and improving efficiency, that's another example where we can see the use of cost-effective AI. Secondly, another point, we're seeing democratization of AI. The high cost of computing power, cloud services and proprietary tools are inhibiting the democratization of AI today. Advanced AI development, as we see it, has remained largely with the top and the, the big tech giants. And this has prevented startups and small enterprises from fully leveraging its potential. This limits innovation and slows the development of diverse application. But we know with Kompact AI, this can change and will change. Another third point is bottlenecks to wider adoption that we see. AI models, as we all know, and as shared by several speakers today, rely heavily on GPUs. They're powerful, but they're expensive resources, which not only costly, but they're also limited in availability. So this makes scaling AI solutions a significant challenge. When we run these advanced models on CPUs, they will lead to performance bottlenecks, making real time or large-scale deployment nearly impossible. Techniques like, you know, that we know about, like quantization and distillation help reduce the computational load. But what usually happens is accuracy often takes a hit, making these solutions far from ideal. This poses a major problem. AI remains out of reach of many researchers, developers, and institutions. And this goes to the digital divide, that was talked about earlier on, especially those without access to elite infrastructure. But the increase in cost-effectiveness will help address all these problems, and that's where Kompact AI comes in. We believe that Kompact AI can help solve these problems. Kompact AI for us, and, you know, spending time with Hrishikesh and his team, is the first infrastructure product in the global market to unlock true value of AI on CPUs. Already we know the platform supports 17 foundational models, with plans to support over 100,later on this year. AI models will be available across thousands of data centers worldwide as a result of developers no longer having to wait for limited GPU resources. With this comparable speed of inference as expensive GPU chips, we believe Kompact AI's platform makes development for next generation AI applications faster, it will be cheaper, and highly accessible. This, will definitely foster a wave of innovation, driving new applications we haven't even imagined yet. So to bring it to a conclusion, breaking open cost-effective AI is not a future possibility, it's our present reality that must happen. And it's a welcome development to see IIT Madras and Kompact AI making this a reality. We now have a unique opportunity to shape the future, to drive the responsible and widespread adoption of AI that will benefit all some of these industries I mentioned and much more. But not just the industries, but society as a whole. So I encourage all of us, let us embrace this challenge and unlock the exponential opportunities that lie ahead. Thank you so much for letting me share these words with you.

Read Full  Transcript
Read Less Transcript
Ex-MD and Head, Strategic Innovation Investments at HSBC. Founder, OatCapital