Kompact AI is already enabling real-world applications and customers, building the software and ecosystem required to scale AI adoption

Ziroh Labs Launches Kompact AI to Power the Next Wave of Enterprise AI Workloads on CPU Infrastructure

 

From Left to Right  – Prof. S. Sadagopan, Founder Director, IIIT-Bangalore , Hrishikesh Dewan, Co-founder and CEO of Ziroh Labs ,Dr. Whitfield Diffie, pioneering cryptographer and recipient of the 2015 ACM A.M. Turing Award.

Bengaluru, Sept 07: Ziroh Labs, an AI and deeptech startup, has further pushed its limits on AI innovation extending the Kompact AI platform across different sectors and form factors, building the foundation for broader AI adoption.

Ziroh Labs’ CPU-first AI platform Kompact AI is designed for high-volume enterprise use cases where workload scale, I/O patterns and smaller AI models make efficient CPU-based inference a practical choice.

Enterprise AI is not one workload. Alongside large, compute-intensive models, organisations are deploying AI across thousands of operational workflows, from software testing and document processing to customer interactions, enterprise automation, cybersecurity and industry-specific applications. Many of these workloads rely on smaller models, process high volumes of data and transactions, and are shaped as much by I/O, latency and deployment scale as by raw compute requirements. Kompact AI is built for this part of the AI landscape: enabling efficient inference for enterprise workloads that can run effectively on CPU infrastructure. 

Hrishikesh Dewan, Co-founder and CEO of Ziroh Labs, said, “The next phase of AI adoption will require infrastructure that is accessible, efficient, and closer to the people and businesses using it. Our focus is to make AI more accessible by enabling organisations to run AI where it is needed, with greater control over cost, performance and data.” 

A Vision Rooted in Decentralised Computing

The launch will also feature Dr. Whitfield Diffie, pioneering cryptographer and recipient of the 2015 ACM A.M. Turing Award. Dr. Diffie has expressed strong support for Kompact AI’s approach to AI infrastructure, particularly its ability to bring AI capabilities to ubiquitous CPU infrastructure.

For Dr. Diffie, the significance goes beyond computing efficiency. His longstanding interest in decentralisation and the distribution of technological capability informs his view of how transformative technologies should evolve. He sees AI as one of the most powerful technologies developed since the World Wide Web, and believes its impact will be shaped in part by how broadly its capabilities can be distributed.

Commenting on Kompact AI, Dr. Diffie described the ability to run AI on ubiquitous CPUs as “one of the most exciting things I have seen in quite a number of years.” His perspective underscores a central idea behind Kompact AI: AI capability should be deployable across the broad base of computing infrastructure already available to organisations, rather than being limited to highly specialised environments.

Foraying into multiple sectors

Kompact AI is being built not simply as an AI runtime, but as an ecosystem for deploying and building practical AI applications.

The platform is being taken into multiple sectors through purpose-built Kompact AI Box solutions, packaged AI infrastructure designed around specific industry requirements. These solutions bring together AI models, inference capabilities to address practical use cases across areas including healthcare, education, retail, fintech and sovereign deployments.

Several partners are already evaluating or implementing their solutions on Kompact AI. These collaborations demonstrate how the platform can support AI workloads across very different software environments, from AI-powered software testing and quality engineering to intelligent enterprise applications and industry-specific workflows. Instead of asking every organisation to build its AI infrastructure from the ground up, Kompact AI is building deployable solutions around defined industry problems.

Taking AI Into the Classroom

Kompact AI’s ecosystem strategy extends beyond enterprises.

Ziroh Labs is working with academic institutions to establish Centres of Excellence (CoEs) focused on AI, giving students access to practical AI infrastructure and environments where they can experiment, build, and deploy AI applications. Kompact AI has the ability to make AI reachable to every educational centre, not just institutions with high budgets. Kompact AI provides a free academic license for every institution and its students.

These CoEs are intended to create a pipeline of developers, researchers, and entrepreneurs who can work with real AI infrastructure, explore new use cases and contribute to India’s growing AI ecosystem.

A Platform Built Around Increasing Accessibility

The larger vision behind Kompact AI is to widen the infrastructure layer on which AI can run. Organisations already have significant CPU infrastructure across data centres, enterprises, institutions, and edge environments. Kompact AI is designed to unlock that installed compute base for AI inference.

This has implications beyond infrastructure economics. Running AI closer to enterprise data and applications can support use cases where data locality, privacy, latency, infrastructure availability and predictable deployment costs are critical.

Ziroh Labs also partnered with academicians from reputed institutes such as IIT Guwahati to develop the Math Lab initiative. The charter of the Math Lab is first to identify whether the mathematics currently employed in large language models and state-space models constitutes numerical structures that can genuinely lead to general intelligence.

Ziroh Labs has collaborated with IIT Guwahati to develop a comprehensive 40+ hour course designed to democratise advanced AI and Large Language Model education for students, developers, researchers, and professionals worldwide. While the course is free for all learners, they would be required to pay for a certification by IIT-Guwahati.

The event also brought together prominent academic and industry voices, including Prof. S. Sadagopan, along with Sanjay Tyagi and Mahadesh, among other leaders from the technology and innovation ecosystem.

Prof. S. Sadagopan, Founder Director, IIIT-Bangalore said, “Sharing the stage with Turing award winner is such an honour. I congratulate Ziroh Labs for doing so much so soon…10+ partners, 100+ technical papers, 1,000+ models being released is incredible. Kompact AI is creating a huge ecosystem for deep tech. Frugal innovation and building energy-efficient AI for everyone is what excites me about the platform which is a timely development for India.”

Leave a Reply

Your email address will not be published. Required fields are marked *