Persistent Systems announced the launch of GenAI Hub, an innovative platform designed to accelerate the creation and deployment of Generative AI (GenAI) applications within enterprises. This platform seamlessly integrates with an organisation’s existing infrastructure, applications, and data, enabling the rapid development of tailored, industry specific GenAI solutions. GenAI Hub supports the adoption of GenAI across various Large Language Models (LLMs) and clouds, without provider lock-in.
To effectively leverage the potential of GenAI and translate ideas into tangible business outcomes, enterprises must seamlessly integrate it into their existing systems. With a wide array of AI models ranging from extensive to specialised, clients require a robust platform like the GenAI Hub. This platform simplifies the development and management of multiple GenAI models, expediting market readiness through pre-built software components, all while upholding responsible AI principles.
The GenAI Hub is comprised of five major components:
Playground is a no-code tool for domain experts to explore and apply GenAI with LLMs on enterprise data without the need for programming skills. It provides a single uniform interface to LLMs from private providers like Azure OpenAI, AWS Bedrock, and Google Gemini, and open models from Hugging Face like LLaMA2 and Mistral.
Agents framework provides a versatile architecture for GenAI application development, leveraging libraries like LangChain and LlamaIndex for innovative solutions, including Retrieval Augmented Generation (RAG).
Evaluation framework uses an “AI to validate AI” approach and can auto-generate ground-truth questions to be verified by a human-in-the-loop. It employs metrics to track application performance and measures any drift and bias that can be addressed.
Gateway serves as a router across LLMs, enabling application compatibility and improving the management of service priorities and load balancing. It also offers detailed insights into token consumption and associated costs.
Custom model pipelines facilitate the creation and integration of bespoke LLMs and Small Language Models (SLMs) into the GenAI ecosystem, supporting a streamlined process for data preparation and model fine-tuning suitable for both cloud and on-premises deployments.
The GenAI Hub streamlines the development of use cases for enterprises, offering step-by-step guidance and seamless integration of data in LLMs, enabling the rapid creation of efficient and secure GenAI solutions at scale, whether for end users, customers, or employees.
Praveen Bhadada, Global Business Head – AI, Persistent, said, “At Persistent, we have always stayed ahead of the curve to capitalise on the latest industry technology trends, and now we’re reaching new frontiers in GenAI to solve critical enterprise challenges and turbocharge client growth. With the Persistent GenAI Hub, clients can embrace a “GenAI-First” strategy, delivering AI-powered applications and services at scale. They can accelerate innovation while practising responsible AI, leveraging pre-built accelerators and evaluation frameworks, and optimising costs with a cross-LLM strategy. The GenAI Hub enables enterprises to streamline operations, enhance customer experiences, and identify new avenues for growth.”
Mark Troller, CIO, Tangoe, said, “Tangoe has been leading the industry in automation for more than a decade, and with Persistent’s expertise and support, we have developed a secure generative AI chatbot that empowers employees to drive higher efficiency in their daily work. This collaboration has not only opened new doors for innovation but also sharpened our competitive edge. We’ve seen strong early adoption from our employees and look forward to building more advanced capabilities using this emerging technology.”
Thomas Reuner, Executive Research Leader and Head of EMEA, HFS Research, said, “We are seeing a shift in the market as organisations look to scale out their GenAI deployments. A pause of reflection often follows this shift as they encounter new deployment challenges and risks. Persistent’s GenAI Hub provides both an evaluation framework to validate the AI approach and a comprehensive set of capabilities to accelerate the time to value to help organisations navigate those challenges.”
