Boost CX & Sales with Got It AI’s ‘Agent Copilot’ – with AI Models Including LLaMA-2, MosaicML, Flan-UL2 and ChatGPT with Hallucination Guard-railed Agent Assist

By quickly surfacing accurate answers and insights from complex knowledge base documents, Agent Copilot significantly improves sales and service agent KPIs, with Got It AI's unique platform featuring anti-hallucination guardrails around a proprietary or open source LLM

ELMAR Architecture
Diagram for Enterprise Large language Model ARchitecture

PALO ALTO, Calif., August 9, 2023 (Newswire.com) - Gartner's Cool Vendor in 2022 for Conversational AI, Got It AI unveiled Agent Copilot, an innovative conversational AI solution to transform customer service and sales operations with guard-railed generative AI. Designed to empower agents with quick and accurate answers from complex knowledge sources such as insurance plans, financial products or manufacturer catalogs, Agent Copilot is poised to significantly enhance customer interactions and response times. Agent Copilot uses TruthChecker AI, a feature designed to catch and avoid inaccuracies in responses generated by Large Language Models (LLMs).

Businesses can customize their Agent Copilot by choosing from a selection of LLMs including ChatGPT, GPT-4, LLaMA2, MosaicML, and FLAN-UL2. The choice of LLM can even be based on the business's specific knowledge base and the measured performance of the LLM against the documents in it. Agent Copilot can be configured with a variety of data sources including PDFs, web pages, documents, and presentations, enabling support of full multi-turn dialogs against the compiled knowledge base. Finally, for organizations with data privacy concerns, enterprise specific fine-tuned LLMs can be installed on-premises. Below are hallucination rates for an identical set of questions for the same set of documents for one of Got It AI's customers.

OpenAI GPT-4, > 175 B, 8.39%
OpenAI ChatGPT-3.5 Turbo, 175B or less, 13.99%
Google Flan-UL2, 20B, 14.08%
MosaicML, 30B, 30.07%
Meta LLaMA-2, 13B, 36.76%
Meta LLaMA-2, 70B, 25.45%
Got It AI LLM, Less than 1B, 8.45%

"Providing accurate information to the agent is crucial in customer service and sales operations. The risks associated with incorrect information are simply too high," said Peter Relan, Chairman of Got It AI. "With Agent Copilot, we offer businesses the opportunity to choose the most suitable LLM for their needs, including Got It AI's LLM, which matches GPT-4's in accuracy for the Agent Copilot task, ensuring the highest level of accuracy and efficiency in their customer interactions. Furthermore, with an additional guard rail called Got It AI's TruthChecker, hallucination rates of the base model can be decreased by 50% to 90% in responding to information Agent Copilot retrieves from a knowledge base. For our own LLM and OpenAI's LLMs, that level of fact checking leads to near human level accuracy."

Agent Copilot is based on Got It AI's recommended future proof architecture, Enterprise Large language Model Architecture (or ELMAR), and is currently being piloted through an open beta program with several enterprises for Agent Assist use cases. It will become available in September 2023 for general availability with the following features:

Knowledge Base connectors to custom data sources and documents (structured and semi-structured) including PDFs, Slide decks and Web pages
Choice of LLMs: FLAN UL-2, LLaMA2, MosaicML, ChatGPT, GPT-4
TruthChecker AI fine tuned for detecting hallucinations in multi-turn responses
Product UI or Microservice API for customer specific UIs
Fluid conversational dialog with hallucination detection, mitigation & disambiguation
Active learning, caching & fine tuning to achieve highest accuracy
On-prem deployment with Open Source LLMs
Integration into other Agent, CX and CRM solutions