Salesforce Nvidia Reasoning Model Changes Enterprise AI
The Salesforce Nvidia reasoning model called Koa is one of the biggest announcements from Salesforce this week at its giant Dreamforce tech conference. Koa is the company’s first reasoning model, built on Nvidia’s open-weight Nemotron model. The two companies worked together to post-train Koa to excel at sales, marketing, and customer-support-related tasks.
Koa is a shining example of how the enterprise world’s needs for AI are diverging from what the frontier labs are offering. Proprietary AI labs would rather have enterprises uploading files, code, prompts, and feedback directly into their models and agents, and spending millions to do so.
But with this model, Salesforce is offering its enterprise customers a very different value proposition.
What Salesforce Is Offering Enterprises
With Koa, Salesforce gives its enterprise customers:
An open-weight alternative to closed frontier models
A model trained to do specific work tasks rather than to solve impossible math problems
One that has not ingested any actual customer data and therefore cannot leak it to others
A model that helps reduce AI spending, since it uses fewer tokens to do the same work
One that can be automatically routed through an AI “gateway,” depending on the need
A model that follows all of a customer’s data requirements and security embedded within Salesforce
Koa will be provided as an alternative to the other models Salesforce offers in its Agentforce platform, where its customers build agents to handle rote tasks like answering customer service questions or scheduling appointments.
How Koa Fits Into Agentforce
“We’ve built many small task-specific language models, which are part of Agentforce’s portfolio,” Jayesh Govindarajan, EVP of Salesforce AI, told TechCrunch. “But reasoning has always been something that we’ve relied on the frontier model providers for. Until now.”
Before Koa, if an agent needed to reason through a long-running or multi-step task, those prompts would be routed to a frontier model like Claude or ChatGPT through Agentforce’s AI gateway. That gateway is the system that decides which model handles which request.
Why Salesforce Built Its Own Reasoning Model
“One of the reasons we hadn’t done this before, train our own enterprise-grade frontier model — we always wanted to — but the challenge has always been the lack of a pre-trained base model to start with,” Govindarajan said. “Until Nemotron came along, there was no sovereign American pre-trained model that was available, one, and two, that was state of the art, and, three, that had clear data provenance. We have no idea what Qwen trains on.”
That reference to Qwen points to the popular Chinese open-weight model produced by Alibaba. The lack of transparency around its training data made it unsuitable for enterprise use.
Training Without Customer Data
Post-training a model like this means taking it from a general-purpose system to one well-versed in sales and customer support knowledge. To do that, Salesforce and Nvidia did not use any actual data from Salesforce’s customers. Instead, they crafted synthetic data that mimicked customers’ patterns.
“We actually simulated a customer service environment with a persona customer service professional, including irate customers that call into the customer service center, all the way to a sales professional who’s trying to close a deal,” Govindarajan described.
This approach allows the Salesforce Nvidia reasoning model to be better at the work tasks Salesforce customers want an agent to do. It is also cheaper in terms of tokens burned than sending those same tasks to Claude or ChatGPT.
The Token Efficiency Advantage
With Nemotron, “we have a unique architecture for inference to be token efficient,” Kari Ann Briski, Nvidia’s VP of Generative AI Software for Enterprise, told TechCrunch. “It’s kind of the trifecta of things that you need to have: sovereign AI, time to first token, efficient reasoning, for the tokenomics of it all.”
That efficiency matters for enterprises watching their AI spending closely. A reasoning model that completes the same work with fewer tokens directly reduces operational costs.
Salesforce Isn’t Abandoning OpenAI or Anthropic
However, Salesforce isn’t exactly abandoning Anthropic or OpenAI. It just announced a partnership with Anthropic called Claudeforce that allows companies to use Claude as their AI interface, while their data remains in Salesforce’s system of records, secured by its infrastructure.
This dual approach suggests Salesforce sees value in offering choice. Enterprises can route tasks to the model that makes the most sense for each job, whether that is Koa for routine work or a frontier model for more complex reasoning.
Why This Matters for Enterprise AI
The Salesforce Nvidia reasoning model signals a broader shift in the industry. Enterprises increasingly want AI that understands their specific business context, respects their data governance requirements, and doesn’t require sending sensitive information to third-party model providers.
Koa addresses those concerns directly. It’s an open-weight model, trained on synthetic data, designed for specific business tasks, and deployed within Salesforce’s security perimeter. For companies that have been hesitant to adopt AI agents due to data privacy or cost concerns, that combination could be compelling.
The announcement also highlights Nvidia’s growing role beyond hardware. By providing Nemotron as a pre-trained base, Nvidia enables companies like Salesforce to build specialized models without starting from scratch. That capability could reshape how enterprise AI develops in the years ahead.
