Salesforce debuts gen AI benchmark for CRM [Video]

The software company’s new generative AI evaluation tool for CRM will help businesses choose the best LLM for a given job.

Credit: Magdalena Petrova

Salesforce today announced a first-of-its-kind gen AI benchmark for CRM, which aims to help businesses make more informed decisions when choosing large language models (LLMs) for use with business applications.

“Customers don’t just want the best model,” explains Clara Shih, CEO of Salesforce AI. “They want to make sure it’s the best model that’s compliant, fits their security standards, and doesn’t break the bank.”

For businesses, Shih says, choosing an LLM for a business application is a constrained optimization problem as they balance cost, accuracy, trust and safety, and speed.

“Cost and performance optimization means you’re not going to use one model for everything,” she says. “Because cost is an issue, there’s a need to route the right work to the right model.”

Enter the new gen AI benchmark. …