EY says its 'invisible' AI router has helped cut token consumption by up to 60%
EY has implemented an 'invisible' AI router to manage token consumption by directing employee queries to the most cost-effective AI model for specific tasks. This strategy has reduced token usage by up to 60% in some divisions as companies look to control rising AI operational costs.
Why it matters
As AI adoption grows, managing the high costs of token-based pricing models is becoming a major financial priority for large enterprises.
Bloomberg/Getty Images The Big Four firm EY has built an "invisible" router into its AI tools to help manage its token spend. The router redirects employees to the right AI tool for their task, said Dan Diasio, the firm's global consulting AI leader. It's cut token consumption in some divisions by 60%, he said. EY does not let every employee query go straight to the smartest AI model in the room. The Big Four firm has introduced an "invisible" router to help manage its internal AI spending, Dan Diasio, EY's global consulting AI leader, told Business Insider. Rolled out globally in April, the router sits behind some of EY's specialized AI tools and acts as an intermediary to direct employees towards the best AI model for the task at hand. "To the users, it makes no apparent change," said Diasio.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in