After Rippling blew millions on AI in months, it built an employee ROI tool
HR software provider Rippling unveiled AI Spend Console, an anti-tokenmaxxing product that helps companies track and contain their AI spending. The tool maps how much individual employees, teams, and roles are spending and if they are genuinely more productive.
Intelligence analysis by Llama
Rippling's AI Spend Console helps companies track and contain their AI spending by mapping individual employee, team, and role spending. The tool was born after Rippling went all in on tokenmaxxing and discovered employees were wildly burning cash.
Imagine you have a magic tool that helps you use AI without breaking the bank. That's what Rippling's AI Spend Console is. It helps companies track and contain their AI spending by mapping individual employee, team, and role spending. This way, companies can make sure they're getting the most out of their AI investment and not wasting money.
Analysis
The Birth of AI Spend Console
Rippling's journey with AI Spend Console began when the company went all in on tokenmaxxing at the start of the year. As a result, employees were wildly burning cash, with some engineers spending up to $50,000 a month. The company's CFO, Adam Swiecicki, presented a shocking number to the executive team in March, revealing that Rippling was on track to burn 40% of its R&D headcount budget on AI tokens. This was a wake-up call for the company, and they immediately undertook an urgent project to understand the spending and what they were getting for that money.
The Problem with Tokenmaxxing
Tokenmaxxing, a practice where companies use AI tokens to pay for AI services, has been a common problem for many companies. The issue is that AI providers, such as Anthropic and OpenAI, have no incentives to help companies control their spend. They have every incentive for it to be a runaway expense, and that's exactly what they do. They don't provide great usage insight, and they don't collaborate with one another.
The Solution
Rippling's solution was to build its own AI gateway that routes prompts to the best, most cost-effective model for the task. This gateway is part of the AI Spend Console product, which produces dashboards that score attributes such as prompts per day combined with work output and spend. With this tool in place, Rippling was able to drop its token spend from 40% of its headcount budget to about 15%. But it didn't curtail AI usage. The company spent a peak of 605 billion tokens the month the CFO issued his warning, and internal usage hit 600 billion tokens again in July. However, the cost of July's token spend was 37% of the cost of April's token spend, which is a significant reduction.
The Future of AI Access
Rippling's experience with AI Spend Console highlights the importance of measuring productivity when it comes to AI access. If companies can't measure productivity, then all bets are off on any of this stuff being available to the broader employee base. As for the product, AI Spend Console is included for Rippling's HR subscribers, though there are additional AI usage-based costs. It can also be used by other companies that want to contain their AI spending and measure productivity.
Key points
- Rippling's AI Spend Console helps companies track and contain their AI spending by mapping individual employee, team, and role spending.
- The tool was born after Rippling went all in on tokenmaxxing and discovered employees were wildly burning cash.
- Rippling's solution was to build its own AI gateway that routes prompts to the best, most cost-effective model for the task.
- The company spent a peak of 605 billion tokens the month the CFO issued his warning, and internal usage hit 600 billion tokens again in July.
- The cost of July's token spend was 37% of the cost of April's token spend, which is a significant reduction.
Rippling's AI Spend Console has the potential to revolutionize the way companies use AI. By providing a tool that helps companies contain their AI spending and measure productivity, Rippling is making it possible for companies to use AI beyond engineering and make it accessible to a broader employee base. This could lead to increased productivity and efficiency across the company.
However, there are also risks associated with Rippling's AI Spend Console. For example, if companies become too reliant on the tool, they may not be able to adapt to changes in the market or new technologies. Additionally, the tool may not be effective in all cases, and companies may still struggle to contain their AI spending.
