Harvey Co-Founder Gabe Pereyra on the Token Pricing Reckoning Coming for AI
Sourcery
1 DAYS AGO
Harvey Co-Founder Gabe Pereyra on the Token Pricing Reckoning Coming for AI
Harvey Co-Founder Gabe Pereyra on the Token Pricing Reckoning Coming for AI

Sourcery
1 DAYS AGO
In this episode, the co-founder and President of Harvey, along with the Head of Applied Research, discuss the company's new Legal Agent Benchmark (LAB) and the evolving economics of AI in the legal field. They explore how Harvey is moving beyond simple chat interfaces to powerful, costly cloud agents and why a multi-model strategy is crucial for law firms.
Harvey has introduced the Legal Agent Benchmark (LAB) to measure AI agent performance on real-world legal tasks, such as contract review, comparing it to coding benchmarks like SWE-bench. The company advocates for a multi-model strategy in law firms to manage costs and risks, as different models excel at different tasks. Harvey is shifting from a chat-based co-pilot to cloud agents, leading to a dramatic increase in query costs, ranging from $20 to $20,000 due to higher token usage. Gabe Pereyra warns that token-based pricing will become expensive for customers, creating misaligned incentives, but believes market competition will correct pricing. The LAB benchmark, created using agent-led data generation with lawyer review, helps identify cost, latency, and practice area improvements, with predictions that it will be saturated within a year.
00:00
00:00
Harvey's Legal Agent Benchmark measures AI performance on real legal tasks.
05:44
05:44
Different AI models excel at different tasks
17:08
17:08
Queries can now cost $20 to $20,000
23:30
23:30
Token-based consumption will become very expensive for customers.
43:01
43:01
Moving from individual to organizational intelligence