Training Data

Box's Aaron Levie: On Reinventing Yourself in the AI Age and Enterprise Diffusion

· Summarized

Share this episode
Anyone with this link can open it.
Share Link
Start at 0:00

Key takeaways

  • The main AI opportunity is the application layer that connects model capability to specific enterprise workflows, data systems, permissions, legacy software, and human review.
  • Model-agnostic application companies can optimize tasks for cost and accuracy, while model providers may struggle to subsidize inference indefinitely as their training and infrastructure costs rise.
  • Box’s strongest AI use cases involve processing information at a scale humans could not afford, such as extracting data from a million contracts or running long-running customer-onboarding workflows.
  • AI-generated code is easier to accept than AI-generated business content because code is usually judged as a utility, while content is still treated as evidence of a person’s knowledge and judgment.
  • Enterprise systems of record need specialized agents that understand their own workflows and open interfaces that let external agents access their data and functionality.
  • Coding diffused quickly because it is highly text-based, technically measurable, economically valuable, and connected to GitHub; other knowledge work will require much more implementation, data cleanup, and change management.

Summary

The application layer is the bridge between models and enterprise work

Aaron Levie agrees that application companies are becoming the hottest part of the AI market. He says the gap between an LLM’s raw capability and an enterprise’s actual workflow is much larger than many researchers assume: agents still need access to other data systems, human-in-the-loop steps, delayed processes, legacy software, and business-process change management. That creates opportunities both for applied companies such as Box and for infrastructure providers serving them. Levie compares this moment with AWS, GCP, and Azure enabling companies such as Snowflake and Databricks, which cloud providers could not simply replace.

Why model providers may not capture all the value

Levie says model labs face a strategic tension: moving up the stack brings them closer to customers, but leaving room for an application ecosystem builds trust and distribution. A model-agnostic company can optimize each task for cost and accuracy without favoring the model it sells, while model providers may subsidize inference only temporarily. He expects costs per token to fall as competitors such as Nvidia, China, and other well-capitalized actors pursue different objectives. He doubts one or two labs will capture 95% of AI’s value, partly because excessive concentration could invite antitrust intervention or nationalization.

Box’s shift from cloud file storage to an AI agent platform

Levie explains that Box began by securely storing and sharing enterprise data in the cloud, then expanded into managing unstructured files such as contracts, research documents, financial records, and marketing assets. Box experimented with image classification, OCR, and other AI applications around 2015, but those systems were expensive and required a separate model for each workflow. The ChatGPT launch changed the company’s view of what was possible, prompting a company-wide pivot and the development of Box’s AI stack and Box Agent. Because Box sits on hundreds of billions of files, agents can search, extract metadata, answer questions, and automate workflows around information companies rarely had the labor to read.

From reading a million contracts to agents that run entire workflows

Levie identifies a straightforward “hero” use case: an enterprise can ask Box to inspect a million contracts or research documents, extract structured data, and make it searchable or usable in automated workflows. The more ambitious goal is a long-running agent that executes an entire process, such as onboarding a bank customer. Instead of a one- or two-week sequence of manual exchanges, the agent would automate every possible step and escalate only unusual cases for human review, potentially reducing the process to about an hour. Other examples include discovering research data and flagging security events faster.

Why AI-generated code is accepted while AI-generated content triggers distrust

Discussing “workslop,” Levie says code is treated largely as a utility: for most users, the goal is to automate something, so AI-generated code is preferable if it removes a bottleneck. Content is different because a presentation, memo, or strategy document is often used to judge whether someone understands a subject and can execute. Levie admits he now reads material twice—once for its substance and once to calculate whether the author wrote it. He compares the transition to using a calculator, but says the analogy is imperfect because AI may perform many tasks at once. He would not want to be a college professor deciding what students actually did.

Box’s harness beats raw model APIs on enterprise file work

Box built an agentic harness around its file system, permissions, search engine, and knowledge of how users select relevant documents. The harness can search repeatedly, rerank results, extract text or document chunks, generate embeddings, and decide when to read a full file. Levie says Box sees better accuracy and latency than simply sending the same task to Claude or an OpenAI API. Box evaluates hundreds of scenarios through its Complex Work Eval across areas such as life sciences, financial services, government, and technology, as well as a holdback evaluation based on how Box employees use their own data.

The model race is moving toward blended proprietary and open-weight systems

Levie says model performance on Box’s use cases generally tracks coding benchmarks, although Gemini is disproportionately strong in some knowledge-work and tool-use tasks. He describes the frontier race as close among several model families and says customers usually accept Box’s default model but sometimes evaluate multiple models for specific cost-and-accuracy requirements. Open-weight adoption is higher than many expect but lower than enterprises ultimately want; some of the current demand reflects the appeal of experimenting with new systems. Over time, mature workloads can be peeled off to cheaper open-weight models, while difficult tasks are escalated to expensive frontier models.

Continual learning must respect enterprise permissions

Levie is interested in systems that incorporate user or company context into model weights rather than retrieving everything through RAG, but he warns that enterprise access controls make this difficult. A researcher may have broad access, while a lawyer may be restricted to five projects and barred from seeing a competitor’s work. Users can also gain or lose access daily, changing the context a personalized model is allowed to use. He expects progress in continual learning and domain-specific models, especially in areas such as drug discovery, but says the right split between information stored in weights and information retrieved at runtime depends on how quickly the data changes and how much performance improves.

Systems of record need both specialized agents and open APIs

Levie says SaaS companies cannot choose between building an excellent agent for their own product and making their data accessible to outside agents: they need both. A specialized agent should be 10 or 20 percentage points better than a generic agent because it understands the product’s workflow and can uncover new use cases, such as an always-on governance agent warning an employee that a document violates retention or legal-hold policies. At the same time, systems of record must expose APIs or agents through tools such as MCP so Claude, ChatGPT, and other systems can use their data. He says users will pay for this value; he would pay much more for LinkedIn if he could query it through MCP.

Coding diffused quickly; enterprise knowledge work requires implementation

Levie attributes coding’s rapid AI adoption to several unusual advantages: code is text whose output directly creates software, labs benchmark themselves on coding, engineers can diagnose technical failures without waiting for IT, and even modest productivity gains are valuable in a highly paid field. Sales, by contrast, depends on customers responding, scheduling meetings, and having budget, so AI cannot remove those external constraints. Other knowledge-work domains also have fragmented data, legacy systems, and complicated permissions—there is no universal “give us your GitHub” connection. Levie therefore expects enterprise diffusion to take longer and says the applied companies that can implement AI and reach customers will capture a large share of the opportunity.

Staying wired in and making a decades-old company AI-first

Levie says Box was well positioned because it had spent 20 years organizing unstructured enterprise data, but the company still had to bet on AI and respond to customer demand. Box uses an AI center of excellence, internal AI-focused engineers, usage leaderboards, and demonstrations from employees who discover effective workflows; when one employee showed a team how he worked with AI, Box organized a training session within hours. Levie’s personal advice is to join Twitter and follow roughly 20 to 100 informed accounts, because a person’s feed can leave them a year ahead or behind. He says young founders have extraordinary leverage, but must combine fast building with enterprise distribution and trust.

Show notes

Starting a company is hard. Reinventing your company for AI as a public company with quarterly earnings results is even harder. Aaron Levie has pulled off the transition with Box and offers hard-won advice for founders. The cofounder and CEO of Box argues the value isn't only in the model; it's in the bridge from a model's raw capability to the actual workflow inside a bank, a law firm, or a pharma company. That's the case for the application layer, and Box is building it: an agent harness tuned so tightly to its own file system, permissions, and search that it beats handing the raw API to Claude or ChatGPT on both accuracy and latency. Aaron explains why token subsidies from the labs can't last, why you want a model-agnostic company routing your tokens rather than the one selling them, and why coding diffused fast while the rest of knowledge work won't. (There's no "give us your GitHub" for a sales rep.) His prediction: within five years, 90% of enterprise tokens go to work no human user ever initiated.

Hosted by Sonya Huang, Sequoia Capital

0:00 – Introduction

1:55 – Are application companies the hottest neolabs?

6:56 – Will the labs move up the stack?

12:34 – Box and betting the company on AI

16:50 – Hero use cases: reading a million contracts and long-running agents

18:42 – Work slop: why AI code is embraced but AI content isn't

24:08 – Building Box's agentic harness and the evals that matter

27:23 – The state of the model race

29:25 – Open-weight model adoption in the enterprise

32:34 – Memory, continual learning, and what belongs in the weights

37:29 – Box Labs and systems of record in a world of agents

44:55 – Will chat be the dominant UI for enterprise AI?

48:00 – Why coding diffused fast and the rest of knowledge work hasn't

54:31 – Staying wired in, making a company AI-first, and what it takes to win

Follow this show on AudioBrevity and new episodes get summarized for you. Create a free account

Couldn't load the audio. A blocker may be stopping the show's tracking links. Open the file