← All Episodes
Based on Lenny's Podcast data
Lenny's Knowledge Sketch

Inside the Expert Network
Training Every Frontier AI Model

Garrett Lord
Founder; expert network for AI training
AUG 24 2025
The Hidden Layer

Expert Networks Are
the Invisible AI Infrastructure

DOMAIN EXPERTSAI TRAININGFRONTIER MODELS
"Every frontier AI model you use has been shaped by expert human feedback. The expert networks that provide that feedback are the most undervalued infrastructure in AI."
  • Domain experts writing AI evals and training data are the unsung heroes of AI development
  • Garrett's network: thousands of verified domain experts available for AI training projects
  • The expert premium: expert-written evals command 100× the price of crowdsourced annotation
  • The bottleneck for AI in specialized domains is expert availability, not compute
Framework

The Expert Network Model

EXPERT RECRUITINGCREDENTIAL CHECKAI TRAINING WORK
10K+
verified domain experts
100×
premium for expert vs. crowdsourced
6-18 months
to build a specialized expert network
  • Verified credentials: doctors, lawyers, engineers, scientists — all background-checked
  • Project matching: right expert for the right AI training task
  • Quality assurance: expert output reviewed for calibration and consistency
  • Compensation: 2-5× market rate for specialized AI training work
The network moatA vetted expert network takes years to build and is nearly impossible to replicate quickly. It's the deepest moat in AI infrastructure.
The Expert AI Training Market

Where Expert Evals Create Value

  • Medicine: Diagnosing edge cases, evaluating clinical AI recommendations
  • Law: Reviewing legal reasoning, hallucination detection in case citations
  • Finance: Evaluating financial model outputs, regulatory compliance checks
  • Science: Verifying scientific claims, research methodology evals
The specialist gap

There are 1 million ML engineers and 200 million domain experts. The bottleneck is connecting them.

The future of expert work

Domain experts will increasingly spend part of their careers training AI. This is a new income stream for specialists.

Playbook

Access Expert Knowledge for AI

  • Don't build your own expert network — partner with existing ones
  • Define your quality requirements before recruiting: what credentials, how many examples, what QA process?
  • Pay expert rates: cheap annotation produces cheap models
  • Invest in expert onboarding: 2 hours of context produces 10× better output
The expert career opportunityDomain experts who understand AI training workflows will command premium rates for the next decade. This is a career skill worth investing in.
Contrarian

Expert Knowledge Myths

AI will replace domain expertsINSTEAD →AI trained by domain experts will replace the tasks domain experts hate. It will amplify what domain experts do uniquely.
Crowdsourcing works for specialized domainsINSTEAD →Crowdsourcing produces average judgments. Specialized domains require specialized expertise.
The best models don't need expert feedbackINSTEAD →The best models require the best expert feedback. The bar rises with model sophistication.
Expert networks are too slow to scaleINSTEAD →Expert networks scale slowly and compound over time. That's the point — it's a defensible moat.
𝕏︎ X / Twitterin LinkedIn📸 Instagram🔗 Copy link
0:00