GenAI Product Development Services

AI breaks on the way to production.

Wrong answers, off-brand responses, guardrails that fail.
I help you close the gaps.

About

Josh

Josh is a seasoned technical product manager with a strong background in new product development, GenAI, machine learning, analytics, and SaaS. He managed a multi-billion-dollar advertising API product at Amazon and played a key role in driving hypergrowth as an early employee at both Highspot and Apptio.

Services

Core Services

AI Evals

Find out exactly where your AI is failing — before your users do.

Includes

  • Golden dataset creation
  • Tracing implementation
  • An end-to-end eval harness

AI Operating System Implementation

Turn scattered AI experiments into a coherent system your team can actually run.

Includes

  • Diagnosis of current workflows
  • Prioritized recommendations
  • Ongoing advisory support

AI Architecture Review

Understand what's holding your AI stack back — with a clear path forward.

Includes

  • Retrieval system design
  • Information architecture assessment
  • Actionable recommendations