Find your next role

Discover roles across ambitious teams

19,627 jobs

Sort by
  • More jobs

Toptal

ML Inference Engineer

Remote · Contract · Mid level

About the role

Design expert-level terminal benchmark tasks from real ML inference work to test AI agents. Create reproducible environments, solutions, and automated checks for task validation.

What you’ll do

• Design expert-level terminal benchmark tasks. • Define files, systems, and environments for tasks. • Write working reference solutions. • Build automated checks for result correctness. • Package tasks with Docker and Git.

What you’ll bring

• 3+ years hands-on ML inference or PhD with active research. • Experience with real scale model serving. • Hands-on with PyTorch or JAX and serving stacks. • Technical fluency in Python and command line. • Work authorization to start early November 2026.

Posted 1 day ago