Find your next role
Discover roles across ambitious teams
17,007 jobs
- More jobs
Welo Global
Lead Prompt Engineer
Remote · United States · Part time · Senior level
About the role
Lead and manage a team through technical migration to LLM autoraters. Optimize AI model performance and mentor junior engineers.
What you’ll do
• Utilize Automatic Prompt Generation tools for baseline prompts. • Supervise Automated Prompt Optimization tool and flag deadlocks. • Manually draft and refine prompts for complex templates. • Monitor shadowbot runs for human and LLM rating disagreements. • Measure autorater quality against human baseline with accuracy metrics.
What you’ll bring
• Native fluency in English. • Based in United States. • Master’s or Doctorate in related analytical field. • 7+ years experience in prompt engineering and LLM tuning. • Strong data analysis skills with SQL or analytics tools. • Excellent verbal and written communication skills.