Responsibilities
- Identify and verify online signals from user behavior that act as reliable indicators of answer quality
- Create and deploy new online metrics for use in A/B tests and product health monitoring, aligned with real-world evaluation outcomes
- Evaluate experimental data to confirm metrics reliably reflect user satisfaction and inform product direction
- Develop and sustain scalable data pipelines that generate key quality metrics for Search, Product, and model development teams
- Collaborate closely with Product and Search teams to communicate insights and clarify data-driven decisions
- Work within a lean, high-impact group where contributions directly influence how answer quality is measured and enhanced