Senior Machine Learning Engineer, Agentic AI
Description
Join us in building the future of finance. Our mission is to democratize finance for all. An estimated $124 trillion of assets will be inherited by younger generations in the next two decades. The largest transfer of wealth in human history. If you’re ready to be at the epicenter of this historic cultural and financial shift, keep reading. About the team + role We are building an elite team, applying frontier technologies to the world’s biggest financial problems. We’re looking for bold thinkers. Sharp problem-solvers. Builders who are wired to make an impact. Robinhood isn’t a place for complacency, it’s where ambitious people do the best work of their careers. We’re a high-performing, fast-moving team with ethics at the center of everything we do. Expectations are high, and so are the rewards. The Agentic AI team builds agentic AI systems that power intelligent, reliable customer experiences across Robinhood products. The team focuses on reducing the time to ship agents with fine-tuned models and while doing so enables other teams to build, evaluate, and improve their own agents. You will contribute to a culture grounded in first-principles thinking, high performance, and strong focus on customer outcomes! As a Senior Machine Learning Engineer (IC5), you will define and uphold the quality bar for agentic systems across the organization. You will design evaluation frameworks, guide model selection, and partner with product, data science, and engineering teams to ensure systems meet clear standards for correctness, safety, latency, and user satisfaction. Your work will shape how agentic systems are built, evaluated, and improved across Robinhood! At Robinhood, we believe in the power of in-person work to accelerate progress, spark innovation, and strengthen community. Our office experience is intentional, energizing, and designed to fully support high-performing teams. This role is based in our Bellevue, WA, New York, NY, or Menlo Park, CA office, with in-person attendance expected at least 3 days per week. What you'll do - Lead the design and evolution of agentic AI systems that power intelligent customer experiences across Robinhood. - Define the technical direction for evaluating autonomous agents, including reasoning quality, planning, tool selection, memory, task completion, safety, latency, and overall user experience. - Design and build scalable evaluation frameworks for agentic systems using automated evals, benchmark datasets, LLM-as-a-Judge techniques, and human feedback to continuously improve agent performance. - Drive model selection and optimization across frontier foundation models, fine-tuned models, retrieval systems, and tool-using agents, balancing quality, latency, cost, and reliability. - Partner closely with Product, Data Science, and Engineering to establish launch criteria, quality standards, and measurable success metrics for production agentic systems. - Improve agent reliability by investigating production failures, identifying root causes across reasoning, planning, retrieval, and tool execution, and driving architectural improvements. - Mentor engineers and influence technical direction across teams while helping establish best practices for building reliable, production-ready agentic AI systems. What you bring - Significant experience