Program Manager III, GenAI Adversarial Testing - Leading YouTube's Responsible Innovation

Join the Frontier of AI Innovation: Become a Program Manager III, GenAI Adversarial Testing at YouTube

Imagine a world where technology and creativity converge to create unparalleled opportunities for self-expression and connection. At YouTube, we're on a mission to build a platform that empowers everyone to have a voice and share their story. As a leader in the tech industry, we're committed to harnessing the power of Generative AI (GenAI) to revolutionize content creation and consumption. To ensure that our products meet the highest standards of responsibility and safety, we're seeking a seasoned Program Manager III, GenAI Adversarial Testing to join our team.

About the Role

As a Program Manager III, GenAI Adversarial Testing, you'll play a pivotal role in designing and implementing scalable ways of assessing and mitigating adversarial risks associated with GenAI models. You'll serve as the architect and operator of our Adversarial Testing program, building, running, and scaling our programmatic approach to Adversarial Testing processes from initial risk assessment to evals, analysis, and launch readiness. Your expertise will help us drive YouTube's responsible innovation, ensuring that our products not only meet but exceed our high policy bar.

Key Responsibilities:

• Design, Manage, and Improve Adversarial Testing Lifecycle: Collaborate with cross-functional teams to develop and continuously improve the lifecycle of adversarial testing, from intake and risk assessment to test set generation, execution, evaluation, and launch readiness.
• Conduct Feature Risk Assessments: Identify vulnerabilities, weak points, abuse vectors, and sensitive output types, and build infrastructure and processes to operationalize strategies and experience across Responsibility launch-readiness workflow.
• Drive Alignment with Product and Policy Teams: Work closely with Product and Policy teams to drive alignment on policy issues and decisions, ensuring that our products meet our high standards of responsibility and safety.
• Establish Program Metrics and Feedback Loops: Develop and track key performance indicators (KPIs) to measure program health, quality of test sets, Red Teaming program, and raters, and use data-driven insights to inform continuous improvement.
• Identify Process Bottlenecks and Drive Continuous Improvement: Analyze workflows, identify areas for improvement, and implement solutions to optimize efficiency, productivity, and organizational awareness across YouTube.

Requirements and Qualifications

Minimum Qualifications:

• Bachelor's Degree or Equivalent: A Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
• 5+ Years of Program or Project Management Experience: Proven experience in managing complex programs or projects, with a strong track record of delivering results in fast-paced environments.
• Experience with GenAI Models: Hands-on experience with Generative AI models, including their capabilities, limitations, and potential risks.
• Trust and Safety Domain Experience: Experience working in a Trust and Safety domain, with a deep understanding of the importance of responsible innovation.

Preferred Qualifications:

• 5+ Years of Experience Managing Cross-Functional Projects: Experience managing cross-functional or cross-team projects, with a proven ability to collaborate with technical and non-technical stakeholders.
• Adversarial Testing or Red Teaming Experience: Experience designing and implementing adversarial testing or red teaming programs for large-scale AI systems.
• Content Policy Development Experience: Experience developing content policies for consumer products, with a view towards GenAI responsibility.
• Release Management Lifecycle Experience: Experience with release management lifecycles and project milestones, with a strong ability to work in fast-paced environments.
• Influential Team Member: Ability to be an influential member of a highly integrated team composed of both technical and non-technical members.

What We Offer

At YouTube, we're committed to creating a work environment that's inclusive, diverse, and supportive. As a Googler, you'll have access to:

• Competitive Salary and Benefits: A competitive salary range of $139,000-$207,000, plus bonus, equity, and benefits.
• Opportunities for Growth and Development: Professional growth opportunities, training, and development programs to help you advance in your career.
• Collaborative and Dynamic Work Environment: A vibrant and dynamic work environment that encourages collaboration, creativity, and innovation.
• Flexible Work Arrangements: Flexible work arrangements, including remote work options, to support work-life balance.

Why Join Us?

At YouTube, we're passionate about empowering creators and building a community that celebrates diversity, equity, and inclusion. As a Program Manager III, GenAI Adversarial Testing, you'll have the opportunity to:

• Make a Meaningful Impact: Contribute to the development of responsible AI products that have a positive impact on users worldwide.
• Work with Cutting-Edge Technology: Collaborate with cross-functional teams to design and implement scalable solutions that push the boundaries of AI innovation.
• Grow Your Career: Develop new skills, take on new challenges, and advance in your career with a leading tech company.

How to Apply

If you're a motivated and experienced program manager with a passion for responsible AI innovation, we encourage you to apply for this exciting opportunity. Please submit your application, including your resume and a cover letter, to:

Don't miss this chance to join our team and help shape the future of AI innovation! Apply now and take the first step towards a rewarding career at YouTube.