Sr Engineering Manager, Product ML Systems Evaluation Engineering

Company: Apple Inc.
Location: Santa Clara
Posted on: May 28, 2023

Job Description:

Are you passionate about innovation that matters? Would you like to play a part in shipping groundbreaking technology for large scale systems, natural language, and artificial intelligence? We interact with various engineering teams to identify issues, test requirements, drive the quality of Siri features and create frameworks that support evaluation and qualification. You will work with the people who craft the intelligent assistant that helps millions of people get things done - just by asking. Join the Siri ML Systems Evaluation Engineering (MLSEE) team at Apple.As a Siri ML SEE Sr. Engineering Manager, you will own evaluation and testing tools and frameworks development, ensuring our quality measurement of Siri and ML products pre-release is predictive of real-life user experience. This role is responsible for developing the approach, tools, and testing for component level testing as well as for systems integration (client/server and data/server), reliability, and consistency measurements. As Siri evolves, testing methodology and tools must respond to the new complexities: delivering such alignment is a key requirement for this role. A meaningful deliverable of the role is a significant improvement in failure action ability, combined with identifying systemic issues, and with failures prioritization. This is a fast-paced role with high visibility, impact, and helps to build the most advanced systems in the industry. This role will focus on the right design, architecture and reliability for evaluation frameworks. Key Qualifications

• 10+ years of professional work experience in SW development.
• Proven success in developing a long-term vision, and executing strategies at scale.
• Experience managing an engineering team, and managing managers.
• The ideal candidate has experience with large scale test infrastructure, evaluation of ML based products, and system integration testing.
• Working experience with different logging and analytics frameworks, and experience with interpreting pre- and post-release product metrics at large scale
• Experience with statistical analysis applications in testing, ML/AI, or manufacturing processes
• Experience with server backend services, especially at the API or protocol level.
• Strong organizational skills and experience working on large multi-functional teams.
• Thrives on working in a fast-paced environment with constantly evolving priorities. Description We are seeking an expert senior engineering manager to lead qualification tools and frameworks for Siri's intelligent services and platforms (HomePod, CarPlay, iPhone, Apple Watch, iPad, MacBook) by developing automation frameworks, performance testing and building sustainable solutions that can scale. You will collaborate with teams across AI/ML and wider Apple, to build effective cross functional partnerships and to ensure success of Siri and of AI/ML services within the Apple ecosystem of platforms and features.You will be responsible for the team delivering test automation tools and frameworks that allow Siri engineers build personalized voice assistant experiences, for multiple platforms and languages: this is a world-class problem to solve. High fidelity and reliability of test automation are required to ship with confidence, and to support continuous hill-climbing.This leadership role will collaborate with AI/ML Engineering teams, to ensure that our tools development is done in lockstep with the new features and products roadmap, and to drive a high tool's adoption among product engineers. This is a fast-paced role with high visibility, impact, and influence in building one the most advanced AI systems in the industry. Education & Experience MS/PhD in Computer Science, Machine Learning or related field
  • At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $196,000 and $343,500, and your base pay will depend on your skills, qualifications, experience, and location.
    
    Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.
    
    Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Keywords: Apple Inc., Santa Clara , Sr Engineering Manager, Product ML Systems Evaluation Engineering, Executive , Santa Clara, California