Summary
Posted: Mar 26, 2025
Weekly Hours: 40
Role Number:200596633
Would you like to play a part in ensuring the quality of groundbreaking technology for large-scale systems, natural language, big data, and artificial intelligence? Drive the evaluation and simulation tools for constructing the most realistic evaluation environments of the Siri user experience and work with the people who built the intelligent assistant that helps millions of people get things done - just by asking? The engineering manager will own evaluations and simulation data tools development, ensuring our evaluation and measurement of Siri and AIML products pre-release is predictive of real-life user experience. This role is responsible for developing the Data Tools and Evaluation Environment Setup, and evaluating the large-scale systems integration (client/server and data/server), reliability, and consistency measurements. As Siri evolves, testing methodology and tools must respond to the new complexities: delivering such alignment is a key requirement for this role. An important deliverable of the role is a significant improvement in failure actionability, combined with identifying systemic issues, and with failures prioritization. This is a fast-paced role with high visibility, impact, and helps to build the most advanced systems in the industry.
Want more jobs like this?
Get Software Engineering jobs in Cupertino, CA delivered to your inbox every week.
Description
You will own the Evaluation engineering data tools roadmap for Siri and Information Intelligence features. You will lead the development of experimental testing tools, with a focus on evaluation and statistical testing and E2E view. Develop and apply various statistical approaches to building E2E test sets. Explore production data to discover gaps in testing. Own failure triage automation; focuses on significantly improving failure actionability. Lead systems integration testing, complete with test plan and tools development (client/server and data/server). Develop success criteria for QE tools testing, and oversees such testing execution and feedback to engineering partners. Think tirelessly of strategic and creative ways to evaluate and improve Siri user experience, and drives the team to work towards this shared goal. Build the team on the foundation of excellence, professional growth, inclusivity, and respect. The ideal candidate has experience with test infrastructure, quality tools and automation, and system integration testing. Self-motivated and dedicated with proven creative and critical thinking capabilities.
Minimum Qualifications
- 10+ years of professional work experience in development.
- 3+ years of experience managing an engineering team.
- Experience working with large-scale server software features, test planning, and execution. Fluent programming in Python (or advanced usage of OO languages such as C++, Java, Obj-C, or Swift).
- Proficient with scripting in Python, Perl, Bash.
Preferred Qualifications
- Working experience with different logging and analytics frameworks.
- Experience with statistical analysis applications in testing, ML/AI, or manufacturing processes Ability to build data pipelines, tools, and test automation frameworks. Experience with root cause analysis of multi-tiered, client-server environments.
- Testing server backend services, especially at the API or protocol level.
- Familiarity with testing machine learning systems.
- Strong organizational skills and experience working on large multi-functional teams. Thrives on working in a fast-paced environment with constantly evolving priorities.
- Ability to lead large teams, develop a long-term vision, and execute strategies at scale.
Pay & Benefits
- At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $190,700 and $329,600, and your base pay will depend on your skills, qualifications, experience, and location.
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
More
- Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.