Sr. Technical/Engineering Program Manager , AWS Neuron

Company: Annapurna Labs Inc.
Location: Cupertino
Posted on: June 26, 2025

Job Description:

Job Description AWS Neuron is the team that delivers the software that powers the Inferentia and Trainium-based Inf1, Inf2, Trn1 an Trn1n families of Machine Learning Accelerated EC2 instances. We build a Compiler , Drivers, Runtime and a fully integrated suite of Pytorch and Tensorflow stacks, providing the highest-scale, distributed Training and Inference servers available. We deliver the solutions powering many of Amazon and Amazon customers largest Machine Learning services. We're seeking a Senior Engineering Program Manager for the AWS Neuron team. In this role you will be responsible for scoping and delivering large projects end-to-end. Responsibilities include collection of business and systems requirements from internal and external customers, writing specifications, driving project schedules from design to release, and managing the production launch. You will lead and coordinate design/implementation efforts between Neuron, internal teams and external customers and partners to develop optimal solutions for new features, verticals, and markets. You will be expected to make appropriate tradeoffs to optimize time-to-market, clearly communicate goals, roles, responsibilities, and desired outcomes to internal cross-functional and remote project teams. The right candidate will possess a strong technical and program management background, will have demonstrated experience leading medium to large projects, and will have a well-rounded technical background in current machine learning technologies as well as products spanning multiple technical domains from higher performance networking/compute and drivers to compilers and software development programs . You must be able to thrive and succeed in an entrepreneurial environment, and not be hindered by ambiguity or competing priorities. This means you are not only able to develop and drive high-level strategic initiatives, but can also roll up your sleeves, dig in and get the job done. As a Senior TPM, you will anticipate bottlenecks, provide escalation management, anticipate and make trade-offs, and balance the business needs versus technical constraints. An ability to take large, complex projects and break them down into manageable pieces, develop functional specifications, then deliver them in a timely manner. In this role you will: · Drive execution of projects · Provide technical direction with limited assistance · Lead cross functional project meetings · Lead milestone reviews · Present project status to the executive team · Manage project builds globally Key job responsibilities Work with Engineering leadership, Product Management, and Business Development to help define requirements and roadmaps, work with Engineering leadership to drive efficiencies in engineering development and ensure the right things are delivered to Customers at the right time. We work like a startup - moving fast and building new things. About the team AWS Neuron is the team that delivers the software that powers the Inferentia and Trainium-based Inf1, Inf2, Trn1 and Trn2 families of Machine Learning Accelerated EC2 instances. We build a Compiler , Drivers, Runtime and a fully integrated suite of Pytorch and Tensorflow stacks, providing the highest-scale, distributed Training and Inference servers available. We deliver the solutions powering many of Amazon and Amazon customers largest Machine Learning services. BASIC QUALIFICATIONS- 3 years of software development experience - 5 years of technical program management working directly with software engineering teams experience - Experience managing programs across cross functional teams, building processes and coordinating release schedules PREFERRED QUALIFICATIONS- 5 years of project management disciplines including scope, schedule, budget, quality, along with risk and critical path management experience - Experience managing projects across cross functional teams, building sustainable processes and coordinating release schedules - Experience defining KPI's/SLA's used to drive multi-million dollar businesses and reporting to senior leadership - 3 years in Machine learning development, building , training and deploying models or ML based services. Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner. Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $133,900/year in our lowest geographic market up to $231,400/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.

Keywords: Annapurna Labs Inc., Santa Clara , Sr. Technical/Engineering Program Manager , AWS Neuron, Engineering , Cupertino, California