Senior Manager, Technology Consulting

Are you passionate about squeezing every last drop of performance out of advanced hardware accelerators? Step into a role where you will shape the future of AI. In this role, you will drive the performance and optimization of both training and serving, delivering massive impact for customers. We are seeking a talented leader to build out a center of excellence and scale this practice. You will have exposure to the newest Tensor Processing Unit (TPU) and Graphics Processing Unit (GPU) hardware, the latest ML models, and the advanced toolchains that bridge them. Your work will directly enable AI research and production deployments across Google Cloud and the broader open-source ecosystem. You will address complex technical issues that directly impact the efficiency and scalability of AI across the industry. The AI and Infrastructure team is redefining what's possible.

Req# 1067369299

Responsibilities

• Design and optimize high-performance kernels (using languages like Pallas, Mosaic, and Triton) targeting Tensor Processing Unit (TPU) and Graphics Processing Unit (GPU) architectures for critical Machine Learning (ML) operations, redefining what's possible from massive training runs to high-speed inference
• Architect infrastructure such as benchmarking suites, autotuning frameworks, performance analysis tools, regression testing, and documentation, transforming how the developer community interacts with increasingly critical custom kernels in key Open-Source Software (OSS) libraries
• Track the latest advancements in hardware architectures, compiler technologies, and AI models to identify new opportunities for performance optimization through custom kernels
• Engage with ML researchers, framework developers (Just After eXecution (JAX), PyTorch), and compiler engineers (Accelerated Linear Algebra (XLA)) to enhance adoption, identify new requirements, and address bottlenecks by providing appropriate solutions

Requirements

• Bachelor's degree or equivalent practical experience
• Overall 12+ years of industry experience; 5 years of experience with software development in C++ or Python
• 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture
• Experience with performance optimization at the kernel level
• Experience optimizing TPU/GPU code, using low-level kernel languages like Pallas, Compute Unified Device Architecture (CUDA), or Triton
• Knowledge of ML Frameworks (JAX/PyTorch), common operations like attention and Mixture of Experts (MoEs), including model optimization and low-precision formats
• Understanding of modern accelerators (e.g., data movement, pipelining, heterogeneous compute, and scale-out)
• Understanding of compiler principles (optimization, code generation) and toolchains such as MLIR, OpenXLA
• Demonstrate a record of building developer infrastructure, including Open-Source Software (OSS) libraries, flexible high-performance APIs, and easy-to-consume documentation to empower the community
• Excellent investigative and problem-solving capabilities with communication skills across cross-functional teams

We offer

• Medical, Dental and Vision Insurance (Subsidized)
• Health Savings Account
• Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
• Short-Term and Long-Term Disability (Company Provided)
• Life and AD&D Insurance (Company Provided)
• Employee Assistance Program
• Unlimited access to LinkedIn learning solutions
• Matched 401(k) Retirement Savings Plan
• Paid Time Off – the employee will be eligible to accrue 15-25 paid days, depending on specific level and tenure with EPAM (accrual eligibility may change over time)
• Paid Holidays - nine (9) total per year
• Legal Plan and Identity Theft Protection
• Accident Insurance
• Employee Discounts
• Pet Insurance
• Employee Stock Purchase Program
• If otherwise eligible, participation in the discretionary annual bonus program
• If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program

This Remote Position Cannot be Performed in New York City.

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our clients, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
Engineer the Future with a Career at EPAM

This posting includes a good faith range of the salary EPAM would reasonably expect to pay the selected candidate. The range provided reflects base salary only. Individual compensation offers within the range are based on a variety of factors, including, but not limited to: geographic location, experience, credentials, education, training; the demand for the role; and overall business and labor market considerations. Most candidates are hired at a salary within the range disclosed. Salary range: $180,000 - $220,000. In addition, the details highlighted in this job posting above are a general description of all other expected benefits and compensation for the position.

Applications will be accepted on a rolling basis.

In accordance with the LA County Fair Chance Ordinance, you may find a copy of the Notice containing a summary of the Ordinance’s key provisions here: Concept FCO Posting 8 27 24 (lacounty.gov)

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

EPAM will not provide new H-1B visa sponsorship for this position. Candidates with existing transferable H-1B status may be considered.