Senior ML Training GPU Optimization Engineer

Marketo | Seattle, WA, United States

Posted Date 3/26/2024
Description Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen. We’re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours! What you will be working on:   Write efficient forward and backward passes in CUDA/CuTe. Write Optimized custom layers in Pytorch. Optimize ML training code for large, distributed training with FP8. Quality and performance analysis between data types such as BF16 and FP8 for large deep learning models. Understand and optimize H100 GPUs. Architect broader, end to end optimized training code and schemes with Pytorch for large distributed models. Write high quality, product level code that is easy to maintain and test following standard methodologies.   What do you need to succeed:   Proficiency in at least two of: Linux, Ansible, Docker, Kubernetes (5+ yrs) Expert in Python and or C++ Expert in CUDA/CuTe, OpenCL and or Triton Expert in Pytorch Experience with DDP, FSDP Experience in distributed computing (7+ yrs) Experience working with AWS or similar cloud infrastructure (5+ yrs) Experience with HW resource management for ML training and/or deployment B.S., M.S, or Ph.D. in Computer Science, Computer Engineering or a related area #FireflyGenAI   Our compensation reflects the cost of labor across several  U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this position is $170,900 -- $325,200 annually. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process. At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP). In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award. Adobe is proud to be an Equal Employment Opportunity and affirmative action employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. Learn more. Adobe aims to make Adobe.com accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email accommodations@adobe.com or call (408) 536-3015. Adobe values a free and open marketplace for all employees and has policies in place to ensure that we do not enter into illegal agreements with other companies to not recruit or hire each other’s employees. At Adobe, you will be immersed in an exceptional work environment that is recognized around the world. You will also be surrounded by colleagues who are committed to helping each other grow through our unique Check-In approach where ongoing feedback flows freely. If you’re looking to make an impact, Adobe's the place for you. Discover what our employees are saying about their career experiences on the Adobe Life blog and explore the meaningful benefits we offer. There's more than meets the eye when it comes to Adobe. Take the quiz and see how well you know us! Adobe is proud to be an Equal Employment Opportunity and affirmative action employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. Learn more. Adobe aims to make Adobe.com accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email accommodations@adobe.com or call (408) 536-3015. Adobe values a free and open marketplace for all employees and has policies in place to ensure that we do not enter into illegal agreements with other companies to not recruit or hire each other’s employees.
Salary325,200.00 Annual

Share this job