Lead Data Platform Engineer3

New York, New York, United StatesDevelopment – Cloud Operations /Mid-Senior Level /RemoteCoupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data across a global network of 10M+ buyers and suppliers. We empower you with the ability to predict, prescribe, and automate smarter, more profitable business decisions to improve operating margins.Why join Coupa?ð¹ Pioneering Technology: At Coupa, we're at the forefront of innovation, leveraging the latest technology to empower our customers with greater efficiency and visibility in their spend.ð¹ Collaborative Culture: We value collaboration and teamwork, and our culture is driven by transparency, openness, and a shared commitment to excellence.ð¹ Global Impact: Join a company where your work has a global, measurable impact on our clients, the business, and each other. Learn more on Life at Coupa blog and hear from our employees about their experiences working at Coupa. The Impact of a Lead Data Platform Engineer at Coupa:If you are passionate about new technologies, have a strong technical background and you are looking for an environment where you can continuously expand your knowledge, you are the right fit for this role. At Coupa, the “Cloud team” is looking for an engineer who is ready to constantly question the status quo with a mixture of system design, code development, deployment, automation, networking, and experience in managing big data/ Machine Learning/GenAI platforms.What You'll Do: Manage end-to-end Data pipeline (ETL jobs) within agreed SLAs.Manage AWS core and big data services (S3, IAM, EMR, Redshift, etc..)Running applications in containers (ECS, Docker)Lead Day 2 operational lifecycle for ML and GenAI infrastructure. This includes designing, deploying, and maintaining high-availability production LLM serving platforms, implementing automated scaling, self-healing, and infrastructure-as-code patterns. Focus on proactive reliability, model performance observability, and continuous cost optimization for high-compute AI workloads.Collaborate closely with our product development and engineering teams to create AI-driven featuresDrive cloud operations consistency by automating platform maintenance, standardizing infrastructure configurations (IaC), and implementing robust release management processes to minimize drift across multi-cloud environments.Manage AWS infrastructure using code (Terraform, Chef, etc..)Administering applications running in Linux operating system.Enable application and system monitoring for better observability.Application and infrastructure support for ETL jobs and data pipelines including participating in an on-call rotation for after-hours emergencies.Collaborate with platform and Dev teams to plan and deploy product releases and patch Linux/ECS clusters.Ability to participate in design reviews, code reviews, and troubleshooting incidents.Ability to operate in a high-pressure environment and troubleshoot complex issues quickly while successfully handling multiple priorities.Ability to record, write, and review RCAs.What You Will Bring to Coupa: Bachelor's Degree and at least 8+ years of experience managing Big Data technologies and Data Pipelines.Sound knowledge and experience in Linux administration and troubleshooting. 5+ years of experience in managing cloud infrastructure and platforms, such as AWS and AzureFamiliar with the current engineering landscape in the generative AI space and have a strong interest in AI and related technologies.Strong expertise in MLOps and production-grade LLM operations. Proven track record in managing high-availability model inference clusters, automating model lifecycle management, and implementing advanced observability (latency, throughput, and error rate monitoring) specifically for AI workloads.Have Bash or Python scripting experienceExperience with containerization, Amazon ECS, EKS/ Azure AKSExperience with tools like Chef, Ansible, Jenkins, Rundeck, or equivalentExperience with source control systems such as Git and operating in complex branching strategiesExperience with Infrastructure as Code products like Terraform, helm chartsGood understanding of DNS and Load balancers setup and troubleshootingExperience in Big Data platforms/Data lakes and managing Business Intelligence tools (like looker..)Knowledge in ApacheSpark architecture and troubleshooting Java applications.Basic understanding of MySQL Server and general database knowledgeExcellent written and verbal communication with a passion for solving the problemConfidence in your ability to own and deliver projects and issues to resolution on your own & can think and act globallyDeep experience in Day 2 cloud operations, including automated incident remediation, capacity planning, and managing large-scale production cloud environments with a focus on performance and reliability.$125,000 - $174,333 a yearThe successful candidate’s starting salary will be determined based on permissible, non-discriminatory factors such as skills, experience, and geographic location within the state.#LI-Remote#LI-TC1At Coupa, we are 100% committed to creating and nurturing an environment that supports your physical, mental, and community well-being . We offer a comprehensive suite of benefits designed to help you and your family thrive:Global Well-Being Perks (For All Employees Globally)Global Wellness Days: Enjoy two designated, company-wide paid wellness days off each year (typically the first Friday in March and the last Friday in September) so the entire global team can unplug, step away, and recharge together .Birthday Time-Off: Celebrate your day! Coupa provides a paid day off on your birthday or another day of your choice within your birthday month .Volunteer Time Off (VTO): Giving back is in our DNA. We offer 40 hours of paid VTO annually to support the community initiatives and volunteer programs you are passionate about .Employee Assistance Program (EAP): Access free, confidential, 24/7/365 counseling and resources for emotional support, work-life solutions, financial advice, legal guidance, and support for new parents .Business Travel Protection: Travel with peace of mind. Zurich Travel Assist provides medical, safety, pre-trip planning, and emergency support during any business travel .Referral Bonus Program: Share the Coupa experience! Receive generous monetary referral bonuses when you successfully refer talented friends or acquaintances who are hired into open roles .Please note: In addition to these global well-being perks, Coupa offers highly competitive, location-specific benefits packages (which include comprehensive medical/dental insurance, retirement/pension plans, and life or accident protection) tailored to your primary work location. Your recruiter will walk you through the specific regional benefits package for this role during the interview process.Coupa complies with relevant laws and regulations regarding equal opportunity and offers a welcoming and inclusive work environment. Decisions related to hiring, compensation, training, or evaluating performance are made fairly, and we provide equal employment opportunities to all qualified candidates and employees. Please be advised that inquiries or resumes from recruiters will not be accepted.By submitting your application, you acknowledge that you have read Coupa’s Privacy Policy and understand that Coupa receives/collects your application, including your personal data, for the purposes of managing Coupa's ongoing recruitment and placement activities, including for employment purposes in the event of a successful application and for notification of future job opportunities if you did not succeed the first time. You will find more details about how your application is processed, the purposes of processing, and how long we retain your application in our Privacy Policy.We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.