Lead Data Engineer

Epsilon Activation Delivery Platform EngineerThe Epsilon Activation Delivery Platform team builds the core framework and connectors powering our audience activation business. We are a small, high-impact team of engineers operating at massive scale—trillions of user events flow through our pipelines every month. By building and maintaining integrations with major advertising players (Meta, Google, Amazon) and Connected TV publishers (LG, Samsung), your work directly connects our data ecosystem to the biggest platforms in the world.This role reports to the Engineering Director and collaborates closely with fellow data engineers, product managers, and partner teams. You will participate in design reviews, code reviews, and the end-to-end delivery of critical business features in a highly collaborative environment.Operate at True Scale: Work in a high-volume data environment where your pipelines will process and route trillions of records monthly. Work with Modern Data Tech: Get hands-on with an innovative big data stack using Spark, Scala, Python, AWS EMR, and Databricks. See Your Impact: Your code will directly enable our business to interface with the world's largest tech, social media, and CTV platforms. Own the Solution: We are a small team, which means you will have the autonomy to take complex problems from ingestion and specification all the way through to production.Core Contribution: Write robust, scalable, and maintainable code using Spark (Scala/Python) and SQL to build out our core framework and data pipelines. Pioneer AI-Assisted Engineering: We are on the cutting edge of AI adoption. You will leverage tools like Cursor and Amazon Q Developer to accelerate coding, debugging, and testing. You'll also actively participate in experimenting with the latest developer workflows for agentic, AI-assisted development, helping define the future of how our team builds software. Scale Integrations: Build, maintain, and optimize the high-concurrency data connectors that feed external publishers and ad networks. Optimize & Solve: Dive deep into complex data processing routines on EMR and Databricks. You will actively fix production issues, tune SQL queries, and solve for performance bottlenecks in a distributed environment. Team Mentorship & Quality: Participate in rigorous code reviews, help enforce engineering standard processes, and mentor mid-level/junior engineers to elevate the team's overall codebase. Continuous Improvement: Build and maintain automated production processing routines that fit seamlessly into our existing scheduled cloud infrastructure.What you'll bring with you: S. in Computer Science, Computer Engineering, or a related field. 5+ years of professional experience on a development team building and maintaining big data pipelines. Deep, hands-on expertise in Apache Spark and distributed computing concepts. Strong programming proficiency in Scala and/or Python. Fluent SQL skills with the ability to ingest complex use cases, refactor code, and tune queries for massive datasets. Proven experience working within cloud environments (AWS preferred) and managed platforms like Databricks or EMR. Ability to solve production issues autonomously and own a problem to the end. Excellent communication skills to work with internal partners, ask the right questions, and translate business requirements into technical solutions.Why you might stand out from other talent: Experience in the AdTech/MarTech space, specifically programmatic advertising, identity resolution, or audience activation. Familiarity with orchestration tools (e.g., Airflow). Experience building and optimizing data integrations with external REST APIs at high concurrency. Exposure to streaming technologies (Kafka) or NoSQL databases.Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. For decades, we've provided marketers from the world's leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision, and 1 Voice. Epsilon's comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology. We process 400+ billion consumer actions each day using advanced AI and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Epsilon is a global company with more than 9,000 employees around the world. Our pillars aren't just words. They're how we show up every day. People centricity: We focus on employee well-being in an environment where colleagues truly care about each other. Collaboration: We work together, support one another, and collectively achieve goals. Growth: There are endless opportunities for growth through learning, development and career advancement. Innovation: We drive progress through cutting-edge solutions and forward-thinking approaches. Flexibility: We've created a balance between work and personal life, and we encourage adaptability to solve problems creatively. Our values guide us to create value for our clients, our people and consumers. Act with integrity Work together to win together Innovate with purpose Respect all voices Empower with accountability These pillars and values are our foundation—shaping our culture, guiding our decisions, and uniting us in common purpose.As an Epsilon employee, you deserve perks and benefits that put you, your family and your finances first. Our benefits encompass a wide range of offerings, including but not limited to the following: Time to Recharge: Flexible time off (FTO), 15 paid holidays Time to Recover: Paid sick time Family Well-Being: Parental/new child leave, childcare & elder care assistance, adoption assistance Extra Perks: Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling Epsilon benefits are subject to eligibility requirements and other terms. Epsilon is an Equal Opportunity Employer. Epsilon's policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information, or any other characteristic protected by applicable federal, state or local law. Epsilon also prohibits harassment of applicants and employees based on any of these protected categories. Epsilon will provide accommodations to applicants needing accommodations to complete the application process. Please reach out to View email address on click.appcast.io to request an accommodation. For San Francisco Bay and Los Angeles Areas: Epsilon will consider for employment qualified applicants with criminal histories in a manner consistent with the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance and San Francisco Police Code Sections 4901-4919, commonly referred to as the San Francisco Fair Chance Ordinance. Applicants with criminal histories are welcome to apply.Compensation Range: USD $98,000.00 - USD $182,000.00/Annually. This is the pay range the Company believes it will pay for this position at the time of this posting. Consistent with applicable law, compensation will be determined based on the skills, qualifications, and experience of the applicant along with the requirements of the position, and the Company reserves the right to modify this pay range at any time. Temporary roles may be eligible to participate in our freelancer/temporary employee medical plan through a third-party benefits administration system once certain criteria have been met. For regular roles, the Company will offer medical coverage, dental, vision, disability, 401k, and paid time off. The Company anticipates the application deadline for this job posting will be 9/30/2026.