Data Engineer II

Data Engineer II US - East Coast (Remote)

At Magnite, we cultivate an environment of continuous growth and collaboration. Our work impacts what millions of people read, watch, and buy, and we're looking for people to help us tackle that responsibility with creativity and focus. Magnite is the world's largest independent sell-side advertising platform. Publishers use our technology to monetize their content across all screens and formats including CTV / streaming, online video, display, and audio. Our tech fuels billions of transactions per day!

About this team: You will join the Innovative Services Group (part of the wider Audience team). Innovative services build solutions across the Audience group (and beyond) that are leveraged by other teams. Examples include probabilistic services able to handle over 500k requests a second, and optimising how compute is deployed in our data pipelines yielding very high cost savings across the teams. The wider Audience team is responsible for managing and delivering the first and third-party data that powers all of the platforms that Magnite operates. We're a globally distributed team of software and data engineers who build and operate huge scale data pipelines and real-time scaled services to enable Magnite and Magnite's customers to reach their goals.

In this role, you will:

• Build and optimize data pipelines using Apache Spark and Python, processing billions of events in both streaming and batch modes.
• Collaborate with senior data engineers to improve Magnite's Audience data pipelines by identifying and implementing innovative solutions.
• Own the operational performance of your builds, ensuring uptime and implementing recovery strategies.
• Collaborate with SRE teams to provision infrastructure using Terraform and AWS (future Kubernetes on-premise).
• Proactively identify and help solve impactful problems.

We're looking for someone with:

• More than anything we expect you to love learning and see problems as things to overcome rather than blockers.
• Hands-on experience with Apache Spark (mainly PySpark).
• Strong Python skills, particularly in the context of Databricks and Spark.
• Data pipeline design knowledge, from sourcing event data to creating queryable data layers.
• Familiarity with event-based data architecture (e.g., Kafka).
• SQL experience for data analysis and transformations.
• Hands-on experience with AWS and Terraform for IaaS solutions.
• Experience writing Jenkins or Github actions pipelines to run build and integration actions.
• GoLang for distributed service development
• Kubernetes experience

Our current tech stack: Python, Golang, Rust, Java / Spring Boot ECS, Fargate, Kubernetes Spark, Databricks Luigi, Airflow Docker ALB, HAProxy RDS, MariaDB, Postgres Redis, Memcache Kafka, SNS, SQS Terraform, Github Actions, Jenkins JavaScript / TypeScript / React Linux (both on-premise and AWS)

In the US East Coast (including NYC and Boston), the base salary range for this role is $120,000 – $135,000. Actual compensation will be determined based on location, experience, skills, and internal equity. This role is also eligible for: Annual performance-based bonus Equity (NASDAQ: MGNI) Comprehensive benefits package

Perks and Benefits: Comprehensive Healthcare Coverage from Day One Generous Time Off Holiday Breaks and Quarterly Wellness Days Equity and Employee Stock Purchase Plan Family-Focused Benefits and Parental Leave 401k Retirement Savings Plan with Employer Match Disability and Life Insurance Cell Phone Subsidy Monthly Fitness and Reimbursement Career Growth: We support internal mobility, skill development, and leadership pathways through structured career frameworks and learning programs. Company Culture: Magnite's culture is rooted in collaboration and connection, recognizing that both are essential to success. Our hybrid schedule includes two remote workdays (Monday and Friday) and three in-office days (Tuesday through Thursday), where employees can take advantage of catered lunches, beverages, snacks, training opportunities, and engaging office events that enhance the work experience. In addition, we support our team through meaningful benefits and programs, including community service and volunteer opportunities, company-matched charitable contributions, access to mental health resources, structured career development initiatives and growth frameworks, culture and inclusion programs, and our Bonusly peer-to-peer recognition platform.

The world's leading agencies and brands trust our platform to access brand-safe, high-quality ad inventory and execute billions of advertising transactions each month. Magnite has offices across North America, EMEA, LATAM, and APAC. Magnite is an Equal Opportunity Employer and does not discriminate against applicants due to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, sexual orientation or any other federal, state or local protected class.