Senior Data Engineer - Ads Measurement

It takes powerful technology to connect our brands and partners with an audience of hundreds of millions of people. Whether you're looking to write mobile app code, engineer the servers behind our massive ad tech stacks, or develop algorithms to help us process trillions of data points a day, what you do here will have a huge impact on our business—and the world. A Little About Us: We are an industry leading direct-to-consumer and ad‑tech solution for advertisers and publishers. Our innovative ad tech gives one‑stop access to Yahoo, Inc. trusted data, high‑quality inventory and demand, creative ad experiences and industry‑leading machine learning at global scale. The Consumer Monetization team’s charter is to find, evaluate, build, and scale new monetization, subscription and internal campaign tools and products, ad formats and functionalities across all Yahoo brands—including Yahoo Homepage, Yahoo Sports, Yahoo Finance, and Yahoo News. This team is uniquely positioned to identify growth and revenue generation opportunities, design and implement solutions across consumer products and advertising platforms including video, display, native, and search. A Lot About You As part of the Consumer Monetization Platform Engineering team, you will be working on data engineering pipelines and next‑generation machine learning‑ and AI‑based data infrastructure, supporting new functionalities on existing platforms, and mining data for analytics insights and product features. Our big data footprints are among the largest in the world, at double‑digit petabyte scale. Developing this infrastructure presents many technical challenges in the areas of efficient query processing, large‑scale stream processing, machine learning and modeling, as well as satisfying complex business rules. If you are enthusiastic about harnessing data at insane scale, enjoy working with new technologies, setting up petabyte data infrastructures, and implementing new machine learning solutions and metrics systems, we want to hear from you! Your Day Improve our existing data infrastructures for machine learning and deep learning using your core expertise. Design and build unified, production‑grade streaming and batch data pipelines that achieve full event coverage with near‑real‑time latency. Develop schema optimization and compression strategies for efficient large‑scale data ingestion and storage. Build the data foundation for ML training pipelines—including feature engineering, real‑time feature serving, and batch feature computation—that powers yield optimization and predictive analytics. Work with other engineers to implement algorithms and systems in an efficient way. Take end‑to‑end ownership of machine‑learning‑based distributed data systems—from data pipelines and training, to real‑time prediction engines. Develop complex queries, very large volume data pipelines, and analytics applications. Develop complex queries and software programs to solve analytics and data mining problems. Build data quality monitoring systems, automated anomaly detection, and reconciliation processes for production‑grade revenue operations. Interact with data analysts, data scientists, product managers, and software engineers to understand business problems and technical requirements to deliver data solutions. Prototype new metrics or data systems. Lead data investigations to troubleshoot data issues that arise along the data pipelines. Maintenance and improvement of released systems. Engineering consulting on large and complex warehouse data. Leverage AI‑assisted development tools (e.g., GitHub Copilot) to accelerate the design and implementation of complex distributed systems. Basic Qualifications BS with 7+ years of relevant industry experience/M.S. in Computer Science with 5+ years of relevant industry experience. Computer Science graduate ideally with specialization in Data Engineering or Machine Learning. Strong fundamentals: algorithms, distributed computing, data structure, database. Fluency with at least one of: Go/Java/Python/C++/Scala/SQL. 5+ years of industry experience on very large scale analytics or ML systems development. 2+ years of experience with Google Cloud Platform tools (BigQuery, Dataproc, Composer, Dataflow, BigTable, etc.). 2+ years of experience in Hadoop technologies (Map/Reduce, Pig, Hive, HBase, Spark, Kafka, Oozie, etc.). Experience in data modeling, schema design, ETL, and data analysis. Self‑driven, challenge‑loving, detail oriented, teamwork spirit, excellent communication skills, ability to multitask and manage expectations. Preferred Qualifications Experience with machine learning algorithms, NLP, and/or statistical methods a big plus. Experience in any of: machine learning, analytics, data mining, or data mart and warehouse. Experience with Deep Learning platforms (TensorFlow/Keras/Spark MLlib). Experience in ad‑tech, programmatic advertising, or publisher‑side monetization platforms. Experience building data quality frameworks, automated reconciliation systems, and observability for data pipelines (OpenTelemetry). Experience with privacy‑enhancing technologies, data clean rooms, or identity resolution systems. Experience with prompt engineering or structured interaction with AI tools to automate data processing tasks. The material job duties and responsibilities of this role include those listed above as well as adhering to Yahoo policies; exercising sound judgment; working effectively, safely and inclusively with others; exhibiting trustworthiness and meeting expectations; and safeguarding business operations and brand integrity. At Yahoo, we offer flexible hybrid work options that our employees love! While most roles don't require regular office attendance, you may occasionally be asked to attend in‑person events or team sessions. You'll always get notice to make arrangements. Your recruiter will let you know if a specific job requires regular attendance at a Yahoo office or facility. If you have any questions about how this applies to the role, just ask the recruiter! Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo will consider for employment qualified applicants with criminal histories in a manner consistent with applicable law. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form ( ) or call View phone number on click.appcast.io. Requests and calls received for non‑disability related issues, such as following up on an application, will not receive a response. We believe that a diverse and inclusive workplace strengthens Yahoo and deepens our relationships. When you support everyone to be their best selves, they spark discovery, innovation and creativity. Among other efforts, our 11 employee resource groups (ERGs) enhance a culture of belonging with programs, events and fellowship that help educate, support and create a workplace where all feel welcome. The compensation for this position ranges from $120,750.00 - $251,250.00/yr and will vary depending on factors such as your location, skills and experience. The compensation package may also include incentive compensation opportunities in the form of discretionary annual bonus or commissions. Our comprehensive benefits include healthcare, a great 401k, backup childcare, education stipends and much (much) more. Currently work for Yahoo? Please apply on our internal career site. #J-18808-Ljbffr