Senior Data Engineer
Sigma Software
Senior Data Engineer
Join Sigma Software to build large-scale data infrastructure powering a real-time AdTech platform processing hundreds of millions of auction requests daily. We are looking for a Senior Data Engineer who enjoys solving complex distributed data challenges and building production-grade ML-oriented data systems.
You will become part of a dedicated Sigma Software team developing predictive modeling and optimization capabilities for a live advertising ecosystem. The role combines large-scale event processing, streaming and batch pipelines, experimentation infrastructure, and high-throughput data engineering in a cloud-native environment.
We as a company offer the opportunity to work on impactful global products, collaborate with experienced engineers, and contribute to architecture decisions while growing your expertise in large-scale distributed systems and modern data platforms.
Our Customer is a technology company operating supply-side infrastructure within the programmatic advertising ecosystem. The company manages a large-scale ad exchange handling hundreds of millions of auction requests per day and is actively investing in predictive decisioning technologies to optimize advertising outcomes in real time.
The project focuses on building a predictive modeling and optimization platform on top of a live ad exchange environment. The platform performs real-time supply scoring and filtering, contextual performance estimation, look-alike audience generation, and multi-objective optimization under business constraints.
The solution processes massive-scale event and auction datasets and includes feature engineering pipelines, streaming and batch ingestion, experimentation infrastructure, point-in-time-correct training data generation, and ML-oriented data services with strict operational reliability and compliance requirements.
Job Description
- Write and defend diagnostic SQL queries against large-scale production datasets
- Build and maintain ingestion pipelines for bid, win, and impression logs into BigQuery
- Harmonize fields across independently designed datasets and maintain versioned field mappings
- Develop point-in-time-correct feature tables and aggregation pipelines
- Design and maintain conversion and labeling pipelines with delayed label handling
- Own the data serving write path, schema contracts, publishing flows, and freshness SLOs
- Build experimentation infrastructure including traffic splitting and reporting pipelines
- Perform large-scale historical backfills and safe reprocessing after mapping changes
- Implement data isolation and safe-aggregation controls for advertiser data protection
- Develop automated data quality validation frameworks
- Collaborate closely with Customer engineers and prepare operational documentation
- Contribute to architecture discussions and platform scalability improvements
Qualifications
- 5+ years of experience in Data Engineering
- At least 2 years of experience working with production ML or large-scale analytics pipelines
- Expert-level SQL skills including window functions and incremental processing patterns
- Strong Python skills for production-grade pipeline development
- Hands-on experience with Spark or PySpark
- Experience designing ETL / ELT pipelines with Airflow, Cloud Composer, Dagster, or similar tools
- Experience working with cloud data warehouses at scale, preferably BigQuery
- Strong understanding of data modeling and point-in-time correctness
- Experience working with event-driven or clickstream datasets at very large scale
- Experience supporting business-critical production pipelines
- Upper-Intermediate English level or higher
Will Be A Plus
- Experience with GCP services including Dataflow, Pub/Sub, GCS, and Beam
- Experience building streaming or near-real-time ingestion systems
- Understanding of feature stores, train/serve skew, and label leakage prevention
- Experience in AdTech or auction-based environments
- Experience handling delayed or incomplete labels in ML systems
- Experience with dbt or similar transformation frameworks
- Experience delivering solutions into Customer-owned infrastructure
- Knowledge of GDPR/CCPA-related privacy engineering practices
- Experience with experimentation infrastructure and statistical validation pipelines
- Experience working in hybrid cloud/on-prem Linux environments
- Terraform and Kubernetes experience
- Experience optimizing warehouse cost and performance
Additional Information
Personal Profile
- Strong analytical and problem-solving skills
- Ownership-oriented mindset
- Ability to work independently in a client-facing environment
- Strong communication and documentation skills
- Comfortable working in a fast-paced engineering environment
- Collaborative and proactive attitude
$110k - $130k
...We are looking for an experienced Senior Data Engineer with strong expertise in Databricks, Python, PySpark, Apache Spark, and large-scale data engineering. The ideal candidate will be responsible...SeniorFull time- Senior Data Engineer ***Sponsorship is not provided*** ***No Third Party Resumes*** Onsite in Peachtree Corners, GA - Hybrid Salary - Competitive Position Summary We are seeking an experienced, highly motivated Senior Data Engineer to help design, develop, and optimize...SeniorTemporary work
- We are looking for a Senior Data Engineer with AI to architect and build intelligent AI workflows that merge models, enterprise data, and business logic into dependable, production-ready solutions. Within this position, you will construct scalable AI deployment pipelines...Senior
- RESPONSIBILITIES: Kforce has a client in Atlanta, GA that seeking a Senior Data Engineer to join their team, to design and develop scalable data solutions supporting enterprise business initiatives. This role will build complex ETL pipelines and data models, work across...SeniorHourly payContract work
$65 - $70 per hour
...Virtual / In-person interview (In-person interview required) Job Description: · We are seeking an experienced Senior Full Stack with Data Engineering with 8+ years of IT experience in designing, developing, and implementing scalable enterprise applications and...SeniorContract work- ...Responsibilities: Develop, manage, organize, store, and analyze enterprise data and data systems. Participate in all phases of the software... ..., development, testing, and QA. Collaborate closely with engineering teams to design and implement scalable data solutions....Senior
- ...Role : Senior Data Engineer location : Bethlehem, NJ ( Hybrid ) Job Type : Contract-W2 Job Description : (Primary: Databricks | Good-to-have: IDMC) Role Summary : Seeking a strong Databricks-focused Data Engineer with expertise in ETL design, data pipeline...SeniorContract work
- ...We're Hiring | Senior Snowflake Data Engineer Location: New Jersey, USA Experience: 8+ Years Snowflake Experience: 5+ Years We are looking for an experienced Senior Snowflake Data Engineer with strong expertise in designing, developing, and optimizing...Senior
$70 - $85 per hour
Senior Data Infrastructure Engineer Remote (Eastern or Central time zone preferred) Contract (Remote) Compensation: $70 - $85 per hour ABOUT THE ROLE We are seeking a Data Infrastructure Engineer to help build and scale a next-generation data platform for a...SeniorHourly payContract workWork at officeRemote work- ...Company – Our client is a growing global provider of data-driven analytical and technical services supporting critical national... ...long-standing reputation as a top workplace. Job Title – Senior Data Engineer Location – Hybrid in Alexandria, VA – typically 3 days...SeniorFull timeRemote work
- ...Senior Data Engineer – Applied AI | Louisville, Kentucky | Onsite | US Citizen Only We’re partnering with an established US and global infrastructure manufacturer looking for a Senior Data Engineer with hands-on Python and applied AI experience to take hands on ownership...Senior
- ...Job Title: Senior Data Engineer Location: Mclean, VA/ Richmond, VA - Hybrid Duration: 07+ Months Contract with Extension Job id – 180924 Responsibilities : Designing and implementing high-performance data pipelines that handle large volumes of data...SeniorContract work
- ...We are looking for an experienced Senior Data Engineer with 5–7 years of hands-on experience in ETL, Reverse ETL, data integration, and cloud-based data platforms. The ideal candidate will have strong SQL skills and practical experience working with AWS data services...SeniorWork experience placement
- ...Job Duties:-• Experience: 8–10 years in Data Engineering and Data Analysis. • Informatica Expertise: Strong hands-on experience in Informatica PowerCenter/IDQ for ETL design, development, and optimization. • PySpark Development: Advanced skills in PySpark for large...Senior
$400k
...Senior Data Engineer - Hedge Fund - New York - Up to $400k TC Join a leading Hedge Fund where Data Engineering sits at the heart of the investment process. Global hedge fund with a consistent record of strong returns Heavy investment in technology and data,...SeniorFull time- ...We are looking for an experienced Senior Data & AI Engineer to join a leading healthcare organization in Phoenix, AZ on a 100% on-site basis. In this role, you will architect, build, and operationalize modern data platforms and AI/ML solutions across complex healthcare...SeniorFull time
- ...growth. Find your future with us. Boeing Commercial Airplanes (BCA) has an exciting opportunity for a Product Data Management Engineer (Mid-Level or Senior) to join our team located in North Charleston, SC. The 787 Engineering organization is seeking a...SeniorPermanent employmentWork experience placementRelocationVisa sponsorshipWork visaFlexible hoursShift workDay shift
- ...To support the Tech Enablement team, the full-time Senior Big Data Engineer will design, build, and maintain data pipelines and systems for web events, tackle challenges with large datasets, and develop frameworks to accelerate machine learning across products in a hybrid...SeniorFull timeRemote work
- ...Senior Data Engineer - AWS Charlotte, NC - Onsite 6 Months+ Required Skills & Qualifications • Data engineering, backend development, or software engineering, with demonstrated hands-on development experience. • Strong hands-on experience with AWS data and cloud...Senior
- ...Senior AWS Data Engineer | Onsite, Washington DC Area | TS/SCI Required About the Role Our client, a federal services contractor, needs a senior data engineer to build and run cloud data pipelines supporting a government mission. You'll own the full data lifecycle...SeniorFull timeFor contractors
- ...partnering with a highly respected organization that is making significant investments in its enterprise data and AI capabilities. This is an opportunity for a senior-level engineer to help shape the future of a modern Azure-based data platform while working with cutting-edge...Senior
- ...Senior Data Engineer - Neo4j & Graph Technologies Python · Neo4j · Graph Databases · Data Engineering · AI Enablement Pittsburgh, PA (Preferred) | Dallas, TX | Cleveland, OH | Hybrid | Full-Time Opportunity ABOUT US Incedo is a global AI, data, and digital...SeniorFull time
- ...Role: Senior AWS Data Engineer Locations: Fort Mill, SC Experience: 09+ years Key Skills: Data, AWS, Airflow, Glue HVR Mode of Hire: Full time Job Description: Design, develop, and maintain ETL processes to extract, transform, and load data from various...SeniorFull time
- ...Position Summary We are seeking a highly skilled Senior Data Engineer to join our dynamic team. This role involves leveraging advanced data solutions to enhance personalization and operational efficiency within our organization. The ideal candidate will bring strong...Senior
- ...Senior Synthetic Data Engineer Location: Remote Description Summary: Seeking an experienced Senior Synthetic Data Engineer to join our team supporting Veterans. The Senior Synthetic Data Engineer is responsible for designing, developing, and maintaining the enterprise...SeniorFull timeLocal areaRemote workFlexible hours
- ...technology consulting leader based in the US. Immediate interviews for the below position. Share your updated resume to apply. Lead Data Engineer Location: Princeton, NJ Design and develop scalable enterprise data solutions using Databricks, supporting large-scale...SeniorFull timeImmediate start
- ...Primary Location : Chicago, IL V-Soft Consulting is currently hiring for a Senior Data Center Engineer for our premier client in Chicago, IL. Education and Experience: ~4-year college degree in a related field and/or relevant professional experience ~7 years...SeniorCurrently hiringLocal area
- ...Hybrid Every other week onsite/5 days in Durham, NC Our client seeks a senior Data Engineer to design, build, and maintain operational and analytical capabilities across modern data platforms. The role focuses on Snowflake, AWS, and Python to enable scalable data lakes...Senior
- The Opportunity A leading financial technology company is looking for a Senior Data Engineer to help build, enhance, and maintain the data infrastructure supporting its lending and insurance businesses. This is a hands-on engineering opportunity for someone with...SeniorFull time
$160k - $180k
...Senior Data Engineer Location: Orange County, CA Salary: $160-180k base + equity We are working with a rapidly scaling advanced technology company developing integrated software and hardware systems that operate in real world environments. Their platform processes...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
- junior data engineer remote United States
- bi data engineer United States
- data platform engineer United States
- principal data engineer United States
- data engineer analytics United States
- data science developer United States
- data integration engineer United States
- data engineer manager United States
- big data developer United States
- data engineer freelance United States






