Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer

Sigma Software

Senior Data Engineer

Join Sigma Software to build large-scale data infrastructure powering a real-time AdTech platform processing hundreds of millions of auction requests daily. We are looking for a Senior Data Engineer who enjoys solving complex distributed data challenges and building production-grade ML-oriented data systems.

You will become part of a dedicated Sigma Software team developing predictive modeling and optimization capabilities for a live advertising ecosystem. The role combines large-scale event processing, streaming and batch pipelines, experimentation infrastructure, and high-throughput data engineering in a cloud-native environment.

We as a company offer the opportunity to work on impactful global products, collaborate with experienced engineers, and contribute to architecture decisions while growing your expertise in large-scale distributed systems and modern data platforms.

Our Customer is a technology company operating supply-side infrastructure within the programmatic advertising ecosystem. The company manages a large-scale ad exchange handling hundreds of millions of auction requests per day and is actively investing in predictive decisioning technologies to optimize advertising outcomes in real time.

The project focuses on building a predictive modeling and optimization platform on top of a live ad exchange environment. The platform performs real-time supply scoring and filtering, contextual performance estimation, look-alike audience generation, and multi-objective optimization under business constraints.

The solution processes massive-scale event and auction datasets and includes feature engineering pipelines, streaming and batch ingestion, experimentation infrastructure, point-in-time-correct training data generation, and ML-oriented data services with strict operational reliability and compliance requirements.

Job Description
  • Write and defend diagnostic SQL queries against large-scale production datasets
  • Build and maintain ingestion pipelines for bid, win, and impression logs into BigQuery
  • Harmonize fields across independently designed datasets and maintain versioned field mappings
  • Develop point-in-time-correct feature tables and aggregation pipelines
  • Design and maintain conversion and labeling pipelines with delayed label handling
  • Own the data serving write path, schema contracts, publishing flows, and freshness SLOs
  • Build experimentation infrastructure including traffic splitting and reporting pipelines
  • Perform large-scale historical backfills and safe reprocessing after mapping changes
  • Implement data isolation and safe-aggregation controls for advertiser data protection
  • Develop automated data quality validation frameworks
  • Collaborate closely with Customer engineers and prepare operational documentation
  • Contribute to architecture discussions and platform scalability improvements
Qualifications
  • 5+ years of experience in Data Engineering
  • At least 2 years of experience working with production ML or large-scale analytics pipelines
  • Expert-level SQL skills including window functions and incremental processing patterns
  • Strong Python skills for production-grade pipeline development
  • Hands-on experience with Spark or PySpark
  • Experience designing ETL / ELT pipelines with Airflow, Cloud Composer, Dagster, or similar tools
  • Experience working with cloud data warehouses at scale, preferably BigQuery
  • Strong understanding of data modeling and point-in-time correctness
  • Experience working with event-driven or clickstream datasets at very large scale
  • Experience supporting business-critical production pipelines
  • Upper-Intermediate English level or higher

Will Be A Plus

  • Experience with GCP services including Dataflow, Pub/Sub, GCS, and Beam
  • Experience building streaming or near-real-time ingestion systems
  • Understanding of feature stores, train/serve skew, and label leakage prevention
  • Experience in AdTech or auction-based environments
  • Experience handling delayed or incomplete labels in ML systems
  • Experience with dbt or similar transformation frameworks
  • Experience delivering solutions into Customer-owned infrastructure
  • Knowledge of GDPR/CCPA-related privacy engineering practices
  • Experience with experimentation infrastructure and statistical validation pipelines
  • Experience working in hybrid cloud/on-prem Linux environments
  • Terraform and Kubernetes experience
  • Experience optimizing warehouse cost and performance
Additional Information

Personal Profile

  • Strong analytical and problem-solving skills
  • Ownership-oriented mindset
  • Ability to work independently in a client-facing environment
  • Strong communication and documentation skills
  • Comfortable working in a fast-paced engineering environment
  • Collaborative and proactive attitude
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in United States vacancy
  • $110k - $130k

     ...We are looking for an experienced Senior Data Engineer with strong expertise in Databricks, Python, PySpark, Apache Spark, and large-scale data engineering. The ideal candidate will be responsible... 
    Senior
    Full time

    Neshent Technologies

    Atlanta, GA
    11 days ago
  • Senior Data Engineer ***Sponsorship is not provided*** ***No Third Party Resumes*** Onsite in Peachtree Corners, GA - Hybrid Salary - Competitive Position Summary We are seeking an experienced, highly motivated Senior Data Engineer to help design, develop, and optimize... 
    Senior
    Temporary work

    Capstone Logistics LLC

    Peachtree Corners, GA
    22 hours ago
  • We are looking for a Senior Data Engineer with AI to architect and build intelligent AI workflows that merge models, enterprise data, and business logic into dependable, production-ready solutions. Within this position, you will construct scalable AI deployment pipelines... 
    Senior

    EPAM Systems

    United States
    3 days ago
  • RESPONSIBILITIES: Kforce has a client in Atlanta, GA that seeking a Senior Data Engineer to join their team, to design and develop scalable data solutions supporting enterprise business initiatives. This role will build complex ETL pipelines and data models, work across... 
    Senior
    Hourly pay
    Contract work

    Kforce Technology Staffing

    Atlanta, GA
    3 days ago
  • $65 - $70 per hour

     ...Virtual / In-person interview (In-person interview required)  Job Description: · We are seeking an experienced Senior Full Stack with Data Engineering with 8+ years of IT experience in designing, developing, and implementing scalable enterprise applications and... 
    Senior
    Contract work

    Long Finch Technologies

    Chicago, IL
    3 days ago
  •  ...Responsibilities: Develop, manage, organize, store, and analyze enterprise data and data systems. Participate in all phases of the software...  ..., development, testing, and QA. Collaborate closely with engineering teams to design and implement scalable data solutions.... 
    Senior

    Apexon

    Parsippany, NJ
    28 days ago
  •  ...Role : Senior Data Engineer location : Bethlehem, NJ ( Hybrid ) Job Type : Contract-W2 Job Description : (Primary: Databricks | Good-to-have: IDMC) Role Summary : Seeking a strong Databricks-focused Data Engineer with expertise in ETL design, data pipeline... 
    Senior
    Contract work

    Prudent Technologies and Consulting, Inc.

    New Jersey
    22 hours ago
  •  ...We're Hiring | Senior Snowflake Data Engineer Location: New Jersey, USA Experience: 8+ Years Snowflake Experience: 5+ Years We are looking for an experienced Senior Snowflake Data Engineer with strong expertise in designing, developing, and optimizing... 
    Senior

    Apexon

    Parsippany, NJ
    8 days ago
  • $70 - $85 per hour

    Senior Data Infrastructure Engineer Remote (Eastern or Central time zone preferred) Contract (Remote) Compensation: $70 - $85 per hour ABOUT THE ROLE We are seeking a Data Infrastructure Engineer to help build and scale a next-generation data platform for a... 
    Senior
    Hourly pay
    Contract work
    Work at office
    Remote work

    Brooksource

    United States
    22 hours ago
  •  ...Company – Our client is a growing global provider of data-driven analytical and technical services supporting critical national...  ...long-standing reputation as a top workplace. Job Title – Senior Data Engineer Location – Hybrid in Alexandria, VA – typically 3 days... 
    Senior
    Full time
    Remote work

    Covenant HR

    Alexandria, VA
    26 days ago
  •  ...Senior Data Engineer – Applied AI | Louisville, Kentucky | Onsite | US Citizen Only We’re partnering with an established US and global infrastructure manufacturer looking for a Senior Data Engineer with hands-on Python and applied AI experience to take hands on ownership... 
    Senior

    Enzo Tech Group

    Louisville, KY
    9 days ago
  •  ...Job Title: Senior Data Engineer Location: Mclean, VA/ Richmond, VA - Hybrid Duration: 07+ Months Contract with Extension Job id – 180924 Responsibilities : Designing and implementing high-performance data pipelines that handle large volumes of data... 
    Senior
    Contract work

    PTR Global

    Richmond, VA
    26 days ago
  •  ...We are looking for an experienced Senior Data Engineer with 5–7 years of hands-on experience in ETL, Reverse ETL, data integration, and cloud-based data platforms. The ideal candidate will have strong SQL skills and practical experience working with AWS data services... 
    Senior
    Work experience placement

    HireRising

    Phoenix, AZ
    9 days ago
  •  ...Job Duties:-• Experience: 8–10 years in Data Engineering and Data Analysis. • Informatica Expertise: Strong hands-on experience in Informatica PowerCenter/IDQ for ETL design, development, and optimization. • PySpark Development: Advanced skills in PySpark for large... 
    Senior

    ThoughtStorm

    Cleveland, OH
    28 days ago
  • $400k

     ...Senior Data Engineer - Hedge Fund - New York - Up to $400k TC Join a leading Hedge Fund where Data Engineering sits at the heart of the investment process. Global hedge fund with a consistent record of strong returns Heavy investment in technology and data,... 
    Senior
    Full time

    Durlston Partners

    New York, NY
    2 days ago
  •  ...We are looking for an experienced Senior Data & AI Engineer to join a leading healthcare organization in Phoenix, AZ on a 100% on-site basis. In this role, you will architect, build, and operationalize modern data platforms and AI/ML solutions across complex healthcare... 
    Senior
    Full time

    Nexorant LLC

    Phoenix, AZ
    1 day ago
  •  ...growth. Find your future with us. Boeing Commercial Airplanes (BCA) has an exciting opportunity for a Product Data Management Engineer (Mid-Level or Senior) to join our team located in North Charleston, SC. The 787 Engineering organization is seeking a... 
    Senior
    Permanent employment
    Work experience placement
    Relocation
    Visa sponsorship
    Work visa
    Flexible hours
    Shift work
    Day shift

    Boeing

    North Charleston, SC
    9 hours ago
  •  ...To support the Tech Enablement team, the full-time Senior Big Data Engineer will design, build, and maintain data pipelines and systems for web events, tackle challenges with large datasets, and develop frameworks to accelerate machine learning across products in a hybrid... 
    Senior
    Full time
    Remote work

    Virtual Vocations Inc

    United States
    2 days ago
  •  ...Senior Data Engineer - AWS Charlotte, NC - Onsite 6 Months+ Required Skills & Qualifications • Data engineering, backend development, or software engineering, with demonstrated hands-on development experience. • Strong hands-on experience with AWS data and cloud... 
    Senior

    Precision Technologies

    Charlotte, NC
    5 days ago
  •  ...Senior AWS Data Engineer | Onsite, Washington DC Area | TS/SCI Required About the Role Our client, a federal services contractor, needs a senior data engineer to build and run cloud data pipelines supporting a government mission. You'll own the full data lifecycle... 
    Senior
    Full time
    For contractors

    Oxenham Group

    Washington DC
    3 days ago
  •  ...partnering with a highly respected organization that is making significant investments in its enterprise data and AI capabilities. This is an opportunity for a senior-level engineer to help shape the future of a modern Azure-based data platform while working with cutting-edge... 
    Senior

    Robert Half

    Raleigh, NC
    22 days ago
  •  ...Senior Data Engineer - Neo4j & Graph Technologies Python · Neo4j · Graph Databases · Data Engineering · AI Enablement Pittsburgh, PA (Preferred) | Dallas, TX | Cleveland, OH | Hybrid | Full-Time Opportunity ABOUT US Incedo is a global AI, data, and digital... 
    Senior
    Full time

    Incedo Inc.

    Pittsburgh, PA
    16 days ago
  •  ...Role: Senior AWS Data Engineer Locations: Fort Mill, SC Experience: 09+ years Key Skills: Data, AWS, Airflow, Glue HVR Mode of Hire: Full time Job Description: Design, develop, and maintain ETL processes to extract, transform, and load data from various... 
    Senior
    Full time

    Coforge

    Fort Mill, York County, SC
    9 days ago
  •  ...Position Summary We are seeking a highly skilled Senior Data Engineer to join our dynamic team. This role involves leveraging advanced data solutions to enhance personalization and operational efficiency within our organization. The ideal candidate will bring strong... 
    Senior

    Dexian

    Covington, KY
    14 days ago
  •  ...Senior Synthetic Data Engineer Location: Remote Description Summary: Seeking an experienced Senior Synthetic Data Engineer to join our team supporting Veterans. The Senior Synthetic Data Engineer is responsible for designing, developing, and maintaining the enterprise... 
    Senior
    Full time
    Local area
    Remote work
    Flexible hours

    HigherEchelon

    United States
    2 days ago
  •  ...technology consulting leader based in the US. Immediate interviews for the below position. Share your updated resume to apply. Lead Data Engineer Location: Princeton, NJ Design and develop scalable enterprise data solutions using Databricks, supporting large-scale... 
    Senior
    Full time
    Immediate start

    Univedge Consulting LLC

    Princeton, NJ
    18 hours ago
  •  ...Primary Location : Chicago, IL V-Soft Consulting is currently hiring for a Senior Data Center Engineer for our premier client in Chicago, IL. Education and Experience: ~4-year college degree in a related field and/or relevant professional experience ~7 years... 
    Senior
    Currently hiring
    Local area

    V-Soft Consulting Group, Inc.

    Chicago, IL
    26 days ago
  •  ...Hybrid Every other week onsite/5 days in Durham, NC Our client seeks a senior Data Engineer to design, build, and maintain operational and analytical capabilities across modern data platforms. The role focuses on Snowflake, AWS, and Python to enable scalable data lakes... 
    Senior

    Eliassen Group

    Durham, NC
    22 hours ago
  • The Opportunity A leading financial technology company is looking for a Senior Data Engineer to help build, enhance, and maintain the data infrastructure supporting its lending and insurance businesses. This is a hands-on engineering opportunity for someone with... 
    Senior
    Full time

    Prestige Staffing

    Charlotte, NC
    18 hours ago
  • $160k - $180k

     ...Senior Data Engineer Location: Orange County, CA Salary: $160-180k base + equity We are working with a rapidly scaling advanced technology company developing integrated software and hardware systems that operate in real world environments. Their platform processes... 
    Senior
    Full time

    Harnham

    Orange County, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!