Sr. Data Engineer

VDart Inc

United States

Sr. Software Development Engineer (Data Engineer)

Remote

Contract

Responsibilities:

Build, optimize, and operate production Apache Spark pipelines that generate attributed conversion and optimization feeds from large-scale impression and conversion data.
Design and evolve data processing and models across modern data lake and warehouse technologies, orchestrated with a production workflow scheduler on AWS.
Build and operate partner optimization feeds and integrations with external partners, including schemas, identity fields and unique IDs, file delivery, reconciliation, and SLAs.
Build, change, and operate production REST APIs, including PHP APIs, delivering secure, backward-compatible changes end to end (implementation, validation, authorization, data access, documentation, automated testing, and production diagnostics).
Trace and modify behavior across controllers, database queries, templates, JavaScript, and automated tests.
Diagnose production failures, reconcile partner-facing data, execute backfills, and manage staged releases and rollbacks.
Write and maintain unit and integration tests across pipelines, APIs, and feeds.

Qualifications and Education Requirements:

7+ years of professional software or data engineering experience.
4+ years building, optimizing, and maintaining production Apache Spark pipelines, with strong Java and Python skills across JVM Spark and PySpark.
Advanced SQL, relational data modeling, and large-scale data processing experience, including production work with Snowflake, MySQL, and Iceberg.
3+ years operating AWS data workloads using S3 and Airflow (or equivalent production workflow orchestration); container orchestration and data-catalog experience a plus.
3+ years building, changing, and operating production REST APIs, including PHP APIs built with Symfony or a closely equivalent PHP MVC framework.
Demonstrated proficiency using AI development tools to deliver production-quality work efficiently - including AI-assisted coding, code review, documentation, and investigation, working with agentic code harnesses, and spec-based (spec-driven) AI development - with the judgment to know when to rely on AI output and when not to.
Ability to independently deliver secure, backward-compatible API changes, including implementation, validation, authorization, data access, documentation, automated testing, and production diagnostics.
Experience implementing external provider or client integrations involving schemas, APIs, file delivery, identity fields, reconciliation, privacy-sensitive data, and SLAs.
Production full-stack experience with PHP, Symfony (or a comparable framework), Doctrine, Twig (or another server-rendered template system), and JavaScript.
Ability to trace and modify behavior across controllers, database queries, templates, JavaScript, and automated tests.
Experience writing unit and integration tests for data pipelines, APIs, and web applications.
Ability to diagnose production failures, reconcile data, execute backfills, manage staged releases and rollbacks, and support delivery commitments.
Hands-on experience building and running big data systems, with a focus on performance, reliability, and data quality.
Experience in ad tech or advertising measurement, such as attribution, conversions, audience and impression data, identity matching, or partner optimization feeds.
Ability to ramp quickly and deliver with minimal onboarding in an existing, complex codebase.

Preferred Skills:

Direct experience building partner optimization or advertising feeds with external platforms (DSPs, publishers, or measurement partners).
Experience with deterministic and probabilistic identity matching - unique IDs, device IDs, IP-based matching, and identity graphs.
Familiarity with edge/log delivery infrastructure and pixel/impression tracking.
Experience with data lake table formats and query engines at large scale.
Experience with privacy and compliance-driven data workflows (deletion, opt-out, suppression, data retention).
Comfort operating in uncharted territory - turning ambiguity into production systems without a detailed guide.

Apply

Vacancy posted 5 days ago

Similar jobs that could be interesting for youBased on the Sr. Data Engineer in United States vacancy

Sr. Data Infrastructure Engineer (Remote)
$116k - $209k
...other. Ready to join a mission that matters? The future of cybersecurity starts with you. About the Role: As a Sr. Data Infrastructure Engineer, you will be a key member of the Data Platform Operations team, responsible for building out the AWS GovCloud environment...
Senior
Permanent employment
Work experience placement
Work at office
Local area
Remote work
Remote
7 days ago
Sr Data Engineer
Job ID: 25980592Reference Number: 25-00862Title: Sr Data EngineerPosted Date: 2025-07-28Company: HAN Staffing Job Description :- Need 12+ of Data EngineerNeed Skills:AWSDatabricksPySparkSplunkWith Thanks & RegardsRishav VermaLead Recruiter HAN IT Staffing Direct Number...
Senior
HAN Staffing
Iselin, NJ
4 days ago
Sr.Data Engineer
Desirable Technical Skills • Familiarity with and invoking web-APIs• Exposure to machine learning engineering• Exposure to NLP and text processing• Experience with pipelines, job scheduling and workflow managementPersonal Skills Experienced in managing work with distributed...
Senior
NTT DATA
Irving, TX
7 days ago
Sr Data Engineer
THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham...
Senior
Work at office
Harnham
Dallas, TX
7 days ago
SR AWS Data Engineer
Job ID: 19901220Reference Number: 23-00979Title: SR AWS Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2023-06-06Contact: Shyam MaramContact... ...candidates willing to move, must ALREADY live here. SR Data Engineer ***All candidates must be local to Malvern, PA. Will not...
Senior
Work experience placement
Local area
HAN Staffing
Iselin, NJ
4 days ago
W2 Sr. Data Engineer
...Staff Data Engineer - Data Platform - (Remote) Location : This position is open to remote work anywhere in the US. Applicants must be willing to travel to the Milliman office in Brookfield, WI as needed and travel nationwide for meetings, conferences, and team events...
Senior
Permanent employment
Full time
Work at office
Remote work
System Soft Technologies
Brookfield, WI
12 hours ago
Data Engineer - Sr
$75 - $80 per hour
Data Engineer - W2 Only - No C2C Location: Mclean VA - Hybrid Onsite Interview - 1 round onsite interview - Local only or some one who is willing to travel to interview Job Description: Ideal candidates will have experience with building Data integration(ETL) pipelines...
Senior
Full time
Local area
Pinnacle Group
McLean, VA
4 days ago
Sr. AWS Data Engineer (Redshift/ S3/ Databricks)
...Resource 1 is in need of a Data Engineer (AWS/ SQL/ Databricks) with at least 5 years of experience for a 6-month contract-for-hire with our client in the north suburbs. Individual will need to be local and able to work onsite in Northfield, IL 3 days per week. The resource...
Senior
Contract work
Local area
3 days per week
Resource 1, Inc.
Northbrook, IL
7 hours ago
Sr. Data Engineer
...We are seeking an experienced Sr. Data Engineer with strong expertise in Databricks, Python, Salesforce Automation, ETL, SQL, and Azure Data Factory to design, build, and operate production-grade data pipelines and lakehouse data products. The role supports data products...
Senior
Full time
BrickRed Systems
Washington DC
3 days ago
Sr Data Engineer
• Analyze and understand data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design... ...with and invoking web-APIs• Exposure to machine learning engineering• Exposure to NLP and text processing• Experience with pipelines...
Senior
NTT DATA
Irving, TX
4 days ago
Sr Data Engineer
Req ID:299734NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to... ...forward-thinking organization, apply now.We are currently seeking a Sr Data Engineer to join our team in Los Angeles, California (US-CA), United...
Senior
NTT DATA
Los Angeles, CA
6 days ago
Sr Data Engineer
...field-service business that is in the middle of transitioning its data warehousing function from an offshore vendor to an in-house,... ...systems. The platform works, but it's young — we need a senior engineer who can help mature it, close data quality gaps, accelerate table...
Senior
Odd job
Full time
Flexible hours
Headfarmer
Phoenix, AZ
7 hours ago
Sr. Data Engineer IV
Sr. Data Engineer IVContract through 12/31/26 with ongoing extensions*REMOTE BUT MUST BE ABLE TO INTERVIEW ONSITE IN PHILADELPHIA, PA*We are seeking a Senior Data Engineer to support enterprise data modernization initiatives focused on inventory, supply, and yield analytics...
Senior
Remote work
Robert Half
Philadelphia, PA
3 days ago
Sr Data Engineer
...NessContact: Meghana GorusuCompany: SRI Tech SolutionsJob Title: Sr Data EngineerLocation: Boston, MA (3-4 days a week onsite)Skill Set:... ...SQL and PythonJob Description:We are looking for a Senior Data Engineer with added emphasis on data analysis and Salesforce knowledge,...
Senior
Work at office
3 days per week
SRI Tech
Boston, MA
3 days ago
Sr. Data Engineer
...ITC Infotech is Sr. Data Engineer to join our team in Tempe, AZ. Work Set up: You'll have to be there in office for 4 business days in week. About Us: ITC Infotech is a leading global technology services and solutions provider, led by Business and Technology Consulting...
Senior
Full time
Work at office
Local area
Day shift
Early shift
ITC Infotech
Tempe, AZ
7 hours ago
Sr. Data Engineer
$100k - $122k
...: a1qjB000000yRADQA2Valid through: 2027-09-30Job Title: Senior Data EngineerLocation (city, state): Arlington, TXAssignment Type: Direct... ...(k).An established organization is expanding its internal data engineering capabilities to support enterprise reporting, customer insights...
Senior
Remote work
Addison Group
Dallas, TX
4 days ago
Sr. Data Engineer (UP)
$200k - $250k
...United StatesIndustry: Trading FirmPosted: 2026-07-28Contact: Ethan HudsonEmail: ****@*****.***: (***) ***-****Senior Data Engineer - Core Data PlatformLocation: Chicago, IL or New York, NY (Hybrid)About the OpportunityAre you ready to architect high-...
Senior
Temporary work
Flexible hours
Objective Paradigm
Chicago, IL
4 days ago
Sr. Big Data -Engineer
...fields of Software Development, Software Consultancy and Information Technology Enabled Services.Job DescriptionJob Description:-Our Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you...
Senior
Permanent employment
Full time
H1b
Sonsoft
Jersey City, NJ
3 days ago
Sr. Data Center Engineer
Job-ID31596945Reference25-33093Job Title: Senior Data Center Engineer Location: Broomfield, COJob Description:This position is considered essential to our data center operations. This role will provide infrastructure management for essential operational components such...
Senior
Work at office
Axelon
Broomfield, CO
3 days ago
SR AWS Big Data Engineer
Job ID: 19913905Reference Number: 23-00987Title: SR AWS Big Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2023-06-08Contact: Shyam... ...hanstaffing.comContact Phone: (***) ***-****Company: HAN StaffingData Engineer PA, NC,AZMust Day One Hybrid - No Remote NO CPT AND NO OPT c...
Senior
For contractors
Remote work
Relocation
HAN Staffing
Iselin, NJ
4 days ago
Sr. Data Engineer
Job Title: Sr. Data Engineer Location: HYBRID in Detroit, MI (3 days per week in office req.) Contract to Hire after 6 months Job Summary: We are looking for a Senior Data Engineer to design, build, and optimize scalable data pipelines and data platforms supporting analytics...
Senior
Contract work
Work at office
3 days per week
Spectraforce Technologies
Detroit, MI
6 days ago
Data Sr Engineer
Req ID:373225NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be... ...organization, apply now.We are currently seeking a Data Sr Engineer to join our team in boston, Massachusetts (US-MA), United States...
Senior
Work at office
Remote work
Flexible hours
NTT DATA
Boston, MA
6 days ago
Sr Data Engineer -- Assortment and Space Planning
...yourself and also be part of something bigger.Position Purpose:Data Engineers within the Assortment and Space Planning Data Science team translate... ...update data structures and integrity on an automated basis.The Sr. Data Engineer position creates and establishes design...
Senior
Full time
Work experience placement
Night shift
Home Depot
Atlanta, GA
6 days ago
Sr. Data Engineer
$2,500 per month
The Sr Data Engineer is responsible for designing, building, and maintaining scalable data pipelines, infrastructure, and data visualization to support our data-driven decision-making processes. The scope of this job includes collaborating with data scientists, analysts...
Senior
Full time
Work experience placement
WellSky
Overland Park, KS
3 days ago
Sr. Data Engineer
...remote position; however, candidates must be willing to travel quarterly to home office in South Sioux City, NE. Sr. Data EngineerAre you a Data Engineer that enjoys building robust data solutions and interested in shaping the future of data infrastructure? Join our growing...
Senior
Work at office
Remote work
Home office
Great West Casualty
South Sioux City, NE
3 days ago
Sr Data Engineer
...secrets to our success -- so we give you unlimited access to everything you need to create innovative new solutions on our engineering team. As a Sr. Data Engineer, you will design, build, and support scalable data solutions that enable faster, more reliable decision-making...
Senior
Full time
Milwaukee Electric Tool
Menomonee Falls, WI
6 days ago
Sr. Data Engineer (HYBRID)
...people who want to do meaningful work in an environment that expects more and delivers more.Job DescriptionEquinox is seeking a Sr. Data Engineer to join our technology team. This hands-on role will build and continuously evolve the data platform, business applications,...
Senior
Work at office
Equinox Holdings
New York, NY
5 days ago
Sr. Data Engineer
...WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole: Sr. Data EngineerLocation: Dallas, TX (3 days work from office)Note:We... ...functional teams to implement data strategy · Design and build data engineering pipeline frameworks while ensuring these are reusable,...
Senior
Hourly pay
Work experience placement
Work at office
Local area
SRI Tech
Dallas, TX
3 days ago
Sr. Data Engineer - AI
...technical role designing, building, and supporting secure, scalable data pipelines that connect enterprise data sources to AI/ML models.... ...solving complex integration challenges and advancing data engineering best practices. Provide practical front-end development support...
Senior
Dairy Farmers of America
Kansas City, KS
4 days ago
Data Engineer (SE / Sr SE)
$130k - $200k
Santa Clara, CAData Engineering - Data Infrastructure /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver software for factory-built autonomous trucks. Headquartered in Silicon Valley with operations in the United States and Europe, Plus...
Senior
Full time
Plus.ai
Santa Clara, CA
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr. Data Engineer. Be the first to apply!