Senior Data Engineer
Sigma Software
Senior Data Engineer
Are you passionate about building cutting-edge, AI-ready data platforms from the ground up? We are looking for a Senior Data Engineer to join our Data Engineering Team and lead high-impact, greenfield initiatives.
You will work on building modern cloud-native data platforms, migrating on-premises legacy systems to the cloud, and laying the architectural foundation for AI-ready data infrastructure.
In this role, you will collaborate closely with Machine Learning, Data Science, and Product teams, serving as a key technical contributor and thought leader. You will also drive R&D efforts around agentic AI architectures, event-driven systems, and LLM-ready data pipelines – turning architectural concepts into production-grade solutions.
Job Description
- Design and build scalable, cloud-native data platforms from greenfield to production
- Implement near-real-time ingestion pipelines using event-driven patterns
- Define and enforce platform standards, including Data Lake / Lakehouse principles, medallion architecture, and data contracts
- Refactor and optimise existing Spark and PySpark scripts for performance and maintainability
- Introduce best practices for code quality, testing, and CI/CD across data pipelines
- Drive adoption of AI tooling and agentic workflows within the data engineering team
- Ensure data quality, observability, and reliability across all pipelines and platforms
- Develop self-service tooling and microservices to simplify platform usage for other teams
Qualifications
- 5+ years of professional experience in Data Engineering
- Strong Python and SQL development skills for pipeline development and optimisation
- Proficiency in Apache Spark / PySpark, including query optimisation and performance tuning
- Hands-on experience with Databricks (preferred) or Snowflake
- Experience with at least one major cloud provider: Azure (preferred), AWS, or GCP
- Experience with stream processing technologies (Kafka, Spark Structured Streaming)
- Solid understanding of ETL/ELT patterns, data modelling (dimensional, Data Vault), and data warehousing
- Experience with orchestration tools (Apache Airflow, Azure Data Factory, or equivalent)
- Knowledge of Infrastructure as Code (Terraform or equivalent)
- Understanding of production-grade system requirements: reliability, scalability, observability, and performance
- Upper-Intermediate English level
WILL BE A PLUS
- Familiarity with RAG pipeline design and LLM integration patterns
- Knowledge of data governance frameworks and tools (Unity Catalog, Apache Atlas, or similar)
- Experience with dbt for data transformation and modelling
- Familiarity with MLflow, Feature Stores, or ML platform integration
Additional Information
PERSONAL PROFILE
- Self-driven and proactive in identifying improvements
- Comfortable working in a fast-paced, innovative environment
- Strong problem-solving mindset with attention to detail
- Open to experimenting with emerging technologies and approaches
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in United States vacancy
- ...\ Duration: 6 months \ \ Work Authorization: \\ GC, USC, All valid EADs except H1B, OPT, CPT \ Must Have: \ \ ~4–6+ years of data science or machine learning experience \ ~ NLP classification for customer messages or call transcripts \ ~ Intent, topic, sentiment...SeniorFull timeH1bRemote work
Akube
United States1 day ago - Job ID: 21061868Reference Number: 24-00028Title: Senior Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-01-05Company: HAN StaffingDESenior
- Job ID: 21057342Reference Number: 24-00019Title: Senior Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-01-04Company: HAN StaffingData EngineerSenior
- ...MANTECH seeks a motivated, career and customer-oriented Senior Data Engineer to join our team in Chantilly, VA. In this role, you will leverage your software development expertise to support the design, ingestion, cleansing, transformation, loading, and visualization...SeniorWork at office
MANTECH
Chantilly, Loudoun County, VA48 minutes ago - THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham...SeniorWork at office
- Job ID: 21295731Reference Number: 24-00153Title: Senior Healthcare Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-02-07Company:... ...Healthcare DomainMinimum of 10+ years of experience in Data Engineering.Required technical skills: Python, PySpark, SQL,...SeniorContract workRemote work
- TBDGen is proud to be an equal-opportunity employer, committed to diversity and inclusivity. We base employment decisions on merit, experience, and business needs, without considering race, color, national origin, age, religion, sex, pregnancy, genetic information, disability...SeniorFull time
- ...Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsJob Title: Senior Data EngineerLocation - Mount Laurel, NJ (Day 1 Onsite)Job Description:Senior Data Engineer with 10 + years of experienceWorked on ETL, Azure, Databricks, Informatica, Oracle...SeniorWork at office
- Senior to Principal Data Engineer (SQLserver, Financial Services), Boston, MA. Hybrid, min 3 days week in office, 135k to 175k base on experienceCompensation Commensurate with experience, EOE, diverse highly educated culture Candidates must be a U.S. citizen or national...SeniorPermanent employmentContract workWork at officeLocal area3 days per week
$116.1k - $170.28k
...About the Role: We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing batch processing systems, with extensive experience in the Apache Hadoop ecosystem (Map...SeniorRemote jobFull timeRackspace
Remote1 day ago$45 - $55 per hour
DescriptionKforce has a client in Minneapolis, MN that is seeking a hybrid Senior Data Engineer to join their team.Summary:The client is looking for a Senior Data Engineer that can hit the ground running with a growing team. This team is focused on a large aspect of the...SeniorFlexible hours- ...CClient: TechMContact: Bhargav Chukka, Gulam Mohammed , Jhansi Bugatha, Vamsi SattaruCompany: SRI Tech SolutionsJob Summary (Senior ML Data Engineer) - Lead the design and maintenance of scalable data pipelines using Databricks, Spark, and Airflow. - Develop and manage...SeniorHourly pay
$75 - $80 per hour
OverviewLABUR is partnering with a client to hire a Senior Data Engineer with 8+ years of experience across modern data platforms including Databricks, Azure Data Factory, and Informatica (PowerCenter/IDMC). Life Sciences or regulated industry experience is strongly preferred...Senior- OverviewWe are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application teams to design, build, and support next-generation data platforms and pipelines that ingest, process, and transform large-scale data into...Senior
- ...Bellevue, WAEmployment Type: C2CIndustry: Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole: Senior Data Engineer Location: Bellevue, WA Job Description: We are seeking a skilled and motivated Senior Data Engineer/Data Engineer to join...Senior
- ...uurHBOStafRotterdamEen baan boordevolInnovatie: Jij bouwt en optimaliseert data-backendoplossingen die onze organisatie intelligenter en efficië... ...te ontwikkelen en te implementeren.Jij gaat het makenAls Data Engineer bij Croonwolter&dros ben jij verantwoordelijk voor het ontwerpen...SeniorFull timeWork at office
- Job Title: Sr. DATA EngineerWork Location : Tampa FLJob Description:Seeking a Senior professional with 3 to 5 years of experience in Python Scala and Spark SQL to design... ...jobs and data pipelines Collaborate with data engineers’ data scientists and stakeholders to translate...Senior
- ...candidate is a problem-solver who enjoys working on complex data systems and is passionate about data quality. You thrive in collaborative... ...and confidently.About the RoleWe're seeking a talented Senior Data Engineer to join our Enterprise Architecture team in a cross-cutting...Senior
- ...services. We are in search of a highly motivated candidate to join our talented Team.Job Title: Senior Data EngineerLocation: McLean, VA (Remote)Summary: Our Data Engineering team is dedicated to integrating our client data and applications with client infrastructure....SeniorRemote work
- ...Metro Area, Texas, United StatesPosted: 2025-11-11Company: Addison GroupTitle: Senior Data EngineerLocation: Coppell, TXSalary Range: $120K-$140KWe are looking to bring on a Senior Data Engineer to our team due to growth. What we need is someone who comes 8+ years of...Senior
- Job Title: Sr. DATA Engineer Work LocationTampa FLJob Description:Mandatory Karat InterviewRole Overview We are seeking a highly skilled and motivated AWS Certified Engineer to design build and optimize scalable data solutions within the Amazon Web Services AWS ecosystem...Senior
$35 - $45 per hour
DescriptionKforce has a client that is seeking a remote Senior Data Engineer to join their team.Summary:We are seeking a Senior Data Engineer to support the design, development, and optimization of enterprise data platforms and large-scale data solutions. This role will...SeniorRemote work$140k - $170k
Chicago, VAHybridFull Time$140k - $170k Join a growing, data-driven organization that is investing heavily in its modern... ...data platform and analytics capabilities. We are seeking a Senior Databricks Data Engineer to design, build, and optimize enterprise-scale data solutions...SeniorFull time- ...award of contract**SOS International LLC (SOSi) is seeking a Data Engineer (C4ISR Architecture) to support our customer in McDill AFB, Florida... ...Department of Education and an additional 5 years of related senior experience, for a total of 17 years, as a substitute to the...SeniorContract workWork at officeWorldwide
- ...leadership, and trusted results to enable national security missions worldwide.Job DescriptionSOSi is seeking a highly skilled Senior Data Engineer to support a US government customer in Chantilly, VA.This role, requires working with a team of developers, data scientists,...SeniorWorldwide
$150k - $190k
...capabilities are our top-tier program and project management, data analytics, and audit services, the backbone of which is... ...and trusted results. We are looking for a dynamic Senior Data Scientist/ML Engineer with an active TS/SCI CI Poly or higher to join our team...SeniorFull timeTemporary workWork experience placementCathexis
Remote1 day ago$120k - $170k
OverviewSteampunk wants you to join our awesome team as a Senior Data Visualization Engineer. In this role you'll be working with a large team of Steampunk and clients to identify data sources, tools, and mission challenges that can all be brought together to create decision...Senior$180k - $220k
Senior Data Engineer - Market and Credit Risk PlatformsLocation: New York City or Remote (US-based)Salary: $180,000 - $220,000 base (commensurate with experience)About the RoleWe are looking for an accomplished Senior Data Engineer to join a dynamic team focused on designing...SeniorWork at officeRemote workFlexible hoursShift work2 days per week1 day per week- OverviewVTG is seeking a talented and experienced Senior Data Engineer to serve as an integrator between business needs and technical solutions. Must be able to work creatively and efficiently to solve difficult technical problems.In this dynamic role, you will not only...Senior
- Company: Tredence Inc. Position Title: Senior Data Engineer Location: 1900 Camden Ave., Suite 66, San Jose, CA 95124 Position Responsibilities: Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders...SeniorRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data center engineer United States
- senior cloud data engineer United States
- data infrastructure engineer United States
- data pipeline engineer United States
- sr information security engineer United States
- master data engineer United States
- hadoop big data developer United States
- data visualization developer United States
- associate data engineer United States
- data engineer freelance United States