Data Engineer

Purple Drive

Saint Louis, MO

Overview:

Location: St. Louis, MO

Title: Data Engineer

Experience: 10+ Years (Software/Data Engineering)

Job Description

Core Responsibilities

Drive adoption and implementation of tools and platforms that support both internal and external customers.
Serve as a key contributor across the full data/software/platform development lifecycle: design, development, documentation, testing, deployment, and support .
Operate efficiently within highly secure environments adhering to PII and PCI-DSS standards.
Support architects and engineers in designing and building scalable, secure, and agile data applications and platforms.
Design, develop, and optimize batch and real-time data pipelines using Medallion Architecture , preferably on Snowflake or Databricks .
Build modular, test-driven data transformation workflows using dbt , following strict TDD practices.
Implement CI/CD pipelines via GitLab and Jenkins for automated testing, deployment, and monitoring.
Embed DataOps principles across all phases of the pipeline lifecycle-testing, monitoring, versioning, collaboration, and automation.
Create scalable, reusable data models to support analytics and reporting, including Power BI dashboards.
Develop, optimize, and support real-time streaming pipelines using technologies such as Kafka and Spark Structured Streaming .
Establish data observability frameworks for monitoring data quality, freshness, lineage, and anomaly detection .
Lead deployments, migrations, and upgrades for data platforms ensuring minimal downtime and strong mitigation planning.
Collaborate with cross-functional stakeholders to translate requirements into reliable, high-impact data solutions.
Maintain comprehensive documentation covering pipeline architecture, processes, standards, and operating procedures.
Troubleshoot complex data and system issues using advanced analytical and problem-solving skills.
Communicate clearly and effectively with both technical and non-technical stakeholders.

Required Qualifications

Bachelor's degree in Computer Science , Engineering , or related technical discipline.
15+ years of proven experience in software development, data engineering, or platform engineering.
Deep hands-on expertise with Databricks , Python , PySpark , and Spark SQL .
Strong experience building high-performance transformations involving joins, window functions, aggregations, partitioning, and caching strategies.
Skilled in developing and managing real-time streaming pipelines .
Experience with Delta Live Tables (DLT) and Databricks Workflows ; knowledge of Lakeflow Declarative Pipelines is a plus.
Strong DevOps background including:
- Databricks Asset Bundles (DABs)
- Git/GitHub/Bitbucket
- Jenkins automation
Proven experience with dbt for modular, testable, and scalable transformation workflows.
Solid understanding of cloud database ecosystems (AWS, Azure, or GCP).
Expertise in designing scalable data models and dashboards using Power BI .
Advanced SQL development and query optimization skills.
Demonstrated capability in building and managing data observability frameworks.
Strong track record in planning and executing large-scale deployments, upgrades, and migrations with minimal operational impact.

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Data Engineer in Saint Louis, MO vacancy

Data Engineer
$114.75k - $135k
...Cushman & Wakefield’s commercial real estate (CRE) forecasting infrastructure across the Americas. This role is focused on engineering robust data pipelines, automating model workflows, and ensuring the integrity and scalability of forecasting systems.Operate as a self-...
Suggested
Minimum wage
Full time
Flexible hours
Cushman & Wakefield
Saint Louis, MO
3 days ago
Senior Data Analyst Engineer
$100k - $160k
...are proud to be a military and veteran friendly employer.About This PositionTKC Holdings is seeking a highly skilled Senior Data & Analytics Engineer to support and advance its enterprise reporting, analytics, and cloud data platform initiatives. This role will be...
Suggested
Full time
Immediate start
TKC Holdings
Saint Louis, MO
2 days ago
Lead Data Engineer
...Lead Data Engineer with Agentic AI experience Core must-haves (screen for these explicitly) Applied Agentic AI engineering experience: evidence of building Agentic workflows - ideally delivered into a real project. Modern multi-agent architecture experience: hands‑on designing...
Suggested
TechDigital Group
Saint Louis, MO
20 hours ago
Data Engineer II
...Data Engineer II Spire is seeking to fill a Data Engineer II position. This role is a primary contributor and designer of the overall Spire data warehouse, data ETL processes and analytics data model and architecture. This role is also responsible for the delivery of...
Suggested
Work experience placement
Spire
Saint Louis, MO
3 days ago
Data Engineer
...Data Engineer Data Engineer - Databases (Oracle, Netezza, SQL Server), Hands-on experience with Hadoop, Python, Impala etc. Roles and Responsibilities: - Work as a member of support team to resolve issues related to product, should have good troubleshooting skills...
Suggested
Omni Inclusive
Saint Louis, MO
1 day ago
Data Engineer II
...Data Engineer II St. Louis, MO Hybrid 4 days onsite confirmed but TONS of flexibility. Ideally USC or GC SQL/T-SQL, Azure Data Factory, Snowflake, Oracle, Python, Palantir Foundry, Star Schema/Data Warehouse design, ETL/ELT pipelines, Azure...
Full time
Work experience placement
3B Staffing LLC
Saint Louis, MO
2 days ago
Data Engineer
...is hybrid from day-1. Must have strong experience with Scala. Description : Experience dealing with large volumes of data, from various sources, both structured and unstructured. Ability to triage and talk through performance / scaling issues of dealing...
ShiftCode Analytics
Saint Louis, MO
4 days ago
Data Engineer
...iQuasar is seeking to fill a Data Engineer in St. Louis, MO. Position: Data Engineer Location: St. Louis, MO ( Onsite Mon-Fri) - Travel expenses will be paid Clearance: Secret Role Overview: The Data Engineer plays a crucial role in the application migration...
Relocation
iQuasar
Saint Louis, MO
12 hours ago
Data Engineer
...We are seeking a highly skilled and motivated Data Engineer with specialized expertise in the Adobe Experience Platform (AEP). The ideal candidate will possess a deep understanding of AEP's architecture, strong hands-on experience with Data Distiller, and a broader background...
Saxon Global
Saint Louis, MO
1 day ago
Data Engineer
...Job Summary The Data Systems Engineer serves as the critical link between IT infrastructure and day-to-day Client Team data needs. This role is equally responsible for proactive data stewardship - building, maintaining, and improving data systems - and responsive...
Moneta Group Investment Advisors LLC
Saint Louis, MO
4 days ago
Remote Game Data Engineer / Analyst (LiveOps)
$100k
...are always looking for ways to improve our games and how we operate them. We’re growing our LiveOps team and are looking for a Data Engineer/Analyst who can help us scale our LiveOps systems, reporting, and player insights to the next level. About the Role You’ll work...
Full time
Remote work
Worldwide
GrabJobs
Saint Louis, MO
20 hours ago
Lead AWS Data Engineer
...Position Title: Lead AWS Data Engineer Location: St. Louis, MO Job Description • Design and build scalable, cloud-native data platforms using PySpark, Python, and modern data engineering practices. • Mentor and guide other engineers, sharing knowledge...
Tech M USAAvance Consulting
Saint Louis, MO
2 days ago
Data Engineer
...A great candidate is excited to support our growing use of data, including working closely with the analytics and product engineering teams, to build a better user experience. Finally, they believe in Raya’s vision, which is to enrich lives by fostering relationships...
GrabJobs
Saint Louis, MO
13 hours ago
Data Engineer
...Medium is seeking a Senior Data Engineer to join their dynamic team in St. Louis. In this role, you will oversee production data pipelines, utilizing your Snowflake expertise to deliver impactful data solutions. As a part of the Data Engineering function, you'll work on...
Medium
Saint Louis, MO
2 days ago
Data Engineer
$30 - $120 per hour
...Senior Platform Engineer, Workday Extend & Integrations Company: Lyft Category: Technology At the company, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. The...
Full time
Contract work
Part time
Internship
Work at office
Remote work
Worldwide
United States Digital Space LLC
Saint Louis, MO
1 day ago
Data Engineer
...Equifax Inc. is seeking a data specialist for their St. Louis office. This role involves implementing data models in GCP, orchestrating automated workflows, and collaborating across departments. Candidates should have at least 5 years of experience in cloud environments...
Full time
Work at office
Flexible hours
Equifax
Saint Louis, MO
2 days ago
Data Engineer
...operates. No matter the location, we tailor our experience to ensure our employees are creative, productive, and happy. The Role As a Data Engineer you will handle everything from data architecture and modeling to data pipeline tooling and dashboarding. You will enable other...
Work at office
Local area
Remote work
GrabJobs
Saint Louis, MO
1 day ago
Data Engineer
...The Data Engineer helps design, build, and maintain pipelines and platforms that power our data-driven decisions across the enterprise. This role will work across cloud platforms, digital systems, and analytics tools to ensure our data is reliable, scalable, and ready...
Work at office
Build-A-Bear
Saint Louis, MO
16 hours ago
Data Engineer
...Technologies helps organizations design and implement digital, data, IoT, and AI strategies that transform how they innovate, operate... ...only) Overview AIPPY Technologies is seeking a highly skilled data engineer to serve as a strategic consultant supporting its client's...
Full time
AIPPY Technologies
Saint Louis, MO
4 days ago
Senior Data Engineer
...meaningful impact, we want to hear from you. Workforce Solutions Data & Analytics (EWS D&A) is a high-energy, fast-growing... ...including F-1 STEM OPT extension support. As a Senior Data Engineer, you will lead the evolution of our data platform, and build data...
Full time
Immediate start
Equifax
Saint Louis, MO
2 days ago
Sr Data Engineer
...Data Engineer The Data Engineer will work iteratively on the cloud platform to design, develop and implement scalable, high performance solutions that offer measurable business value to customers. Data Solutions: Design and implementation of data pipelines using...
Omni Inclusive
Saint Louis, MO
2 days ago
Data Analyst/Engineer - Junior/Entry
$100k
...Cloud World/Oracle Java One (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023... ...developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions with clients. Who Should Apply Recent...
Full time
H1b
SynergisticIT
Saint Louis, MO
4 days ago
Senior Data Engineer
...Summary Unable to Provide Sponsorship or do C2C We are seeking a Senior Data Engineer to support a Fortune 50 health insurance organization, driving impactful AI/ML initiatives across the pharmacy domain. This role will focus on designing, building, and scaling advanced...
Brooksource
Saint Louis, MO
20 hours ago
Senior Data Engineer
...Responsibilities Data Warehouse Design and Development (Snowflake): Design, develop, and maintain scalable and efficient data models... ...Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field. Minimum of 7 years...
TechDigital Group
Saint Louis, MO
14 hours ago
Senior Geospatial Data Engineer
...Object Computing, Inc. is seeking a Senior Geospatial Data Engineer to join our Xtrack Product Team. In this role, you will lead the design and implementation of scalable, cloud-based geospatial data infrastructures, and play a key part in shaping our data architecture...
Object Computing
Saint Louis, MO
13 hours ago
Senior Data Engineer
...NextEra Energy is seeking a Sr Data Engineer based in Houston, TX. The role involves designing and maintaining scalable data pipelines using modern technologies like Amazon Redshift and Databricks. Successful candidates will leverage strong software engineering principles...
Full time
NextEra Energy , Inc.
Saint Louis, MO
2 days ago
Snowflake Data Engineer
Competencies: 10-12+ years of experience Matillion Snowflake Advanced SQL Sr Data Engineer Role Summary: We are seeking a highly skilled Senior Data Engineer with strong hands-on experience in Matillion, Snowflake, and production support operations. The ideal candidate...
Permanent employment
Siri InfoSolutions Inc
Saint Louis, MO
1 day ago
Data Engineer
...turnkey real estate development, master planning, architecture, engineering, and construction firm that safely delivers clients across... ...entertainment related building projects. The Role We Want You For As a Data Engineer at Clayco, you will help build and operate the...
For contractors
Flexible hours
Clayco
Saint Louis, MO
3 days ago
Junior Data Engineer/Junior Java Spring boot developer
$90k - $154k
...Current demand often includes entry-level software programmers, Java full stack developers , Python/Java developers , DevOps engineers , data analysts , data engineers , data scientists , and ML/AI engineers . The focus remains consistent: Java / Full Stack /...
Full time
H1b
SynergisticIT
Saint Louis, MO
2 days ago
Remote Data Engineer
...in national-security focused agencies within the Department of Defense and U.S. Intelligence Community. We are seeking to hire a Data Engineer to our team! Client: CTEC develops and delivers innovative customer-centric technologies and solutions that support the Office...
Work experience placement
Work at office
Remote work
GrabJobs
Saint Louis, MO
20 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!