Data Engineer
Purple Drive
Overview: Location: St. Louis, MO Title: Data Engineer Experience: 10+ Years (Software/Data Engineering) Job Description Core Responsibilities
- Drive adoption and implementation of tools and platforms that support both internal and external customers.
- Serve as a key contributor across the full data/software/platform development lifecycle: design, development, documentation, testing, deployment, and support .
- Operate efficiently within highly secure environments adhering to PII and PCI-DSS standards.
- Support architects and engineers in designing and building scalable, secure, and agile data applications and platforms.
- Design, develop, and optimize batch and real-time data pipelines using Medallion Architecture , preferably on Snowflake or Databricks .
- Build modular, test-driven data transformation workflows using dbt , following strict TDD practices.
- Implement CI/CD pipelines via GitLab and Jenkins for automated testing, deployment, and monitoring.
- Embed DataOps principles across all phases of the pipeline lifecycle-testing, monitoring, versioning, collaboration, and automation.
- Create scalable, reusable data models to support analytics and reporting, including Power BI dashboards.
- Develop, optimize, and support real-time streaming pipelines using technologies such as Kafka and Spark Structured Streaming .
- Establish data observability frameworks for monitoring data quality, freshness, lineage, and anomaly detection .
- Lead deployments, migrations, and upgrades for data platforms ensuring minimal downtime and strong mitigation planning.
- Collaborate with cross-functional stakeholders to translate requirements into reliable, high-impact data solutions.
- Maintain comprehensive documentation covering pipeline architecture, processes, standards, and operating procedures.
- Troubleshoot complex data and system issues using advanced analytical and problem-solving skills.
- Communicate clearly and effectively with both technical and non-technical stakeholders.
- Bachelor's degree in Computer Science , Engineering , or related technical discipline.
- 15+ years of proven experience in software development, data engineering, or platform engineering.
- Deep hands-on expertise with Databricks , Python , PySpark , and Spark SQL .
- Strong experience building high-performance transformations involving joins, window functions, aggregations, partitioning, and caching strategies.
- Skilled in developing and managing real-time streaming pipelines .
- Experience with Delta Live Tables (DLT) and Databricks Workflows ; knowledge of Lakeflow Declarative Pipelines is a plus.
- Strong DevOps background including:
- Databricks Asset Bundles (DABs)
- Git/GitHub/Bitbucket
- Jenkins automation
- Proven experience with dbt for modular, testable, and scalable transformation workflows.
- Solid understanding of cloud database ecosystems (AWS, Azure, or GCP).
- Expertise in designing scalable data models and dashboards using Power BI .
- Advanced SQL development and query optimization skills.
- Demonstrated capability in building and managing data observability frameworks.
- Strong track record in planning and executing large-scale deployments, upgrades, and migrations with minimal operational impact.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Saint Louis, MO vacancy
$100k
...we are looking for entry-level software programmers, Java full-stack developers, Python/Java developers, data analysts/data scientists, and machine learning engineers for full-time positions with clients. Who should apply? Recent computer science/engineering/...SuggestedFull timeH1bRemote work- ...Data Engineer - Databases (Oracle, Netezza, SQL Server), Hands-on experience with Hadoop, Python, Impala etc. Responsibilities Work as a member of support team to resolve issues related to product, should have good troubleshooting skills and good knowledge in support work...Suggested
- ...Data Engineer III Date: May 3, 2026 Location: Birmingham, AL, US, 35203; Saint Louis, MO, US, 63101 Company: Spire Inc. Company Overview We are committed to understanding the needs of the homes and businesses we serve. That's why we're always looking for driven, collaborative...SuggestedWork experience placementFlexible hours
$49 - $70 per hour
...Job Summary Our client is seeking a Data Engineer to join their team! This position is located Hybrid in St.Louis, Missouri. Core Responsibilities Build and maintain scalable data pipelines and analytics solutions across cloud and Microsoft platforms. Design ELT/ETL processes...SuggestedHourly payLocal area- ...in a modern way while leveraging cloud-native development and having a passion for building applications. The primary focus of a Data Engineer is to help our clients build reliable, performant, and scalable solutions to help drive our customers' business forward....Suggested
- ...turnkey real estate development, master planning, architecture, engineering, and construction firm that safely delivers clients across... ...entertainment related building projects. The Role We Want You For As a Data Engineer at Clayco, you will help build and operate the...For contractorsFlexible hours
- ...Object Computing, Inc. is seeking a Senior Geospatial Data Engineer to join our Xtrack Product Team. In this role, you will lead the design and implementation of scalable, cloud-based geospatial data infrastructures, and play a key part in shaping our data architecture...
$100k
...Cloud World/Oracle Java One (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023... ...developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions with clients. Who Should Apply Recent...Full timeH1b- ...is hybrid from day-1. Must have strong experience with Scala. Description : Experience dealing with large volumes of data, from various sources, both structured and unstructured. Ability to triage and talk through performance / scaling issues of dealing...
- ...Role : Data Engineer Location : St. Louis, MO ( Onsite - Hybrid, 3 Days in a week ) Must haves: Scala, Pyspark, Databricks and AWS Role Overview: Team Focus: Supports critical data ingestion, streaming and model monitoring platforms that enable...3 days per week
- ...Position Title: Lead AWS Data Engineer Location: St. Louis, MO Job Description • Design and build scalable, cloud-native data platforms using PySpark, Python, and modern data engineering practices. • Mentor and guide other engineers, sharing knowledge...
- ...We are seeking a highly skilled and motivated Data Engineer with specialized expertise in the Adobe Experience Platform (AEP). The ideal candidate will possess a deep understanding of AEP's architecture, strong hands-on experience with Data Distiller, and a broader background...
$114.75k - $135k
...Data Engineer Supports the development, optimization, and maintenance of Cushman & Wakefield's commercial real estate (CRE) forecasting infrastructure across the Americas. This role is focused on engineering robust data pipelines, automating model workflows, and ensuring...Minimum wageFlexible hours- ...Data Engineer II St. Louis, MO Hybrid 4 days onsite confirmed but TONS of flexibility. Ideally USC or GC SQL/T-SQL, Azure Data Factory, Snowflake, Oracle, Python, Palantir Foundry, Star Schema/Data Warehouse design, ETL/ELT pipelines, Azure...Full timeWork experience placement
- Lead Data Engineer with Agentic AI experience Core must-haves (screen for these explicitly) Applied Agentic AI engineering experience: evidence of building Agentic workflows - ideally delivered into a real project. Modern multi-agent architecture experience: hands‑on...
- ...Responsibilities Data Warehouse Design and Development (Snowflake): Design, develop, and maintain scalable and efficient data models... ...Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field. Minimum of 7 years...
- ...The Data Engineer will work iteratively on the cloud platform to design, develop and implement scalable, high performance solutions that offer measurable business value to customers. Responsibilities Data Solutions: Design and implementation of data pipelines using GCP...
- ...improvements. This position manages the installation and maintenance of mechanical systems at Data Centers and operations of specialized cooling systems. Acts as an Engineering resource for the complete H5 portfolio of mission critical facilities. Plans and monitors...Work at officeImmediate start
- ...paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. The Senior Data Engineer is responsible for architecting, implementing, and maintaining scalable data pipelines while ensuring data quality, security, and...Full timeWork at officeImmediate start3 days per week
- Centene Corp. is seeking a Lead Data Engineer to design and maintain scalable technology solutions in St. Louis. The role involves building production processes and conducting performance tuning while ensuring regulatory compliance. Ideal candidates should have a Bachelor...Remote jobFull timeWork experience placement
$114.7k - $221.1k
...industry training and more. Join us to drive positive, lasting change that moves missions and the government forward! The work: Data Engineer is responsible for creating efficient data pipelines, ensuring data quality, and implementing ETL (Extract, Transform, Load)...Live inWork at officeLocal area- Job Description Design, build, and maintain data ingestion pipelines from SQL Server into Azure Databricks using CDC-based and batch... ...patterns, semantic search, or recommendation systems) General engineering Proficiency in Python for pipeline development and automation...Second job
$600 per week
...Databases, APIs, Python, Pandas, Excel, Dash, Snowflake, Docker, Airflow, Apache Spark, and Machine Learning. Now hiring for our Data Engineer cohort starting in July 2026. What We Require Willingness to relocate anywhere in the continental United States Authorization to...Hourly payWork experience placementImmediate startRelocationVisa sponsorshipRelocation package- ...Data Center Engineer The engineer in this position should have a wealth of experience engineering/installing datacenter equipment. The engineer will typically take on the more complex work and pull all aspects of a job together into a cohesive package. This would include...For contractorsWork at officeLocal area
- *** Must be a US Citizen or Green Card only Applicant **** The Data Analytics Engineer will be a part of the Data Engineering team whose primary mission is to build trusted Data Ingestion Pipelines to seamlessly move and transform data from SaaS and in house transactional...2 days per week
- ...specialize in all areas of product/project governance, UX/UI, multi-platform applications, quality assurance/testing, cloud computing, and data analytics. Since its inception, Halo Group has been recognized for numerous awards, including: INC 5000 Future 50 101 Best and...Permanent employmentFull time
- Summary Unable to Provide Sponsorship or do C2C We are seeking a Senior Data Engineer to support a Fortune 50 health insurance organization, driving impactful AI/ML initiatives across the pharmacy domain. This role will focus on designing, building, and scaling advanced...
$106.9k - $176.5k
...wherever you want it to go. Join EY and help to build a better working world. We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks. The ideal candidate will have strong client management and...Summer holidayFlexible hours$90k - $154k
...Current demand often includes entry-level software programmers, Java full stack developers , Python/Java developers , DevOps engineers , data analysts , data engineers , data scientists , and ML/AI engineers . The focus remains consistent: Java / Full Stack /...Full timeH1b$140k - $200k
...Speechify is hiring a Software Engineer in St. Louis, Missouri, responsible for data collection to support model training operations. This role requires proficiency in bash/Python scripting, Docker, and managing cloud infrastructure on GCP. Ideal candidates have a BS/MS...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- remote data engineer Saint Louis, MO
- entry level big data engineer Saint Louis, MO
- big data devops engineer Saint Louis, MO
- entry level data engineer Saint Louis, MO
- data engineer Saint Louis, MO
- software data engineer Saint Louis, MO
- big data cloud engineer Saint Louis, MO
- junior big data engineer Saint Louis, MO
- sr information security engineer Saint Louis, MO
- director data engineering Saint Louis, MO


