Senior Lead Data Engineer — Spark, Databricks & Cloud Infra
Brillio
Brillio is seeking a Senior Lead Data Engineer to design and maintain ETL/ELT pipelines using PySpark and Python in Databricks. This role demands expertise in SQL, cloud infrastructure management using Terraform, and familiarity with CI/CD practices. You will collaborate in agile teams to ensure data quality and optimize performance. Brillio is known for its innovative digital solutions and is a recognized employer of choice with a commitment to fostering talent. #J-18808-Ljbffr Brillio
$125k - $130k
...certification year after year. Senior Lead Data Engineer Salary: $125,000 - $130,000... ...PySpark and Python in Databricks (notebooks, jobs, Delta Lake... .../gold layers) and optimize Spark jobs for performance, cost,... .... Provision and manage cloud infrastructure using Terraform...DatabricksSeniorWork experience placement- Job Title : Lead AWS Data Bricks Spark/Scala Engineer Job ID: 2022-11882 Job Location: Remote, Memphis, TN (preferred... ...to Work Required Key Technology : DataBricks, AWS, Spark Job Responsibilities :... ...architected applications for AWS Cloud Drive the mentality of quality...DatabricksPermanent employmentRemote work
$49 - $70 per hour
...currently seeking a talented Senior Software Engineer (Cloud Data Engineering). Do you have... ...data pipelines using Spark and Azure, and supporting... ...What You Will Be Doing: A leading provider of mobility solutions... ...servicessuch as Azure Databricks, Azure Functions, and Azure...DatabricksSenior- EY is seeking a Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks. You will design and implement scalable data solutions that deliver business value while collaborating closely with clients and stakeholders. The ideal candidate...DatabricksSenior
$86.62k - $101.9k
...Job Title Lead Data Engineer Job Description Summary Job Description... ...-driven pipelines in Databricks using Delta Lake, Unity Catalog... ...-time data processing using Spark Structured Streaming and Change... ...on experience (6+ years) in cloud-native data engineering,...DatabricksMinimum wageRemote workFlexible hours- ...C2C We are seeking a Senior Data Engineer to support a Fortune 5... ...operations. Responsibilities Lead the development and... ...software and cloud-based applications. Drive... ...platforms, including AWS, Databricks, Azure, and GCP .... ...frameworks such as Apache Spark . Familiarity with advanced...DatabricksSenior
- ...build, and maintain large‑scale data pipelines using Python, Apache Spark, and SQL across AWS services (S3, Redshift, Glue). Lead a cross‑functional team of data engineers, providing mentorship, code... ...track record in large‑scale, cloud‑native environments. Expertise...Senior
$106.9k - $176.5k
...seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks. The ideal candidate will... ...their business objectives. Lead end-to-end data pipeline development... ...and experience with Spark for big data processing....DatabricksSeniorSummer holidayFlexible hours- Navitus Health Solutions / Lumicera Health Services in St. Louis, Missouri is hiring for an Engineer, Development Operations. This vital role focuses on designing and automating cloud infrastructure using Azure services, aiding in scalable and secure deployments....SeniorRemote workFlexible hours
- ...Position Title: Lead AWS Data Engineer Location: St. Louis, MO Job Description • Design and build scalable, cloud-native data platforms using PySpark, Python, and modern... ...Formation, Glue, Athena, Data Pipelines, Databricks Unity catalog, DBX S3 Any...Databricks
- ...Job Title : Lead Data Engineer Location: St. Louis, MO (Hybrid, 3 Days Onsite) Must haves - Scala, PySpark, Databricks and AWS Role Overview: Team Focus: Supports... ...python, NIFI) Big Data Platforms (Spark, Hadoop/Ozone, Hive or impala, AWS,...Databricks
- ...Cloud Engineer Location: St. Louis, MO Clearance: Secret Job Description: Azure Cloud engineer with experience integrating data from both internal and external data sources to build a data... ...data engineering pipelines with Databricks or Spark. 1+ year working with...DatabricksRelocation
- ...Senior Solution Architect We are looking for a Data Architect with strong experience in Databricks, enterprise data modernization,... ...role, you will lead scalable cloud data architecture... ...intelligence into platform engineering, establish... ...in Databricks, Spark/PySpark, SQL,...DatabricksSenior
- ...enjoy building modern data solutions,... ...This Role Exists The Senior Developer supports... ...ingest data into Databricks and support integration... ...topics, and data engineering processes while... ...pipelines using Apache Spark, Kafka, or similar... ...working with cloud platforms such as...DatabricksSeniorWork at officeFlexible hours
$140.25k - $165k
...Job Title Senior Manager, Data Engineering Job Description Summary Job Description Job... ...(NYSE: CWK) is a leading global commercial real estate... ...engineering deliverables on Databricks and Azure while also leading... ...on delivery on Databricks (Spark, Lakeflow, Spark Declarative...DatabricksSeniorMinimum wageLocal areaRemote workFlexible hours- ...training facility, and leading market tools, we... ...seeking a Senior Specialist to join... ...and unstructured data sources, working with... ...three years of data engineering / analytics experience... ...leveraging Databricks and AWS services such... ...data engineering, cloud architecture, or related...DatabricksSeniorLocal area
$124k - $280k
...Specialty/Competency: Data, Analytics & AI... ...and analytics engineering focus on leveraging... ...experiences you need to lead and deliver value... ...needs. As a Senior Manager you lead large... ...Certification in Cloud Platforms [e.g.,... ...Snowflake Architect, Databricks Data Engineer...DatabricksSeniorFull timeH1b- A leading recruitment firm is seeking a Data Engineer to enhance a large beverage company’s data and analytics initiatives. The candidate will design... ...engineering experience, specifically in Azure Databricks and Apache Spark, is essential. This position is remote,...DatabricksRemote job
$77k - $202k
...Specialty/Competency: Data, Analytics & AI... ...and analytics engineering focus on leveraging... ...experiences you need to lead and deliver value... ...strategies. As a Senior Associate you... ...Certification in Cloud Platforms [e.g., AWS... ...Snowflake Core, Snowflake Databricks Data Engineer...DatabricksSeniorFull timeH1b- A leading technology recruitment firm is seeking a Senior Data Engineer to support AI/ML initiatives within a Fortune 50 health insurance organization. This role involves... ...in Python and SQL, and familiarity with cloud platforms. The company promotes a transparent hiring...Senior
- A technology services firm is seeking a skilled cloud developer to manage GCP Composer environments and optimize data ingestion pipelines. The role includes enhancing Dataflow and Dataproc processes, managing Airflow DAGs, and implementing infrastructure as code with Terraform...
- Aqua IT is seeking a Sr Software Engineer in St. Louis, Missouri to support an Agile software factory. This role focuses on delivering data-centric applications, leveraging cloud-native technologies, and collaborating with integrated teams. The ideal candidate will have...Senior
- Equifax is looking for a Senior Data Engineer in St. Louis, Missouri, responsible for architecting and maintaining scalable data pipelines. Ideal... ..., strong Python and SQL skills, and a proven record in cloud technologies. This on-site role engages with the Finance team...Senior
- A leading technology company in St. Louis is looking for a Senior Geospatial Data Engineer. In this role, you will design and implement scalable, cloud-based geospatial data infrastructures while optimizing complex business processes. Ideal candidates have extensive experience...Senior
- ...Technology Group (CSTG) is a leading multi-cloud technology consulting firm... .... The primary focus of a Data Engineer is to help our clients build... ...data or analytic pipelines (Spark, AWS Glue or Azure... ...Experience Experience with Databricks, Spark, Kafka, Kinesis, EventHub...Databricks
- ...Solutions Group is seeking a Cloud Engineer to support our client’s intelligence... ...testing frameworks. Lead containerized solution deployments... ...and optimize geospatial data processing and API integrations... ...Technologies AWS Services GitLab Apache Spark, Glue, and other ETL...SeniorRemote workFlexible hoursNight shift
$120k - $150k
...Data Engineer Absolute Business Solutions Corp (ABSC) is not just another... ...scalable data pipelines, optimize Spark workloads, and deliver high-performance cloud solutions in support of our IC customer... ...based tools such as Jupyter and Databricks Knowledge of Scala, SQL and R...DatabricksRemote work- Gravity Engineering Services Pvt Ltd. in St. Louis, Missouri, is looking for an experienced Data Engineer to lead data engineering projects. The successful candidate will design, build... ...using technologies such as Python, Apache Spark, and SQL while working in AWS. With...Senior
- A technology solutions firm is seeking a Lead AWS Data Bricks Spark/Scala Engineer to architect and implement solutions primarily on AWS. This role emphasizes... ...data management and engineering proficiency using Databricks and Spark, with responsibilities including migration...DatabricksRemote job
- ...Senior Geospatial Data Engineer Object Computing, Inc. is seeking a Senior Geospatial... ...Team. In this role, you will lead the design and implementation of scalable, cloud-based geospatial data infrastructures... ...technologies such as Hadoop, Spark, MapReduce, or Kafka....Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Lead Data Engineer — Spark, Databricks & Cloud Infra. Be the first to apply!
- informatica cloud developer Saint Louis, MO
- senior cloud data engineer Saint Louis, MO
- cloud engineer Saint Louis, MO
- senior devops cloud engineer Saint Louis, MO
- cloud developer Saint Louis, MO
- devops cloud engineer Saint Louis, MO
- cloud architect Saint Louis, MO
- big data cloud engineer Saint Louis, MO
- senior cloud engineer Saint Louis, MO
- senior cloud solutions architect Saint Louis, MO

