Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Lead Data Engineer — Spark, Databricks & Cloud Infra

Brillio

Brillio is seeking a Senior Lead Data Engineer to design and maintain ETL/ELT pipelines using PySpark and Python in Databricks. This role demands expertise in SQL, cloud infrastructure management using Terraform, and familiarity with CI/CD practices. You will collaborate in agile teams to ensure data quality and optimize performance. Brillio is known for its innovative digital solutions and is a recognized employer of choice with a commitment to fostering talent. #J-18808-Ljbffr Brillio

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Lead Data Engineer — Spark, Databricks & Cloud Infra in Saint Louis, MO vacancy
  • $125k - $130k

     ...certification year after year. Senior Lead Data Engineer Salary: $125,000 - $130,000...  ...PySpark and Python in Databricks (notebooks, jobs, Delta Lake...  .../gold layers) and optimize Spark jobs for performance, cost,...  .... Provision and manage cloud infrastructure using Terraform... 
    Databricks
    Senior
    Work experience placement

    Brillio

    Saint Louis, MO
    2 days ago
  • Job Title : Lead AWS Data Bricks Spark/Scala Engineer Job ID: 2022-11882 Job Location: Remote, Memphis, TN (preferred...  ...to Work Required Key Technology : DataBricks, AWS, Spark Job Responsibilities :...  ...architected applications for AWS Cloud Drive the mentality of quality... 
    Databricks
    Permanent employment
    Remote work

    Highbrow LLC

    Saint Louis, MO
    4 days ago
  • $49 - $70 per hour

     ...currently seeking a talented Senior Software Engineer (Cloud Data Engineering). Do you have...  ...data pipelines using Spark and Azure, and supporting...  ...What You Will Be Doing: A leading provider of mobility solutions...  ...servicessuch as Azure Databricks, Azure Functions, and Azure... 
    Databricks
    Senior

    TECHNOLOGY PARTNERS INC

    Saint Louis, MO
    21 hours ago
  • EY is seeking a Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks. You will design and implement scalable data solutions that deliver business value while collaborating closely with clients and stakeholders. The ideal candidate... 
    Databricks
    Senior

    EY

    Saint Louis, MO
    21 hours ago
  • $86.62k - $101.9k

     ...Job Title Lead Data Engineer Job Description Summary Job Description...  ...-driven pipelines in Databricks using Delta Lake, Unity Catalog...  ...-time data processing using Spark Structured Streaming and Change...  ...on experience (6+ years) in cloud-native data engineering,... 
    Databricks
    Minimum wage
    Remote work
    Flexible hours

    Cushman & Wakefield

    Saint Louis, MO
    6 days ago
  •  ...C2C We are seeking a Senior Data Engineer to support a Fortune 5...  ...operations. Responsibilities Lead the development and...  ...software and cloud-based applications. Drive...  ...platforms, including AWS, Databricks, Azure, and GCP ....  ...frameworks such as Apache Spark . Familiarity with advanced... 
    Databricks
    Senior

    Brooksource

    Saint Louis, MO
    3 days ago
  •  ...build, and maintain large‑scale data pipelines using Python, Apache Spark, and SQL across AWS services (S3, Redshift, Glue). Lead a cross‑functional team of data engineers, providing mentorship, code...  ...track record in large‑scale, cloud‑native environments. Expertise... 
    Senior

    Gravity Engineering Services Pvt Ltd.

    Saint Louis, MO
    3 days ago
  • $106.9k - $176.5k

     ...seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks. The ideal candidate will...  ...their business objectives. Lead end-to-end data pipeline development...  ...and experience with Spark for big data processing.... 
    Databricks
    Senior
    Summer holiday
    Flexible hours

    EY

    Saint Louis, MO
    4 days ago
  • Navitus Health Solutions / Lumicera Health Services in St. Louis, Missouri is hiring for an Engineer, Development Operations. This vital role focuses on designing and automating cloud infrastructure using Azure services, aiding in scalable and secure deployments.... 
    Senior
    Remote work
    Flexible hours

    Navitus Health Solutions / Lumicera Health Services

    Saint Louis, MO
    4 days ago
  •  ...Position Title: Lead AWS Data Engineer Location: St. Louis, MO Job Description • Design and build scalable, cloud-native data platforms using PySpark, Python, and modern...  ...Formation, Glue, Athena, Data Pipelines, Databricks Unity catalog, DBX S3 Any... 
    Databricks

    Tech M USAAvance Consulting

    Saint Louis, MO
    21 hours ago
  •  ...Job Title : Lead Data Engineer Location: St. Louis, MO (Hybrid, 3 Days Onsite) Must haves - Scala, PySpark, Databricks and AWS Role Overview: Team Focus: Supports...  ...python, NIFI) Big Data Platforms (Spark, Hadoop/Ozone, Hive or impala, AWS,... 
    Databricks

    Futran Tech Solutions Pvt. Ltd.

    Saint Louis, MO
    21 hours ago
  •  ...Cloud Engineer Location: St. Louis, MO Clearance: Secret Job Description: Azure Cloud engineer with experience integrating data from both internal and external data sources to build a data...  ...data engineering pipelines with Databricks or Spark. 1+ year working with... 
    Databricks
    Relocation

    iQuasar

    Saint Louis, MO
    2 days ago
  •  ...Senior Solution Architect We are looking for a Data Architect with strong experience in Databricks, enterprise data modernization,...  ...role, you will lead scalable cloud data architecture...  ...intelligence into platform engineering, establish...  ...in Databricks, Spark/PySpark, SQL,... 
    Databricks
    Senior

    Hcltech

    Saint Louis, MO
    1 day ago
  •  ...enjoy building modern data solutions,...  ...This Role Exists The Senior Developer supports...  ...ingest data into Databricks and support integration...  ...topics, and data engineering processes while...  ...pipelines using Apache Spark, Kafka, or similar...  ...working with cloud platforms such as... 
    Databricks
    Senior
    Work at office
    Flexible hours

    D&G Support Services

    Saint Louis, MO
    1 day ago
  • $140.25k - $165k

     ...Job Title Senior Manager, Data Engineering Job Description Summary Job Description Job...  ...(NYSE: CWK) is a leading global commercial real estate...  ...engineering deliverables on Databricks and Azure while also leading...  ...on delivery on Databricks (Spark, Lakeflow, Spark Declarative... 
    Databricks
    Senior
    Minimum wage
    Local area
    Remote work
    Flexible hours

    Cushman & Wakefield

    Saint Louis, MO
    3 days ago
  •  ...training facility, and leading market tools, we...  ...seeking a Senior Specialist to join...  ...and unstructured data sources, working with...  ...three years of data engineering / analytics experience...  ...leveraging Databricks and AWS services such...  ...data engineering, cloud architecture, or related... 
    Databricks
    Senior
    Local area

    KPMG

    Saint Louis, MO
    4 days ago
  • $124k - $280k

     ...Specialty/Competency: Data, Analytics & AI...  ...and analytics engineering focus on leveraging...  ...experiences you need to lead and deliver value...  ...needs. As a Senior Manager you lead large...  ...Certification in Cloud Platforms [e.g.,...  ...Snowflake Architect, Databricks Data Engineer... 
    Databricks
    Senior
    Full time
    H1b

    PwC

    Saint Louis, MO
    1 day ago
  • A leading recruitment firm is seeking a Data Engineer to enhance a large beverage company’s data and analytics initiatives. The candidate will design...  ...engineering experience, specifically in Azure Databricks and Apache Spark, is essential. This position is remote,... 
    Databricks
    Remote job

    Insight Global

    Saint Louis, MO
    1 day ago
  • $77k - $202k

     ...Specialty/Competency: Data, Analytics & AI...  ...and analytics engineering focus on leveraging...  ...experiences you need to lead and deliver value...  ...strategies. As a Senior Associate you...  ...Certification in Cloud Platforms [e.g., AWS...  ...Snowflake Core, Snowflake Databricks Data Engineer... 
    Databricks
    Senior
    Full time
    H1b

    PwC

    Saint Louis, MO
    1 day ago
  • A leading technology recruitment firm is seeking a Senior Data Engineer to support AI/ML initiatives within a Fortune 50 health insurance organization. This role involves...  ...in Python and SQL, and familiarity with cloud platforms. The company promotes a transparent hiring... 
    Senior

    Brooksource

    Saint Louis, MO
    1 day ago
  • A technology services firm is seeking a skilled cloud developer to manage GCP Composer environments and optimize data ingestion pipelines. The role includes enhancing Dataflow and Dataproc processes, managing Airflow DAGs, and implementing infrastructure as code with Terraform... 

    TechDigital Group

    Saint Louis, MO
    21 hours ago
  • Aqua IT is seeking a Sr Software Engineer in St. Louis, Missouri to support an Agile software factory. This role focuses on delivering data-centric applications, leveraging cloud-native technologies, and collaborating with integrated teams. The ideal candidate will have... 
    Senior

    Aqua IT

    Saint Louis, MO
    2 days ago
  • Equifax is looking for a Senior Data Engineer in St. Louis, Missouri, responsible for architecting and maintaining scalable data pipelines. Ideal...  ..., strong Python and SQL skills, and a proven record in cloud technologies. This on-site role engages with the Finance team... 
    Senior

    Equifax

    Saint Louis, MO
    2 days ago
  • A leading technology company in St. Louis is looking for a Senior Geospatial Data Engineer. In this role, you will design and implement scalable, cloud-based geospatial data infrastructures while optimizing complex business processes. Ideal candidates have extensive experience... 
    Senior

    Object Computing, Inc.

    Saint Louis, MO
    3 days ago
  •  ...Technology Group (CSTG) is a leading multi-cloud technology consulting firm...  .... The primary focus of a Data Engineer is to help our clients build...  ...data or analytic pipelines (Spark, AWS Glue or Azure...  ...Experience Experience with Databricks, Spark, Kafka, Kinesis, EventHub... 
    Databricks

    CleanSlate Technology Group

    Saint Louis, MO
    21 hours ago
  •  ...Solutions Group is seeking a Cloud Engineer to support our client’s intelligence...  ...testing frameworks. Lead containerized solution deployments...  ...and optimize geospatial data processing and API integrations...  ...Technologies AWS Services GitLab Apache Spark, Glue, and other ETL... 
    Senior
    Remote work
    Flexible hours
    Night shift

    (EDO) Entertainment Data Oracle, Inc.

    Saint Louis, MO
    2 days ago
  • $120k - $150k

     ...Data Engineer Absolute Business Solutions Corp (ABSC) is not just another...  ...scalable data pipelines, optimize Spark workloads, and deliver high-performance cloud solutions in support of our IC customer...  ...based tools such as Jupyter and Databricks Knowledge of Scala, SQL and R... 
    Databricks
    Remote work

    Absolute Business Solutions Corp

    Saint Louis, MO
    4 days ago
  • Gravity Engineering Services Pvt Ltd. in St. Louis, Missouri, is looking for an experienced Data Engineer to lead data engineering projects. The successful candidate will design, build...  ...using technologies such as Python, Apache Spark, and SQL while working in AWS. With... 
    Senior

    Gravity Engineering Services Pvt Ltd.

    Saint Louis, MO
    3 days ago
  • A technology solutions firm is seeking a Lead AWS Data Bricks Spark/Scala Engineer to architect and implement solutions primarily on AWS. This role emphasizes...  ...data management and engineering proficiency using Databricks and Spark, with responsibilities including migration... 
    Databricks
    Remote job

    Highbrow LLC

    Saint Louis, MO
    4 days ago
  •  ...Senior Geospatial Data Engineer Object Computing, Inc. is seeking a Senior Geospatial...  ...Team. In this role, you will lead the design and implementation of scalable, cloud-based geospatial data infrastructures...  ...technologies such as Hadoop, Spark, MapReduce, or Kafka.... 
    Senior

    Object Computing

    Saint Louis, MO
    21 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Lead Data Engineer — Spark, Databricks & Cloud Infra. Be the first to apply!