Lead Databricks Data Engineer: Scalable Pipelines & AI
Amerilife Group, LLC
AmeriLife Group, LLC is seeking a Lead Data Engineer to play a key role in engineering its enterprise data platform on Databricks. In this position, you will design and build scalable data pipelines and develop transformation frameworks crucial for enterprise analytics and AI initiatives. This role demands strong experience in Python, SQL, Databricks, and PySpark. A comprehensive benefits package is available, including PTO, medical, dental, and retirement savings. #J-18808-Ljbffr Amerilife Group, LLC
$150k - $175k
Job Summary The Lead Data Engineer will play a key role in engineering the enterprise data platform on Databricks, building scalable pipelines and transformation frameworks that support enterprise analytics and AI initiatives. Key Responsibilities Design and build scalable...DatabricksPipelineLocal area- Revstar is looking for a Databricks Engineer to develop and optimize data pipelines and implement AI solutions. The role requires expertise in Apache Spark and Delta Lake... ..., remote-first environment while building scalable data solutions across various industries. This...DatabricksPipelineRemote job
$125k - $145k
Amerilife Group, LLC is seeking a Senior Data Engineer to design and develop scalable data pipelines that support analytics, reporting, and AI initiatives. The candidate will build and maintain PySpark pipelines in Databricks and develop data ingestion workflows. This...DatabricksPipeline$125k - $145k
A leading insurance provider in New York is seeking a Senior Data Engineer to design and develop scalable data pipelines for analytics and AI initiatives. Responsibilities include building PySpark pipelines... ..., SQL, and experience with Databricks. The salary range is $125,000...DatabricksPipeline$125k - $145k
Job Summary Senior Data Engineer will design and develop scalable data pipelines that support analytics, reporting, and AI initiatives across the enterprise data platform. Key Responsibilities... ...and maintain PySpark pipelines in Databricks. Develop scalable data ingestion and...DatabricksPipelineLocal area- ...Solution Architect to lead and oversee... ...organization: AI initiatives ,... ...Development , and Data & Cloud... ...ensure delivery of scalable, innovative, and... ...development, deployment pipelines, and continuous... ...Snowflake, Databricks, and BigQuery.... ..., and data engineering. #J-18808-Ljbffr...DatabricksPipelineFor subcontractor
$125k - $135k
...skilled and motivated Data Engineer II to join our... ...supporting the F‑35 AI/ML Spares Project.... ...AWS‑based ETL/ELT pipelines, curated... .... You will design scalable data infrastructure... ...Responsibilities Lead end‑to‑end data pipeline... ...Prefect. Use Azure Databricks (Spark) and Azure...DatabricksPipeline$160k - $190k
...an Enterprise Data Architect who is... ...well‑structured, scalable data systems.... ...platform built on Databricks and Lakehouse... ...analytics, AI, and operational... ...Responsibilities Define and lead the enterprise... ...with data engineering teams to... ...into production pipelines Core Technical...DatabricksPipelineLocal area- A leading technology firm is seeking a talented Data Engineer to build and optimize scalable data pipelines and infrastructure. This role is fully remote, requiring applicants to be based in the U.S. Responsibilities include developing ETL processes, designing data storage...PipelineRemote work
- ...Principal Software Engineer focused on Agentic AI and DevOps. The... ...capabilities, lead cloud-native DevOps... ...maintain CI/CD pipelines using Azure... ...enabling resilient, scalable ingestion and... ...alerting. Engineer data and analytics... ...integrations: Azure Databricks, PostgreSQL,...DatabricksPipeline
- A data analytics firm is seeking a Data Engineer skilled in MEM SQL (SingleStore) to design and optimize scalable data pipelines. The ideal candidate will have strong SQL skills and experience in ETL processes. Responsibilities include developing data solutions, collaborating...Pipeline
- Booz Allen Hamilton International is seeking a Junior Data Engineer to leverage big data for impactful missions. The role involves implementing data engineering activities, developing scalable platforms, and collaborating in an Agile multi-disciplinary team for crucial...Pipeline
- Job Title Data Engineer III Location Doral, FL Required Clearance Top... ...(Bronze/Silver/Gold) using Databricks or reliable data processing... ...training. Develop automated data pipelines that process structured and... ...workflows. Design scalable ML inference systems that handle...DatabricksPipeline
- Overview We are hiring a Data Engineer on behalf of one of our prestigious Fortune 500... ...Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines for structured and unstructured data... ...technologies like Spark, Hadoop, or Databricks is preferred. Knowledge of data...DatabricksPipelineVisa sponsorship
- ...Hours Full Time - Remote The Data Engineer is responsible for building,... ...‑on development of data pipelines, data models, and transformation... ..., maintain, and optimize scalable ELT/ETL pipelines using modern... ...platforms such as Databricks, Snowflake, or Azure Synapse...DatabricksPipelineFull timeRemote workShift work
$90k - $170k
...we’re looking for a skilled Data Engineer to join our team and help drive... ...endpoints and running as a scalable cloud service in AWS.... ...What You’ll be Doing Data Pipeline Development: Design and implement... ...and reports in Tableau and Databricks to expose key data points and...DatabricksPipelinePermanent employmentFull timeWork experience placementRemote workWork from homeRelocationFlexible hours- ...cyber resiliency and AI to protect today and enable... ...organization to lead Data and AI Strategy advisory... ...platforms (Snowflake, Databricks, Fabric, AWS Glue) Serve... ...in Software Architect/Engineer roles OR a Master’s... ...memory management, RAG pipelines, LLM evaluation, and...DatabricksPipeline
- A defense technology company is seeking a Data Engineer III to design and implement medallion architectures using Databricks. The role involves developing automated data pipelines and implementing MLOps best practices. Candidates should have strong data engineering skills...DatabricksPipeline
- ...is seeking an experienced Senior Data Engineer to contribute to advancements in AI systems. The ideal candidate will... ...experience in building robust data pipelines and a deep understanding of SQL... ...accuracy and clarity, designing scalable data systems, and optimizing SQL...PipelineRemote job
- ...robust NG RF Systems Launch Engineering team, you will develop and train AI models to automate... ...metrics. You will manage data and project infrastructure... ...the agents, knowledge pipelines, and ML models that reduce... ...Experience with Databricks or similar platforms for...DatabricksPipelinePermanent employmentTemporary workLocal area
- A technology company is seeking a skilled Data Engineer to enhance their data infrastructure. The role is crucial for building and optimizing data pipelines while ensuring data integrity and security. Responsibilities include managing databases, automating workflows, and...PipelineRemote job
- Junior Data Engineer - Jobright.ai, Doral, FL Job Summary Booz Allen Hamilton International is a leading firm in technology solutions, seeking a Data... ...activities, develop scalable platforms, and work with... ...industry Deploy and develop pipelines and platforms that organize...Pipeline
- ...Predictive Analytics / ML Engineer is responsible for... ...learning solutions to support data-driven decision-making.... ...problems. Develop pipelines to integrate models... ...improve model accuracy, scalability, and interpretability.... ...SageMaker, Azure ML, GCP AI Platform). Knowledge of...Pipeline
- Data Engineer job at Royal Caribbean Group. Miramar, FL. Journey with... ...Group’s Data Analytics and AI Team has an exciting career... ...optimizing reusable enterprise data pipelines effectively and in a timely... ...pipelines for greater scalability, etc. Work with stakeholders...PipelineFull time
- ...technical contribution. As a Data Engineering Manager, you will... ...team. What You’ll Do Lead the design and... ...directly to complex Databricks implementations and architectural... ...data modeling, ELT pipelines, orchestration, and... ...the reliability, scalability, and security of data...DatabricksPipeline
- ...in class software engineering and exceptional client... .... US clients are leading trading and financial... ..., FPGA, and AI. Position overview As a Senior Data Engineer / Analytic... ...of data engineering pipelines and ETL processes.... ...Platform tools to build scalable and efficient systems...PipelineRemote jobStart working todayWork at officeWork from homeFlexible hours
$106.61k - $284.28k
...repository of healthcare data spanning over 150... ...foundation for ambitious engineers. In this high-impact... ...and visionary, leading the evolution of our... ...Architect Petabyte Pipelines: Engineer scalable, reliable, and performant... ...products. Innovate with AI: Leverage Cursor AI,...PipelineHourly payFull timeTemporary workLocal areaShift work- ...in class software engineering and exceptional client... .... US clients are leading trading and... ...Blockchain, FPGA, and AI. Position overview... ...looking for a Senior Data Engineer with deep... ...and optimize data pipelines and ETL processes,... ...high performance, scalability, and reliability....PipelineRemote jobStart working todayWork at officeFlexible hours
- ...generation of enterprise AI missed something... ...a trusted data foundation for the... ...it is a massively scalable multi-model database... ...developers, data engineers, and technology leaders... ...generating pipeline meetings through targeted... ...& AI world, i.e., Databricks, Neo4j, Snowflake,...DatabricksPipelineWork at officeRemote workWorldwide
- ...Data Engineer - Clinical Data Mart (Remote, West Coast Preferred) EX BCBS Preferred REMOTE... ...Responsibilities: Build dbt Pipelines: Design and maintain staging,... ...APIs (highly preferred) Background in AI/ML within the healthcare domain Overall...PipelineRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Databricks Data Engineer: Scalable Pipelines & AI. Be the first to apply!

