Senior Data Engineer: Spark, Airflow & Big Data Pipelines
Cloud BC Labs
Cloud BC Labs is seeking a Data Engineer with 5+ years of experience in designing and maintaining data pipelines. The role involves processing large datasets and ensuring data quality across various systems, utilizing technologies like Apache Spark, PySpark, and Airflow. The ideal candidate will collaborate with cross-functional teams, participate in architecture reviews, and support analytics initiatives. Proficiency in data ingestion from Oracle, SQL Server, and other sources is required, along with strong communication skills. #J-18808-Ljbffr Cloud BC Labs
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer: Spark, Airflow & Big Data Pipelines in Dallas, TX vacancy
$79.6k - $139.3k
Senior Data Engineer with DevOps Category: Architecture Main location... ...scalable data pipelines supporting analytics,... ...data engineering and big data processing Strong expertise in Apache Spark (Spark Core, Spark SQL... ...experience with Apache Airflow for workflow orchestration...PipelineSeniorBig dataPermanent employmentFull timeLocal area- ...celebrate both the small & big wins. INCLUSION is a core tenant... ...Lantern is looking for a Senior Data Engineer to join our Data Engineering... ...knowledge of building data pipelines, batch processing frameworks... ...big data technologies such as Spark (preferred), Databricks, or...PipelineSeniorBig dataTemporary workWork at office
- Vytwo is looking for a Senior Data Engineer to join our dynamic team in the United States. The ideal candidate... ...skills in Data Engineering, Apache Spark, and Databricks. Responsibilities include designing scalable data pipelines, optimizing workflows, and collaborating...PipelineSeniorRemote jobWork from homeRelocationFlexible hours
$106.9k - $176.5k
.... We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering... ...objectives. Lead end-to-end data pipeline development, including data... ...in Databricks and experience with Spark for big data processing. Proven experience...PipelineSeniorBig dataSummer holidayFlexible hours$157.41k - $207.8k
...Job Function: Software Engineering About the Job Senior Data Engineer Location: Irving... ...of our AI-enabled data pipeline. Collaborate closely... ...time data insights for big data processing and... ...data technologies (Hive, Spark, PySpark, Airflow and Databricks); Visualization...PipelineSeniorBig dataFor contractorsWork at officeLocal areaRemote work- ...digital banking, and data and marketing—each... ...Career Growth, Best Engineering Team, and Best Places... ...Dynamic role to lead the big data engineering... ...,AI workflow and pipelining tools to maximize efficiency... ..., PySpark SQL, Airflow, Parquet, Kafka, and Spark.* Solid experience...PipelineSeniorBig dataFull timeImmediate startRemote workShift work
$77k - $202k
...development areas. Interpret data to inform insights... ...processes. As a Senior Associate you will... ...AWS Certified Data Engineer - Associate,... ...Analyst / Certified Big Data Tester (ATA),... ...and end‑to‑end data pipeline validation Utilizing... ...tools such as Qlik, Airflow, or Prefect...PipelineSeniorBig dataFull timeH1b- Dormont Manufacturing Co is looking for a passionate Data Engineer to enhance our Data Analytics and Business Intelligence platform. The ideal... ..., proficiency in ETL processes, and skills in Python, SQL, and big data technologies. We offer a supportive work environment,...PipelineSeniorBig data
$125k - $140k
...Title: AWS Certified Data Engineer Job Description... ...strong expertise in big data processing using... ...efficient, and secure data pipelines and analytics... ...big data applications (Spark, Hive, Iceberg) for performance... ...tools like Apache Airflow. • Version Control:...PipelineBig dataTata Consultancy Services
Irving, TX2 days ago$157.41k
...Health company, is hiring a Senior Data Engineer in Irving, TX to develop, build... ...‑scale data structures, pipelines, and efficient ETL workflows... ...programming languages. Apache Spark, PySpark, or Scala. JIRA,... ...cases. Data warehousing and big‑data implementation. Pay Range...PipelineSeniorBig dataTemporary workLocal areaRemote work9005 CVS Pharmacy, Inc.
Irving, TX10 hours ago- ...is seeking a technical leader for its data engineering function, responsible for overseeing data... ..., and ensuring the reliability of data pipelines. Ideal candidates will have a bachelor’... ...A mastery of SQL, cloud platforms, and big data frameworks is essential. The...PipelineSeniorBig data
- Position Data Engineer Location Dallas, TX / Pittsburgh, PA / Cleveland... ...maintaining scalable data pipelines supporting analytics,... ...will have strong expertise in Spark, PySpark, Airflow, SQL, Data Lakes, and large... ...experience in Data Engineering and Big Data processing. Strong...PipelineBig data
- ...Data Architect Technical/Functional Skills... ...Architecture, Data Engineering, and Enterprise... ...Architect end-to-end data pipelines, ETL/ELT frameworks... ...• Experience with Big Data & Data Processing: o Spark, Hadoop, Kafka,... ...Talend, DataStage, Airflow • Experience with...PipelineSeniorBig data
Diverse Lynx
Irving, TX8 hours ago $50 - $58 per hour
...advancement Job Title: Data Quality Engineer Location: Dallas, TX (... ..., and manage complex data pipelines. This role requires collaboration... ...workflows with Apache Airflow (MWAA) and support large-scale... ...with AWS services: Glue, EMR (Spark), S3, Lambda, ECS/EKS, MWAA...PipelineSeniorHourly payLong term contractWork from homeFlexible hoursSelectMinds
Dallas, TX4 days ago$92.7k - $185.4k
...community at a time. Job Summary As a Senior Analytics Engineer within the Pharmacy Services... ...scalable and sustainable pipelines for massive amounts of enterprise data. Leveraging industry‑leading... ...engineering services such as Airflow, Spark, Kubernetes, preferably Composer...PipelineSeniorHourly payFull timeTemporary workLocal areaCVS Health
Irving, TX5 days ago- ...industries of tomorrow. Its engineers build critical... ...are seeking a Lead Data Engineer to play a... ...advancing NMC²’s big data engineering... ...platforms, real‑time data pipelines, and analytics‑... .... Experience with Spark, Flink, or Beam. Experience with Airflow or other orchestration...PipelineBig dataTemporary workFlexible hours
$186k - $223k
...relationship, for all. About the Role As a Senior Engineer for our Data Platform team, you will be... ...Responsible for maintaining and enhancing data pipelines and database management frameworks,... ..., PubSub, Dataflow Databases and Big Data Tooling : Redshift, BigQuery,...PipelineSeniorBig dataWork experience placement$99k - $164.8k
...are seeking a highly skilled Senior Data Engineer to guide the design,... ...the delivery of scalable data pipelines, ingestion frameworks, and transformation... ...using Snowflake, Python, Spark, Informatica (PowerCenter/... ...frameworks (Control-M, Airflow)Strong SQL expertise with experience...PipelineSeniorWork at officeLocal area- ...leadership for the County’s data engineering function, overseeing... ..., and security of data pipelines. Guides modernization... ...Azure Data Engineer, AWS Big Data, GCP Professional Data Engineer) Airflow, Snowflake, Databricks,... ...such as Hadoop, Spark, Databricks, or Flink....PipelineBig data
$99k - $164.8k
...are seeking a highly skilled Senior Data Engineer to guide the design,... ...the delivery of scalable data pipelines, ingestion frameworks, and transformation... ...using Snowflake, Python, Spark, Informatica (PowerCenter/... ...frameworks (Control-M, Airflow) Strong SQL expertise with experience...PipelineSeniorCasual workWork at officeLocal area- 9+year of experience in data engineering, machine learning, or AI deployment... ...with Palantir Foundry (pipelines, code workbooks, ontology modeling... ...Scala, or Java; experience with Spark and cloud platforms. Hands-on... ...Unix/Linux environments and big data tools. Familiarity with...PipelineBig data
$157.41k
...for the following role in Irving, TX: Sr. Data Engineer to analyze data engineering problems and... ...and manage large‑scale data structures, pipelines and efficient Extract/Load/Transform (... ...reporting, Cognos BI Reporting tools; “Big data” platforms including Hadoop (GCP or...PipelineSeniorBig dataHourly payFull timeTemporary workLocal areaRemote work4062 Aetna Resources, LLC
Irving, TX10 hours ago- 100 CRC Insurance Group, LLC is looking for a Senior Data Engineer to design and develop data pipelines leveraging Databricks Lakehouse architecture. The ideal... ...years of experience in Databricks, strong knowledge in Spark, and a Databricks certification. Responsibilities...PipelineSenior
- TechniPros is seeking a Data Engineer in Dallas, TX to lead and optimize large-scale data pipelines across various systems. The candidate must have 8-12 years of experience... ...and strong coding skills in Python, Java, or Spark, along with expertise in SQL and NoSQL. This role...PipelineSenior
- ...Insight Global is seeking a Data Engineer in Mexico for one of our top... ...transformation and developing data pipelines. You will design data models... ...including Hadoop, Spark, Kafka, SQL databases Collaborate... ...requirements are met Work with big data pipelines to develop streaming...PipelineBig dataRemote work
$170.4 per hour
...passionate about enabling Data & AI teams to solve the world... ...business. Founded by engineers, we leap at every opportunity... ...deep-dive forensics into Spark core internals and the broader... ...Expertise in large-scale big data solutions and ETL pipelines using Spark, Delta Lake,...PipelineSeniorBig dataLocal areaWorldwide- ...Job Title: Senior Data Engineer with DevOps Duration : Full Time... ...scalable data pipeline supporting analytics,... ...data engineering and big data processing ~... ...Strong expertise in Apache Spark (Spark Core, Spark SQL... ...experience with Apache Airflow for workflow orchestration...PipelineBig dataHourly payFull timeContract work
$140k - $200k
...the commercial real estate space is hiring a Senior Data Engineer to own and scale a modern data platform... ...cutting-edge stack including Snowflake, dbt, Airflow, and Python, supporting advanced use cases like RAG pipelines, vector search, and LLM-driven workflows. This...PipelineSeniorFull time- ...Your Mission: As a Senior Full Stack Developer at Hawk... ...and ensuring best-in-class engineering practices. Support and... ...with distributed systems or big data stacks (Kafka, Spark, Hadoop). ~ Deep... ...DevOps practices, and CI/CD pipelines. ~ Familiarity with observability...PipelineSeniorBig data
Hawk Corporation
Dallas, TX4 days ago - ...Job Description Hadoop Data Engineer responsible for... ...maintain scalable data pipelines using Hadoop ecosystem tools (HDFS, Hive, Spark, Sqoop, Kafka). Build... ...Develop and manage big data solutions for structured... ...Workflow orchestration tools (Airflow, Oozie) Unix/Linux...PipelineBig data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer: Spark, Airflow & Big Data Pipelines. Be the first to apply!
Related searches
- senior cloud data engineer Dallas, TX
- principal data engineer Dallas, TX
- finance data engineer Dallas, TX
- aws data engineer Dallas, TX
- data engineer Dallas, TX
- sr data engineer Dallas, TX
- software data engineer Dallas, TX
- junior data engineer remote Dallas, TX
- remote data engineer Dallas, TX
- data engineer contract Dallas, TX