Data Engineer - Airflow, dbt, Kubernetes/OpenShift
Conch Technologies Inc
Job Title: Data Engineer Airflow, dbt, Kubernetes/OpenShift
Experience: 10+ Years
Duration: 12 months Contract on W2
Location : Jersey City , NJ ( Hybrid , Onsite )
Job DescriptionWe are seeking a highly skilled Data Engineer with strong enterprise data engineering experience and deep expertise in Apache Airflow, dbt Core, Python, Kubernetes/OpenShift, and SQL . The role will focus on building, operating, and optimizing scalable data pipelines supporting financial, accounting, migration, and high-volume data processing workloads.
Key Responsibilities- Design, develop, and maintain complex Apache Airflow DAGs for batch and event-driven pipelines.
- Optimize Airflow scheduling, executors, workers, dependencies, retries, SLAs, and alerting.
- Lead dbt Core implementation, including data modeling, testing, documentation, macros, incremental models, and CI/CD.
- Develop staging, intermediate, and mart data models following analytics engineering best practices.
- Deploy and manage data workloads on Kubernetes/OpenShift .
- Implement workload distribution, horizontal scaling, resource optimization, and autoscaling.
- Monitor and tune pipeline performance across Airflow, dbt, data platforms, and infrastructure.
- Implement observability through logs, metrics, alerts, and proactive monitoring.
- Ensure high availability, fault tolerance, security, and resiliency.
- Collaborate with data architects, platform engineers, and business stakeholders.
- Support financial reporting, accounting, regulatory data, and enterprise migration initiatives.
- 10+ years of Data Engineering, Analytics Engineering, or Platform Engineering experience.
- Expert-level Apache Airflow DAG development, orchestration, scheduling, and performance tuning.
- Expert-level dbt Core modeling, testing, macros, implementation, and optimization.
- Strong Python and advanced SQL skills.
- Deep production experience with Kubernetes and/or OpenShift .
- Strong understanding of distributed workload management and performance optimization.
- Experience with cloud data platforms, containerized deployments, CI/CD, Git , and enterprise production environments.
- Financial services or accounting platform experience.
- Enterprise system migration experience.
- Experience with Oracle data warehouses .
- Experience supporting high-volume data processing and regulatory reporting.
- Expert Apache Airflow / DAG development and performance tuning .
- Expert dbt Core / data modeling / testing / implementation .
- Strong Python + SQL .
- Production Kubernetes/OpenShift experience.
- Enterprise-scale data engineering and distributed workload optimization experience.
With Regards,
Prem Chand Kolli | US IT Recruiter
View email address on us.fitly.work View phone number on us.fitly.work *825
Conch Technologies, Inc |
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - Airflow, dbt, Kubernetes/OpenShift in Jersey City, NJ vacancy
- ...Job Summary (Senior Data Engineer): - Lead the design, development, and maintenance... ...complex data pipelines using Apache Airflow and dbt Core for enterprise-scale financial... ...cloud-native container platforms (Kubernetes/OpenShift), ensuring efficient resource...Suggested
Expert Technology Services
Jersey City, NJ3 days ago - ...seeking a highly skilled Senior Data Engineer with 8+ years of hands-on experience... ...deep expertise in Apache Airflow DAG development, dbt Core modeling and implementation,... ...cloud-native container platforms (Kubernetes / OpenShift). This role is critical to building...Suggested
Zuven technologies Inc
Jersey City, NJ3 days ago - ...Senior Data Engineer Airflow, dbt, Kubernetes/OpenShift Location: Jersey City, NJ - onsite Duration: 6 months Interview: Virtual round and final in-person Note: Must be local with DL copy LinkedIn with location (before 2022)...SuggestedLocal area
Akaasa Technologies
Jersey City, NJ3 days ago $80 - $85 per hour
...Senior Data EngineerSeeking a highly skilled Senior Data Engineer with 8+ years of hands-on experience in enterprise... ...deep expertise in Apache Airflow DAG development, dbt Core modeling and... ...native container platforms (Kubernetes / OpenShift). location: Jersey City, New...SuggestedHourly payContract workRandstad
Jersey City, NJ1 day ago- ...Sr Data Engineer Location: Jersey City, NJ Duration: Long Term Must Have Skills ~10... ...The role requires hands-on experience with DBT and Apache Airflow deployed on Kubernetes, specifically within an on-prem OpenShift environment. ~ This position involves closer...Suggested
GlobalPoint
Jersey City, NJ1 day ago $80 - $85 per hour
...Seeking a highly skilled Senior Data Engineer with 8+ years of hands-on experience... ...including deep expertise in Apache Airflow DAG development, dbt Core modeling and implementation,... ...cloud-native container platforms (Kubernetes / OpenShift). location: Jersey City, New...Hourly payContract workTemporary workWork experience placementJersey City, NJ6 days ago- ...Description Job Description Job Title: Senior Data Engineer. Location: Jersey City, NJ (On-site).... ...platforms. This role requires expert-level Apache Airflow , dbt Core , and production Kubernetes / OpenShift . General ETL or warehouse-only engineers...Contract work
ZipStaff Inc.
Jersey City, NJ6 days ago - ...possible.As a Lead Software Engineer at JPMorgan Chase,... ...& Investment Banking - Data Analytics - Payments Technology... ...using Spark, Airflow, Kafka, and FlinkDevelops... ...grade data platforms on Kubernetes with open catalog... ...BI platforms (Tableau, dbt Metrics) JPMorganChase...
$70 per hour
...676 ****@*****.*** Python Oracle Linux Airflow Developer - Onsite Final Interview **USC and GC only** DBT needed Location: Jersey City, NJ - 3 days onsite... ...the automation and orchestration of complex data workflows. The ideal candidate will have hands-on...- ...Title: Data Engineer with Financial Services, Databricks and MDM Experience - NJ ":... ...PySpark, or Snowpark. • Experience with dbt (Data Build Tool) for: o Data transformation... ...orchestration and workflow tools (e.g., Airflow, Databricks Workflows, Snowflake Tasks)...Contract work
3B Staffing LLC
Jersey City, NJ3 days ago - ...Hi, Title- Lead AWS Data Engineer Location- Jersey City, NJ Contract: Job Summary: We are seeking... ...modernization programs Familiarity with tools such as dbt, Apache Airflow, AWS Glue, or similar orchestration frameworks Solid...Contract work
Centraprise
Jersey City, NJ6 hours ago $126k - $210k
...you will Build robust batch/streaming data pipelines and transformations that ensure... ...and dependencies using modern data engineering tools.Partner with analytics, AI, business... ..., SQL, and orchestration tools such as Airflow and/or dbt.Strong understanding of cloud and lakehouse...Temporary workWorldwideFlexible hours- ...possible.As a Lead Software Engineer at JPMorgan Chase,... ...& Investment Banking - Data Analytics - Payments Technology... ...using Spark, Airflow, Kafka, and FlinkDevelops... ...grade data platforms on Kubernetes with open catalog... ...BI platforms (Tableau, dbt Metrics) JPMorganChase...
- ...a brighter future and make a meaningful difference.As a Lead Data Engineer at JPMorganChase within the Corporate Sector, you are an integral... ...and operate workflow orchestration (e.g., Apache Airflow) to schedule, monitor, and manage data movement and transformationsModel...
$126k - $210k
...bachelors degree in Computer Science, Engineering, or a related discipline, or equivalent... ...experience in software development and data engineering; experience in financial services... ..., SQL, and orchestration tools such as Airflow and/or dbt. We need a strong understanding of...Full timeTemporary workWorldwideFlexible hoursBNY
Jersey City, NJ14 days ago$82.42k - $126.6k
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...shell scripting. Experience in orchestration tool like Autosys, Airflow. Sound knowledge of relational databases (SQL) and experience...Full timeTemporary workRelocation$65 - $70 per hour
Position: Data Engineer- AWSLocation: Jersey City, New JerseyDuration: ContractJob ID: 172543Job Overview: As a Data Engineer III specializing... ...Redshift.Experience with scheduling/orchestration tools like Airflow or AWS Step Functions.Proficiency in Unix scripting, data...Full time- We are seeking a seasoned Data Engineer with 3-7 years of experience in data engineering, cloud platforms and distributed systems, along... ...pipelines and container orchestration tools like Docker and Kubernetes.• Experience working in agile environments delivering complex...Work experience placement
$142.32k - $213.48k
...come join us. We’ll enable growth and progress together.The Sr Data Engineer, AVP is an intermediate level position responsible for... ...experience requiredHands on experience with AWS Glue, AWS Athena, AIRFLOW, SNOWFLAKEDatabase expertise on Database systems - MongoDB, Oracle...Full time$130k - $200k
...Data Engineer Shaped is an API for developers to seamlessly add personalized ranking and recommendation into their products. These... ..., or BigQuery) ~ Nice-to-have skills should include DBT, Meltano, Airflow, and Apache Flink (or other stream processing frameworks)...Work at officeRemote workShaped
Brooklyn, NY3 days ago- ...Job Description The Data Engineer will be based in Fremont, California. In this position, you will report... ..., Apache Spark, or Apache Hadoop. Docker or Kubernetes Familiarity with data orchestration tools like Apache Airflow is a plus Working experience with cloud infrastructure...Work experience placementWorldwide
re-zoo-me
Brooklyn, NY2 days ago - ...for you to take your software engineering career to the next level. As... ...software layer that makes our OpenShift platform usable at enterprise... ...cloud solutions that enable Kubernetes-based hypervisor and container... ...and handling operational data according to sensitivity and...
- ...Empowers You to Build Your Future The Lead Data Engineer is responsible for overseeing the data... ...orchestration tools (e.g., Apache Airflow,Luigi) and data integration platforms (e... ...Snowflake, AzureAWS Glue, AWS AppFlow, Prefect, dbt, S3, QlikSQL, Python, Java #J-18808-...Contract work
3Core Systems
Brooklyn, NY1 day ago - ...looking for a talented, senior engineering professional ready to take... ..., and operate an on-premises OpenShift-based platform that hosts both... ...the platform to support both Kubernetes workloads and VM workloads, including... ...and handling operational data according to sensitivity and...
- ...Data EngineerWe are seeking an experienced professional with strong expertise in Snowflake... ...and tools where relevant to enhance data engineering, analytics, automation, and productivity... ...:Technical: Snowflake, Oracle Pl/SQL, DBT, Python, any BI reporting toolStrong hands...
Resource Logistics
Jersey City, NJ3 days ago - ...Role: Data Ops Engineer Location: Jersey City, NJ FTE only Job Description Must Have Technical/Functional Skills... .... Knowledge of workflow orchestrators such as Airflow, Oozie, ADF. Experience with Git, artifact management, and...
AceStack LLC
Jersey City, NJ4 days ago - ...Data EngineerWe are seeking a skilled Data Engineer to design, develop, and support modern data platforms and pipelines that power analytics, reporting, and... ...in Snowflake, Python, SQL, AWS, Oracle, and Apache Airflow, with exposure to AI/Generative AI technologies.ResponsibilitiesDesign...
E-Solutions
Jersey City, NJ4 days ago $61k - $101k
...certification in software engineering concepts, plus 5+ years... ...engineering or data platform development.... ...orchestration tools such as Apache Airflow. We need proficiency... ...data platforms on Kubernetes with open catalog integration... ...such as Tableau and dbt Metrics....Full timeJ.P. Morgan
Jersey City, NJ19 days ago- ...As a Lead Software Engineer at JPMorgan Chase, within... ...& Investment Banking – Data Analytics – Payments Technology... ...using Spark, Airflow, Kafka, and Flink Develops... ...data platforms on Kubernetes with open catalog integration... ...BI platforms (Tableau, dbt Metrics) About Us...
JPMorgan Chase & Co.
Jersey City, NJ9 days ago - ...Snowflake Developer w/d Strong DBT ExperienceLocation: 1 Pershing... ...: Design and develop scalable data pipelines using modern data... ...proactive monitoring. Work with other engineers on the team to elevate... ...Snowflake Hands-on experience with Airflow is highly recommended Strong...Work experience placement
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Airflow, dbt, Kubernetes/OpenShift. Be the first to apply!
Related searches
- data engineer contract Jersey City, NJ
- big data cloud engineer Jersey City, NJ
- big data developer Jersey City, NJ
- finance data engineer Jersey City, NJ
- software data engineer Jersey City, NJ
- data engineer machine learning Jersey City, NJ
- senior data quality engineer Jersey City, NJ
- data visualization developer Jersey City, NJ
- aws data engineer Jersey City, NJ
- principal data engineer Jersey City, NJ