Data Engineer - Airflow, dbt, Kubernetes/OpenShift
Conch Technologies Inc
Job Title: Data Engineer Airflow, dbt, Kubernetes/OpenShift
Experience: 10+ Years
Duration: 12 months Contract on W2
Location : Jersey City , NJ ( Hybrid , Onsite )
Job DescriptionWe are seeking a highly skilled Data Engineer with strong enterprise data engineering experience and deep expertise in Apache Airflow, dbt Core, Python, Kubernetes/OpenShift, and SQL . The role will focus on building, operating, and optimizing scalable data pipelines supporting financial, accounting, migration, and high-volume data processing workloads.
Key Responsibilities- Design, develop, and maintain complex Apache Airflow DAGs for batch and event-driven pipelines.
- Optimize Airflow scheduling, executors, workers, dependencies, retries, SLAs, and alerting.
- Lead dbt Core implementation, including data modeling, testing, documentation, macros, incremental models, and CI/CD.
- Develop staging, intermediate, and mart data models following analytics engineering best practices.
- Deploy and manage data workloads on Kubernetes/OpenShift .
- Implement workload distribution, horizontal scaling, resource optimization, and autoscaling.
- Monitor and tune pipeline performance across Airflow, dbt, data platforms, and infrastructure.
- Implement observability through logs, metrics, alerts, and proactive monitoring.
- Ensure high availability, fault tolerance, security, and resiliency.
- Collaborate with data architects, platform engineers, and business stakeholders.
- Support financial reporting, accounting, regulatory data, and enterprise migration initiatives.
- 10+ years of Data Engineering, Analytics Engineering, or Platform Engineering experience.
- Expert-level Apache Airflow DAG development, orchestration, scheduling, and performance tuning.
- Expert-level dbt Core modeling, testing, macros, implementation, and optimization.
- Strong Python and advanced SQL skills.
- Deep production experience with Kubernetes and/or OpenShift .
- Strong understanding of distributed workload management and performance optimization.
- Experience with cloud data platforms, containerized deployments, CI/CD, Git , and enterprise production environments.
- Financial services or accounting platform experience.
- Enterprise system migration experience.
- Experience with Oracle data warehouses .
- Experience supporting high-volume data processing and regulatory reporting.
- Expert Apache Airflow / DAG development and performance tuning .
- Expert dbt Core / data modeling / testing / implementation .
- Strong Python + SQL .
- Production Kubernetes/OpenShift experience.
- Enterprise-scale data engineering and distributed workload optimization experience.
With Regards,
Prem Chand Kolli | US IT Recruiter
View email address on us.fitly.work View phone number on us.fitly.work *825
Conch Technologies, Inc |
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - Airflow, dbt, Kubernetes/OpenShift in Jersey City, NJ vacancy
- ...seeking a highly skilled Senior Data Engineer with 8+ years of hands-on experience... ...deep expertise in Apache Airflow DAG development, dbt Core modeling and implementation,... ...cloud-native container platforms (Kubernetes / OpenShift). This role is critical to building...Suggested
Zuven technologies Inc
Jersey City, NJ2 days ago - ...Job Summary (Senior Data Engineer): - Lead the design, development, and maintenance... ...complex data pipelines using Apache Airflow and dbt Core for enterprise-scale financial... ...cloud-native container platforms (Kubernetes/OpenShift), ensuring efficient resource...Suggested
Expert Technology Services
Jersey City, NJ2 days ago - ...Senior Data Engineer Airflow, dbt, Kubernetes/OpenShift Location: Jersey City, NJ - onsite Duration: 6 months Interview: Virtual round and final in-person Note: Must be local with DL copy LinkedIn with location (before 2022)...SuggestedLocal area
Akaasa Technologies
Jersey City, NJ2 days ago $80 - $85 per hour
...Seeking a highly skilled Senior Data Engineer with 8+ years of hands-on experience... ...including deep expertise in Apache Airflow DAG development, dbt Core modeling and implementation,... ...cloud-native container platforms (Kubernetes / OpenShift). location: Jersey City, New Jersey...SuggestedHourly payContract workTemporary workWork experience placementRandstad
Jersey City, NJ1 day ago$80 - $85 per hour
...Senior Data EngineerSeeking a highly skilled Senior Data Engineer with 8+ years of hands-on experience in enterprise... ...deep expertise in Apache Airflow DAG development, dbt Core modeling and... ...native container platforms (Kubernetes / OpenShift). location: Jersey City, New...SuggestedHourly payContract workRandstad
Jersey City, NJ3 days ago- ...seeking a highly skilled Senior Data Engineer with 10+ years of professional experience... ...hands-on expertise in Apache Airflow DAG development, dbt Core modeling and implementation,... ...container platforms such as Kubernetes and OpenShift. This role is responsible for building...
Compunnel
Jersey City, NJ3 hours ago - Job Title: Senior Data Engineer. Location: Jersey City, NJ (On-site). Employment Type: Contract (W2 through ZipStaff... .... This role requires expert-level Apache Airflow , dbt Core , and production Kubernetes / OpenShift . General ETL or warehouse-only engineers without...Contract work
- ...Sr. Data Engineer Jersey City, NJ, United States About the Job Our client is expanding... ...with pipeline technologies like DBT, Apache Airflow or FiveTran Experience with MPP... ...container orchestration tools like Docker or Kubernetes Experience with Azure data product...Flexible hours
Inizio Partners
Jersey City, NJ3 days ago - ...possible.As a Lead Software Engineer at JPMorgan Chase,... ...& Investment Banking - Data Analytics - Payments Technology... ...using Spark, Airflow, Kafka, and FlinkDevelops... ...grade data platforms on Kubernetes with open catalog... ...BI platforms (Tableau, dbt Metrics) JPMorganChase...
- Job Title: Sr. Data Engineer Location: Jersey City, NJ Hybrid (3-4 days... ...services, API design, etc. Kubernetes CI/CD (preferably GitLab) Job Orchestration (preferably Airflow) Familiarity with Snowflake... ...expert) Nice to have Azure DBT AI automation experience Financial...
- ...Data Engineer - LOCAL ONLY - NYC OR NJ Long Term 2-3 years of experience, Snowflake... ...intelligence tools • Proven experience with dbt (data build tool) & Snowflake • Strong... ...tools like Azure Data Factory or Airflow • Experience with git and git-based workflowsWork experience placementLocal area
Veracity
Jersey City, NJ4 hours ago - ...About the job Lead AWS Data Engineer Role - AWS/Senior DE Location - JC, NJ (3-4 days reporting in office) Type -... ...legacy modernization programs Familiarity with tools such as dbt, Apache Airflow, AWS Glue, or similar orchestration frameworks Solid...Work at office
Inizio Partners
Jersey City, NJ1 day ago - ...Data Engineer Location: Jersey City, NJ Position Type: Contract to Hire Duration: 08/03/20... ...or Snowpark. Hands-on experience with dbt (Data Build Tool) for: Data transformation... ...and workflow tools such as Airflow, Databricks Workflows, or Snowflake Tasks...Contract work
Argyle Infotech
Jersey City, NJ4 days ago - ...ROLE: - Sr. Data Engineer LOCATION: - Jersey City, NJ DURATION: - Only fulltime MUST SKILLS: - SQL, PLSQL,... ...ETL and ELT tools ~ Hands-on experience with Snowflake, DBT and Airflow is highly preferred ~ Experience in building cloud native...Full time
Maintec Technologies
Jersey City, NJ1 day ago $126k - $210k
...you will Build robust batch/streaming data pipelines and transformations that ensure... ...and dependencies using modern data engineering tools.Partner with analytics, AI, business... ..., SQL, and orchestration tools such as Airflow and/or dbt.Strong understanding of cloud and lakehouse...Temporary workWorldwideFlexible hours- ...We are looking for a Senior Data Engineer to join our Data Team and help... ...domain data models, improve our dbt and data transformation... ...using technologies such as dbt, Airflow, Spark , or similar frameworks... ...or other streaming systems; Kubernetes; Iceberg or other open table...Work at officeFlexible hours3 days per week
- ...possible.As a Lead Software Engineer at JPMorgan Chase,... ...& Investment Banking - Data Analytics - Payments Technology... ...using Spark, Airflow, Kafka, and FlinkDevelops... ...grade data platforms on Kubernetes with open catalog... ...BI platforms (Tableau, dbt Metrics) JPMorganChase...
- ...a brighter future and make a meaningful difference.As a Lead Data Engineer at JPMorganChase within the Corporate Sector, you are an integral... ...and operate workflow orchestration (e.g., Apache Airflow) to schedule, monitor, and manage data movement and transformationsModel...
$126k - $210k
...bachelors degree in Computer Science, Engineering, or a related discipline, or equivalent... ...experience in software development and data engineering; experience in financial services... ..., SQL, and orchestration tools such as Airflow and/or dbt. We need a strong understanding of...Full timeTemporary workWorldwideFlexible hoursBNY
Jersey City, NJ16 days ago$90k - $125k
...Annually A Day in the Life of a Data Analytics Engineer at MetLife Legal Plans:... ...analytics solutions using DBT Cloud, AWS, Python, and SQL... ...management tools such as Airflow, Prefect, or Dagster. Familiarity... ...Terraform or other IaaC, Kubernetes Cluster, IBM I DB2, AWS CLI...Full timeContract workTemporary workLocal areaRemote work$142.32k - $213.48k
...come join us. We’ll enable growth and progress together.The Sr Data Engineer, AVP is an intermediate level position responsible for... ...experience requiredHands on experience with AWS Glue, AWS Athena, AIRFLOW, SNOWFLAKEDatabase expertise on Database systems - MongoDB, Oracle...Full time$82.42k - $126.6k
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...shell scripting. Experience in orchestration tool like Autosys, Airflow. Sound knowledge of relational databases (SQL) and experience...Full timeTemporary workRelocation- We are seeking a seasoned Data Engineer with 3-7 years of experience in data engineering, cloud platforms and distributed systems, along... ...pipelines and container orchestration tools like Docker and Kubernetes.• Experience working in agile environments delivering complex...Work experience placement
$65 - $70 per hour
Position: Data Engineer- AWSLocation: Jersey City, New JerseyDuration: ContractJob ID: 172543Job Overview: As a Data Engineer III specializing... ...Redshift.Experience with scheduling/orchestration tools like Airflow or AWS Step Functions.Proficiency in Unix scripting, data...Full time- ...looking for a talented, senior engineering professional ready to take... ..., and operate an on-premises OpenShift-based platform that hosts both... ...the platform to support both Kubernetes workloads and VM workloads, including... ...and handling operational data according to sensitivity and...
- ...for you to take your software engineering career to the next level. As... ...software layer that makes our OpenShift platform usable at enterprise... ...cloud solutions that enable Kubernetes-based hypervisor and container... ...and handling operational data according to sensitivity and...
- ...Snowflake Data Engineer Location: NY/NJ Role Overview: Build and scale cloud data products... ...Develop transformation logic in SQL and dbt with version control, CI/CD, and... ...snapshots, tests, exposures. ~ Orchestration: Airflow, Control-M, or Autosys. ~ AWS: S3, IAM...
Futran Tech Solutions Pvt. Ltd.
Passaic, NJ1 day ago $60 - $65 per hour
...-on experience with Snowflake, including data modeling, performance optimization, and cost... ...and tools where relevant to enhance data engineering, analytics, automation, and productivity... .... Python. Oracle PL/SQL. DBT. BI Reporting Tools. Data Modeling....Cynet Systems
Jersey City, NJ2 days ago- Jump is seeking a Senior Data Engineer to own the data platform, focusing on reliability and performance of a Snowflake/dbt stack. You will build and maintain pipelines, tests, and governance to deliver trustworthy data for internal dashboards and client products. You...Remote job
- Job Description We are searching for a seasoned Data Engineer with a specialty in the workings of DBT. In this position you will be joining a small team (3-4 people) and helping across a variety of data projects (storage, ingestion, data cleaning, transformation) specifically...Full timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Airflow, dbt, Kubernetes/OpenShift. Be the first to apply!
Related searches
- data engineer contract Jersey City, NJ
- big data cloud engineer Jersey City, NJ
- big data developer Jersey City, NJ
- finance data engineer Jersey City, NJ
- software data engineer Jersey City, NJ
- data engineer machine learning Jersey City, NJ
- senior data quality engineer Jersey City, NJ
- data visualization developer Jersey City, NJ
- aws data engineer Jersey City, NJ
- data center engineer Jersey City, NJ