Apache Airflow Engineer
Exl Service Holdings Inc
We are seeking Apache Airflow migration resources to support a client initiative focused on migrating existing Cybermation-scheduled scripts to Apache Airflow. The resources will analyze the current Cybermation schedules, understand the existing shell/API invocation patterns, convert the schedules into Airflow DAGs, validate execution behavior, and support production deployment and handover.The migration objective is to preserve the existing business execution behavior while improving schedule control, monitoring, logging, retry handling, operational visibility, and supportability through Apache Airflow.Bachelor’s degree or equivalent experience in Computer Science, Information Technology, Engineering, or a related discipline.7+ years of overall engineering experience with hands-on Airflow, Python, and Linux/shell exposure.Strong practical understanding of job scheduling, batch/workflow orchestration, production readiness, and operational support processes.Analyze existing Cybermation job schedules, dependency patterns, runtime parameters, execution frequency, owners, success/failure behavior, and operational support expectations.Review existing shell scripts and API/cURL invocation logic to determine the appropriate Airflow DAG design, task structure, error handling, and retry configuration.Design, develop, and maintain Apache Airflow DAGs to orchestrate shell scripts, API calls, and dependent jobs with appropriate scheduling and operational controls.Configure Airflow schedules, task dependencies, retries, logging, alerting hooks, variables, connections, parameters, and environment-specific configuration as per client standards.Perform dry runs, unit testing, schedule validation, API response validation, failure/retry validation, and production-readiness checks for migrated jobs.Create migration mapping, validation evidence, deployment notes, operational runbooks, and support handover documentation.Coordinate with client SMEs, application owners, infrastructure teams, and release teams to support deployment, issue triage, initial run monitoring, and hypercare.Full timePosting Date: 2026-07-28
$155.7k - $208.7k
Job Posting Title:Lead Product Software Engineer - Data SystemsReq ID:10151200Job Description:Department/Group Overview:ESPN Product... ..., with hands-on experience using Databricks, Snowflake, and Apache Airflow for data pipeline orchestration and validation.Solid software...SuggestedFull time$144k - $160k
...Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that... ...their data. To learn more, visit . About This Role Software Engineers in our Infrastructure and Systems teams help build and...SuggestedFull timeInternshipAstronomer
New York, NY1 day ago$160k - $220k
...foot or in a vehicle, our technology is an ironman suit for engineers, linemen, and vegetation crews: same worker, same boots on the... ...runs machine learning training, and hosts our web app. We run Apache Airflow on Astronomer with DAGs that orchestrate high-volume...SuggestedFull timeWork experience placementWork at office2 days per week$152k - $230k
...Jacobs is seeking a dynamic and experienced Senior Mechanical Engineer with Tunnel Ventilation/HVAC Professional Engineer to join our... ...equipment and instrumentation. Perform field inspection, testing and airflow measurements. Draft design documents using AutoCAD,...SuggestedFull timeWork at officeRemote work$218.4k - $300.3k
FEQ327R500As the Director of Field Engineering, you will be responsible for partnering with our enterprise customers to democratize Data... ...globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks...SuggestedWork experience placementLocal areaWorldwide$90k - $115k
...methodologies, tools, distributed processing engines, event streaming platforms, and other... ...workflows or with other orchestration tools like Airflow, dbt etc. * Exposure in building robust... ...etc.* Proficiency in Big Data Platforms: Apache Spark, Presto, Amazon EMR* Experience...Temporary workLocal area$125k - $165k
...ClearBridge Investments is seeking a highly skilled and motivated Data Engineer who also possesses robust data analysis capabilities to design,... ..., Tableau, Power BI) and workflow orchestration tools (e.g., Airflow, AutoSys).Knowledge of data governance tools and practices.Soft...Full timeLocal area$130k - $225k
Network Security Production Engineer - Load Balancing Location New York Business Area Engineering and CTO Ref # 10048... ...infrastructure Automation or orchestration Frameworks e.g. Ansible, Airflow, Terraform, Chef, Salt.Proven experience with object-oriented...Temporary workFor contractorsWork experience placementWork at office$194k - $267k
...durable, automated systems that maximize platform reliability and engineering velocity.The ideal candidate is someone who enjoys analyzing... ...networking protocolsSolid understanding and experience with Apache nginx, Apache Tomcat, or similarStrong problem solving and debugging...Local areaWorldwideFlexible hours- A leading data solutions company is seeking a skilled Data Engineer to design and maintain data pipelines and architectures. The ideal... ...will have 3-6 years of experience with Snowflake and Apache Airflow, focusing on data governance and ETL processes. This is a mid...Contract work
Aptonet
New York, NY5 days ago - ...Cogent Data Solutions LLC , we are looking for a QA Automation Engineer with one of our direct clients in Austin, Texas . Title: QA Automation... .... Experience with PEIMS data collection. Experience Using Apache POI and Apache PDFBox. Seniority level Mid-Senior level...Contract workRemote work
Cogent Data Solutions
New York, NY2 days ago - ...monitoring using ITRS Geneos, LGTM stacks, and other APM tools.· Set up and monitor automated jobs in a central scheduler; ActiveBatch and Airflow· Develop automation solutions that eliminate repetitive manual work and reduce operational toil.· Disciplined use of ticket, issue,...
$104k - $139k
...material Prepares final records for the projects. Required Skills and Qualifications A minimum of 1 year of construction industry engineering experience Bachelor’s Degree in Civil Engineering, Construction or Project Management; an advanced degree is a plus (In lieu of...Full timeContract workFor contractorsFor subcontractorWork at officeLocal areaImmediate startWeekend work- ...Job Description Job Description HVAC Specialist / Building Engineer (Commercial – Non-Union) We are seeking a highly skilled HVAC Specialist / Building Engineer to join the operations team at a premier Class A commercial office property. This is a non-union position...Work at office
Trandon Associates, Inc
New York, NY11 days ago - ...runway to tackle bold ideas. We’re looking for exceptional engineers with deep experience in low-level, high-performance software and... ...record in performance engineering ~ Familiarity with tools like Apache Arrow, Parquet, DataFusion, Clickhouse, or DuckDB is a plus ~...Full timeWork at office
Spiral
New York, NY1 day ago $120k - $140k
Commissioning Engineer (Mechanical / HVAC)Location: Mount Vernon, NY (Projects throughout NYC)Salary:$120,000-$140,000Job Type: Full-TimeAbout the RoleWe're partnering with a growing mechanical contractor to hire a Commissioning Engineer who will oversee the startup, testing...For contractorsWork at office$100.2k - $167k
...reviewing and refactoring.Good knowledge of the following software engineering principles: SOLID, DRY, Law of Demeter.Keen understanding of... ...) practices.Experience with Spring & Spring Boot, Redis and Apache Kafka.Familiarity with cloud platforms (ideally Microsoft...Full timePart timeInternshipWork at office- ...Talascend is currently seeking a Senior Systems Engineer for a contract opportunity with our client in Bellevue, Washington . Overview... ...platforms, including services built on Node.js, Java, and hosted on Apache Tomcat. Familiarity with cloud technologies (Azure, AWS) and...Contract workWork experience placement
Talascend
New York, NY3 days ago $102k - $140k
Our New York City office has an exciting opportunity for a Design Services During Construction (DSDC) Engineer with experience in construction of complex water and wastewaterinfrastructure and facilities. Candidate will work closely with the other members of the project...Full timeContract workTemporary workFor contractorsWork experience placementWork at officeLocal area- ...real products out of cutting edge research in silicon photonics. The opportunity: As a growing company, we’re looking for engineers who want to move fast, solve hard problems, and leave their mark on a foundational technology. You’ll join a mission-driven team at...Flexible hours
Voyant Photonics
New York, NY16 days ago - ...technology transition. This exciting role within our Production Engineering team will provide you with the opportunity to partner with our... ...with enterprise scheduling tools such as Active Batch, Airflow, Control-M, AutoSys · Experience using/building monitoring on...Afternoon shift
$125k - $150k
Company DescriptionSenior Project Engineer, HVAC Control SystemsValhalla, USA-NY or Los Angeles, USA-CAFull-timeAt Ramboll, you will find a dedicated group of professionals that are pioneers and leaders in Data Center Strategy, Planning, Design, Integration, Commissioning...Flexible hours$93k - $100k
...Description Join JB&B and shape the future of the built environment! Founded in 1915, Jaros, Baum & Bolles has been a pillar of engineering innovation in New York City for over a century. Specializing in mechanical, electrical, plumbing (MEP) , JB&B has contributed to...Contract workFor contractorsWork at officeWork from homeJB&B
New York, NY2 days ago$105k - $155k
...Preferred QualificationsBusiness ContextThe Java Developer / Data Engineer will join the Compliance, Surveillance & Supervision Product... ...patterns• Experience with big data processing frameworks, including Apache Spark• Hands-on experience with cloud data lakes, relational...Full timeLocal areaWork from homeFlexible hours$140k - $205k
...Reliability EngineerCooley is seeking a Senior Site Reliability Engineer to join the Infrastructure & Development Operations team.... ...technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/AirflowExperience with IaC deployment of AKS/EKS/GKE...Full timeTemporary workWork at officeFlexible hoursWeekend work- ...5 years.Must have both (Scala/Spark) Required Experience:(1) Software development and design in Scala(2) Hands on experience with Apache Spark / Hadoop(3) Deep expertise in SQL and ETL batch processing(4) Proficient in a Unix/Linux, CentOS(5) Hands on experience in AWS...
- ...States East CoastPosition OverviewAs a Senior Machine Learning Test Engineer in the Research Enablement team, you will work side-by-side... ...with data pipelines and orchestration tools (e.g., Airflow, Metaflow)Familiarity with MLOps practices (model monitoring, drift...Full timeFor contractorsWork at officeRemote work
$105.1k - $164.13k
...maintainability.Provide architectural guidance, mentor mid/junior engineers, and represent the engineering team to stakeholders.Required... ...Proven experience with at least one major message broker, such as Apache Kafka, RabbitMQ, IBM MQ, Solace, or NATS.Experience with data...Permanent employmentFull timeContract workPart timeLocal areaRemote work$160k - $240k
Senior Software Engineer - Apache Kafka Infrastructure Location New York Business Area Engineering and CTO Ref # 10051649 Description & Requirements The Bloomberg Managed Services organization (BMS) is responsible for creating and curating Bloomberg...Temporary workFor contractorsWork experience placement$93.69k - $119.24k
About Us A career at Hitachi Rail will help create a legacy. With operations in every corner of the world, our work goes to the cutting-edge of digital transformation and technology. From the multi-cultural strength of our global organisation to the sustainable and innovative...Full timeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Apache Airflow Engineer. Be the first to apply!
