Lead Data Engineer / Airflow Architect - Orchestration & Integration
Artmac Soft LLC
Who we are
Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.
Job Description:
Job Title : Lead Data Engineer / Airflow Architect Orchestration & Integration
Job Type : W2/C2C
Experience : 9-12 Years
Location : Prosper, Texas
Responsibilities:
- 9 12 years of experience in Data Engineering, Data Integration, ETL, or related areas.
- Strong hands-on expertise with Apache Airflow and enterprise orchestration architecture.
- Proven experience designing and implementing complex, enterprise-scale Airflow DAGs.
- Experience with Oracle EBS integration and enterprise application data flows.
- Experience designing highly scalable, reliable, and fault-tolerant data pipelines.
- Experience implementing data quality and validation mechanisms.
- Hands-on experience with CI/CD practices and source control.
- Experience participating in or leading technical architecture and design reviews.
- Strong programming skills in Python.
- Strong proficiency in SQL and relational databases.
- Strong understanding of ETL/ELT and data integration architecture
- Strong understanding of database synchronization, data replication, and data movement patterns.
- Strong knowledge of monitoring, observability, logging, alerting, and failure recovery.
- Strong understanding of software engineering principles, design patterns, and development standards.
- Design and define enterprise Airflow architecture, standards, frameworks, and best practices.
- Architect and develop scalable, reusable, and maintainable Airflow DAGs for complex data workflows.
- Lead the design of ETL/ELT and data integration architectures across multiple enterprise systems.
- Develop robust data pipelines using Python, SQL, and Airflow.
- Design and implement integration patterns for Oracle EBS and other enterprise applications.
- Design pipelines to support high-volume, scalable, and performance-sensitive workloads.
- Establish and improve pipeline observability, including logging, monitoring, metrics, SLA tracking, and operational dashboards.
- Implement data quality and validation frameworks to ensure data accuracy, completeness, and consistency.
Qualification:
-
Bachelor's degree or equivalent combination of education and experience.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer / Airflow Architect - Orchestration & Integration in Prosper, TX vacancy
- A leading tech company in Texas is seeking an experienced MuleSoft Lead with over 15 years... ...solutions while collaborating with Architects and stakeholders. The ideal candidate has... ...in MuleSoft and strong expertise in integration, DataWeave, and SOA. The position requires...Suggested
- ...Role: Senior Data Engineer (Remote) ~ Must be a US... ...reporting, and application integration Develop high... ...manage workflow orchestration using Apache Airflow or similar tools, ensuring... ...including data architects, analysts,... ...data solutions Lead technical design sessions...SuggestedRemote work
Vytwo
Prosper, TX2 days ago - A data solutions firm is seeking a Senior Data Engineer to design and maintain scalable data pipelines using Python and SQL. The ideal candidate will have over five years of experience and hands-on knowledge of Databricks or Snowflake. Responsibilities include optimizing...SuggestedRemote job
$110k - $204.2k
...Lead Data Engineer We are seeking a highly skilled and strategic Lead Data Engineer to join our team. In this advanced individual contributor... ...component of this position involves pioneering the integration of advanced AI solutions into our reporting processes to significantly...SuggestedFull timeWork at officeLocal areaFlexible hours- ...seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong... ...implement scalable data pipelines, integrate diverse data sources, and build... ...subject areas. Transformation & Orchestration Use DBT to develop modular, testable...SuggestedFull time
$135k - $140k
Role: Test Architect with AI and Solutions Experience Location: Dallas... ...closely with Directors, Engineering Leaders, and Business Stakeholders... ..., performance, security, data, and compliance testing.... ...automation frameworks (UI, API, integration & Data), performance, and...Shift work- Vytwo is seeking an Agiloft CLM Consultant to lead configuration, implementation and support of CLM modules for enterprise clients... ...requires 8-10 years of hands-on Agiloft CLM experience, strong ERP integration know-how, and the ability to design secure workflows and...Remote jobLocal areaWork from homeFlexible hours
- ...combines system signals (latency, errors, integration and data-flow health) with commercial... ...source of truth. AI enablement across engineering — shipping agents and productivity tools... ...development, including designing and architecting large-scale production applications...Temporary workWork from homeHome officeRelocation packageFlexible hours
- ...Vytwo Technologies Inc. is seeking a Senior Data Engineer to design and maintain scalable data pipelines. This fully remote position allows... ...significant experience with tools like Databricks and Apache Airflow. The role includes responsibilities like building data processing...Remote work
Vytwo Technologies Inc.
Prosper, TX3 days ago $172.2k - $236.9k
...The Principal Solutions Architect(role is remote but must be... ...Dallas, TX or Louisville, KY) leads teams of System and... ...scalable solutions building and integration. With a background in engineering, this role will be an... ...and Python Varity of data base technologies like...Full timeTemporary workApprenticeshipRemote workFlexible hoursHumana
Frisco, TX2 days ago- Position Purpose:The Sr Data Engineering Manager is... ...Organizational Leadership : Lead multiple engineering... ..., data products, integration frameworks, metadata... ...Matillion, DBT, and Airflow Orchestration.Experience in cloud... ...or Google Cloud, to architect and deploy scalable...Bi-weekly payWeekly payFull timeContract workTemporary workWork experience placementWork at officeLocal areaRemote workFlexible hours
- ...Toyota Financial Services is seeking a Lead Data Platform Engineer to drive the modernization of an enterprise scheduler on AWS MWAA. You will... ...Python, implement CI/CD pipelines, and collaborate with architects and stakeholders to ensure reliability, governance, and reusable...
Toyota North America
Frisco, TX18 hours ago - ...seeking a Senior AI Data Engineer to join our forward-thinking... ...this role, you will architect and own the data... ...ground-truth datasets. Integrate ServiceNow incident,... ...practices for orchestration, testing, deployment,... ...streaming pipelines (Kafka, Airflow,dbt), with strong...
Unavailable
Frisco, TX2 days ago - ...overall experience Minimum 10+ years of experience in MuleSoft At least 3+ years of experience as MuleSoft Lead At least 3+ years of experience as an Integration architect Strong knowledge of SOA and experience in designing Mule Interfaces Mule ESB, SOA, JSON, XSD, XML...
TechDigital Group
Frisco, TX2 days ago $145.6k - $166.4k
...distributed messaging systems, and data routing layers. You will serve as the... ...application developers and infrastructure engineers, ensuring that code architectures... ...design principles. • Middleware & Integration Engineering: Architect and manage enterprise middleware,...Full timeLocal area- ...the nation’s leading self-storage provider... ...You’ll Do Architect, build, and... ...and streaming data pipelines using... ..., dbt, Airflow/Cloud Composer... ...analysts, and engineers to operationalize... ...embeddings, LLM orchestration, or RAG workflows... ...production integration You’ll have the...Work at officeRemote workVisa sponsorshipFlexible hoursShift work
- Job Description: The Technical Lead will be responsible for overseeing and leading technical projects in the areas of Snowflake , DBT ,... ...maintain database systems using snowflake and sql. 5. Implement data transformation and modeling using dbt (data build tool). 6. Write...
- ...Job Description Job Description Role: IT Strategic Architect (Business Process Transformation & AI-Enabled Optimization) Client Location: Minneapolis, MN Hybrid Work - 3 Days onsite * Healthcare domain experience is a must Role Summary The IT Strategic...Work from homeFlexible hours
Vytwo
Prosper, TX8 days ago - ...Lead Adobe RTCDP Architect Bounteous is seeking a CDP Architect specializing in Adobe Real-Time Customer Data Platform (RTCDP) to design, implement, and... ...Martech Consultant, Data Engineering teams, privacy... ...SDK and API, ensuring integrity, completeness, and privacy...Full time
Bounteous, Inc.
Frisco, TX13 days ago - ...managers, and cross-functional teams to deliver scalable solutions, integrations, workflows, and user interfaces. Required Skills 3 to 5... ...CSS, and JavaScript skills Experience designing workflows, data models, and reusable components Experience integrating...
Ipolarity LLC
Frisco, TX3 days ago $122.65k - $283.91k
...ID: 383109 NTT DATA strives to hire exceptional... ...Migration Test Architect-REMOTE to join our team... ...experienced Test Architect to lead the end-to-end testing... ...Testing System Integration Testing (SIT) End-to... ..., or Quality Engineering. ~ Strong hands-on knowledge...Temporary workWork at officeRemote workFlexible hoursNTT DATA, Inc.
Mckinney, TX14 days ago- ...which partners with many of the leading employers in IT, financial services, engineering, semiconductor, clinical and... ...Job Description Position: DevOps Architect Location: Frisco, TX Duration... ...automated deployment, continuous integration, and release engineering tools...Contract workFlexible hours
- ...Contract Role Summary Senior/Architect-level role responsible for... ...Works with stakeholders, engineering teams, and vendors to deliver... ...based workflows Implement integrations using CXone APIs, DEX, real-time data APIs, and event streaming Lead SIP trunking architecture...Contract work
- ...a seasoned IT professional with over 12 years of experience to lead the transformation to Microsoft Intune. This role involves assessing... ...collaborating with subject matter experts to ensure seamless integration and migration. You will be responsible for creating...
- Vytwo Technologies Inc. is seeking an IT Strategic Architect with expertise in business process transformation and AI-enabled optimization. This position requires a minimum of 8 years in business strategy and transformation, with a focus on developing scalable, customer...Remote work
- ...together. The Licensed Design Architect serves as the primary design... ...within the organization, leading the design phase of Design-Build... ...Experience in design-build, integrated project delivery (IPD), or... ...effectively with builders, engineers, and trade partners. Experience...For contractorsFor subcontractorWork at office
- Vytwo Technologies Inc. is seeking a Test Architect with extensive experience to define and drive enterprise-scale test strategies. The role involves collaborating with leadership to embed quality into delivery through scalable testing practices. The ideal candidate will...
- ...growing IT consulting firm in Frisco, Texas, is seeking a DevOps Architect to champion DevOps practices across the organization. The... ...platforms, and proficiency in automated deployment and continuous integration tools. Responsibilities include providing technical support,...Contract work
- Vytwo is seeking an IT Strategic Architect focused on aligning business strategies with transformation initiatives. This hybrid role requires extensive experience in the healthcare domain and aims to leverage AI-enabled automation to optimize processes. The ideal candidate...Work from homeFlexible hours
- ...Description Job Title: AI/ML Architect with Databricks , AWS... ...Databricks on AWS to lead the design and... ...scalable, high‑performance data and machine learning... ...thinking with strong engineering execution, demonstrating... .... AWS Cloud Integration Architect end-to-end...Remote workWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer / Airflow Architect - Orchestration & Integration. Be the first to apply!
Related searches