Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer Cloud Pipelines & Governance

Vytwo

Role: Senior Data Engineer Remote Work: INDIA Location: Hyderabad / Noida, INDIA

  • Only Consultants local to INDIA are eligible.
  • No visa Sponsorship
Primary Responsibilities Design, develop, and maintain scalable data pipelines using Python, PySpark, and other modern programming languages to support both batch and streaming workloads. Build and optimize data processing frameworks on cloud platforms such as Databricks or Snowflake, ensuring performance, reliability, and cost efficiency. Design and implement robust data models, including transactional (OLTP) and dimensional (OLAP) schemas, to support analytics, reporting, and application integration. Develop high quality SQL code including complex queries, stored procedures, and views, with a focus on performance tuning and efficient data access patterns. Create and manage workflow orchestration using Apache Airflow or similar tools, ensuring reliable scheduling, dependency management, and monitoring. Implement and enforce data governance and metadata standards through tools such as Microsoft Purview, including data lineage, classification, cataloging, and security policies. Build automated data quality and validation frameworks to ensure accuracy, completeness, and reliability of production datasets. Collaborate with cross functional teams including data architects, analysts, scientists, and business stakeholders to understand requirements and deliver scalable, well designed data solutions. Lead technical design sessions and code reviews, promoting engineering best practices, reusability, and maintainability. Support cloud infrastructure and DevOps practices, including CI/CD pipelines, version control, testing automation, and environment management. Monitor and troubleshoot production data pipelines, proactively addressing issues, performance bottlenecks, and system failures. Contribute to the evolution of the enterprise data platform, recommending tools, frameworks, and architectures to improve scalability and efficiency. Required Qualifications 5+ years of experience in data engineering, software engineering, or similar disciplines. Hands‑on experience with Databricks or Snowflake. Experience with orchestration tools such as Apache Airflow. Experience working with cloud ecosystems (Azure preferred; AWS/GCP acceptable). Advanced SQL skills and experience with OLTP and OLAP data modeling. Solid understanding of modern data warehousing, data lake, and ELT/ETL design patterns. Familiarity with data governance tools, especially Microsoft Purview. Solid programming expertise in Python, PySpark, or similar languages. Preferred Qualifications Healthcare industry experience, including claims, clinical, FHIR, HL7, or provider data. Experience with containerization (Docker, Kubernetes) for data workloads. Experience supporting machine learning workflows or analytical data science pipelines. Knowledge of distributed computing concepts and performance tuning. #J-18808-Ljbffr Vytwo

Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer Cloud Pipelines & Governance in Dallas, TX vacancy
  •  ...provider in the United States seeks an experienced Senior Data Engineer to design and optimize databases and data systems...  ...analytics. The role involves developing scalable pipelines and data models, enhancing data governance, and mentoring junior engineers. Ideal candidates... 
    Pipeline
    Senior
    Remote job
    Flexible hours

    Alliance Technical Group

    Dallas, TX
    4 days ago
  •  ...high growth business as the Data Engineer. The position will work...  ...structure. We are looking for a Senior Data Engineer, or similarly...  ...scalable, maintainable cloud data pipelines, while also helping us identify...  ..., and mature our data governance practices. The ideal candidate... 
    Pipeline
    Senior
    Full time
    Contract work
    Temporary work
    Part time
    For contractors
    For subcontractor
    Internship
    Work at office
    Flexible hours

    Allworth Financial

    Dallas, TX
    11 hours ago
  •  ...Company's Periscope by McKinsey team is seeking a senior data engineer to design, build, and scale data pipelines on Azure using Databricks. You will lead...  ...environments, and applying best practices for data governance, security, and #J-18808-Ljbffr McKinsey & Company
    Pipeline
    Senior

    McKinsey & Company

    Dallas, TX
    2 days ago
  • Ziosk is seeking a Senior Data Engineer to design and optimize our modern data platform...  ...on building scalable ETL pipelines with Azure Databricks, Delta Lake, and governance practices for reliable...  ...data scientists, analysts, and cloud teams to deliver trusted datasets... 
    Pipeline
    Senior

    Ziosk

    Dallas, TX
    4 days ago
  • Fixity Technologies is seeking a Data Engineer to design, develop, and maintain scalable data pipelines and platforms that support BI, analytics, and ML initiatives....  ...warehousing, real-time processing, data quality and governance, and collaboration with data scientists and... 
    Pipeline
    Senior

    Fixity Technologies

    Dallas, TX
    1 day ago
  • Lantern is seeking a Senior Data Engineer to design and implement robust data pipelines for enterprise-scale data solutions in a hybrid Dallas office setting. You...  ...FHIR exposure is a plus, with strong emphasis on data quality and governance. #J-18808-Ljbffr byebyeoffice
    Pipeline
    Senior
    Work at office

    byebyeoffice

    Dallas, TX
    1 day ago
  • Insight Global is looking for a Sr. Data Engineer in Dallas, Texas to develop a modern analytical data warehouse. The ideal candidate will design dimensional data models and build ETL/ELT pipelines using Azure tools. This role emphasizes collaboration with cross-functional... 
    Pipeline
    Senior

    Insight Global

    Dallas, TX
    1 day ago
  • Harnham is seeking a Senior Data Engineer to help modernize a cloud-first data platform within a large financial services organization. You will design, build, and optimize enterprise data pipelines and Snowflake architectures to support analytics and reporting. You will... 
    Pipeline
    Senior

    Harnham

    Richardson, TX
    1 day ago
  • Acosta is seeking a Senior Data Engineer for their connected data initiative. This hybrid role involves designing, building, and scaling data...  .... The successful candidate will ensure high-quality data pipelines and collaborate with various teams to support analytics. Qualifications... 
    Pipeline
    Senior

    Acosta

    Dallas, TX
    1 day ago
  • Anblicks is looking for an experienced data engineer with over 12 years in the field, particularly...  ...role requires leading scalable data pipeline projects and mentoring junior engineers...  ...maintaining high standards in data governance and modeling. Strong communication skills... 
    Pipeline
    Senior

    Anblicks

    Dallas, TX
    2 days ago
  • Cloud Hybrid Technologies, LLC is searching for an ETL/ELT Data Engineer located in Dallas, Texas. You will analyze and build data assets using IBM Datastage and Informatica, manage data pipelines, and support CI/CD. Your role will include creating ETL transformations... 
    Pipeline
    Senior

    Cloud Hybrid Technologies, LLC

    Dallas, TX
    4 days ago
  • We are seeking a Senior Data Engineer with 10+ years of experience to support...  ..., build, and optimize data pipelines and workflows across modern...  .... Leverage Snowflake, cloud-native solutions, and dbt to...  ...practices. Familiarity with data governance and security best practices... 
    Pipeline
    Senior

    Gardner Resources Consulting, LLC

    Dallas, TX
    2 hours ago
  • $100k - $105k

    Tata Consultancy Services is looking for a Data Engineer to design, develop, and maintain data pipelines using PySpark in a Big Data environment. You will ensure...  ...and PySpark development, along with expertise in cloud platforms like AWS and Databricks. Strong problem-... 
    Pipeline
    Senior

    Tata Consultancy Services

    Dallas, TX
    2 days ago
  • K&L Gates in Dallas is seeking a Senior Data Engineer to design scalable enterprise data platforms...  ...junior engineers, and optimizing data pipelines to align with the firm's AI strategy....  ...should have extensive experience in data governance and be able to translate complex... 
    Pipeline
    Senior

    K&L Gates

    Dallas, TX
    2 days ago
  • $140k - $160k

     ...of its enterprise data platform. The team...  ...building a modern cloud-native analytics ecosystem...  ...\'ll help define engineering standards,...  ...maintenance role. As a Senior Data Engineer, you...  ...ingestion pipelines, transformation frameworks...  ..., observability, governance, and operational... 
    Pipeline
    Senior

    Harnham

    Richardson, TX
    1 day ago
  • Senior Data Engineer - Palantir Foundry will be responsible for designing, building, and...  ...complex business processes into governed, production‑grade data pipelines, ontologies, and applications that...  ...Qualifications Familiarity with cloud‑based data platforms and modern... 
    Pipeline
    Senior

    Acosta

    Dallas, TX
    2 days ago
  • We are seeking a skilled Data Engineer to design, develop, and maintain scalable data pipelines and data platforms that support business...  ...working with large datasets, cloud platforms, ETL/ELT processes,...  ..., integrity, security, and governance standards are met. Collaborate... 
    Pipeline
    Senior

    Fixity Technologies

    Dallas, TX
    1 day ago
  •  ...PETADATA is seeking a seasoned Senior Data Lake Engineer with over 15 years of...  ...and best practices for data governance, cataloging, and access control...  ...workflows. ETL / ELT Pipelines: Develop and maintain robust...  ...native data lake development. Cloud Expertise: Deep, hands-on... 
    Pipeline
    Senior
    Remote work

    Petadata

    Dallas, TX
    5 days ago
  • $130k - $155k

    We are seeking an experienced Senior Data Engineer to join our growing IT team. This role will be...  ...developing and maintaining scalable data pipelines and infrastructure to support our...  ...solutions. Implement best practices for data governance, security, and quality assurance to... 
    Pipeline
    Senior
    Work at office
    Flexible hours

    Health-E Commerce

    Dallas, TX
    3 days ago
  • Job Description The Data Solutions Engineer IV works in close collaboration to...  ...practices, methodologies, governance, and standards and serves as...  ...governance of enterprise ETL / ELT pipelines, leveraging Fivetran for...  ..., Snowflake as the central cloud data platform, and dbt for... 
    Pipeline
    Senior

    BOK Financial

    Richardson, TX
    11 hours ago
  • $128k - $249k

     ...Job Summary We are seeking a Senior Data Engineer to join the Enterprise...  ..., and Azure AI Foundry data pipelines; mentoring staff; collaborating...  ...leaders; and delivering reliable governed products aligned with the...  ...Program Manager; Project Manager; Cloud Platform Engineer; Security... 
    Pipeline
    Senior
    Local area
    Flexible hours
    Afternoon shift

    K&L Gates

    Dallas, TX
    3 days ago
  • $79.6k - $139.3k

    Senior Data Engineer Position Description: We are seeking a highly motivated...  ...and maintain scalable data pipelines and transformation...  ...with emerging Big Data, AWS cloud, and AI technologies and recommend...  .... Familiarity with data governance, metadata management, and data... 
    Pipeline
    Senior
    Local area

    CGI Technologies and Solutions, Inc.

    Dallas, TX
    4 days ago
  • $195.3k - $199.2k

     ...develop, and maintain scalable data pipelines and systems using Databricks...  ...leading and executing data engineering projects from inception to...  ...prescriptive analytics, and cloud‑based tools to provide more...  ...etc.) Experience with data governance, security, and compliance in... 
    Pipeline
    Senior
    Apprenticeship
    Work at office
    Easy work

    McKinsey & Company

    Dallas, TX
    2 days ago
  •  ...TX is seeking an experienced Data Engineering Manager to lead the design, development, and governance of our data warehouse and analytical...  ...reliability across data pipelines. The role requires 10+ years in...  ...and hands‑on experience with cloud platforms #J-18808-Ljbffr Texas... 
    Pipeline

    Texas Capital Bank

    Richardson, TX
    1 day ago
  • Billee.AI is seeking a Senior Data Engineer in Dallas, Texas, to enhance our utility billing platform. This role involves collaborating with the engineering team to design data models, ensure platform reliability, and contribute to analytics. Ideal candidates will have... 
    Pipeline
    Senior

    Billee.AI

    Dallas, TX
    4 days ago
  • Harnham is hiring a Senior Data Engineer in Richardson, TX, to build a modern analytics platform from the ground up. You will design scalable ingestion pipelines, transformation frameworks, and cloud-native data architectures enabling analytics, reporting, and AI across... 
    Pipeline
    Senior

    Harnham

    Richardson, TX
    1 day ago
  • Mphasis is seeking a Senior Data & Platform Engineer located in Dallas, Texas. This role involves designing and operating data pipelines, normalizing data in Snowflake, and developing AI-powered agents for enhanced platform intelligence. Candidates should have 10 years... 
    Pipeline
    Senior

    Mphasis

    Dallas, TX
    2 days ago
  •  ...firm in the United States is seeking a Senior Data Engineer with over 10 years of experience to...  ...solutions. This role involves designing data pipelines, leveraging Snowflake and dbt, and...  .... Ideal candidates are proficient in cloud environments and are effective communicators... 
    Pipeline
    Senior

    Gardner Resources Consulting

    Dallas, TX
    11 hours ago
  • $130k - $155k

    Health--e-Commerce in Dallas is seeking an experienced Senior Data Engineer to join their IT team. This role involves designing and maintaining data pipelines and infrastructure to support the organization's data needs. The ideal candidate will have at least 5 years of... 
    Pipeline
    Senior
    Flexible hours

    Health-E Commerce

    Dallas, TX
    3 days ago
  • Medium is seeking a Senior Data Engineer to join their team and drive the architecture of data systems that support AI-driven loyalty products...  ...responsibilities include managing and optimizing ETL/ELT pipelines, translating client requirements into robust data... 
    Pipeline
    Senior
    Remote work
    Flexible hours

    Medium

    Dallas, TX
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer Cloud Pipelines & Governance. Be the first to apply!