Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineering Support Engineer - Databricks & PySpark

$55 - $62 per hour

NTT Data Americas, Inc.

Company Overview: Req ID: 394117 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. NTT DATA's Client is currently seeking a Senior Data Engineering Support Engineer to join their team in Addison, Texas. Job Description: Role Overview Client is seeking a Senior Data Engineering Support Engineer with expert-level proficiency in Databricks and PySpark. In this role, you will be the primary technical anchor for our enterprise big data operations, driving high availability, performance efficiency, and cost optimization across all production data pipelines. Beyond resolving complex production incidents, you will lead root-cause analysis (RCA), design automated self-healing scripts, and mentor junior support staff to ensure the overall stability of our Delta Lakehouse environment. Key Responsibilities Critical Incident & Escalation Management: Act as the highest tier of internal escalation for complex, high-priority production failures in massive-scale batch and streaming PySpark jobs. Deep-Dive Performance Tuning: Drive the resolution of complex distributed computing bottlenecks, including severe data skew, Out-Of-Memory (OOM) errors, improper partition pruning, and costly shuffle operations using Spark UI, logs, and Ganglia metrics. Cost & Cluster Optimization: Analyze Databricks cluster utilization and run strategies to reduce cloud compute spend (e.g., configuring auto-scaling, spot instances, and choosing optimal driver/executor node types). Governance & Reliability Frameworks: Oversee and troubleshoot data access control, schema evolution, and data lineage tracking within Databricks Unity Catalog. Automation & SRE Mindset: Build robust, automated frameworks and scripts in Python/PySpark to automate data reconciliation, system health checks, and self-healing pipelines. Strategic Playbooks & Documentation: Author comprehensive, technical runbooks and post-mortem RCA documents. Establish SOPs (Standard Operating Procedures) to reduce future incident resolution time (MTTR). Mentorship & Leadership: Provide technical guidance to junior support engineers, conduct technical code reviews for hotfixes, and closely collaborate with core development teams to bridge the gap between engineering and operations. Required Qualifications & Skills 7+ years of total experience in Data Engineering. 3+ years dedicated to supporting or optimizing large-scale Databricks and PySpark systems in production. W2 Only Preferred Technical skills Advanced Technical Mastery: Advanced PySpark and Python engineering skills, with an explicit understanding of Spark architecture (lazy evaluation, DAG execution, execution memory vs. storage memory). High proficiency in advanced SQL for complex analytical troubleshooting. Expert-level understanding of Delta Lake internals (ACID transactions, Time Travel, Liquid Clustering, Optimize/Z-Order commands). Troubleshooting Excellence: Proven track record of diagnosing and resolving distributed data pipeline issues at scale, including thread dumps, memory leaks, and serialization errors. Cloud & CI/CD Platform Experience: Strong architectural experience deploying and managing resources within major cloud networks (AWS, Azure, or GCP). Robust understanding of Git-based workflows, automated testing, and secure hotfix deployment via CI/CD pipelines. Active Databricks Certifications (e.g., Databricks Certified Data Engineer Professional). Deep experience managing production environments utilizing Delta Live Tables (DLT) and advanced Unity Catalog rule engines. NTT DATA provides a reasonable range of compensation for U.S.-based positions. The starting pay range for this remote role is ($55.00 - $62.00/Hour). This range reflects the minimum and maximum target compensation for the position across all US locations. Actual compensation will depend on a number of factors, including the candidate's actual work location, relevant experience, technical skills, and other qualifications. This position may also be eligible for incentive compensation based on individual and/or company performance. This position is eligible for company benefits including medical, dental, and vision insurance with an employer contribution, flexible spending or health savings account, life and AD&D insurance, short and long term disability coverage, paid time off, employee assistance, participation in a 401k program with company match, and additional voluntary or legally required benefits About NTT DATA: NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com NTT DATA endeavors to make accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here. If you'd like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here. #LI-NorthAmerica NTT Data Americas, Inc.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Data Engineering Support Engineer - Databricks & PySpark in Addison, TX vacancy
  • Job Description Senior Data Engineer - Python, PySpark & AWS Location: Plano, TX Relocation : Open Open...  ...ideal candidate will have experience supporting production data engineering...  ...workflow schedulingtools. Preferred: Databricks experience and exposure to machine... 
    Databricks
    Senior
    Relocation

    SCI Solutions Global LLC

    Plano, TX
    1 day ago
  •  ...currently seeking a Sr. Associate, Data Science Engineer to join our Consulting practice.Responsibilities...  ...with hands-on expertise in Python, PySpark, SQL, Databricks, and Snowflake, while partnering...  ...of personal well-being benefits to support your mental health. Depending on... 
    Databricks
    Senior
    H1b
    Local area

    KPMG

    Dallas, TX
    3 days ago
  • Senior Data Engineer Location Dallas TX Job Description : Proficient with Python FHIR, Data Bricks...  ...manage efficient ETL pipelines using Databricks workflows or other orchestration...  ...ingesting and processing this data using pyspark Fundamental AWS services (S3, SQS) or... 
    Databricks
    Senior

    Yochana

    Dallas, TX
    1 day ago
  • Senior ML Data Engineer Feature Engineering ETL Qualifications 7 years in data engineering and at...  ...Proven experience managing pipelines on Databricks using Apache Spark with a strong...  ...and advanced skills in Apache Spark PySpark for big data processing and analytics... 
    Databricks
    Senior
    Remote job

    Samprasoft

    Plano, TX
    1 day ago
  •  ...Type: 1099, C2C, W-2Company: SRI Tech SolutionsRole: Data Engineer - Lakehouse (PySpark / Databricks / Airflow / AWS)Location: Dallas, TX (Day 1 Onsite)Job...  ...data pipelines into a Lakehouse architecture to support analytics, reporting, and regulatory needs. Works extensively... 
    Databricks

    SRI Tech

    Dallas, TX
    3 days ago
  • Databricks Data Engineer Role: Databricks Data Engineer with Pyspark Profile Type: Hybrid Client Location: Dallas, TX JD: 8+ Years of experience as Databricks Data Engineer with Pyspark Share updated resume to: ****@*****.***. Argyle Infotech
    Databricks

    Argyle Infotech

    Dallas, TX
    1 day ago
  •  ...Summary:Hillwood is seeking a Senior Data Engineer to join its Corporate IT...  ...wide Data Lakehouse on the Databricks platform, which serves as the...  ...data solutions that support meaningful business insights...  ...proficiency in SQL, Python, PySpark, and modern data engineering... 
    Databricks
    Senior
    Full time

    hillwood

    Dallas, TX
    2 days ago
  •  ...Role Summary: The Senior Data Engineer is a hands-on technical role...  ...developing, testing, deploying, and supporting scalable enterprise data...  ...with Python and/or PySpark for data engineering workloads...  ...Data Lake Storage, Synapse, Databricks, or comparable modern cloud... 
    Databricks
    Senior
    Hourly pay
    Daily paid
    Permanent employment
    Full time
    Contract work

    Cinemark USA, Inc

    Plano, TX
    a month ago
  •  ...Sr. Manager of the Data & AI Support Engineering Team As a Sr. Manager of the Data & AI Support Engineering...  ...realize business value from Databricks Ecosystem products through strong technical...  ..., and support quality. Act as a senior escalation point for customers and... 
    Databricks
    Senior
    Work experience placement
    Worldwide

    Databricks

    Plano, TX
    4 days ago
  • Senior Data Engineer, AI & Agents Appnovation is the AI Product Company. Headquartered...  .... You will operate across Databricks and Snowflake, converting...  ...SQL together with Spark / PySpark, and experience with...  ...projects and high-profile clients Supportive work environment with... 
    Databricks
    Senior
    Contract work

    Appnovation

    Dallas, TX
    1 day ago
  • $105k - $150k

    Senior Azure Data EngineerDirect HirePlano, TX (Onsite)Ready to put your Azure Databricks expertise to work on a modern, enterprise...  ...Senior Azure Data Engineer with deep hands-on...  ...solutions using PySpark, Delta Lake, Unity...  ...exposure (e.g., MLflow or supporting ML pipelines).... 
    Databricks
    Senior
    Relocation

    Yoh

    Plano, TX
    2 days ago
  •  ...is looking for a motivated, innovative data engineer to help shape and extend our data estate...  ...and schedule-driven activities Support and extend the downstream data models that...  ...implementation on cloud-based platforms (e.g. AWS, Databricks, Snowflake) ~ Experience with event-... 
    Databricks
    Senior
    Flexible hours

    Cetera Financial Group, Inc.

    Dallas, TX
    16 hours ago
  •  ...Sr Data EngineeringThis is Hybrid role at fortworth, TX and there will be in-person...  ...ExperienceBachelors degree in Computer Science Engineering Information Systems or related field or...  ...Microsoft Azure EventHub Data Factory Databricks Blob Storage Power BI Azure Functions... 
    Databricks
    Senior

    LTM

    Dallas, TX
    2 days ago
  • $120k - $140k

     ...Description Job Description Title: Senior Data Engineer Location: Coppell, TX Salary...  ...who specializes in Microsoft Azure and Databricks. This person will be a part of multiple...  ...(ADO), SQL (ETL, SSIS packages), and PySpark or Scala automation. Architecture experience... 
    Databricks
    Senior

    Addison Group

    Dallas, TX
    14 days ago
  • $195.3k - $199.2k

     ...design, develop, and maintain scalable data pipelines and systems using Databricks on Azure (among other environments...  ...be leading and executing data engineering projects from inception to...  ...insights and marketing, with expert support and training. It is a unique combination... 
    Databricks
    Senior
    Apprenticeship
    Easy work

    McKinsey & Company

    Dallas, TX
    1 day ago
  • Backend Data Engineer We are seeking a Backend Data Engineer with strong API development experience...  ...in cloud platforms (AWS preferred), Databricks, and Spark, with a solid foundation in...  ...scalable, cloud-based solutions to support business needs. Collaborate with cross-... 
    Databricks
    Senior

    Hackajob

    Plano, TX
    1 day ago
  • Senior Data Engineers with Enterprise architecture exposure/ Data Architect Hybrid - Plano, Texas...  ...Plano, TX is mandatory . Snowflake, Databricks, ETL/ELT (ADF, dbt, Spark), Azure, Kafka...  ...Enterprise architecture exposure ) to support a long-term hybrid consulting... 
    Databricks
    Senior
    Long term contract
    Local area

    3B Staffing LLC

    Dallas, TX
    1 day ago
  •  ...bring deep expertise in Data Science, Machine...  ...seeking an experienced Data Engineer to join our data team....  ..., and AI teams to support analytics, machine learning...  ...Synapse, and Azure Databricks. Architect and manage...  ...database queries, PySpark jobs, and data pipeline... 
    Databricks
    Senior
    Full time
    Local area

    Tiger Analytics Inc.

    Dallas, TX
    2 days ago
  •  ...Description Job Details: Job title:Senior Azure Data Engineer Work Location with Zip code:...  ...required: 7-9 Years Must have skills: Databricks Python AI/ML Detailed Job...  ...development/5 years, Databricks, PySpark, Python/3-5 yrs, Azure cloud Data Factory... 
    Databricks
    Senior

    eTeam Inc.

    Richardson, TX
    24 days ago
  •  ...Intelligence, Generative AI, Data Science, Data Engineering and Advanced Analytics to...  ...doing We are seeking a Senior Data Engineer to join our...  ...analytics and AI team supporting some of our large enterprise...  ...scalable data pipelines using Databricks, Apache Spark, Python, and... 
    Databricks
    Senior
    Full time
    Temporary work
    Local area

    Tiger Analytics Inc.

    Dallas, TX
    2 days ago
  •  ...of Interest:  Enterprise Data; Data   Pay Transparency...  ...Job Description The Senior Manager, Data Engineering provides leadership and oversight...  ...multiple teams or domains supporting data ingestion,...  ...Confluent, dbt, Spark, Snowflake, Databricks, and similar technologies.... 
    Databricks
    Senior

    Bank of Oklahoma

    Richardson, TX
    4 days ago
  •  ...s Wine and Spirits LLC Job Title: Senior Unified Data/Semantic Engineer Locations: 2300 SW 145th Avenue, Miramar...  ...over time. Provide training and support to the wider engineering and...  ...developing semantic layer solutions (Databricks, Snowflake, or similar) and cloud-based... 
    Databricks
    Senior
    Work at office
    Local area
    Remote work

    Southern Glazer's Wine and Spirits

    Dallas, TX
    1 day ago
  • $70 per hour

     ...Position : Senior Data Engineer with AI Location: Dallas, TX (Hybrid)...  ...develop schema definitions; support data warehouse/mart to integrate...  ...Python, Advanced SQL, PySpark or Scala, Unix scripting...  ...EC2, EMR, S3, Athena, Glue; Databricks Data lake & warehouse: Snowflake... 
    Databricks
    Senior
    Internship
    Flexible hours

    Goldenpick Technologies

    Dallas, TX
    1 day ago
  • Sr. Data Engineer 6-Month Contract-to-Hire 5 days onsite in Addison,...  ...information into one place Senior level resource owning and leading...  ...PHI/PII by design and support HIPAA compliance and audit readiness...  ...preferred; BigQuery, Databricks, or Redshift experience is transferable... 
    Databricks
    Senior
    Full time
    Contract work

    3B Staffing LLC

    Addison, TX
    1 day ago
  •  ...consider a career in Advisory.KPMG is currently seeking a Senior Associate, Data Engineer for our Consulting practice.Responsibilities:Assist...  ...for implementation of large-scale data solutions in Databricks to support multiple use cases (delta lake, reporting and analytics... 
    Databricks
    Senior
    Local area
    Visa sponsorship

    KPMG

    Dallas, TX
    1 day ago
  • $137.4k - $161.7k

     ...make an impact?West Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In...  ...intelligence. Working with technologies such as Databricks, Snowflake, and Microsoft Fabric, you...  ..., Snowflake, and Microsoft Fabric to support enterprise analytics, AI, and business... 
    Databricks
    Senior
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    Dallas, TX
    16 hours ago
  • Job Title: Senior Data Engineer - Power BI, Power Automate, Snowflake & Python Specialist Location: Dallas, TX Looking for a versatile Senior...  ...hybrid data pipelines across Azure Data Factory, Synapse, Databricks, Snowflake, and ADLS • Build Python automation scripts for... 
    Databricks
    Senior

    Futran Tech Solutions Pvt. Ltd.

    Dallas, TX
    1 day ago
  •  ...Job Description Job Description Senior Data Engineer – Plano, TX | Full-Time / Hybrid...  ...This role will focus heavily on  Azure Databricks, PySpark, Spark SQL, scalable ETL/ELT pipelines...  ...and data protection techniques. Support the development and evolution of a scalable... 
    Databricks
    Senior
    Full time
    Local area
    Remote work
    Relocation package
    1 day per week

    HumCap, Inc.

    Plano, TX
    12 days ago
  • $109.7k - $164.5k

    AWS Ai/ML Data Engineer (Remote, Full-time) Think of TEKsystems Global Services (TGS) as the...  ...to join us? Heres what the opportunity supported through our TGS Talent Acquisition Team...  ...SnowPro Core Certification Experience with Databricks Familiarity with Streaming technologies... 
    Databricks
    Senior
    Permanent employment
    Full time
    Temporary work
    Remote work

    TEKsystems

    Dallas, TX
    4 days ago
  • $117.6k - $161.7k

     ...of our caring communityThe Senior Data Engineer Designs, builds, and maintains...  ...Deployed Engineer to support our mission of improving the...  ...cloud-based data platforms, Databricks, PostgreSQL, and healthcare...  ...data transformations using PySpark and SQL within DatabricksIntegrate... 
    Databricks
    Senior
    Full time
    Temporary work
    Apprenticeship
    Work at office
    Remote work
    Work from home
    Home office

    Humana

    Dallas, TX
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineering Support Engineer - Databricks & PySpark. Be the first to apply!