Lead Spark, Scala Senior Data Engineer
$86k - $140kTata Consultancy Services
Must Have Technical/Functional Skills
• Strong experience in Apache Spark with Scala
• Experience building and working on Spark application with Scala data frame APIs
• Knowledge of Cloud AWS/S3, Iceberg, Git
• Strong SQL and data modelling skills
• Experience with building/managing application for large scale data platforms storage, computing aspects, data ingestion/governance and data management and performance.
• Skilled at troubleshooting complex issues in large scale distributed systems.
Roles & Responsibilities
• Excellent communication and stakeholder management skills
• Strong leadership and coordination capabilities
• Ability to drive discussions with both technical and non-technical stakeholders
• Act as the primary onsite coordinator between client stakeholders and offshore teams.
Lead onsiteoffshore collaboration, ensuring clear communication of requirements, timelines, and deliverables.
• Proactive problem-solving mindset
• Ability to work in a fast-paced client-facing environment
• Attend and represent the team in client meetings, providing technical insights and progress updates.
• Proactively identify risks, blockers, and dependencies, and drive solutions.
• Provide technical guidance to offshore team members. Salary Range: $86,000-$140,000 a year
#LI-AS3
• Strong experience in Apache Spark with Scala
• Experience building and working on Spark application with Scala data frame APIs
• Knowledge of Cloud AWS/S3, Iceberg, Git
• Strong SQL and data modelling skills
• Experience with building/managing application for large scale data platforms storage, computing aspects, data ingestion/governance and data management and performance.
• Skilled at troubleshooting complex issues in large scale distributed systems.
Roles & Responsibilities
• Excellent communication and stakeholder management skills
• Strong leadership and coordination capabilities
• Ability to drive discussions with both technical and non-technical stakeholders
• Act as the primary onsite coordinator between client stakeholders and offshore teams.
Lead onsiteoffshore collaboration, ensuring clear communication of requirements, timelines, and deliverables.
• Proactive problem-solving mindset
• Ability to work in a fast-paced client-facing environment
• Attend and represent the team in client meetings, providing technical insights and progress updates.
• Proactively identify risks, blockers, and dependencies, and drive solutions.
• Provide technical guidance to offshore team members. Salary Range: $86,000-$140,000 a year
#LI-AS3
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Spark, Scala Senior Data Engineer in Austin, TX vacancy
- ...in Austin, Texas, is seeking an experienced Data Engineer to join their team. In this contract role, you... ...must be proficient in Python, Java, or Scala, and familiar with data engineering technologies like Airflow and Spark. This opportunity offers competitive hourly...SeniorHourly payContract work
- ...Job Title : Lead AWS Data Bricks Spark/Scala Engineer Job ID: 2022-11882 Job Location: Remote, Memphis, TN (preferred), Morris Plains, NJ, Austin, TX (preferred), St. Louis, MO Job Travel Location(s): # Positions: 1 Employment Type: W2 Candidate Constraints: Duration:Long...SuggestedPermanent employmentRemote work
Highbrow
Austin, TX3 days ago $123.97k - $180.5k
...payments technology leader in Austin, Texas is seeking a Sr. Data Engineer to execute large scale ETL processes and build high-performing... ...Computer Science and at least 2 years of experience with SQL, Spark, and Python. This position may allow for telecommuting and requires...SeniorRemote work$110.7k - $171.8k
Visa is seeking a Senior Data Engineer in Austin, Texas. This hybrid role focuses on designing and optimizing scalable data pipelines and supporting... ...a relevant field, and a strong grasp of tools like Apache Spark and SQL. The estimated salary range is $110,700 to $171,800...Senior- ...A technology company is seeking a Senior Data Platform Engineer for an onsite position in Austin, TX. The ideal candidate will have over 9 years... ...designing production data workflows with Airflow, optimizing Spark jobs, and developing APIs using FastAPI. This role offers...Senior
EITACIES
Austin, TX3 days ago - YETI is looking for a Senior Data Engineer to build and operate their enterprise data platform. This role focuses on Google BigQuery and requires significant experience in data engineering, SQL, and Python programming. The ideal candidate will have 8+ years of experience...Senior
$110.7k - $171.8k
...Senior Data Engineer About Us Visa is a world leader in payments technology, facilitating transactions... ...data processing solutions using Apache Spark, including performance tuning and... ...grade data engineering solutions using Scala and Python (and Java where applicable)...SeniorWork experience placementWork at officeLocal areaVisa
Austin, TX3 days ago$138.7k - $175.45k
...The Role This role is for a senior individual contributor in Data Engineering who can independently lead complex technical work, apply... ...experience, including Python or Scala, SQL, and relational/non-... ...pipelines using Databricks (Apache Spark, Delta Lake) to support...SeniorFull timeH1bLocal areaWork from homeRelocation packageFlexible hoursGeneral Motors
Austin, TX3 days ago- ...framework stack, to use case and data model design. Drive... ...the continual improvement of engineering tools, cloud-based technologies... ...frameworks: Hive/Hadoop, Apache Spark, and Airflow. # Working with... ...programming languages: Python, Scala, Java, or Unix and SQL. # Working...SeniorWork experience placementWork at officeLocal areaRemote workMonday to ThursdayFlexible hours1 day per week
Roku
Austin, TX1 day ago $134k - $219.4k
...Join our GPSC Insight Engineering team, responsible... ...and delivering new data solutions for... ...partners. As a Senior Data Engineer, you... ...practices. You will help lead and deliver innovative... ...Python or Scala, SQL, and relational... ...distributed data processing (Spark) and container...SeniorH1bLocal areaWork from homeRelocation packageFlexible hoursGeneral Motors
Austin, TX3 days ago- A technology solutions firm is seeking a Lead AWS Data Bricks Spark/Scala Engineer to architect and implement solutions primarily on AWS. This role emphasizes data management and engineering proficiency using Databricks and Spark, with responsibilities including migration...Remote job
$106.9k - $176.5k
Technology - Data and Decision Science - Data Engineering - Senior Location: Anywhere in Country At EY... ...business objectives. Lead end-to-end data pipeline... ...Databricks and experience with Spark for big data processing.... ...such as Python, Scala, or SQL. Experience with...SeniorSummer holidayFlexible hours- A large, global organization is seeking a highly motivated Senior Data Engineer to lead the architecture and deployment of next-generation data-driven platforms. This role bridges Data Science and Production Engineering, ensuring reliable and scalable deployments in the...Senior
- Cloudera is seeking a Director in Engineering to lead the technical roadmap for Data Engineering. The ideal candidate will possess over 10 years of experience... ...and specialized knowledge in technologies like Spark and Airflow. This role entails collaboration with cross...
- ...Data Engineer (Python/Spark) Austin, Texas Who We Are Headquartered in New York City, Take-Two Interactive Software, Inc. is a leading developer, publisher, and marketer of interactive entertainment for consumers around the globe. We develop and publish products...Full timeCasual workFlexible hours
Take-Two Interactive
Austin, TX4 days ago $138k
...Senior Data Engineer The Senior Data Engineer is a highly experienced data professional responsible for leading the design, development, and optimization of complex data pipelines and platforms... ...data processing frameworks (e.g., Spark). Hands-on expertise with workflow...SeniorTemporary workWork at officeThe University of Texas at Austin Staff
Austin, TX3 days ago- ...Senior Data Engineer Parallels has an immediate vacancy for this position. Push the boundaries of tech. In your sweatpants. We're... ...experience with the distributed data processing tools like Spark, Presto, etc. and streaming technologies such as Kafka/Flink...SeniorWork at officeImmediate startRemote workFlexible hours
Parallels International GmbH
Austin, TX1 day ago - Apex Systems is seeking a Senior Data Engineer in Austin, Texas. This permanent role requires over 10 years of data engineering experience, with expertise in SQL, Spark, and distributed computing. The candidate will own high-impact data solutions, collaborate across teams...SeniorPermanent employment
$134k - $219.4k
A leading automotive company in Austin, TX, is seeking a Senior Data Engineer to design and build scalable data solutions for their global purchasing supply chain. The ideal... ...in data engineering, proficiency in Python or Scala, and strong collaboration skills. This hybrid...SeniorWork at office$128k - $249k
...and your search for important and impactful work lead to the same place. We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes... ...data transformation and automation, utilizing Spark and CI/CD pipelines through Azure DevOps or...SeniorFull timeTemporary workLocal areaRemote workRelocationFlexible hoursAfternoon shiftK&L Gates LLP
Austin, TX3 days ago- ...Bachelor’s degree in Computer Science, Software Engineering, Computer Engineering, Electrical... ...building and supporting ETL/ELT pipelines and data platforms in cloud environments. Strong proficiency in Python, SQL, Spark, and Databricks for data engineering use cases...SeniorLocal area
- ## Job Description# Senior Data Engineer**Location:** Austin, Texas (Onsite) **Employment Type:** Permanent* 10 or more years of total experience... ....* Proficiency with big data technologies such as Spark, PySpark, and Databricks.* Deep understanding of distributed...SeniorPermanent employment
- ...expertise as described in below requirement. Responsibilities: As a Senior Data Engineer, you will help design, enhance and build solutions dealing... ...2 years - Experience coding and scripting (Python, Java, Scala) and design experience Preferred 2 years - Experience with...SeniorFull timeWork experience placement
$286.2k - $326.7k
Senior Distinguished Data Engineer (Remote-Eligible) Distinguished Data Engineers are individual contributors... ...implementation in an unified manner Lead the way in creating next-generation... ...years of experience using Python, SQL or Scala 1+ year of experience deploying...SeniorRemote jobFull timePart timeLocal area$150k - $190k
...to connect consumers with the world’s leading brands through data-driven content and technology.... ...HAVE: 5+ years of experience in data engineering within fast-paced, cloud-native environments... ...with distributed systems, Spark, and data quality best practices Strong...SeniorRemote work- ...the Team We are building a tight‑knit, senior engineering group based in Austin, TX, tasked with creating... ...(.NET), Azure OpenAI, and an advanced data backend powered by Snowflake, Databricks... ...). Advanced SQL and strong Python (or Scala); comfortable writing production‑grade...SeniorLocal areaShift work
$155.8k - $262.55k
...Insights , an industry-leading visualization... ...identities to sensitive data and enables fast, policy... ...unified view. This is a Senior Staff role: you will design... ...cost improvements across Spark/Flink/SQL/CQL workloads... ...with product and UI engineering to deliver low-latency...SeniorTemporary workRemote workFlexible hoursSailPoint Technologies Holdings, Inc.
Austin, TX2 days ago$75k - $150k
...empowered to succeed and thrive. As a Zelus Data Engineer, you will be expected to: Design,... ...platform support In addition to the above, a Senior Data Engineer will be expected to: Break... ...Proficiency with Python (preferred), Scala, and/or other data-oriented programming...SeniorFlexible hours$131.25k - $175k
...to: SVP of Tech As the Sr. Principal Data Engineer, you will be the primary architect of... ...Photon). The Stack: Deep proficiency in Spark (PySpark/Scala), Python, and SQL. Experience with... ...is a diversified media company and a leading provider of local news and sports. The...SeniorFull timeWork experience placementH1bLocal areaImmediate startRemote workFlexible hoursDigital Remedy
Austin, TX4 days ago- ..., you’ll join Schwab’s Global Data and Analytics team to help build... ...of data architecture and AI, engineering resilient pipelines that... ...documents. Mentorship: Mentor senior and junior engineers via pair... ...frameworks such as Apache Beam or Spark. Experience with modern data...SeniorWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Spark, Scala Senior Data Engineer. Be the first to apply!
Related searches
- senior automation controls engineer Austin, TX
- senior accounts payable Austin, TX
- senior brand designer Austin, TX
- senior financial advisor Austin, TX
- senior cost analyst Austin, TX
- senior business analyst contract Austin, TX
- senior app developer Austin, TX
- senior manager cyber security Austin, TX
- senior infrastructure manager Austin, TX
- senior digital account manager Austin, TX