Lead Spark, Scala Senior Data Engineer
$86k - $140kTata Consultancy Services
Must Have Technical/Functional Skills
• Strong experience in Apache Spark with Scala
• Experience building and working on Spark application with Scala data frame APIs
• Knowledge of Cloud AWS/S3, Iceberg, Git
• Strong SQL and data modelling skills
• Experience with building/managing application for large scale data platforms storage, computing aspects, data ingestion/governance and data management and performance.
• Skilled at troubleshooting complex issues in large scale distributed systems.
Roles & Responsibilities
• Excellent communication and stakeholder management skills
• Strong leadership and coordination capabilities
• Ability to drive discussions with both technical and non-technical stakeholders
• Act as the primary onsite coordinator between client stakeholders and offshore teams.
Lead onsiteoffshore collaboration, ensuring clear communication of requirements, timelines, and deliverables.
• Proactive problem-solving mindset
• Ability to work in a fast-paced client-facing environment
• Attend and represent the team in client meetings, providing technical insights and progress updates.
• Proactively identify risks, blockers, and dependencies, and drive solutions.
• Provide technical guidance to offshore team members. Salary Range: $86,000-$140,000 a year
#LI-AS3
• Strong experience in Apache Spark with Scala
• Experience building and working on Spark application with Scala data frame APIs
• Knowledge of Cloud AWS/S3, Iceberg, Git
• Strong SQL and data modelling skills
• Experience with building/managing application for large scale data platforms storage, computing aspects, data ingestion/governance and data management and performance.
• Skilled at troubleshooting complex issues in large scale distributed systems.
Roles & Responsibilities
• Excellent communication and stakeholder management skills
• Strong leadership and coordination capabilities
• Ability to drive discussions with both technical and non-technical stakeholders
• Act as the primary onsite coordinator between client stakeholders and offshore teams.
Lead onsiteoffshore collaboration, ensuring clear communication of requirements, timelines, and deliverables.
• Proactive problem-solving mindset
• Ability to work in a fast-paced client-facing environment
• Attend and represent the team in client meetings, providing technical insights and progress updates.
• Proactively identify risks, blockers, and dependencies, and drive solutions.
• Provide technical guidance to offshore team members. Salary Range: $86,000-$140,000 a year
#LI-AS3
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Spark, Scala Senior Data Engineer in Austin, TX vacancy
$86k - $140k
...Services is seeking a skilled professional for a role in Austin, Texas. The ideal candidate will possess strong experience in Apache Spark with Scala and excellent leadership skills. Responsibilities include acting as a primary onsite coordinator and fostering effective...Senior- ...in Austin, Texas, is seeking an experienced Data Engineer to join their team. In this contract role, you... ...must be proficient in Python, Java, or Scala, and familiar with data engineering technologies like Airflow and Spark. This opportunity offers competitive hourly...SeniorHourly payContract work
- Job Title : Lead AWS Data Bricks Spark/Scala Engineer Job ID: 2022-11882 Job Location: Remote, Memphis, TN (preferred), Morris Plains, NJ, Austin, TX (preferred), St. Louis, MO Job Travel Location(s): # Positions: 1 Employment Type: W2 Candidate Constraints: Duration:Long...SuggestedPermanent employmentRemote work
$123.97k - $180.5k
...payments technology leader in Austin, Texas is seeking a Sr. Data Engineer to execute large scale ETL processes and build high-performing... ...Computer Science and at least 2 years of experience with SQL, Spark, and Python. This position may allow for telecommuting and requires...SeniorRemote work- ...do here! The Apple Services Engineering Security team builds and provides... ...help protect our customers data in Apple’s infrastructure.... ...years of experience working with Spark and other distributed data technologies... ...least one of Java, Python or Scala ~ Deep expertise in Data...Senior
Apple
Austin, TX4 days ago - ...reading. About the Role We are looking for a Senior Data Engineer to join our Data Automation team. You... ...-purpose language (such as Python or Scala) for data processing, and SQL for data... ...processing frameworks, such as Apache Spark, including performance tuning and optimization...Senior
GrabJobs
Austin, TX5 days ago - ...Cloud Data Engineer We are looking for passionate data engineers to join our growing Data... ...and functional script language: Python, Scala, and C#. • Advanced working knowledge... ...Experience with other Big Data tools such as Spark, Snowflake, and Kafka • Preference for...SeniorWork at officeRemote work
Software Technology Inc
Austin, TX1 day ago $110.7k - $171.8k
...Job Description We are seeking a Senior Data Engineer to join our Data Engineering organization... ...data processing solutions using Apache Spark, including performance tuning and... ...grade data engineering solutions using Scala and Python (and Java where applicable)...SeniorWork experience placementWork at officeLocal areaVisa
Austin, TX3 days ago$106.9k - $176.5k
...world. Technology – Data and Decision Science – Data Engineering – Senior We are seeking a highly... ...business objectives. Lead end-to-end data pipeline... ...and experience with Spark for big data processing.... ...languages such as Python, Scala, or SQL. Experience...SeniorSummer holidayFlexible hoursEY
Austin, TX5 days ago- ...framework stack, to use case and data model design. Drive... ...the continual improvement of engineering tools, cloud-based technologies... ...frameworks: Hive/Hadoop, Apache Spark, and Airflow. # Working with... ...programming languages: Python, Scala, Java, or Unix and SQL. # Working...SeniorWork experience placementWork at officeLocal areaRemote workMonday to ThursdayFlexible hours1 day per week
Roku
Austin, TX1 day ago $134k - $219.4k
...Join our GPSC Insight Engineering team, responsible... ...and delivering new data solutions for... ...partners. As a Senior Data Engineer, you... ...practices. You will help lead and deliver innovative... ...Python or Scala, SQL, and relational... ...distributed data processing (Spark) and container...SeniorH1bLocal areaWork from homeRelocation packageFlexible hoursGeneral Motors
Austin, TX3 days ago- ...Senior Specialist Seeking a Senior Specialist with 7 to 1... ...of experience in Python and data technologies including Flask, Apache Spark, Scala, and Nginx to design and implement... ...and advancements in data engineering and Python ecosystems. Lead the design and development...SeniorTemporary work
ClifyX
Austin, TX2 days ago - A technology solutions firm is seeking a Lead AWS Data Bricks Spark/Scala Engineer to architect and implement solutions primarily on AWS. This role emphasizes data management and engineering proficiency using Databricks and Spark, with responsibilities including migration...Remote job
- ...Job Title: Sr. Software Engineer (Spark & Scala) Location: ustin, TX / Sunnyvale, CA Type: Contract Desirable Skills: • Customer... ...for resources with Software Engineering experience and not Data Engineering.• Strong Software Engineering experience (Application...SeniorContract work
Syntricate Technologies
Austin, TX1 day ago $177.8k - $240.5k
...the place for you. The ASP Data Engineering Team supports the data needs... ...Support team interacts with leading companies and believes that world... ..., such as Python, Java, Scala, or NodeJS ~ Experience with... ...technologies such as: Hadoop, Hive, Spark, EMR Experience operating...SeniorLocal areaWorldwideFlexible hoursAmazon
Austin, TX5 days ago- A large, global organization is seeking a highly motivated Senior Data Engineer to lead the architecture and deployment of next-generation data-driven platforms. This role bridges Data Science and Production Engineering, ensuring reliable and scalable deployments in the...Senior
- ...Data Engineer (Python/Spark) Austin, Texas Who We Are Headquartered in New York City, Take-Two Interactive Software, Inc. is a leading developer, publisher, and marketer of interactive entertainment for consumers around the globe. We develop and publish products...Full timeCasual workFlexible hours
Take-Two Interactive
Austin, TX4 days ago - ...Sr. Data Engineer, iCloud Would you like to drive the future of Apple... ...years of experience working with Spark and other distributed data... ...least one of Java, Python or Scala ~ Deep expertise in Data... ...collaboration skills & ability to lead high-level discussions on...Senior
Apple
Austin, TX4 days ago - ...Team We are building a tight-knit, senior engineering group based in Austin, TX, tasked with creating... ...(.NET), Azure OpenAI, and an advanced data backend powered by Snowflake, Databricks... ...~ Advanced SQL and strong Python (or Scala); comfortable writing production-grade...SeniorLocal areaShift work
Light and Wonder, Inc.
Austin, TX1 day ago - ...looking for passionate SDETs (software data engineers in test) to join our growing Data and Analytics... ...and functional script language: Python, Scala, and C#. Advanced working knowledge... ...with other Big Data tools such as Spark, Snowflake, and Kafka Preference for...SeniorWork at office
Software Technology Inc
Austin, TX1 day ago $286.2k - $326.7k
...Senior Distinguished Data Engineer (Remote-Eligible) Distinguished Data Engineers are individual contributors... ...implementation in an unified manner Lead the way in creating next-generation talent... ...of experience using Python, SQL or Scala 1+ year of experience deploying...SeniorFull timePart timeLocal areaRemote workCapital One
Austin, TX4 days ago- ...Senior Data Engineer Parallels has an immediate vacancy for this position. Push the boundaries of tech. In your sweatpants. We're... ...experience with the distributed data processing tools like Spark, Presto, etc. and streaming technologies such as Kafka/Flink...SeniorWork at officeImmediate startRemote workFlexible hours
Parallels International GmbH
Austin, TX1 day ago - ...Senior Data Engineer Fully Remote-United States Job Type Full-time Description Overview Tanaq Technical Services (TTS), a... ...S3, Redshift, Data Factory ETL/ELT frameworks: Airflow, Spark, Databricks Data modeling, schema design, and optimization...SeniorFull timeContract workLocal areaRemote work
St. George Tanaq Corporation
Austin, TX4 days ago - ...Data Engineer (Intermediate or Senior) Requisition ID: req1358 Employment Type: Unclassified Regular... ...Conduct advanced data analysis and lead larger data analysis projects,... ...Microsoft Fabric, Databricks, Snowflake, Spark, SQL, Python, and cloud platforms....SeniorFull timeWork at officeShift work
Teacher Retirement System of Texas
Austin, TX2 days ago $76 per hour
...Sr Data Engineer Location: Austin, Texas (Onsite) Employment Type: Contract Role Overview We are seeking a hands-on Senior Data Engineer to design, build, and operationalize ETL/ELT... ...data pipelines using Python, Scala, Spark, SQL, and Databricks.* Build CI...SeniorHourly payContract workApex Systems
Austin, TX4 days ago$117.6k - $161.7k
...a part of our caring community The Senior Data Engineer designs, builds, and maintains data processing... ...:SQL, Databricks,Python, Apache Spark, Git,Azure Services (Synapse, Azure ADLS... ...About Humana: Humana Inc. (NYSE: HUM) is a leading U.S. healthcare company. Through our...SeniorBi-weekly payFull timeTemporary workApprenticeshipWork at officeImmediate startRemote workWork from homeHome officeHumana
Austin, TX4 days ago- ...Data Engineer Location: Austin, TX / Sunnyvale, CA (Onsite) Duration: W2 / C2C Contract Experience: 11+ Years Job Description Looking... ...maintain data pipelines and reports using Python, SQL, Java, Spark, PySpark, Java Collaborate with data analysts, and...Contract work
Syntricate Technologies
Austin, TX1 day ago - Apex Systems is seeking a Senior Data Engineer in Austin, Texas. This permanent role requires over 10 years of data engineering experience, with expertise in SQL, Spark, and distributed computing. The candidate will own high-impact data solutions, collaborate across teams...SeniorPermanent employment
- ...thought possible. Are you ready to lead in this new era of technology... ...for a Sr. Consultant, Data Engineer to join our growing team of experts... ..., Netezza, SQL Server, Spark) ~ Experience building ETL /... ...as well) ~ Python Scripting, Scala is required. ~ Ability to prepare...Senior
IBM Computing
Austin, TX1 day ago $94.43k - $202.75k
...worlds top professional services firms. Spark your curiosity and ignite your career... .... KPMG is currently seeking a Senior Associate, Data Engineer for our Consulting practice. Responsibilities... ...and development activities and lead a small workstream for implementation...SeniorLocal areaVisa sponsorshipKPMG
Austin, TX3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Spark, Scala Senior Data Engineer. Be the first to apply!
Related searches
- senior development executive Austin, TX
- senior technical manager Austin, TX
- senior procurement specialist Austin, TX
- senior manager data science Austin, TX
- senior platform engineer Austin, TX
- senior procurement Austin, TX
- senior director product management Austin, TX
- senior cost manager Austin, TX
- senior compliance officer Austin, TX
- senior tax director Austin, TX