Lead Spark Scala Engineer
Purple Drive
Job Title: Lead Spark Scala Engineer
Role Summary
We are seeking a Lead Spark Scala Engineer with strong expertise in Apache Spark and Scala to design, build, and optimize large‑scale data platforms. The ideal candidate must have prior Apple experience and proven ability to lead technical execution, manage distributed systems, and drive strategic initiatives across complex data environments.
Key Responsibilities
-
Design and develop Spark applications using Scala DataFrame APIs .
-
Build and manage applications for large‑scale data platforms including storage, ingestion, governance, and performance optimization.
-
Troubleshoot and resolve complex issues in distributed systems.
-
Collaborate with cross‑functional teams to deliver on status reporting, roadmap reviews, quarterly engineering reviews, and newsletters .
-
Drive technical execution and ensure alignment with strategic objectives.
-
Analyze and interpret data transformations, ensuring accuracy and consistency in analytics and metrics.
-
Provide leadership in project management, communication, and stakeholder engagement.
Essential Skills
-
Strong experience in Apache Spark with Scala .
-
Hands‑on expertise with Scala DataFrame APIs .
-
Knowledge of AWS/S3, Iceberg, Git .
-
Strong SQL and data modeling skills.
-
Experience building/managing applications for large‑scale data platforms .
-
Skilled at troubleshooting distributed systems .
-
Strong understanding of technical concepts and ability to think strategically.
-
Prior Apple experience (mandatory) .
-
Familiarity with using a Mac laptop .
-
Excellent communication and project management skills.
Preferred Skills
-
Experience with data analytics and interpretation beyond data movement.
-
Ability to identify how data transformations impact downstream analytics and metrics.
-
Strong strategic thinking and ability to handle fast‑paced, ambiguous projects with multiple stakeholders.
Experience Required
-
6-8 years of experience in Spark/Scala engineering.
-
Proven track record in large‑scale data platform development .
-
Prior Apple project experience is mandatory .
Vacancy posted 27 days ago
Similar jobs that could be interesting for youBased on the Lead Spark Scala Engineer in Austin, TX vacancy
- ...scripting and exposure to Python• Knowledge of Troubleshooting Core Java Applications is a plus• Exposure to Real-time Execution engines like Spark, Storm, Kafka• Version control Management tools : Subversion or Clearcase or CVS, Github• Experience in Service Management...SuggestedPermanent employmentFull timeH1b
$190k
...functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology... ...science, information systems, or system controls & engineering or a related field (Master’s degree is a plus).6+ years...SuggestedWork at officeLocal area$24 - $30 per hour
..., Kerry, and ex-MBB consultants. Position Overview: Nulixir is looking for a highly qualified and experienced professional to lead Nulixir’s day-to-day operations of our in-house beverage canning/bottling line operations. Position Location: This position will...SuggestedFull timeRelocationShift workNulixir
Austin, TX11 days ago- ...outside About the Role We're looking for a GTM AI Enablement Lead to help accelerate the next chapter of Sensi.AI's go to market... ...practices. Our approach fosters an inclusive environment that sparks innovation and reflects the vibrant communities we serve. All...SuggestedLocal areaRemote workFlexible hours
Sensi.AI
Austin, TXmore than 2 months ago - ...Boh Lead Supervisor Fresh Ideas Management is a dynamic food service management company that believes good food is a powerful thing. Food brings people together and food creates memories. Fresh Ideas encourages creativity by creating fun working environments for...SuggestedHourly payFull timeFlexible hours
$23 per hour
...Position Title: Concessions Lead Supervisor - Q2 Stadium Pay Range : $23.00 per hour We Make Applying Easy! Want to apply to this job via text messaging? Text JOB to 75000 and search requisition ID number 1555220 . The advertised program is an AI recruiting...Hourly payRemote workCompass Group
Austin, TXa month ago$100.4k - $197.9k
...accounts, and bring forward relevant examples from similar clients to spark opportunity creation.Facilitate and support joint account... ...ownership, and disciplined pipeline tracking.Capture and share leading practices, client examples, market signals, and successful co-sell...Local area- ...and share the values that help TASB support school boards, keep reading! About You As Lead Pre-K Teacher, you are an energetic educator who enjoys creating magical moments that spark a lifelong love of learning in young children. You understand the value of play and the...Weekly payLocal areaRemote workFlexible hours
Texas Association of School Boards
Austin, TX2 days ago - ...Lead Business Data AnalystLocation: Sunnyvale, CA or Austin, TX (5x/ week onsite)Duration... ...analysis, transformation, and feature engineering (Pandas, NumPy). Experience with Tableau... ...Experience with Snowflake, Databricks, or Hadoop/Spark environments.Required Skills...Long term contract
AceStack LLC
Austin, TX5 days ago $15.89 - $21.87 per hour
...a difference, and being a part of a meaningful mission. Join our outstanding Culinary Leadership team as our new Culinary Server Lead today! A few details about the role: Direct daily coverage to complete all work assignments; replace any absent or reassign...Hourly payFull timeSecond jobLifespace Communities
Austin, TX1 day ago$18.22 - $25.08 per hour
...career, making a difference, and being a part of a meaningful mission. Join our top-notch Culinary team as our new Dietary Assistant Lead today! A few details about the role: Provide and maintain a high level of resident and guest engagement. Oversee the...Hourly payFull timeLifespace Communities
Austin, TX17 days ago- ...only in your community, but around the world. We believe building engineering is more than systems and structures, it’s about powering... ...the built environment. This isn’t just a job, it’s a chance to lead innovation, engineer impact, and build a legacy of excellence.Site...Work at officeLocal area
$107.6k - $198.4k
...workstreams, develop client-ready materials, and help drive measurable mission outcomes.Key ResponsibilitiesAct as the functional workstream lead for IBM MREF implementation to organize, lead and validate all epics and sprintsThe successful candidate would possess these skills:...Local area$116.93k - $133.64k
STV is seeking a Senior BIM Lead for our Water Practice to provide leadership, technical guidance, and mentorship in building information... ...capabilities.Requirements:Bachelor's degree in architecture, Engineering, or Construction Management.A minimum of 15 years of AEC...Full timeFlexible hours- ...helps CFOs and finance leaders transform their organizations into engines of value creation. We combine deep finance domain expertise,... ...Works on one or multiple assigned strategic client pursuits and lead a complex delivery at rapid pace to meet client needs and agreed...Full timeContract workWork experience placementLive inWork at officeLocal area
$88k - $177k
About GlobalFoundries:GlobalFoundries is a leading full-service semiconductor foundry providing a unique combination of design, development... ...and written communication skills.B.S. or higher degree in engineering, a physical science, or mathematics; a J.D. is not required....Ongoing contractFull timeContract workLocal area- ...based HR and financial management solutions that put organizations on the fast track to a better way to work.As a Workday Financials Lead - FDM/R2R your primary responsibilities may include:Manage teams in the identification of business requirements, functional design,...Full timeWork experience placementLive inWork at officeLocal area
- Flex is the diversified manufacturing partner of choice that helps market-leading brands design, build and deliver innovative products that improve the world.A career at Flex offers the opportunity to make a difference and invest in your growth in a respectful, inclusive...Full timeVisa sponsorshipFlexible hoursShift work
- Company Background: Ownwell has developed a leading end-to-end property tax solution that is purpose-built for SFR and CRE investors, operators, and property managers. We have brought Data Science and Machine Learning to a space that is ripe for disruption. We combine a...Local areaImmediate startFlexible hours
$113.93k - $208.21k
...Environmental PlanningBusiness Unit: ANA United StatesWork Type: HybridDate Posted: 2026-08-26Arcadis is the world's leading company delivering sustainable design, engineering, and consultancy solutions for natural and built assets.We are more than 34,000 people, in over 30...Full timePart timeWork at officeRemote workFlexible hours- Who We AreWe are Accenture, a global professional services company, searching for a Workday Certified Compensation/Benefits Lead.This individual will be part of a team of advisory professionals focused on cloud-based data-reporting operations that integrate and optimize...Full timeWork experience placementLive inWork at officeLocal area
- Freese and Nichols is currently searching for a Water Treatment Engineer to serve as a Senior Project Manager in our Austin, TX office.... ...large, complex, and essential systems. Primary Responsibilities: Lead and oversee the analysis, design, construction administration, and...Full timeContract workWork at officeLocal areaRemote workFlexible hours
- ...source system teams. You mentor junior developers, drive platform best practices, and work closely with solution architects, functional leads and business stakeholders to deliver high-quality EPM solutions across the full implementation lifecycle.The Work: Design and build...Full timeWork experience placementLive inWork at officeLocal area
- ...RolePresidio has an exciting opportunity for a Security Practice Lead to join our Cybersecurity National Practice. This individual’s... ...region by working closely with the broader Presidio Sales and Engineering organization.Travel Requirements: 20-25% travelResponsibilities...Full timeFor contractorsLocal area
- ...Join us!THE PERSON: The ideal candidate brings deep technical credibility — enough to earn the trust of hardware architects, silicon engineers, and security operations teams alike — and the operational discipline to build programs that work across a global footprint of...
$178.1k - $240.9k
...you passionate about solving business problems through data driven decision making? We are looking for a Sales Analytics and Insights lead to partner with the AWS Global Sales & Sales Strategy teams to understand customer trends and opportunities, surface insights on the...Local areaFlexible hours- ...drive transformations on a scale. THE WORK:As an Oracle WMS Cloud Lead, you will design, configure, and deliver innovative warehouse... ...business stakeholders.Bachelor's degree in Computer Science, Engineering or equivalent OR equivalent (minimum 12 years) work experience....Full timeWork experience placementLive inWork at officeLocal area
$109k - $163.4k
...reporting skills to help manage your office performance as well as meet organizational goals · Work closely with AT&T Consulting Practice Leads, Consultants, and Core Sales Account teams to engage new clients and expand existing business engagements · Develop, design, and...Temporary workSecond jobWork at officeLocal area$88k - $177k
About GlobalFoundries: GlobalFoundries is a leading full-service semiconductor foundry providing a unique combination of design, development, and fabrication services to some of the world’s most inspired technology companies. With a global manufacturing footprint spanning...Full timeLocal area- ...our communities, and our planet. If this sparks your interest, you’re in the right place.... ...improvement, interior design, workplace strategy, engineering, and building performance optimization.... ...and deliver design excellence. You will lead business development strategies, support...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Spark Scala Engineer. Be the first to apply!
Related searches