Senior Big Data Engineer - Spark, Java, Cloud, Scalable
LiveRamp
LiveRamp is seeking a Senior Software Engineer for the Identity Engineering team in San Francisco to maintain the graph processing engine that connects trillions of identifiers and devices. The role focuses on scalability, performance, cost, security, and compliance to empower AI-driven marketing insights.
You will collaborate with product managers and engineers to deliver modular, scalable applications and modernize infrastructure using Spark, batch processing, REST APIs, and cloud platforms.
#J-18808-LjbffrVacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Big Data Engineer - Spark, Java, Cloud, Scalable in San Francisco, CA vacancy
$160k - $280k
...Machine Learning Engineer is responsible... ...foundational tools and data pipelines to... ...maintainable, scalable and performant.... ...skills in Python, Java, bash, SQL, and... ...Experience using big data... ..., Docker, Helm, Spark, pySpark) Experience... ...with any public cloud environment - AWS...CloudSeniorBig dataWork experience placementImmediate startFlexible hours- ...Architecting Performance Tuning Big Data CERTIFICATION... ...-on experience in cloud-native platforms, big... ...systems, modern data engineering tools, and collaborating... ...business teams to deliver scalable, secure, and high-... ...workflows using Apache Spark on Databricks....CloudSeniorBig dataWork at officeRemote work
NewVision Software
San Francisco, CA4 days ago - Senior Data Engineer SAN FRANCISCO, CA / ENGINEERING / FULL-TIME What will you be... ...doing? Building fast, reliable, scalable data pipelines that process... ...databases. Experience with Apache Spark or other Big Data frameworks; working with cloud infrastructure; data...CloudSeniorBig dataFull timeWork experience placement
- About the job Senior Data Engineer Role: Senior Data Engineer... ...in solving big data problems, design... ...for greater scalability, etc. Build the infrastructure... ...Hadoop/MapReduce, Spark, Hive, Kafka and... ...implementation in Java, Scala and Python... ...with AWS cloud services: EC2, EMR...CloudSeniorBig dataWork experience placement
- Software Engineer We are looking for a foundational... ...evolution of our data platform. You will... ...building robust, scalable data systems and... ..., using modern cloud technologies (AWS,... ...modern language (e.g., Java, Go). Big Data Expertise:... ...such as Spark, Flink, or Dask. Pipeline...CloudSeniorBig data
$155.4k - $208.4k
...Posting Title:Sr Data EngineerReq ID:101... ...global organization of engineers, product... ..., innovation, and scalability for our businesses... ...years of related big data engineering experience... ...libraries such as Spark, Presto, Hive to... ...one major MPP or cloud database technology...CloudSeniorBig dataFull timeWork experience placementHulu
San Francisco, CA6 days ago$185k - $218k
...is building the data platform to power... ...recognized on Forbes Cloud 100 2025 List and... ...an experienced Senior Software Engineer to join our... ...and maintaining scalable data platforms that... ...Experience with big data technologies... ...PySpark, Kafka, Spark, Iceberg, and Datalake...CloudSeniorBig dataWork at officeLocal areaRemote workRelocationFlexible hours3 days per weekCheckr
San Francisco, CA3 days ago$166k - $225k
...about enabling data teams to solve the... .... Founded by engineers — and customer obsessed... ...projects:Apache Spark: Develop the de... ...framework for big data.Data Plane... ...of data on cloud storage backends... ...fast, tuning free, scalable, and robust.What... ...experience in either Java, Scala or C++....CloudSeniorBig dataLocal areaWorldwideDataBricks
San Francisco, CA9 days ago$172.5k - $260.1k
...of Salesforce.Sales Cloud AI is... ...We are looking for engineers to develop the Sales... ...processes conversational data from voice, video,... ...experience with building big data high availability... ...language such as Java, Go, Python, C++, or... ...including Flink, Spark, Storm, Cassandra,...CloudSeniorBig dataFull timeSalesforce
San Francisco, CA5 days ago$300k - $390k
...motivated and experienced engineering leader to lead a... ...Lila's product data platform. You will... ...a reliable, scalable, and self-service... ..., lake house, and cloud-native object storage... ...Lila’s leadership in big data processing.... ...experience leading senior engineers. ~...CloudSeniorBig dataFull timeWork at officeLocal areaFlexible hoursLila Sciences, Inc.
San Francisco, CA3 days ago$190k - $240k
...infrastructure position first. As a Data Platform Engineer, you will be responsible for the... ...is still burning in. 3+ years in cloud infrastructure, SRE, or platform engineering... ...) Distributed data processing (Spark, PySpark, or similar big data frameworks — or experience...CloudSeniorBig dataWork at office2 days per week- ...Data EngineerStrong experience in data engineering, ETL (preferably Informatica Cloud), and data architecture. Experience working with Salesforce platforms and data models. Hands... ...of data modeling, data warehousing, and big data processing. Experience with data quality...CloudSeniorBig data
Insight Global
San Francisco, CA5 days ago - ...execution-focused Senior Data Scientist with a minimum... ...while working with big data technologies and modern cloud platforms. You will... ...Python, SQL, Spark, and AWS. The role... ...build, and deploy scalable machine learning models... ...Collaborate with engineering teams to integrate...CloudSeniorBig dataContract work
Proximity Works
San Francisco, CA3 days ago $130k - $196.5k
...of responsible data collaboration between... ...the Identity Engineering team maintain... ..., focusing on scalability, modernization,... ...to Spark and SingleStore... ...primarily focused on big data technologies... ...similar3+ years of Java , SQL... ...experience using cloud based platforms...CloudSeniorBig dataWorldwideLiveRamp
San Francisco, CA3 days ago- ...Proximity seeks a highly skilled Senior Data Scientist to design, build, and deploy scalable ML models at scale. You will work with big data, Spark, Hadoop, and modern cloud platforms, delivering data-... ..., while collaborating with engineers to deploy on AWS and optimize...CloudSeniorBig data
Proximity Works
San Francisco, CA4 days ago - ...the implementation of scalable data architectures for cutting... ...of complex feature engineering workstreams, ensuring... ...environments (Scala, Java) when required by client... ...using modern frameworks (Spark, LangChain, Databricks... ...(Terraform) across cloud providers (AWS, Azure,...CloudSeniorApprenticeshipWork at officeLocal areaEasy work
McKinsey & Company
San Francisco, CA6 days ago - ...Principal Data Engineer For Marketing And Consumer... ..., and scalability for our businesses... ...will serve as the senior technical... ...building depth in big-data engineering... ..., Scala, or Java; strong AWS fundamentals... ...such as Spark, Presto, Hive to... ...major MPP or cloud database technology...CloudBig dataWork experience placement
The Walt Disney Studios
San Francisco, CA3 days ago - ...for a high-caliber Senior Solution Architect... ...deploy production-grade Big Data and AI solutions on... ..., focusing on data engineering, data science, and cloud-native... ...distributed compute (Apache Spark) workloads, and... ...highlighting the value of scalability and maintainability...CloudSeniorBig dataTemporary work
Koantek
San Francisco, CA5 days ago - ...Hyperbolic Labs is building an Open-Access AI Cloud and seeks a Data Engineer to own the data warehouse and pipelines from 0 to 1. You will work between data analysts and engineering to ensure reliable, fast data access at scale. You will design data models for new products...CloudSenior
Jobleads-US
San Francisco, CA5 hours ago - ...fastest-growing AI data business in... ...Work together with engineers, scientists, operators... ...Handshake is hiring a Senior Data Platform... ...targets. Improve the cloud foundation behind... ...cloud partners on scalable platform... ...Spacelift, Datadog, dbt, Spark or Dataproc. Supporting...CloudSeniorFull timeWork at officeLocal areaRemote workFlexible hours
Handshake
San Francisco, CA3 days ago - Lead Data Engineer With MarTech Location: SFO, CA (Hybrid 2... ...activation pipelines. Architect scalable, event-driven systems... ...high-performance big-data applications using Scala, Databricks, Spark SQL, Spark Streaming, and... .... Build and optimize cloud-native data pipelines on...CloudBig data2 days per week
- ...is looking for a Senior Manager, Infrastructure Data Science to shape... ..., reliability engineering, infrastructure... ...creators of Apache Spark, Databricks has... ...projections to ensure scalability and cost-... ...capabilities in a cloud... ...data modeling, and big data technologiesLeadership...CloudSeniorBig dataWork at officeWorldwide
DataBricks
San Francisco, CA8 days ago $166k - $225k
...Databricks Inc. is seeking a Software Engineer with a backend focus to build... ...and 5+ years of experience in Java, Scala, or C++.... ...developing services and tools for data processing and ensuring scalability and security across cloud platforms. Comprehensive health...CloudSeniorDatabricks
San Francisco, CA4 days ago$182k - $242k
...CoreWeave is The Essential Cloud for AI™. Built for... ...What You’ll Do The Data Engineering Team builds and... ...resilient data pipelines, scalable lakehouse systems, and... ...Role We’re seeking a Senior Data Engineer to design... ...systems using Spark, Flink, or similar technologies...CloudSeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
San Francisco, CA3 days ago$500 per month
...pay Required Skills big data Python databases data engineering About micro1 micro1... ...Design, build, and maintain scalable big data pipelines and... ...(e.g., Hadoop, Spark, Flink). Strong foundation... ...teams. Expertise with cloud-based big data platforms...CloudBig dataPart timeFor contractorsRemote workmicro1
San Francisco, CA11 days ago- ...Ouster in San Francisco seeks a Sr. Data Infrastructure / Quality Engineer to architect, build, and validate cloud data pipelines powering autonomous sensing products. You will transform raw LiDAR and multimodal streams into robust, reproducible training datasets for...CloudSenior
Ouster
San Francisco, CA4 days ago $185k - $221.4k
...and own production data infrastructure.... ...time. Uphold high engineering standards and collaborate... ...maintainable, and scalable technical... ...alerting. Hands-on cloud data stack experience... ...comfortable with Spark or Trino at scale... ...Autonomy. Small, senior teams give you room...CloudSeniorRemote workFlexible hoursForesite Labs
San Francisco, CA5 days ago- ...processing raw data, kafka ingestions... ...a robust and scalable data model. Create... ...SQL, and other Big Data related... ...with product and engineering team to... ...applications Knowledge of cloud platforms, for... ...using SQL, Spark, Hive etc. Experience... ...such as Scala/Java/Python/R etc. (...CloudBig data
$224k - $264k
...Checkr is building the data platform to power... ...on Forbes Cloud 100 2025 List and is... ...Company. As a Staff Data Engineer on the People Data... ...keep this platform scalable, reliable, and ready... ...). Experience with big data technologies such as Kafka, Spark, Iceberg, data lakes...CloudBig dataWork at officeLocal areaRemote workRelocationFlexible hours3 days per week$167.7k - $245.2k
...ingesting petabytes of data every day. This... ...for a Data Engineer to help build... ...architect and operate scalable data pipelines... ...Scala, C++, or Java within a... ...such as Kafka, Spark, or Flink.Experience... ...stores or operating cloud-native services... ...to make really big things happen on...CloudSeniorFull timeTemporary workLocal areaWorldwideFlexible hoursCISCO Systems
San Francisco, CA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Big Data Engineer - Spark, Java, Cloud, Scalable. Be the first to apply!
Related searches
- data systems engineer San Francisco, CA
- finance data engineer San Francisco, CA
- data engineer contract San Francisco, CA
- big data devops engineer San Francisco, CA
- sr data engineer San Francisco, CA
- senior data engineer San Francisco, CA
- entry level big data engineer San Francisco, CA
- principal data engineer San Francisco, CA
- etl data engineer San Francisco, CA
- data engineer manager San Francisco, CA