Senior Software Engineer - Big Data
$130k - $196.5kLiveRamp
Senior Software Engineer - Big Data page is loaded## Senior Software Engineer - Big Datalocations: San Franciscotime type: Full timeposted on: Posted Todayjob requisition id: JR012086**LiveRamp is the data collaboration platform of choice for the world’s most innovative companies. A groundbreaking leader in consumer privacy, data ethics, and foundational identity, LiveRamp is setting the new standard for building a connected customer view with unmatched clarity and context while protecting precious brand and consumer trust. LiveRamp offers complete flexibility to collaborate wherever data lives to support the widest range of data collaboration use cases—within organizations, between brands, and across its premier global network of top-quality partners.****Hundreds of global innovators, from iconic consumer brands and tech giants to banks, retailers, and healthcare leaders turn to LiveRamp to build enduring brand and business value by deepening customer engagement and loyalty, activating new partnerships, and maximizing the value of their first-party data while staying on the forefront of rapidly evolving compliance and privacy requirements.**We on the Identity Engineering team maintain the graph processing engine that connects the trillions of different identifiers for consumers and the devices they use online. Help us process this trillion edge graph as quickly and efficiently as possible.We handle product requests and enhancements, focusing on scalability, modernization, performance, cost, security, legal compliance, reliability, and quality. Projects include architectural refreshes like POCs for batch data processing, developing new REST APIs, and migrating applications to Spark and SingleStore. These initiatives aim to improve processing speed, scalability, maintainability, and cost-effectiveness.**You will:*** Lead complex problems, by breaking into their essential components, design and implement elegant solutions focussing on value delivered.* Deliver on the problems problems by collaborating with the team and cross functional teams* Modernize our applications to be modular, scalable by leveraging the latest stack* Collaborate closely with product managers, and other engineers to deliver high-quality software* Design with privacy and security-first principles and err on the side of shipping fast and iterating.**About you:*** 6+ years of professional software development experience, primarily focused on big data technologies.* 3+ years of experience writing and optimizing large-scale batch processing using Spark/Hadoop or similar* 3+ years of Java , SQL programming skills* 2+ years of experience using cloud based platforms such as GCP, AWS, Azure or similar technologies.* Experience with technologies like Docker, Terraform and/or Kubernetes* Startup personality and enjoy working as part of a team: smart, ethical, friendly, hard-working, and productive.**Nice to have:*** Experience with GCP products such as BigTable, BigQuery, Dataproc, PubSub or other data tools like Kafka, Hive, or Apache Beam* Experience with development tools such as Terraform, Kubernetes, Helm, or Gradle* Experience with designing and implementing interfaces and infrastructure for large scale systems and RESTful APIsThe approximate annual base compensation range is $130,000 to $196,500. The actual offer, reflecting the total compensation package and benefits, will be determined by a number of factors including the applicant's experience, knowledge, skills, and abilities, geography, as well as internal equity among our team.## Benefits:* People: Work with talented, collaborative, and friendly people who love what they do.* Fun: We host in-person and virtual events such as game nights, happy hours, camping trips, and sports leagues.* Work/Life Harmony: Flexible paid time off, paid holidays, options for working from home, and paid parental leave.* Comprehensive Benefits Package: LiveRamp offers a comprehensive benefits package designed to help you be your best self in your personal and professional lives. Our benefits package offers medical, dental, vision, life and disability, an employee assistance program, voluntary benefits as well as perks programs for your healthy lifestyle, career growth and more.* Savings: Our 401K matching plan—1:1 match up to 6% of salary—helps you plan ahead. Also Employee Stock Purchase Plan - 15% discount off purchase price of LiveRamp stock (U.S. LiveRampers)* RampRemote: A comprehensive office equipment and ergonomics program—we provide you with equipment and tools to be your most productive self, no matter where you're located## *LiveRamp’s mission is to connect data in ways that matter, and doing so starts with our people. We know that inspired teams enlist people from a blend of backgrounds and experiences. And we know that individuals do their best when they not only bring their full selves to work but feel like they truly belong. Connecting LiveRampers to new ideas and one another is one of our guiding principles—one that informs how we hire, train, and grow our global team across nine countries and four continents. Click* *to learn more about Diversity, Inclusion, & Belonging (DIB) at LiveRamp.*LiveRamp is an affirmative action and equal opportunity employer (AA/EOE/W/M/Vet/Disabled) and does not discriminate in recruiting, hiring, training, promotion or other employment of associates or the awarding of subcontracts because of a person's race, color, sex, age, religion, national origin, protected veteran, disability, sexual orientation, gender identity, genetics or other protected status. Qualified applicants with arrest and conviction records will be considered for the position in accordance with the San Francisco Fair Chance Ordinance.We use automated decision systems (ADS) as part of our recruitment and hiring process. If you require an accommodation or believe that the use of an ADS may create a barrier to your application or participation in the hiring process due to a disability or other protected characteristic, please let us know. We are committed to providing reasonable accommodations and ensuring an equitable hiring experience for all candidates.**California residents**: Please see our for more information regarding how we collect, use, and disclose the personal information you provide during the job application process.**To all recruitment agencies**: LiveRamp does not accept agency resumes. Please do not forward resumes to our jobs alias, LiveRamp employees or any other company location. LiveRamp is not responsible for any fees related to unsolicited resumes.LiveRamp is the data collaboration platform of choice for the world’s most innovative companies. A groundbreaking leader in consumer privacy, data ethics, and foundational identity, LiveRamp is setting the new standard for building a connected customer view with unmatched clarity and context while protecting precious brand and consumer trust. LiveRamp offers complete flexibility to collaborate wherever data lives to support the widest range of data collaboration use cases—within organizations, between brands, and across its premier global network of top-quality partners.Hundreds of global innovators, from iconic consumer brands and tech giants to retailers, financial services, and healthcare leaders turn to LiveRamp to build enduring brand and business value by deepening customer engagement and loyalty, activating new partnerships, and maximizing the value of their first-party data while staying on the forefront of rapidly evolving compliance and privacy requirements. LiveRamp is based in San Francisco, California with offices worldwide. Learn more at LiveRamp.com. #J-18808-Ljbffr LiveRamp
- ...About the Role Join a startup building an agentic data lakehouse platform. As a Senior Software Engineer, Distributed Data Systems, you'll work on a greenfield... ..., or platform engineer ~ Experience with big data systems (Apache Spark, Hadoop) ~ Strong background...SeniorBig data
$155k - $190k
...Senior Software Engineer - Data Processing Seattle, WA Senior Software Engineer - Data Processing Truveta is the world’s first health provider... ...people with a special combination of health, software and big data experience who share our company values. This...SeniorBig dataFor contractorsVisa sponsorshipWork visaFlexible hours$166k - $225k
...are passionate about enabling data teams to solve the world's toughest... ...their business. Founded by engineers — and customer obsessed — we... ...traditional SQL query engines. As a software engineer on the Runtime team... ...source standard framework for big data. Data Plane Storage :...SeniorBig dataLocal areaWorldwide- ...A technology consulting firm is seeking a Senior Data Engineer to work in San Francisco. This hybrid role requires strong proficiency in Scala and Java, along with experience in Spark and various Big Data technologies. Candidates should have at least 2-5 years of development...SeniorBig dataContract work3 days per week
- ...A leading tech staffing firm in San Francisco is seeking a Senior Data Engineer/Back-end Engineer. This role requires extensive experience with big data and strong backend service skills. The candidate will work on innovative projects, collaborating with cross-functional...SeniorBig data
- ...Join a leading company as a Sr. Data Engineer, where you'll develop data pipelines and collaborate within Agile teams to enhance data analytics... ...7 years of experience in IT and expertise in Python, SQL, and big data technologies. Competitive salary, benefits including...SeniorBig dataFlexible hours
- ...Senior Data Engineer with Scala, Java & Spark - W2 Role Location: San Francisco, CA (Hybrid - 3 days a week onsite) Job Type: W2 Contract... ...with Spark Processing engine. ~1+ years of experience with Big data tools / technologies / Streaming (Hive, Impala, OOZIE,...SeniorBig dataContract workWork at office3 days per week
- ...company seeks a Sr. Staff Technical Solutions Engineer to deliver tailored technical solutions... ...technical expertise in Apache Spark and data technologies while fostering customer relationships... ...will have extensive experience in big data, a strong background in troubleshooting...SeniorBig data
- A data processing company is seeking a Generalist Software Engineer to join their fully remote team. The role involves developing web applications and working on data mining and machine learning projects. Ideal candidates will have skills in Python, PostgreSQL, and a passion...Big dataRemote work
- ...Software Engineer We are looking for a foundational member of our engineering team: a highly motivated... ...design, creation, and evolution of our data platform. You will be part of the team... ...modern language (e.g., Java, Go). Big Data Expertise: You have hands-on...SeniorBig data
- ...Senior Cloud Data Operations Engineer Responsibilities Support/Operate an Enterprise Data Services Platform (RedShift/EMR/OpenSearch Service)... ...and Shell Knowledgeable of Spark processing engine & Big Data/Hadoop framework Experience implementing highly available...SeniorBig dataLong term contractContract workRemote work
$216k - $270k
...Scale AI, Inc. is seeking a software engineer to design, build, and maintain scalable systems within its Generative AI Data Engine. As part of a dynamic hybrid team based in San Francisco or New York City, you will play a crucial role in producing high-quality AI data...Senior$144.9k - $168.4k
...a crowded marketplace. Ready to join the team that's defining the future of digital advertising? We are seeking a Software Engineer to join our Big Data Services team. This role focuses on building, maintaining, and optimizing large-scale data processing systems while...Big dataInternshipWork at officeRelocation- ...People.ai is an AI-powered foundational data platform that helps customers unlock go... ...have made processes their own. As a Senior Software Engineer on the Matching team, you will work on... ...Perform data-driven research using big data and leveraging Data Science toolset...SeniorBig data
$180k
...predictive sports analytics data products. We believe... ...a challenge rooted in engineering, mathematics, and... ...Analytics team is seeking a Senior Data Platform Engineer... ...production, data streams, to "Big Data" analytics. ~... .... Automation : Software development for operational...SeniorBig dataRemote work- ...About the Team Data Platform at OpenAI owns the foundational data stack powering critical... ...with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is to... ...infrastructure at OpenAI. You will scale and harden big data compute and storage platforms, build...Big dataWork at officeRelocation package
$200k - $350k
...the Role Join a well-funded AI/ML data analytics startup building an agentic data... ...from messy enterprise data. As a Senior Software Engineer, Platform , you'll be a core member of... ..., data engineering, data modeling, and big data technologies. Proven track record...SeniorBig dataWork at officeRemote workVisa sponsorship$216k - $270k
...Scale AI in San Francisco is seeking an experienced software engineer with over 5 years in high-growth environments. The role involves designing and maintaining full-stack systems and implementing features using technologies like React and Node.js. Ideal candidates should...Senior- ...A technology firm is looking for a Senior Software Engineer to join their team in San Francisco. The role involves designing and implementing scalable permission systems and architecting frameworks for secure collaboration between organizations. Candidates should have...Senior
- A tech startup in San Francisco seeks a Senior Software Development Engineer to tackle engineering challenges in providing data access solutions. This role involves writing clean code, embracing a DevOps culture, and managing production environments for large-scale data...Senior
$160k - $200k
...financial journey. ABOUT THE TEAM Data Platform Engineers at Rocket Money further our mission by... ...Data Analytics, Machine Learning, and Software Engineering teams to build data... ...to buy. You have experience making big changes to critical data infrastructure...SeniorBig dataTemporary workWork at office- ...A leading technology firm in California seeks versatile Sr Software Engineers specializing in Machine Learning, Data Engineering, and Full-Stack Development. The ideal candidate will engage in challenging existing concepts and innovating solutions while building products...Senior
- ...backed by top-tier VCs. About You You are a passionate Senior Software Engineer eager to develop and scale our multi-tenant SaaS... ...Developer certification is highly desirable. ~ Experience with Big Data technologies. ~ Work from anywhere in the US! We are fully...SeniorBig dataImmediate startRemote workHome officeFlexible hours
- ...A global technology company based in San Francisco is seeking a motivated Software Engineer to enhance their product engineering team. The role focuses on designing and building data workflows and pipelines using Palantir Foundry, crucial for the company's operations....Senior
$311k
...Scale AI, Inc. is seeking a Senior Software Engineer in San Francisco. In this role, you will lead the design and implementation of scalable backend systems for federal clients, managing the complete lifecycle of feature development. Ideal candidates will have strong...Senior$164k
...Senior Software Engineer, Data Engineering San Francisco, CA, USA About the Role The Data engineering team has been created keeping in mind the importance and criticality of data for the overall success of Chime. The mission of this group is to build scalable...SeniorFull timeWork at officeLocal areaRemote workNight shift$97.02k - $163.03k
...maintain, and enhance complex software systems leveraging... ...Implement software engineering best practices including... ..., experimentation, and data-driven decision-making.... ...Hands-on experience with big data ecosystem products... ...roles (I, II, III, Senior, Lead, etc.) new hires...SeniorBig dataMinimum wageFull timeWork at officeLocal areaFlexible hours$269k - $316k
...Senior Engineering Manager, Data Engineering Denver, Colorado, United States; San Francisco, California, United States Checkr is building the... ...quality and operational excellence ~ Experience working on big data products at scale ~ AI first mindset ~ An A-...SeniorBig dataWork at officeLocal areaRemote workRelocationFlexible hours3 days per week- ...Build the data infrastructure for robots operating in the real world. Robotics is moving... ...unexpectedly, or need to be improved, engineers rely on data to understand what actually... ...highly skilled product and Rust focused Software Engineer with professional experience delivering...SeniorRemote work
$69.84 - $77.84 per hour
...Senior Software Engineer – Python / PySpark (Contract) Genesis10 is currently seeking a Senior Software... ...platform Build and maintain data ingestion, validation, and transformation... ...Languages: Java, Scala, SQL, HiveQL Big Data Technologies: Hadoop, Spark, HDFS,...SeniorBig dataHourly payContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer - Big Data. Be the first to apply!
- software sales engineer San Francisco, CA
- software engineer internship remote San Francisco, CA
- IT software developer San Francisco, CA
- new grad software engineer San Francisco, CA
- software engineer staff San Francisco, CA
- integration software engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- software engineer part time San Francisco, CA
- facebook software engineer San Francisco, CA
- senior robotics software engineer San Francisco, CA


