Software Engineer (Big Data)
$144.9k - $168.4kQuantcast
At Quantcast, we don't just build advertising technology, we revolutionize how it works. Our AI-powered Demand Side Platform (DSP) connects the world's most ambitious marketers with their ideal audiences across the open internet, delivering results that actually move the needle. Since 2006, we've been the industry's trailblazer, launching the first AI-powered measurement platform for publishers and the first AI-driven DSP. Our AI doesn't just optimize—it delivers the measurable outcomes that matter most to our clients, giving them the competitive edge they need in a crowded marketplace. Ready to join the team that's defining the future of digital advertising? We are seeking a Software Engineer to join our Big Data Services team. This role focuses on building, maintaining, and optimizing large-scale data processing systems while supporting the needs of our data science and engineering teams. You will work closely with engineers, data scientists, and researchers to ensure a reliable, scalable, and efficient data infrastructure that powers advanced analytics and modeling workflows. The primary focus of the team is driving and developing systems and services that enable Quantcast to scale its distributed storage and compute platform. The ideal candidate has a passion for large-scale distributed systems (e.g., HDFS and Spark). What you’ll do: Contribute to the development and optimization of large-scale data workflows using technologies such as Apache Spark or similar frameworks Debug and resolve issues in distributed environments, including data inconsistencies and job failures Maintain and enhance the services that support the distributed storage and compute platform Assist in deploying and maintaining production systems, including CI/CD workflows Work to make our platform more elastic and fault-tolerant Provide technical input into roadmaps for the team Write clean, maintainable, and well-tested code Who you’re: BS in computer science or equivalent experience 1-3 years of professional software engineering experience (internships included) You must be work-authorized in the United States without the need for employer sponsorship. This is a hybrid role based in our San Francisco. To ensure a manageable commute for in-office days, candidates must reside within a 60-mile radius of San Francisco, CA. No relocation candidates at this time. Familiarity with data processing frameworks such as Apache Spark, Hadoop, or similar. Familiarity with containerization tools (e.g., Docker and Kubernetes) Experience with workflow orchestration tools (e.g., Airflow) is a plus Proficient in Java and/or Python programming languages Linux system administration/automation experienceStrong problem-solving and debugging skills Organized, detail-oriented personality What you’ll learn in this role: Hands-on experience with large-scale distributed systems in production. Exposure to real-world data science and modeling workflows. Best practices in building scalable and reliable data infrastructure. Collaboration across engineering and modeling teams. The salary range for this position is $144,900 - $168,400 USD At Quantcast, we craft offers that reflect your unique skills, expertise, and geographic location. On top of a competitive salary, this position includes a performance bonus, equity, and a comprehensive benefits package. For more details, visit our Careers Page and see how we support our team. We are headquartered in San Francisco with offices around the world. Quantcast is an Equal Opportunity Employer. Please see the Applicant Privacy Notice for details on our applicant privacy policy. Join the team that unlocks potential. #J-18808-Ljbffr Quantcast
$123.7k - $254.67k
...platform purpose-built for performance marketers. We leverage massive data and cutting-edge science to automate and optimize TV advertising... ...advertisers can trust to grow their business. As a Data Engineer at tvScientific, you will be a key player in implementing the robust...Big dataWork at officeRemote workRelocationRelocation package- About the Team Data Platform at OpenAI owns the foundational data stack powering critical... ...with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is to... ...infrastructure at OpenAI. You will scale and harden big data compute and storage platforms, build...Big dataWork at officeRelocation package
$123.7k - $254.67k
...platform purpose-built for performance marketers. We leverage massive data and cutting‑edge science to automate and optimize TV advertising... ...advertisers can trust to grow their business. As a Senior Data Engineer at tvScientific, you will be a key player in implementing the...Big dataWork at officeLocal areaRelocationRelocation package$117k - $209.33k
...5**Position Overview**Autodesk is seeking a Senior Software Developer to join the Enterprise Data Engineering & Visualization (EDEV) team. This team builds scalable... ...Spark, PySpark, Spark SQL & Java* Experience with big data ecosystems (Hadoop, Hive, Spark, Presto)*...Big data$200k - $236k
...Software Engineer, Data Platform Hybrid - SF Bay Area GlossGenius is the AI-powered system behind the world's most meaningful appointments... ...Experience implementing modern data orchestration patterns for big data use-cases, including batch and streaming workloads ~...Big dataWork at officeHome officeFlexible hours3 days per week$130k - $196.5k
Senior Software Engineer - Big Data page is loaded## Senior Software Engineer - Big Datalocations: San Franciscotime type: Full timeposted on: Posted Todayjob requisition id: JR012086**LiveRamp is the data collaboration platform of choice for the world’s most innovative...Big dataWork at officeWork from homeWorldwideFlexible hoursNight shift$180k - $250k
...confidence by unifying energy data, planning, forecasting, and operations... ...buyers, data scientists, and engineers, Verse enables faster, smarter... ...with highest standards of software-engineering best practices.... ...Intimate knowledge of scaling "big data" solutions in cloud-based...Big dataRemote workFlexible hours$166k - $225k
...are passionate about enabling data teams to solve the world's toughest... ...their business. Founded by engineers — and customer obsessed — we... ...traditional SQL query engines. As a software engineer on the Runtime team... ...source standard framework for big data. Data Plane Storage :...Big dataLocal areaWorldwide$162k - $216k
...design and ship category-defining software that enables Ryder and its 50,... ...-facing software to the data platform that will power the next... ...and creating impact for the engine of the American economy, you'll... ...foundation in data analytics and big data technologies, with the...Big dataFull timeWork at officeImmediate startRemote workMonday to Friday$141.1k - $190.91k
...Come help us bring modern software to modern science. ROLE OVERVIEW... ...a rich and variety of science data. To keep up our innovation, Benchling... ...of Benchling’s Data Platform engineers, you’ll join a rapidly growing... ...-facing data warehouse. The Big Data Infrastructure team is...Big dataFull timeTemporary workWork at officeLocal areaRemote workHome officeFlexible hours3 days per week- A leading advertising technology firm is looking for a Software Engineer to enhance large-scale data processing systems in San Francisco. The role involves working with data scientists and engineers to maintain an efficient infrastructure while developing workflows with...Big data
$147.4k - $220.9k
...Software Data Engineer, App Store Apple's App Store is the world's largest and most innovative app marketplace, home to over 1.5 million apps... ...or Python and proficiency in SQL ~ Hands-on experience in big data technologies, such as: Hadoop, Spark/Flink, Kafka,...Big dataRelocation- ...Staff Software Engineer Slack is looking for a Staff Software Engineer to join the Data Infrastructure team within the broader Data Engineering organization. The mission of... ...scale. ~ Strong technical background with big data and infrastructure technologies — such as...Big dataPermanent employment
- ...Backend Engineer – Data & Agent Platform Location: San Francisco (Hybrid) TensorStax is building... ...What We're Looking For: Strong software engineering experience in Python, with a... ...services. Strong understanding of big data transformation, ETL, and ELT pipelines...Big data
$215.2k - $245.6k
Capital One National Association is seeking a Lead Data Engineer in San Francisco, CA. The role involves driving technological transformations... ...of application development experience and familiarity with big data and cloud computing technologies. A competitive salary range...Big data$147.4k - $220.9k
...Francisco, California, United States Software and Services Apple's App... ...a strong passion for using data to drive business decisions, generate... ...? As a Software Data Engineer on the App Store Data team, you... ...in SQL Hands‑on experience in big data technologies, such as: Hadoop...Big dataRelocation$207k - $362.25k
...addresses. About the role Rippling's Data Cloud underpins every analytical... ..., and applications. As a Senior Staff Engineer on the Query and Data Platform team, you... ...custom compilers/programming languages. ~ Big Data Mastery: Proficient in the "modern data...Big dataWork at officeShift work3 days per week$210k - $385k
...Location Type Hybrid Department Data Science Compensation $210K -... ...in an LLM-first search engine and specialized data sources.... ...Qualifications 3+ years of software engineering experience shipping... ...maintainable code Experience with big data systems including distributed...Big dataFull timeLocal area- ...proprietary infrastructure and software, we empower over 200,000... ...at the heart of our company's data and AI strategy. We are building... ...a high level architect (staff engineer), you will oversee the strategy... ...services, and client libraries for big data using tools like GCP,...Big dataWork at officeWorldwide
$153k - $222k
...practical experience. 10 years of experience as a sales engineer or technical consultant in a cloud computing... ...professional consulting in the fields of cloud computing, data, information lifecycle management, and Big Data. Experience with developing data warehousing, data...Big dataFull timeLocal area$200k - $240k
Engineering Manager - Data Platform Responsible for building and scaling the data infrastructure that powers SentiLink’s products and decisioning... ...paced, startup or growth‑stage environments Experience with big data and streaming technologies (Spark, Kafka, Flink, etc.)...Big dataRemote workHome officeFlexible hours- ...Mission The Privacy & Conversion Data team is responsible for how... ...We’re seeking a Staff Engineer to lead the architecture and technical... .... ~8+ years of professional software engineering experience, with a... ...SQL; experience with modern big data ecosystems is a plus. ~...Big dataFull timeWork at officeRemote workRelocationRelocation package
$182k - $228k
...collecting and analyzing large-scale data sets. Your primary focus will... ...members to refine the data engineering roadmap and drive execution of... ...:*** Solid foundation in software engineering, with a proven track... ...Familiarity with Spark or other big data processing framework is a...Big dataFull timeWork at officeLocal area3 days per week$179.4k - $263.12k
6Sense in San Francisco is looking for a skilled Data Engineer to design and build reliable big data systems. The ideal candidate will have a BS/MS degree in Computer Science and experience with Big Data technologies such as Hadoop and Spark. The position offers a competitive...Big data- ...company seeks a Sr. Staff Technical Solutions Engineer to deliver tailored technical solutions... ...technical expertise in Apache Spark and data technologies while fostering customer relationships... ...will have extensive experience in big data, a strong background in troubleshooting...Big data
- ...part and supported the Regular Toilet is seeking a Staff Data & AI Technical Solutions Engineer, responsible for leading technical solutions for complex... ...with data pipelines and expertise in Spark, SQL, and Big Data technologies. This position requires U.S. citizenship...Big data
- 6Sense is looking for a Data Engineer in San Francisco to design and build robust big data systems and data transformations. Candidates should have a BS/MS in Computer Science or a related field, along with strong experience in Big Data technologies like Hadoop and Spark...Big data
- ...solutions provider in San Francisco is seeking an experienced Data Engineer to support its Data Analytics platform. This role involves developing... ...experience, including proficiency in Python and knowledge of big data tools. CGS offers a comprehensive benefits package,...Big data
$181.1k - $272.1k
Apple Inc. in San Francisco is hiring a Senior Software Data Engineer for the App Store. In this role, you will be responsible for building and... ...requirements. Candidates should have over 7 years of experience with big data tools like Hadoop and Spark, strong programming skills...Big data- Join a leading company as a Sr. Data Engineer, where you'll develop data pipelines and collaborate within Agile teams to enhance data analytics... ...7 years of experience in IT and expertise in Python, SQL, and big data technologies. Competitive salary, benefits including...Big dataFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer (Big Data). Be the first to apply!
- graduate software developer San Francisco, CA
- rust software engineer San Francisco, CA
- senior software design engineer San Francisco, CA
- software engineer student San Francisco, CA
- software engineer amazon San Francisco, CA
- software developer positions San Francisco, CA
- software engineer full time San Francisco, CA
- software qa engineer San Francisco, CA
- new graduate software engineer San Francisco, CA
- junior software developer San Francisco, CA



