Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer (Big Data)

$144.9k - $168.4k

Quantcast

At Quantcast, we don't just build advertising technology, we revolutionize how it works. Our AI-powered Demand Side Platform (DSP) connects the world's most ambitious marketers with their ideal audiences across the open internet, delivering results that actually move the needle. Since 2006, we've been the industry's trailblazer, launching the first AI-powered measurement platform for publishers and the first AI-driven DSP. Our AI doesn't just optimize—it delivers the measurable outcomes that matter most to our clients, giving them the competitive edge they need in a crowded marketplace. Ready to join the team that's defining the future of digital advertising? We are seeking a Software Engineer to join our Big Data Services team. This role focuses on building, maintaining, and optimizing large-scale data processing systems while supporting the needs of our data science and engineering teams. You will work closely with engineers, data scientists, and researchers to ensure a reliable, scalable, and efficient data infrastructure that powers advanced analytics and modeling workflows. The primary focus of the team is driving and developing systems and services that enable Quantcast to scale its distributed storage and compute platform. The ideal candidate has a passion for large-scale distributed systems (e.g., HDFS and Spark). What you’ll do: Contribute to the development and optimization of large-scale data workflows using technologies such as Apache Spark or similar frameworks Debug and resolve issues in distributed environments, including data inconsistencies and job failures Maintain and enhance the services that support the distributed storage and compute platform Assist in deploying and maintaining production systems, including CI/CD workflows Work to make our platform more elastic and fault-tolerant Provide technical input into roadmaps for the team Write clean, maintainable, and well-tested code Who you’re: BS in computer science or equivalent experience 1-3 years of professional software engineering experience (internships included) You must be work-authorized in the United States without the need for employer sponsorship. This is a hybrid role based in our San Francisco. To ensure a manageable commute for in-office days, candidates must reside within a 60-mile radius of San Francisco, CA. No relocation candidates at this time. Familiarity with data processing frameworks such as Apache Spark, Hadoop, or similar. Familiarity with containerization tools (e.g., Docker and Kubernetes) Experience with workflow orchestration tools (e.g., Airflow) is a plus Proficient in Java and/or Python programming languages Linux system administration/automation experienceStrong problem-solving and debugging skills Organized, detail-oriented personality What you’ll learn in this role: Hands-on experience with large-scale distributed systems in production. Exposure to real-world data science and modeling workflows. Best practices in building scalable and reliable data infrastructure. Collaboration across engineering and modeling teams. The salary range for this position is $144,900 - $168,400 USD At Quantcast, we craft offers that reflect your unique skills, expertise, and geographic location. On top of a competitive salary, this position includes a performance bonus, equity, and a comprehensive benefits package. For more details, visit our Careers Page and see how we support our team. We are headquartered in San Francisco with offices around the world. Quantcast is an Equal Opportunity Employer. Please see the Applicant Privacy Notice for details on our applicant privacy policy. Join the team that unlocks potential. #J-18808-Ljbffr Quantcast

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer (Big Data) in San Francisco, CA vacancy
  • $123.7k - $254.67k

     ...platform purpose-built for performance marketers. We leverage massive data and cutting-edge science to automate and optimize TV advertising...  ...advertisers can trust to grow their business. As a Data Engineer at tvScientific, you will be a key player in implementing the robust... 
    Big data
    Work at office
    Remote work
    Relocation
    Relocation package

    tvScientific

    San Francisco, CA
    1 hour ago
  • About the Team Data Platform at OpenAI owns the foundational data stack powering critical...  ...with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is to...  ...infrastructure at OpenAI. You will scale and harden big data compute and storage platforms, build... 
    Big data
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    1 day ago
  • $123.7k - $254.67k

     ...platform purpose-built for performance marketers. We leverage massive data and cutting‑edge science to automate and optimize TV advertising...  ...advertisers can trust to grow their business. As a Senior Data Engineer at tvScientific, you will be a key player in implementing the... 
    Big data
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    5 days ago
  • $117k - $209.33k

     ...5**Position Overview**Autodesk is seeking a Senior Software Developer to join the Enterprise Data Engineering & Visualization (EDEV) team. This team builds scalable...  ...Spark, PySpark, Spark SQL & Java* Experience with big data ecosystems (Hadoop, Hive, Spark, Presto)*... 
    Big data

    Autodesk, Inc.

    San Francisco, CA
    5 days ago
  • $200k - $236k

     ...Software Engineer, Data Platform Hybrid - SF Bay Area GlossGenius is the AI-powered system behind the world's most meaningful appointments...  ...Experience implementing modern data orchestration patterns for big data use-cases, including batch and streaming workloads ~... 
    Big data
    Work at office
    Home office
    Flexible hours
    3 days per week

    GlossGenius

    San Francisco, CA
    4 days ago
  • $130k - $196.5k

    Senior Software Engineer - Big Data page is loaded## Senior Software Engineer - Big Datalocations: San Franciscotime type: Full timeposted on: Posted Todayjob requisition id: JR012086**LiveRamp is the data collaboration platform of choice for the world’s most innovative... 
    Big data
    Work at office
    Work from home
    Worldwide
    Flexible hours
    Night shift

    LiveRamp

    San Francisco, CA
    5 days ago
  • $180k - $250k

     ...confidence by unifying energy data, planning, forecasting, and operations...  ...buyers, data scientists, and engineers, Verse enables faster, smarter...  ...with highest standards of software-engineering best practices....  ...Intimate knowledge of scaling "big data" solutions in cloud-based... 
    Big data
    Remote work
    Flexible hours

    Verse

    San Francisco, CA
    9 days ago
  • $166k - $225k

     ...are passionate about enabling data teams to solve the world's toughest...  ...their business. Founded by engineers — and customer obsessed — we...  ...traditional SQL query engines. As a software engineer on the Runtime team...  ...source standard framework for big data. Data Plane Storage :... 
    Big data
    Local area
    Worldwide

    Databricks Inc.

    San Francisco, CA
    4 days ago
  • $162k - $216k

     ...design and ship category-defining software that enables Ryder and its 50,...  ...-facing software to the data platform that will power the next...  ...and creating impact for the engine of the American economy, you'll...  ...foundation in data analytics and big data technologies, with the... 
    Big data
    Full time
    Work at office
    Immediate start
    Remote work
    Monday to Friday

    Baton (A Ryder Technology Lab)

    San Francisco, CA
    8 days ago
  • $141.1k - $190.91k

     ...Come help us bring modern software to modern science. ROLE OVERVIEW...  ...a rich and variety of science data. To keep up our innovation, Benchling...  ...of Benchling’s Data Platform engineers, you’ll join a rapidly growing...  ...-facing data warehouse. The Big Data Infrastructure team is... 
    Big data
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Home office
    Flexible hours
    3 days per week

    Benchling

    San Francisco, CA
    5 hours ago
  • A leading advertising technology firm is looking for a Software Engineer to enhance large-scale data processing systems in San Francisco. The role involves working with data scientists and engineers to maintain an efficient infrastructure while developing workflows with... 
    Big data

    Quantcast

    San Francisco, CA
    5 days ago
  • $147.4k - $220.9k

     ...Software Data Engineer, App Store Apple's App Store is the world's largest and most innovative app marketplace, home to over 1.5 million apps...  ...or Python and proficiency in SQL ~ Hands-on experience in big data technologies, such as: Hadoop, Spark/Flink, Kafka,... 
    Big data
    Relocation

    Apple

    San Francisco, CA
    3 days ago
  •  ...Staff Software Engineer Slack is looking for a Staff Software Engineer to join the Data Infrastructure team within the broader Data Engineering organization. The mission of...  ...scale. ~ Strong technical background with big data and infrastructure technologies — such as... 
    Big data
    Permanent employment

    Salesforce

    San Francisco, CA
    1 day ago
  •  ...Backend Engineer – Data & Agent Platform Location: San Francisco (Hybrid) TensorStax is building...  ...What We're Looking For: Strong software engineering experience in Python, with a...  ...services. Strong understanding of big data transformation, ETL, and ELT pipelines... 
    Big data

    Tensorstax

    San Francisco, CA
    3 days ago
  • $215.2k - $245.6k

    Capital One National Association is seeking a Lead Data Engineer in San Francisco, CA. The role involves driving technological transformations...  ...of application development experience and familiarity with big data and cloud computing technologies. A competitive salary range... 
    Big data

    Capital One National Association

    San Francisco, CA
    1 day ago
  • $147.4k - $220.9k

     ...Francisco, California, United States Software and Services Apple's App...  ...a strong passion for using data to drive business decisions, generate...  ...? As a Software Data Engineer on the App Store Data team, you...  ...in SQL Hands‑on experience in big data technologies, such as: Hadoop... 
    Big data
    Relocation

    Apple Inc.

    San Francisco, CA
    1 day ago
  • $207k - $362.25k

     ...addresses. About the role Rippling's Data Cloud underpins every analytical...  ..., and applications. As a Senior Staff Engineer on the Query and Data Platform team, you...  ...custom compilers/programming languages. ~ Big Data Mastery: Proficient in the "modern data... 
    Big data
    Work at office
    Shift work
    3 days per week

    Rippling

    San Francisco, CA
    5 hours ago
  • $210k - $385k

     ...Location Type Hybrid Department Data Science Compensation $210K -...  ...in an LLM-first search engine and specialized data sources....  ...Qualifications 3+ years of software engineering experience shipping...  ...maintainable code Experience with big data systems including distributed... 
    Big data
    Full time
    Local area

    Pantera Capital

    San Francisco, CA
    4 days ago
  •  ...proprietary infrastructure and software, we empower over 200,000...  ...at the heart of our company's data and AI strategy. We are building...  ...a high level architect (staff engineer), you will oversee the strategy...  ...services, and client libraries for big data using tools like GCP,... 
    Big data
    Work at office
    Worldwide

    Airwallex

    San Francisco, CA
    4 days ago
  • $153k - $222k

     ...practical experience. 10 years of experience as a sales engineer or technical consultant in a cloud computing...  ...professional consulting in the fields of cloud computing, data, information lifecycle management, and Big Data. Experience with developing data warehousing, data... 
    Big data
    Full time
    Local area

    Google

    San Francisco, CA
    1 day ago
  • $200k - $240k

    Engineering Manager - Data Platform Responsible for building and scaling the data infrastructure that powers SentiLink’s products and decisioning...  ...paced, startup or growth‑stage environments Experience with big data and streaming technologies (Spark, Kafka, Flink, etc.)... 
    Big data
    Remote work
    Home office
    Flexible hours

    SentiLink

    San Francisco, CA
    3 days ago
  •  ...Mission The Privacy & Conversion Data team is responsible for how...  ...We’re seeking a Staff Engineer to lead the architecture and technical...  .... ~8+ years of professional software engineering experience, with a...  ...SQL; experience with modern big data ecosystems is a plus. ~... 
    Big data
    Full time
    Work at office
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    1 hour ago
  • $182k - $228k

     ...collecting and analyzing large-scale data sets. Your primary focus will...  ...members to refine the data engineering roadmap and drive execution of...  ...:*** Solid foundation in software engineering, with a proven track...  ...Familiarity with Spark or other big data processing framework is a... 
    Big data
    Full time
    Work at office
    Local area
    3 days per week

    Turo Inc

    San Francisco, CA
    2 days ago
  • $179.4k - $263.12k

    6Sense in San Francisco is looking for a skilled Data Engineer to design and build reliable big data systems. The ideal candidate will have a BS/MS degree in Computer Science and experience with Big Data technologies such as Hadoop and Spark. The position offers a competitive... 
    Big data

    6Sense

    San Francisco, CA
    5 days ago
  •  ...company seeks a Sr. Staff Technical Solutions Engineer to deliver tailored technical solutions...  ...technical expertise in Apache Spark and data technologies while fostering customer relationships...  ...will have extensive experience in big data, a strong background in troubleshooting... 
    Big data

    Databricks Inc.

    San Francisco, CA
    4 days ago
  •  ...part and supported the Regular Toilet is seeking a Staff Data & AI Technical Solutions Engineer, responsible for leading technical solutions for complex...  ...with data pipelines and expertise in Spark, SQL, and Big Data technologies. This position requires U.S. citizenship... 
    Big data

    I did my part and supported the Regular Toilet

    San Francisco, CA
    5 days ago
  • 6Sense is looking for a Data Engineer in San Francisco to design and build robust big data systems and data transformations. Candidates should have a BS/MS in Computer Science or a related field, along with strong experience in Big Data technologies like Hadoop and Spark... 
    Big data

    6Sense

    San Francisco, CA
    4 days ago
  •  ...solutions provider in San Francisco is seeking an experienced Data Engineer to support its Data Analytics platform. This role involves developing...  ...experience, including proficiency in Python and knowledge of big data tools. CGS offers a comprehensive benefits package,... 
    Big data

    CGS Federal (Contact Government Services)

    San Francisco, CA
    2 days ago
  • $181.1k - $272.1k

    Apple Inc. in San Francisco is hiring a Senior Software Data Engineer for the App Store. In this role, you will be responsible for building and...  ...requirements. Candidates should have over 7 years of experience with big data tools like Hadoop and Spark, strong programming skills... 
    Big data

    Apple Inc.

    San Francisco, CA
    1 day ago
  • Join a leading company as a Sr. Data Engineer, where you'll develop data pipelines and collaborate within Agile teams to enhance data analytics...  ...7 years of experience in IT and expertise in Python, SQL, and big data technologies. Competitive salary, benefits including... 
    Big data
    Flexible hours

    Contact Government Services, LLC

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer (Big Data). Be the first to apply!