Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Quantitative Data Engineer: Python, Spark & Production Tech

NPAworldwide

A leading financial tech firm in San Francisco seeks a Python-first quant developer to design and implement robust data pipelines and tools. This role emphasizes clean coding and a deep understanding of data manipulation libraries, SQL and non-SQL databases, and distributed computing frameworks like Apache Spark. You will work closely with quantitative researchers within a clean sheet environment, contributing to modern investment infrastructures and gaining broad exposure without being spread thin. Apply if you're keen on building impactful solutions in a high-stakes investment context. #J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Quantitative Data Engineer: Python, Spark & Production Tech in San Francisco, CA vacancy
  •  ...Francisco is seeking a QA Automation Engineer to ensure the quality of services for their data-driven AI infrastructure. The ideal candidate...  ...in backend test automation using Python, along with knowledge of Kubernetes and Apache Spark. This position offers generous... 
    Suggested
    Flexible hours

    Stealth Startup

    San Francisco, CA
    2 days ago
  • Veeva Systems, Inc. is looking for a Data Engineer to lead the development of scalable data processing systems. You will architect and build resilient data platforms using Python and Spark on AWS, design ETL workflows, and implement the Medallion Architecture for data governance... 
    Suggested
    Flexible hours

    Veeva Systems, Inc.

    San Francisco, CA
    4 days ago
  • A leading tech company is seeking a Staff Data & AI Technical Solutions Engineer in San Francisco. This hybrid position requires engagement...  ...in data architectures and production environments. The ideal...  ...have extensive experience with Spark and data pipelines, and will collaborate... 
    Suggested

    Databricks

    San Francisco, CA
    5 days ago
  •  ...Software Solutions is hiring a Senior Data Engineer (Apache Spark) in San Francisco, USA . Lead the...  ...cluster resource management Expert-level Python and/or Scala programming for Spark...  ...company building AI-powered enterprise products. Join 150+ professionals working on cutting... 
    Suggested
    Flexible hours

    Appit LLC

    San Francisco, CA
    1 day ago
  • A leading tech solutions provider is looking for a Snowflake Data Engineer to join an insurance-focused delivery team in California. The role requires strong hands-on experience in Snowflake and Python, with 8-10 years in data engineering. The engineer will build data pipelines... 
    Suggested

    Komforce

    San Francisco, CA
    4 days ago
  •  ...technology firm is looking for a Software Engineer to enhance large-scale data processing systems in San Francisco....  ...with technologies like Apache Spark and Docker. Ideal candidates have a...  ...years of experience. Strong Java and Python skills are necessary, along with a problem... 

    Quantcast

    San Francisco, CA
    1 day ago
  • $160k - $220k

     ...Applied Data Scientist III - Global Ad Tech Business Industry: Ad Technology...  ...scientists and engineers. Why this company...  ...grade challenges in production. A culture that supports...  ...systems such as Spark and big‑data...  ...coding experience in Python and scientific computing... 
    Full time

    Sphere Digital Recruitment Group

    San Francisco, CA
    2 days ago
  •  ...software, automation, and data-driven decision-making....  ...for a Senior Data Engineer to help make it autonomous...  ...-scale lithium production facility, Lithium One,...  ...decision depends on. The Tech This is some of the most...  ...related role. Strong Python and SQL, with deep experience... 
    Full time
    Contract work
    Immediate start
    Shift work

    Mariana Minerals

    San Francisco, CA
    2 hours ago
  •  ...A technology consulting firm is seeking a Senior Data Engineer to work in San Francisco. This hybrid role requires strong proficiency in Scala and Java, along with experience in Spark and various Big Data technologies. Candidates should have at least 2-5 years of development... 
    Contract work
    3 days per week

    Saransh

    San Francisco, CA
    2 days ago
  •  ...Senior Python Developer- AI/ML San Francisco...  ...our global high-tech clients, a leader...  ...cutting-edge data science and machine...  ...and efficiency in production environments. Collaboration...  ...software engineering best practices....  ...technologies, including Spark, Hadoop, or Databricks... 
    Contract work
    Flexible hours

    Sustainable Talent

    San Francisco, CA
    4 days ago
  • $127k - $225k

     ...logistics, and deep tech. With offices in...  ...: As a Software Engineer on our Labelling and Data Automation team, you...  ...embedding models to our production environment -...  .... - Proficient in Python programming and strong...  ...frameworks (Apache Hadoop/Spark) or orchestration... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    1 day ago
  • $124.8k - $220.8k

     ...those pipelines into production. We work with customers...  ...initiatives working alongside engineering, product, and...  ...solutions on customer data such as RAG architectures...  ...Graduate degree in a quantitative discipline (Computer...  ...Experience working with Apache Spark to process large-scale... 
    Work at office
    Remote work
    Work from home
    Home office
    Flexible hours

    Databricks

    San Francisco, CA
    2 days ago
  •  ...Data Engineer We're seeking a Data Engineer to transform large-scale...  ...formats that power Mach9's ML and product pipelines. You'll work with...  ...production systems in Python. Solid foundation in distributed...  ...and cloud platforms (e.g., Spark, AWS Batch). Familiarity... 

    Mach9 Robotics Inc

    San Francisco, CA
    3 hours ago
  • $170k - $220k

     ...Windfall is seeking a Sr. Data Engineer to join our data team. As a Sr....  ...you will work closely with our product, data science, and other...  ...Programming languages - Java, Python, and Kotlin Data warehouse...  ...Dataflow (Apache Beam) and Apache Spark Orchestration - Airflow... 

    Windfall

    San Francisco, CA
    3 days ago
  • $152.3k - $247.5k

     ...implementations on big data projects and large-...  ...Platform by architecting production-level data pipelines,...  ...with expertise in data engineering and data warehousing,...  ...technologies such as Spark Streaming and Kafka, performance...  ...experience in SQL and Python, Scala, or Java.... 
    Work experience placement

    Cacheflow

    San Francisco, CA
    10 hours ago
  • $204.5k - $267k

     ...Senior Data Engineer Locations: New York, NY; Boston, MA...  ...Formation Bio is a tech and AI driven pharma company...  ...Thrive Capital, John Doerr, Spark Capital, SV Angel...  ...ready datasets using SQL, Python, and clinical standards...  ...research and product use. Apply Generative... 
    Work at office
    Local area
    Relocation
    3 days per week

    Formation Bio (Formerly TrailSpark)

    San Francisco, CA
    10 hours ago
  • $180k - $195k

     ...is backed by climate-tech and Silicon Valley investors...  ...As a Senior Data Engineer at Gridware, you'll design...  ...controls ~ Strong in Python and SQL, with deep experience...  ...modern data stacks - Spark, Kafka, Databricks,...  ...architectures for production systems ~ Familiar with... 

    Gridware

    San Francisco, CA
    3 hours ago
  • $160k - $175k

     ...efficiently. The company is backed by climate-tech and Silicon Valley investors. For...  ...visit Role Overview As a Data Engineer at Gridware, you'll help build and...  ...and batch ingestion processes using Python, SQL, Databricks, and Spark Implementing data quality checks,... 

    Gridware

    San Francisco, CA
    4 days ago
  • $175.5k - $180k

    Tech & AI Senior Data Engineer I - QuantumBlack, AI by McKinsey Job ID: 109245 Atlanta...  ...~ Expert-level proficiency in Python and SQL and the ability to...  ...construction, and output handling in production workflows using modern frameworks (Spark, LangChain, Databricks, Dask,... 
    Apprenticeship
    Work at office
    Local area
    Easy work

    McKinsey & Company

    San Francisco, CA
    10 hours ago
  • $172.5k - $260.1k

     ...Data Engineer Salesforce is the #1 AI CRM, where humans...  ...ambition meets action. Tech meets trust. And...  ...Engineering team builds the products and pipelines that...  ...Strong proficiency in Python and SQL ~ Familiarity...  ...Hands-on experience with Spark SQL, AWS (S3, EMR),... 
    Permanent employment

    Salesforce

    San Francisco, CA
    3 days ago
  • A tech research firm in San Francisco seeks an expert to design and implement high-throughput data pipelines for large-scale microscopy datasets. You will oversee the architecture of the system, ensuring reliability and cost-effectiveness. Ideal candidates have over 5... 
    Contract work

    Kubelt

    San Francisco, CA
    1 day ago
  •  ...pioneering life sciences organization in the UK is seeking a Data Engineer to work on Veeva Link’s next-gen Data Platform. You...  ...team. Ideal candidates have expertise in Java or Python and experience with Apache Spark. This role supports flexible working environments to thrive... 
    Remote job
    Work at office
    Work from home
    Flexible hours

    Veeva Systems

    San Francisco, CA
    2 days ago
  • $233.6k - $292k

     ...Senior Forward Deployed Data Scientist / Engineer to work directly with...  ...of data science, product development, and AI deployment...  ..., or judgment. Python and SQL matter in...  ...science, machine learning, quantitative engineering, or...  ...distributed systems such as Spark, Ray, or Airflow... 

    Scale AI, Inc.

    San Francisco, CA
    10 hours ago
  • $208k - $282k

     ...Staff Data Engineer At Komodo Health, our mission is to reduce the global burden of disease...  ...: Data Foundations owns the core data products that power Komodo's Healthcare Map. We...  ...tools for the problem across SQL, Python, Spark, Rust, C++, and emerging AI-enabled engineering... 
    Work experience placement
    Local area
    Flexible hours

    Komodo Health

    San Francisco, CA
    2 days ago
  •  ...high-growth Digital, Data and AI...  ...Management, Telecom, Hi-Tech, and Life Sciences...  ...the “Power of 3”: Engineering & Operations excellence...  ...services and products to maximize business...  ...Databricks using PySpark, Python, and SQL across...  ...using Spark/Photon. Configure... 
    Flexible hours

    Incedo Inc.

    San Francisco, CA
    2 days ago
  • $130.05k - $175.95k

    The Onyx Research Data Platform organization...  ...R&D and Digital & Tech, designed to deliver...  ...shop consisting of product and portfolio leadership, data engineering, infrastructure ,...  ...data space, such as Spark, Kafka, Storm, etc....  ...engineering tools (Python/Spark, Kafka, Storm... 
    Local area

    GlaxoSmithKline

    San Francisco, CA
    1 day ago
  • $123.7k - $254.67k

    A leading social media platform in San Francisco is seeking a Senior Data Engineer to implement and optimize data infrastructure using AWS. This role requires strong proficiency in Spark and Scala, alongside a Bachelor’s degree in Computer Science or a related field. You... 

    Pinterest

    San Francisco, CA
    1 day ago
  • A leading data collaboration company in San Francisco is seeking a Senior Software Engineer to join their Identity Engineering team. This role involves leading complex projects...  ...should have extensive experience with Spark, Hadoop, and cloud platforms such as GCP or AWS... 
    Remote work

    LiveRamp

    San Francisco, CA
    1 day ago
  •  ...and context retrieval loss in scaled production environments. Hundreds of teams building...  ...: We are looking for a Senior Data Infrastructure Engineer to build and scale the real-time data...  ...and batching systems (Kafka, Spark, Flink, or Ray) operating at petabyte... 

    Judgment Labs

    San Francisco, CA
    3 days ago
  •  ...users find their spark with precision and...  ...vast conversation data and enhance user connections...  ...iterate, and ship production‑ready ML solutions...  ...with engineering, data science and...  ...to keep Grindr’s tech stack ahead of the...  ..., with fluency in Python and popular ML frameworks... 
    Casual work
    Work at office
    Immediate start
    Flexible hours

    Grindr

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Quantitative Data Engineer: Python, Spark & Production Tech. Be the first to apply!