Quantitative Data Engineer: Python, Spark & Production Tech
NPAworldwide
A leading financial tech firm in San Francisco seeks a Python-first quant developer to design and implement robust data pipelines and tools. This role emphasizes clean coding and a deep understanding of data manipulation libraries, SQL and non-SQL databases, and distributed computing frameworks like Apache Spark. You will work closely with quantitative researchers within a clean sheet environment, contributing to modern investment infrastructures and gaining broad exposure without being spread thin. Apply if you're keen on building impactful solutions in a high-stakes investment context. #J-18808-Ljbffr
- ...Francisco is seeking a QA Automation Engineer to ensure the quality of services for their data-driven AI infrastructure. The ideal candidate... ...in backend test automation using Python, along with knowledge of Kubernetes and Apache Spark. This position offers generous...SuggestedFlexible hours
- Veeva Systems, Inc. is looking for a Data Engineer to lead the development of scalable data processing systems. You will architect and build resilient data platforms using Python and Spark on AWS, design ETL workflows, and implement the Medallion Architecture for data governance...SuggestedFlexible hours
- A leading tech company is seeking a Staff Data & AI Technical Solutions Engineer in San Francisco. This hybrid position requires engagement... ...in data architectures and production environments. The ideal... ...have extensive experience with Spark and data pipelines, and will collaborate...Suggested
- ...Software Solutions is hiring a Senior Data Engineer (Apache Spark) in San Francisco, USA . Lead the... ...cluster resource management Expert-level Python and/or Scala programming for Spark... ...company building AI-powered enterprise products. Join 150+ professionals working on cutting...SuggestedFlexible hours
- A leading tech solutions provider is looking for a Snowflake Data Engineer to join an insurance-focused delivery team in California. The role requires strong hands-on experience in Snowflake and Python, with 8-10 years in data engineering. The engineer will build data pipelines...Suggested
- ...technology firm is looking for a Software Engineer to enhance large-scale data processing systems in San Francisco.... ...with technologies like Apache Spark and Docker. Ideal candidates have a... ...years of experience. Strong Java and Python skills are necessary, along with a problem...
$160k - $220k
...Applied Data Scientist III - Global Ad Tech Business Industry: Ad Technology... ...scientists and engineers. Why this company... ...grade challenges in production. A culture that supports... ...systems such as Spark and big‑data... ...coding experience in Python and scientific computing...Full time- ...software, automation, and data-driven decision-making.... ...for a Senior Data Engineer to help make it autonomous... ...-scale lithium production facility, Lithium One,... ...decision depends on. The Tech This is some of the most... ...related role. Strong Python and SQL, with deep experience...Full timeContract workImmediate startShift work
- ...A technology consulting firm is seeking a Senior Data Engineer to work in San Francisco. This hybrid role requires strong proficiency in Scala and Java, along with experience in Spark and various Big Data technologies. Candidates should have at least 2-5 years of development...Contract work3 days per week
- ...Senior Python Developer- AI/ML San Francisco... ...our global high-tech clients, a leader... ...cutting-edge data science and machine... ...and efficiency in production environments. Collaboration... ...software engineering best practices.... ...technologies, including Spark, Hadoop, or Databricks...Contract workFlexible hours
$127k - $225k
...logistics, and deep tech. With offices in... ...: As a Software Engineer on our Labelling and Data Automation team, you... ...embedding models to our production environment -... .... - Proficient in Python programming and strong... ...frameworks (Apache Hadoop/Spark) or orchestration...Full timeWork at officeWork from homeFlexible hours$124.8k - $220.8k
...those pipelines into production. We work with customers... ...initiatives working alongside engineering, product, and... ...solutions on customer data such as RAG architectures... ...Graduate degree in a quantitative discipline (Computer... ...Experience working with Apache Spark to process large-scale...Work at officeRemote workWork from homeHome officeFlexible hours- ...Data Engineer We're seeking a Data Engineer to transform large-scale... ...formats that power Mach9's ML and product pipelines. You'll work with... ...production systems in Python. Solid foundation in distributed... ...and cloud platforms (e.g., Spark, AWS Batch). Familiarity...
$170k - $220k
...Windfall is seeking a Sr. Data Engineer to join our data team. As a Sr.... ...you will work closely with our product, data science, and other... ...Programming languages - Java, Python, and Kotlin Data warehouse... ...Dataflow (Apache Beam) and Apache Spark Orchestration - Airflow...$152.3k - $247.5k
...implementations on big data projects and large-... ...Platform by architecting production-level data pipelines,... ...with expertise in data engineering and data warehousing,... ...technologies such as Spark Streaming and Kafka, performance... ...experience in SQL and Python, Scala, or Java....Work experience placement$204.5k - $267k
...Senior Data Engineer Locations: New York, NY; Boston, MA... ...Formation Bio is a tech and AI driven pharma company... ...Thrive Capital, John Doerr, Spark Capital, SV Angel... ...ready datasets using SQL, Python, and clinical standards... ...research and product use. Apply Generative...Work at officeLocal areaRelocation3 days per week$180k - $195k
...is backed by climate-tech and Silicon Valley investors... ...As a Senior Data Engineer at Gridware, you'll design... ...controls ~ Strong in Python and SQL, with deep experience... ...modern data stacks - Spark, Kafka, Databricks,... ...architectures for production systems ~ Familiar with...$160k - $175k
...efficiently. The company is backed by climate-tech and Silicon Valley investors. For... ...visit Role Overview As a Data Engineer at Gridware, you'll help build and... ...and batch ingestion processes using Python, SQL, Databricks, and Spark Implementing data quality checks,...$175.5k - $180k
Tech & AI Senior Data Engineer I - QuantumBlack, AI by McKinsey Job ID: 109245 Atlanta... ...~ Expert-level proficiency in Python and SQL and the ability to... ...construction, and output handling in production workflows using modern frameworks (Spark, LangChain, Databricks, Dask,...ApprenticeshipWork at officeLocal areaEasy work$172.5k - $260.1k
...Data Engineer Salesforce is the #1 AI CRM, where humans... ...ambition meets action. Tech meets trust. And... ...Engineering team builds the products and pipelines that... ...Strong proficiency in Python and SQL ~ Familiarity... ...Hands-on experience with Spark SQL, AWS (S3, EMR),...Permanent employment- A tech research firm in San Francisco seeks an expert to design and implement high-throughput data pipelines for large-scale microscopy datasets. You will oversee the architecture of the system, ensuring reliability and cost-effectiveness. Ideal candidates have over 5...Contract work
- ...pioneering life sciences organization in the UK is seeking a Data Engineer to work on Veeva Link’s next-gen Data Platform. You... ...team. Ideal candidates have expertise in Java or Python and experience with Apache Spark. This role supports flexible working environments to thrive...Remote jobWork at officeWork from homeFlexible hours
$233.6k - $292k
...Senior Forward Deployed Data Scientist / Engineer to work directly with... ...of data science, product development, and AI deployment... ..., or judgment. Python and SQL matter in... ...science, machine learning, quantitative engineering, or... ...distributed systems such as Spark, Ray, or Airflow...$208k - $282k
...Staff Data Engineer At Komodo Health, our mission is to reduce the global burden of disease... ...: Data Foundations owns the core data products that power Komodo's Healthcare Map. We... ...tools for the problem across SQL, Python, Spark, Rust, C++, and emerging AI-enabled engineering...Work experience placementLocal areaFlexible hours- ...high-growth Digital, Data and AI... ...Management, Telecom, Hi-Tech, and Life Sciences... ...the “Power of 3”: Engineering & Operations excellence... ...services and products to maximize business... ...Databricks using PySpark, Python, and SQL across... ...using Spark/Photon. Configure...Flexible hours
$130.05k - $175.95k
The Onyx Research Data Platform organization... ...R&D and Digital & Tech, designed to deliver... ...shop consisting of product and portfolio leadership, data engineering, infrastructure ,... ...data space, such as Spark, Kafka, Storm, etc.... ...engineering tools (Python/Spark, Kafka, Storm...Local area$123.7k - $254.67k
A leading social media platform in San Francisco is seeking a Senior Data Engineer to implement and optimize data infrastructure using AWS. This role requires strong proficiency in Spark and Scala, alongside a Bachelor’s degree in Computer Science or a related field. You...- A leading data collaboration company in San Francisco is seeking a Senior Software Engineer to join their Identity Engineering team. This role involves leading complex projects... ...should have extensive experience with Spark, Hadoop, and cloud platforms such as GCP or AWS...Remote work
- ...and context retrieval loss in scaled production environments. Hundreds of teams building... ...: We are looking for a Senior Data Infrastructure Engineer to build and scale the real-time data... ...and batching systems (Kafka, Spark, Flink, or Ray) operating at petabyte...
- ...users find their spark with precision and... ...vast conversation data and enhance user connections... ...iterate, and ship production‑ready ML solutions... ...with engineering, data science and... ...to keep Grindr’s tech stack ahead of the... ..., with fluency in Python and popular ML frameworks...Casual workWork at officeImmediate startFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Quantitative Data Engineer: Python, Spark & Production Tech. Be the first to apply!
- quant developer San Francisco, CA
- senior data center engineer San Francisco, CA
- data engineer manager San Francisco, CA
- data science developer San Francisco, CA
- etl data engineer San Francisco, CA
- entry level big data engineer San Francisco, CA
- data engineer San Francisco, CA
- big data cloud engineer San Francisco, CA
- junior big data engineer San Francisco, CA
- remote data engineer San Francisco, CA

