Get new jobs by email
  •  ...LLM-powered financial applications . You will be responsible for developing scalable, low-latency ingestion systems that handle millions of...  ...financial documents . Requirements : Python, LLM. Knowing Spark and Databricks is a BIG plus. Typescript is also nice. Experience... 
    Suggested
    Full time
    Contract work
    Work at office
    Immediate start
    Remote work

    Fintool

    San Francisco, CA
    2 days ago
  • Hadoop Application Developer - Permanent Position Our client is a leading manufacturer and supplier of metal components for the automotive industry, recently ranked 13th of the 150 Top North American Suppliers in “Automotive News.” A growing and vital company, client provides... 
    Suggested
    Permanent employment

    MIT RESOURCE

    San Francisco, CA
    3 days ago
  • Senior Database Engineer(Elastic/Mongo/Hadoop) Senior Database Engineer(Elastic/Mongo/Hadoop) Workplace Type : Remote - Region : San...  ...instances with TLS/SSL and/or LDAP • Candidate must also be able to develop automated solutions for ad-hoc script execution requests, ad-... 
    Suggested
    Remote work

    CatchProbe Intelligence Technologies

    San Francisco, CA
    12 hours ago
  • Overview Senior Database Engineer(Elastic/Mongo/Hadoop) - San Francisco, CA. Workplace Type: Remote - Region: San Francisco, CA. Job...  ...SHA1, X509, LDAP) including TLS/SSL and/or LDAP reconfiguration. Develop automated solutions for ad-hoc script execution, ad-hoc report... 
    Suggested
    Full time
    Remote work

    CatchProbe Intelligence Technologies

    San Francisco, CA
    2 days ago
  • $194 per hour

     ...infrastructure is reliable, scalable, and developer-friendly as we continue to power...  ...proficiency in Python and SQL. Hands-on Spark development experience. Expertise with modern...  ...data‑infrastructure technologies such as Hadoop, Hive, Kafka (or similar streaming platforms... 
    Suggested
    Work from home
    Flexible hours

    Parafin Inc.

    San Francisco, CA
    4 days ago
  •  ...on some of the most exciting big data open source technologies (Spark, Kafka, Kubernetes, etc.), at the scale of hundreds of petabytes...  ...Spark ~ Deep knowledge of big data technologies (e.g. Spark, Hadoop, Parquet/ORC, Flink) ~ Experience in leading cross-team engineering... 
    Suggested
    Part time
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    2 days ago
  • $130.6k - $192k

     ...orchestration and tracking frameworks such as Metaflow, MLflow, Dagster, or Airflow. Large-Scale Data Processing - Knowledge of Spark, Hadoop, or other distributed data processing technologies. Monitoring & Observability - Proficiency with metrics and alerting solutions... 
    Suggested
    Hourly pay
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    DoorDash

    San Francisco, CA
    3 days ago
  • $375 per month

     ...high level of technical productivity, reliability, and simplicity by developing in Java and leveraging tools/frameworks like Docker, Kubernetes, Terraform, Java, Gradle, Jenkins, GCP, Hadoop and Spark, SQL and err on the side of shipping fast and iterating. Your team will... 
    Suggested
    Work at office
    Work from home
    Home office
    Flexible hours
    Night shift

    LiveRamp

    San Francisco, CA
    4 days ago
  •  ...project. They are also software engineers who use Python to develop Kubernetes operators and Linux open source infrastructure-as-...  ...cloud infrastructure solutions like OpenStack, Kubernetes, Ceph, Hadoop and Spark either On-Premises or in Public Cloud (AWS, Azure, Google... 
    Suggested
    Full time
    Freelance
    Work at office
    Local area
    Remote work
    Worldwide

    Canonical

    San Francisco, CA
    4 days ago
  •  ...object-oriented programming and design skills in Python or Java; Hands-on experience with big-data technologies such as SQL, Hive, Hadoop and Spark; Experience with-or a strong desire to learn-statistical modeling and machine learning techniques; Excellent communication... 
    Suggested
    Full time

    Happy Elements

    San Francisco, CA
    3 days ago
  • $138.9k - $186.2k

     ...& Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more - all working...  ...), data engineering, SQL, and big data technologies (e.g., Spark, Hadoop). Testing Experience : Proven experience in automated testing... 
    Suggested

    Disney Cruise Line - The Walt Disney Company

    San Francisco, CA
    2 days ago
  • $140k - $180k

     ...business operations. We collectively work on developing and supporting the intricate calculations...  ...with a modern data stack (Kafka, Spark, Airflow, lakehouse architectures, real-time...  ...Apache Spark (including Databricks), and Hadoop and knowledge of database technologies like... 
    Suggested
    H1b
    Work at office
    Work from home
    Work visa
    2 days per week

    Tatari

    San Francisco, CA
    4 days ago
  •  ...immediate past two years. Job Description Job Title: Sr. Java Developer Location: San Francisco, CA Duration: 6-12 Months Contract...  ...or Go; experience working with Kafka; experience working with Spark, Hadoop, Storm or any realtime stream analysis platform Qualifications... 
    Suggested
    Contract work
    Local area
    Immediate start

    Cygnus Professionals

    San Francisco, CA
    1 day ago
  •  ...we are EvolutionaryScale’s mission is to develop artificial intelligence to understand biology...  ...processing pipelines using tools like Spark and Ray, for acquiring biology datasets....  ...processing systems using technologies such as Hadoop, Spark, or Ray. Knowledge of streaming... 
    Suggested
    H1b
    Visa sponsorship

    Evolutionary Scale

    San Francisco, CA
    5 days ago
  •  ...unparalleled technical expertise from a distinguished team of developers with an extensive understanding of the banking and payments...  ...Utilize open-source distributed data processing frameworks (e.g., Hadoop, Spark) to handle large-scale data transformations and batch... 
    Suggested
    Full time
    Summer work
    Internship
    Flexible hours
    Shift work

    Lead

    San Francisco, CA
    2 days ago
  • $166k - $225k

     ...ETL to data science. Below are some example projects: Apache Spark : Develop the de facto open source standard framework for big data. Data...  ...systems, databases, and big data systems (Apache Spark, Hadoop). Pay Range Transparency Databricks is committed to fair and... 
    Local area
    Worldwide

    Databricks Inc.

    San Francisco, CA
    4 days ago
  •  ...complex challenges. About the Role Our client is seeking a Python Developer to develop and optimize applications that support machine...  ...experience with big data processing technologies, including Spark, Hadoop, or Databricks. Proficiency in cloud platforms (AWS, GCP, or... 
    Flexible hours

    Sustainable Talent

    San Francisco, CA
    2 days ago
  •  ...in the fight against heart disease. What You’ll Do Develop robust ETL (Extract, Transform, Load) processes to...  ...with distributed computing frameworks (e.g., Ray, Spark, Dask) and supporting infrastructure (e.g., Hadoop, Docker, Kubernetes). Experience with at least one... 

    Heartflow

    San Francisco, CA
    3 days ago
  • $178k - $195.8k

     ...and serve customers across North America. Responsibilities Develop and maintain the data infrastructure and services that are...  ...data processing. Familiarity with big data frameworks (Hadoop, BigQuery, Dask, Spark, Kafka, etc.). What We Value We work in the service of others... 
    Seasonal work
    Remote work
    Flexible hours

    Replica, Inc.

    San Francisco, CA
    2 days ago
  •  ...problems in data systems & ML infrastructure. You will: Develop robust ETL (Extract, Transform, Load) processes to...  ...with distributed computing frameworks (e.g. Ray/Spark/Dask) and supporting infrastructure (e.g. Hadoop, Docker, Kubernetes). Competency with at least one... 
    Second job
    Local area
    Worldwide
    Relocation

    HeartFlow, Inc

    San Francisco, CA
    3 days ago
  • $200k - $250k

     ...modern and reliable tools and technologies. SedonaDB and Apache Spark are built in Java and Scala, with deeply optimized Python wrappers...  ...-source projects such as Apache Spark, Apache Iceberg, Apache Hadoop, Apache Hive, DeltaLake, or Trino, and has a passion for open-source... 
    Full time
    Work at office
    Remote work

    Wherobots

    San Francisco, CA
    4 days ago
  • $155.5k - $287.88k

     ...other team members across different teams. Develop alert & monitoring systems and procedures...  ...computing frameworks like Apache Spark and Flink. Should be able to communicate...  ...Experience in distributed computing framework - Hadoop, Spark, Flink or Storm. Experience with... 
    Full time
    Temporary work
    Part time
    Work experience placement
    Local area
    Relocation package

    Activision Blizzard,Inc.

    San Francisco, CA
    1 day ago
  • $150k - $250k

     ...with a strong foundation in systems programming and ideally experience with building distributed data systems or databases (e.g. Hadoop, Spark, Dask, Ray, BigQuery, PostgreSQL etc) 3+ years of experience working with distributed data systems (query planning,... 
    Full time
    Summer work
    Internship
    Work at office
    Flexible hours
    Night shift

    Eventual

    San Francisco, CA
    3 days ago
  • $184.3k - $247.1k

     ...Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more all...  ...and supporting infrastructure for both real-time data pipelines (Spark, Flink, Kafka, Databricks) and orchestration frameworks (Airflow... 
    Full time
    Work experience placement

    The Walt Disney Company

    San Francisco, CA
    8 days ago
  • $275k

     ...6z (Andreessen Horowitz), Accel, GV (formerly Google Ventures), Spark Capital, Thrive Capital, Forerunner Ventures and Health Care Service...  ..., architectural, and product alignment across the group Develop and grow your managers and team of teams through mentorship, feedback... 
    Full time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Headway

    San Francisco, CA
    8 days ago
  • $184.3k - $247.1k

     ...Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more all...  ...and supporting infrastructure for both real-time data pipelines (Spark, Flink, Kafka, Databricks) and orchestration frameworks (Airflow... 
    Full time
    Work experience placement

    ZipRecruiter

    San Francisco, CA
    8 days ago
  •  ...z (Andreessen Horowitz), Accel, GV (formerly Google Ventures), Spark Capital, Thrive Capital, Forerunner Ventures and Health Care Service...  ...a product : Whether it's our patient search experience or a developer productivity improvement, we treat everything we build at... 
    Full time
    Immediate start
    Remote work
    Work from home
    Visa sponsorship
    Flexible hours

    Headway

    San Francisco, CA
    8 days ago
  •  ...innovative companies across AI, cybersecurity, healthtech, fintech, developer tools, and enterprise SaaS. Were looking to connect with...  ...systems ~ Familiarity with big data tools (Apache Spark, Kafka, Hadoop) and MLOps platforms (MLflow, TFX, SageMaker) ~ Deep... 
    Full time

    SignalFire

    San Francisco, CA
    8 days ago
  • $167.8k - $209.7k

     ...tohundreds of thousands of businessesand empower millions of developers worldwide to craft personalized customer experiences. Our...  ...distributed systems. ~ Expertise in big data technologies such as Hadoop, Spark, Kafka, and other distributed computing systems. ~... 
    Part time
    Local area
    Remote work
    Worldwide

    Twilio

    San Francisco, CA
    2 days ago
  •  ...Entertainment, to ESPN and ESPN+, and much more. Innovation: We develop and execute groundbreaking products and techniques that shape...  ...cost, and reliability, leveraging cutting-edge tools like Airflow, Spark, Flink, and Databricks Delta Sharing. Lead the adoption of best... 
    Hourly pay
    Worldwide

    ZipRecruiter

    San Francisco, CA
    3 days ago