Get new jobs by email
  •  ...LLM-powered financial applications . You will be responsible for developing scalable, low-latency ingestion systems that handle millions of...  ...financial documents . Requirements : Python, LLM. Knowing Spark and Databricks is a BIG plus. Typescript is also nice. Experience... 
    Suggested
    Full time
    Contract work
    Work at office
    Immediate start
    Remote work

    Fintool

    San Francisco, CA
    3 days ago
  • Hadoop Application Developer - Permanent Position Our client is a leading manufacturer and supplier of metal components for the automotive industry, recently ranked 13th of the 150 Top North American Suppliers in “Automotive News.” A growing and vital company, client provides... 
    Suggested
    Permanent employment

    MIT RESOURCE

    San Francisco, CA
    4 days ago
  • Senior Database Engineer(Elastic/Mongo/Hadoop) Senior Database Engineer(Elastic/Mongo/Hadoop) Workplace Type : Remote - Region : San...  ...instances with TLS/SSL and/or LDAP • Candidate must also be able to develop automated solutions for ad-hoc script execution requests, ad-... 
    Suggested
    Remote work

    CatchProbe Intelligence Technologies

    San Francisco, CA
    1 day ago
  • Overview Senior Database Engineer(Elastic/Mongo/Hadoop) - San Francisco, CA. Workplace Type: Remote - Region: San Francisco, CA. Job...  ...SHA1, X509, LDAP) including TLS/SSL and/or LDAP reconfiguration. Develop automated solutions for ad-hoc script execution, ad-hoc report... 
    Suggested
    Full time
    Remote work

    CatchProbe Intelligence Technologies

    San Francisco, CA
    3 days ago
  • $155k - $215k

     ...more exclusive features. At Imply, we are on a mission to help developers unleash the power of real-time analytics. Our unique database...  ...of large-scale distributed systems and databases such as Hadoop, Spark, Presto, ElasticSearch. A history of open-source contributions... 
    Suggested
    Remote job
    16 hours
    Full time
    Home office

    Imply

    Burlingame, CA
    4 days ago
  • $194 per hour

     ...infrastructure is reliable, scalable, and developer-friendly as we continue to power...  ...proficiency in Python and SQL. Hands-on Spark development experience. Expertise with modern...  ...data‑infrastructure technologies such as Hadoop, Hive, Kafka (or similar streaming platforms... 
    Suggested
    Work from home
    Flexible hours

    Parafin

    San Francisco, CA
    4 days ago
  •  ...AI Platform, an end-to-end platform for developing, deploying, and operating enterprise AI applications...  ...computing technologies such as Apache Spark, Ray, etc. for data exploration and ML...  ...computing technologies (e.g., Hadoop, Spark, Kafka). Familiarity with managed... 
    Suggested

    C3.ai, Inc.

    Redwood City, CA
    1 day ago
  • $170k - $215k

     ...data architectures. Build and maintain scalable data pipelines using technologies such as GCP (or AWS), BigQuery, Python, and Spark. Develop and manage service-oriented and event-driven architectures, utilizing tools like Pub/Sub and Kafka. Collaborate with machine learning... 
    Suggested
    Full time
    Visa sponsorship

    Ohalo Genetics

    South San Francisco, CA
    4 days ago
  • $180k

     ...company. We own and manage core systems including Apache Kafka, HDFS, Spark, Flink, and Trino, enabling real-time ML pipelines, feed ranking...  .... Hands-on experience with Kafka, Flink, Spark, Trino, or Hadoop*in production. Strong debugging, profiling, and performance optimization... 
    Suggested
    Temporary work
    H1b
    Work at office
    Work from home
    Work visa

    xAI

    Palo Alto, CA
    1 day ago
  •  ...design patterns and OO design principles • Experience with Java, Scala, Python. • Experience with either distributed computing (Hadoop/Spark/Cloud) or parallel processing (CUDA/threads/MPI) • Expertise in design pattern (UML diagrams) and data modeling of large scale analytic... 
    Suggested
    Immediate start

    Cygnus Professionals Inc.

    Palo Alto, CA
    1 day ago
  • $161.79k - $240.12k

     ...explore how familiar experiences can be enhanced and innovations developed through the integration of leading-edge technology, science,...  ..., Kubernetes). Experience with big data technologies (e.g., Hadoop, Spark) and data warehousing solutions. Strong ability to... 
    Suggested
    3 days per week

    Kohler Co.

    Palo Alto, CA
    2 days ago
  •  ...on some of the most exciting big data open source technologies (Spark, Kafka, Kubernetes, etc.), at the scale of hundreds of petabytes...  ...Spark ~ Deep knowledge of big data technologies (e.g. Spark, Hadoop, Parquet/ORC, Flink) ~ Experience in leading cross-team engineering... 
    Suggested
    Part time
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    3 days ago
  • $130.6k - $192k

     ...orchestration and tracking frameworks such as Metaflow, MLflow, Dagster, or Airflow. Large-Scale Data Processing - Knowledge of Spark, Hadoop, or other distributed data processing technologies. Monitoring & Observability - Proficiency with metrics and alerting solutions... 
    Suggested
    Hourly pay
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    DoorDash USA

    San Francisco, CA
    13 hours ago
  • $289.46k - $338.27k

     ...- all created by our global community of developers and creators. At Roblox, we’re building the...  ...data processing systems. Work with Spark and Kubernetes - the engines upon which we...  ...processing technologies tools such as Spark, Hadoop, Hive, Beam, or Flink. Drive to learn new... 
    Suggested
    Full time
    Work experience placement
    Work at office
    Local area
    Monday to Friday

    Roblox Corporation

    San Mateo, CA
    2 days ago
  • $375 per month

     ...high level of technical productivity, reliability, and simplicity by developing in Java and leveraging tools/frameworks like Docker, Kubernetes, Terraform, Java, Gradle, Jenkins, GCP, Hadoop and Spark, SQL and err on the side of shipping fast and iterating. Your team will... 
    Suggested
    Full time
    Work at office
    Work from home
    Worldwide
    Home office
    Flexible hours
    Night shift

    C0035 LiveRamp, Inc.

    San Francisco, CA
    4 days ago
  •  ...End Data Engineer LOCATION: San Bruno, CA DURATION: 6 to 12+ months RATE: DOE Duties: Looking for a backend data engineer with Apache Spark, Hive and Airflow knowledge. Must-haves: Excellent knowledge with SQL and Hive (HiveQL) Ability to build data pipelines using... 

    Redolent Infotech Pvt. Ltd.

    San Bruno, CA
    4 days ago
  •  ...project. They are also software engineers who use Python to develop Kubernetes operators and Linux open source infrastructure-as-...  ...cloud infrastructure solutions like OpenStack, Kubernetes, Ceph, Hadoop and Spark either On-Premises or in Public Cloud (AWS, Azure, Google... 
    Full time
    Freelance
    Work at office
    Local area
    Remote work
    Worldwide

    Canonical

    San Francisco, CA
    13 hours ago
  •  ...immediate past two years. Job Description Job Title: Sr. Java Developer Location: San Francisco, CA Duration: 6-12 Months Contract...  ...or Go; experience working with Kafka; experience working with Spark, Hadoop, Storm or any realtime stream analysis platform Qualifications... 
    Contract work
    Local area
    Immediate start

    Cygnus Professionals Inc.

    San Francisco, CA
    2 days ago
  • $138.9k - $186.2k

     ...& Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more - all working...  ...), data engineering, SQL, and big data technologies (e.g., Spark, Hadoop). Testing Experience : Proven experience in automated testing... 

    Disney Cruise Line - The Walt Disney Company

    San Francisco, CA
    3 days ago
  •  ...object-oriented programming and design skills in Python or Java; Hands-on experience with big-data technologies such as SQL, Hive, Hadoop and Spark; Experience with-or a strong desire to learn-statistical modeling and machine learning techniques; Excellent communication... 
    Full time

    Happy Elements

    San Francisco, CA
    4 days ago
  •  ...unparalleled technical expertise from a distinguished team of developers with an extensive understanding of the banking and payments...  ...Utilize open-source distributed data processing frameworks (e.g., Hadoop, Spark) to handle large-scale data transformations and batch... 
    Full time
    Summer work
    Internship
    Flexible hours
    Shift work

    Lead

    San Francisco, CA
    3 days ago
  • $157k - $230k

     ...enthusiastic about building new technologies. Responsibilities Design, develop, and support a petabyte-scale cloud database that is highly...  ...systems, and large-scale data processing solutions like Hadoop and Spark. Large scale distributed systems, transactions and... 
    Full time
    Work at office
    Flexible hours

    Snowflake

    Menlo Park, CA
    1 day ago
  •  ...complex challenges. About the Role Our client is seeking a Python Developer to develop and optimize applications that support machine...  ...experience with big data processing technologies, including Spark, Hadoop, or Databricks. Proficiency in cloud platforms (AWS, GCP, or... 
    Flexible hours

    Sustainable Talent

    San Francisco, CA
    3 days ago
  •  ...conceptual model for a data domain inside the central data platform. Develop and maintain data schemas and models for products within...  ...in Cloud (GCP, AWS, ..), SQL and NoSQL databases, Java, Hadoop, Python, Spark, Data Lakes, Data Warehouses, and Data Marts preferred... 
    Full time
    Work experience placement
    Immediate start
    Remote work
    Work from home
    Free visa
    Flexible hours

    Motorsport Hackers

    Palo Alto, CA
    4 days ago
  •  ...in the fight against heart disease. What You’ll Do Develop robust ETL (Extract, Transform, Load) processes to...  ...with distributed computing frameworks (e.g., Ray, Spark, Dask) and supporting infrastructure (e.g., Hadoop, Docker, Kubernetes). Experience with at least one... 

    Heartflow

    San Francisco, CA
    4 days ago
  •  ...problems in data systems & ML infrastructure. You will: Develop robust ETL (Extract, Transform, Load) processes to...  ...with distributed computing frameworks (e.g. Ray/Spark/Dask) and supporting infrastructure (e.g. Hadoop, Docker, Kubernetes). Competency with at least one... 
    Second job
    Local area
    Worldwide
    Relocation

    HeartFlow, Inc

    San Francisco, CA
    4 days ago
  • $178k - $195.8k

     ...and serve customers across North America. Responsibilities Develop and maintain the data infrastructure and services that are...  ...data processing. Familiarity with big data frameworks (Hadoop, BigQuery, Dask, Spark, Kafka, etc.). What We Value We work in the service of others... 
    Seasonal work
    Remote work
    Flexible hours

    Replica Inc.

    San Francisco, CA
    3 days ago
  • $140k - $200k

     ...Qualifications: 5+ years of professional software development experience with a focus on big data technologies Experience with Hadoop, Spark, Hive, and/or other big data technologies Comprehensive computer science fundamentals in coding, object-oriented programming, data... 
    Full time
    Contract work
    For contractors
    For subcontractor
    H1b
    Work at office
    Remote work
    Flexible hours

    ZipRecruiter

    Palo Alto, CA
    3 days ago
  • $200k - $250k

     ...modern and reliable tools and technologies. SedonaDB and Apache Spark are built in Java and Scala, with deeply optimized Python wrappers...  ...-source projects such as Apache Spark, Apache Iceberg, Apache Hadoop, Apache Hive, DeltaLake, or Trino, and has a passion for open-source... 
    Full time
    Work at office
    Remote work

    Wherobots

    San Francisco, CA
    13 hours ago
  • $192k - $260k

     ...2013 by the original creators of Apache Spark, Databricks has grown from a tiny corner...  ...customers successful on our platform. We develop and operate one of the largest scale software...  ..., and big data systems (Apache Spark, Hadoop). Pay Range Transparency Databricks is committed... 
    Work at office
    Local area
    Worldwide

    Databricks Inc.

    San Francisco, CA
    3 days ago