Get new jobs by email
  • Overview As a Senior Spark Technical Solutions Engineer, you will provide a deep dive technical...  ...and APIs for custom-built solutions developed by Databricks customers. Provide...  ...following at production scale: Big Data, Hadoop, Spark, Machine Learning, Artificial Intelligence... 
    Suggested
    Worldwide
    Weekend work
    Weekday work

    Databricks

    San Francisco, CA
    11 hours ago
  •  ...Hadoop Application Developer - Permanent Position Our client is a leading manufacturer and supplier of metal components for the automotive industry, recently ranked 13th of the 150 Top North American Suppliers in Automotive News. A growing and vital company, client provides... 
    Suggested
    Permanent employment
    Part time

    MIT RESOURCE

    San Francisco, CA
    23 hours ago
  •  ...LLM-powered financial applications . You will be responsible for developing scalable, low-latency ingestion systems that handle millions of...  ...financial documents . Requirements : Python, LLM. Knowing Spark and Databricks is a BIG plus. Typescript is also nice. Experience... 
    Suggested
    Full time
    Contract work
    Work at office
    Immediate start
    Remote work

    Fintool

    San Francisco, CA
    1 day ago
  • Senior Database Engineer(Elastic/Mongo/Hadoop) Senior Database Engineer(Elastic/Mongo/Hadoop) Workplace Type : Remote - Region : San...  ...instances with TLS/SSL and/or LDAP • Candidate must also be able to develop automated solutions for ad-hoc script execution requests, ad-... 
    Suggested
    Remote work

    CatchProbe Intelligence Technologies

    San Francisco, CA
    4 days ago
  • $375 per month

     ...high level of technical productivity, reliability, and simplicity by developing in Java and leveraging tools/frameworks like Docker, Kubernetes, Terraform, Java, Gradle, Jenkins, GCP, Hadoop and Spark, SQL and err on the side of shipping fast and iterating. Your team will... 
    Suggested
    Full time
    Part time
    Work at office
    Work from home
    Worldwide
    Home office
    Flexible hours
    Night shift

    C0035 LiveRamp, Inc.

    San Francisco, CA
    23 hours ago
  • $90k - $130k

     ...Experience building and enhance Scala framework and Spark experience Design and develop automated testing framework to perform data validation....  ...high performing and scalable data pipeline platform using Hadoop, Apache Spark, MongoDB, Kafka. Collaborate with application... 
    Suggested
    Full time

    CARE IT SERVICES

    San Francisco, CA
    3 days ago
  • $194 per hour

     ...infrastructure is reliable, scalable, and developer-friendly as we continue to power...  ...proficiency in Python and SQL. Hands-on Spark development experience. Expertise with modern...  ...data‑infrastructure technologies such as Hadoop, Hive, Kafka (or similar streaming platforms... 
    Suggested
    Work from home
    Flexible hours

    Parafin Inc

    San Francisco, CA
    3 days ago
  •  ...AI Platform, an end-to-end platform for developing, deploying, and operating enterprise AI applications...  ...computing technologies such as Apache Spark, Ray, etc. for data exploration and ML...  ...computing technologies (e.g., Hadoop, Spark, Kafka). Familiarity with managed... 
    Suggested

    C3.ai, Inc.

    Redwood City, CA
    4 days ago
  •  ...A Software Engineer At Snowflake, You Will: Design, develop, and support a petabyte-scale cloud database that is highly parallel...  ...systems, and large-scale data processing solutions like Hadoop and Spark. Large scale distributed systems, transactions and... 
    Suggested
    Part time
    Work at office

    Snowflake Computing

    San Mateo, CA
    1 day ago
  • $130.6k - $192k

     ...orchestration and tracking frameworks such as Metaflow, MLflow, Dagster, or Airflow. Large-Scale Data Processing - Knowledge of Spark, Hadoop, or other distributed data processing technologies. Monitoring & Observability - Proficiency with metrics and alerting solutions... 
    Suggested
    Hourly pay
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    DoorDash

    San Francisco, CA
    2 days ago
  • $100k - $232k

     ...leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in...  ...databases; Demonstrate familiarity with big data technologies like Hadoop, Spark, or Kafka is a plus; Experience with machine learning and... 
    Suggested
    Part time
    H1b

    PwC (US)

    San Francisco, CA
    1 day ago
  • $117.6k - $166.15k

     ...Technology organization. We are responsible for designing, developing, and implementing Virtual Cards, payables, and acceptance commercial...  ...Git, Jenkins, Maven, and SonarQube. Experience with Kafka, Spark, and Hadoop is advantageous. Proficiency in HTML5, CSS3, and... 
    Suggested
    Work experience placement
    Work at office
    Local area

    Visa

    Foster, CA
    1 day ago
  •  ...complex challenges. About the Role Our client is seeking a Python Developer to develop and optimize applications that support machine...  ...experience with big data processing technologies, including Spark, Hadoop, or Databricks. Proficiency in cloud platforms (AWS, GCP, or... 
    Suggested
    Part time
    Flexible hours

    Sustainable Talent

    San Francisco, CA
    23 hours ago
  • $289.46k - $338.27k

     ...- all created by our global community of developers and creators. At Roblox, we’re building the...  ...data processing systems. Work with Spark and Kubernetes - the engines upon which we...  ...processing technologies tools such as Spark, Hadoop, Hive, Beam, or Flink. Drive to learn new... 
    Suggested
    Full time
    Work experience placement
    Work at office
    Local area
    Monday to Friday

    Roblox Corporation

    San Mateo, CA
    11 hours ago
  •  ...on some of the most exciting big data open source technologies (Spark, Kafka, Kubernetes, etc.), at the scale of hundreds of petabytes...  ...Spark ~ Deep knowledge of big data technologies (e.g. Spark, Hadoop, Parquet/ORC, Flink) ~ Experience in leading cross-team engineering... 
    Suggested
    Part time
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    6 days ago
  •  ...drive. You bring energy, even in the face of complexity, aiming for excellence when it matters most. ~ You bring initiative - sparking ideas, asking good questions, and supporting the team to explore ambitious paths in a fast-moving, open and exploratory... 
    Full time
    Work at office

    Honey Health

    Hayward, CA
    10 days ago
  •  ...knowledge of object orientated programming and constructing algorithms. Knowledge of big data tools and frameworks such as Apache Spark, Hadoop, Kafka and Elasticsearch. A USA Citizen, Resident, Green card holder or possess a valid H1B. Achieved a very good degree in... 
    Currently hiring
    H1b

    Sartre Group

    San Francisco, CA
    3 days ago
  •  ...immediate past two years. Job Description Job Title: Sr. Java Developer Location: San Francisco, CA Duration: 6-12 Months Contract...  ...or Go; experience working with Kafka; experience working with Spark, Hadoop, Storm or any realtime stream analysis platform Qualifications... 
    Contract work
    Local area
    Immediate start

    Cygnus Professionals Inc.

    San Francisco, CA
    5 days ago
  • $138.9k - $186.2k

     ...& Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more - all working...  ...), data engineering, SQL, and big data technologies (e.g., Spark, Hadoop). Testing Experience : Proven experience in automated testing... 

    Disney Cruise Line - The Walt Disney Company

    San Francisco, CA
    1 day ago
  • $140k - $180k

     ...business operations. We collectively work on developing and supporting the intricate calculations...  ...with a modern data stack (Kafka, Spark, Airflow, lakehouse architectures, real-time...  ...Apache Spark (including Databricks), and Hadoop and knowledge of database technologies like... 
    H1b
    Work at office
    Work from home
    Work visa
    2 days per week

    Tatari

    San Francisco, CA
    3 days ago
  •  ...object-oriented programming and design skills in Python or Java; Hands-on experience with big-data technologies such as SQL, Hive, Hadoop and Spark; Experience with-or a strong desire to learn-statistical modeling and machine learning techniques; Excellent communication... 
    Full time

    Happy Elements

    San Francisco, CA
    2 days ago
  •  ...project. They are also software engineers who use Python to develop Kubernetes operators and Linux open source infrastructure-as-...  ...cloud infrastructure solutions like OpenStack, Kubernetes, Ceph, Hadoop and Spark either On-Premises or in Public Cloud (AWS, Azure, Google... 
    Full time
    Freelance
    Work at office
    Local area
    Remote work
    Worldwide

    Canonical

    San Francisco, CA
    3 days ago
  •  ...unparalleled technical expertise from a distinguished team of developers with an extensive understanding of the banking and payments...  ...Utilize open-source distributed data processing frameworks (e.g., Hadoop, Spark) to handle large-scale data transformations and batch... 
    Full time
    Summer work
    Internship
    Flexible hours
    Shift work

    Lead

    San Francisco, CA
    1 day ago
  •  ...we are EvolutionaryScale’s mission is to develop artificial intelligence to understand biology...  ...processing pipelines using tools like Spark and Ray, for acquiring biology datasets....  ...processing systems using technologies such as Hadoop, Spark, or Ray. Knowledge of streaming... 
    H1b
    Visa sponsorship

    Evolutionary Scale

    San Francisco, CA
    4 days ago
  •  ...in the face of complexity, always aiming for excellence when it matters most. ~ You bring infectious energy and initiative - sparking bold ideas, asking the right questions, and inspiring the team to explore ambitious paths in a fast-moving, open and exploratory... 
    Full time
    Work at office

    Honey Health

    Hayward, CA
    10 days ago
  • $166k - $225k

     ...ETL to data science. Below are some example projects: Apache Spark : Develop the de facto open source standard framework for big data. Data...  ...systems, databases, and big data systems (Apache Spark, Hadoop). Pay Range Transparency Databricks is committed to fair and... 
    Local area
    Worldwide

    Databricks Inc.

    San Francisco, CA
    3 days ago
  •  ...building data platforms Experience with Python and Rust Experience with data analytics systems such as Clickhouse, Delta Lake, Apache Spark, Hadoop, or Snowflake What We Offer / Compensation Base Salary Range: $138,000 — $200,000 USD Equity compensation (RSUs) for all full-... 
    Full time
    Work experience placement
    Flexible hours

    Neuralink

    Fremont, CA
    11 hours ago
  •  ...in the fight against heart disease. What You’ll Do Develop robust ETL (Extract, Transform, Load) processes to...  ...with distributed computing frameworks (e.g., Ray, Spark, Dask) and supporting infrastructure (e.g., Hadoop, Docker, Kubernetes). Experience with at least one... 

    Heartflow

    San Francisco, CA
    2 days ago
  •  ...problems in data systems & ML infrastructure. You will: Develop robust ETL (Extract, Transform, Load) processes to...  ...with distributed computing frameworks (e.g. Ray/Spark/Dask) and supporting infrastructure (e.g. Hadoop, Docker, Kubernetes). Competency with at least one... 
    Second job
    Local area
    Worldwide
    Relocation

    HeartFlow, Inc

    San Francisco, CA
    2 days ago
  • $178k - $195.8k

     ...and serve customers across North America. Responsibilities Develop and maintain the data infrastructure and services that are...  ...data processing. Familiarity with big data frameworks (Hadoop, BigQuery, Dask, Spark, Kafka, etc.). What We Value We work in the service of others... 
    Seasonal work
    Remote work
    Flexible hours

    Replica, Inc.

    San Francisco, CA
    1 day ago