Get new jobs by email
- ...LLM-powered financial applications . You will be responsible for developing scalable, low-latency ingestion systems that handle millions of... ...financial documents . Requirements : Python, LLM. Knowing Spark and Databricks is a BIG plus. Typescript is also nice. Experience...SuggestedFull timeContract workWork at officeImmediate startRemote work
- ...infrastructure is reliable, scalable, and developer-friendly as we continue to power... ...proficiency in Python and SQL. ~ Hands-on Spark development experience. ~ Expertise with... ...data‑infrastructure technologies such as Hadoop, Hive, Kafka (or similar streaming platforms...SuggestedWork from homeFlexible hours
Parafin
San Francisco, CA26 days ago - Hadoop Application Developer - Permanent Position Our client is a leading manufacturer and supplier of metal components for the automotive industry, recently ranked 13th of the 150 Top North American Suppliers in “Automotive News.” A growing and vital company, client provides...SuggestedPermanent employment
- Senior Database Engineer(Elastic/Mongo/Hadoop) Senior Database Engineer(Elastic/Mongo/Hadoop) Workplace Type : Remote - Region : San... ...instances with TLS/SSL and/or LDAP • Candidate must also be able to develop automated solutions for ad-hoc script execution requests, ad-...SuggestedRemote work
Senior Database Engineer(Elastic/Mongo/Hadoop) (San Francisco) at CatchProbe Intelligence Techn[...]
Overview Senior Database Engineer(Elastic/Mongo/Hadoop) - San Francisco, CA. Workplace Type: Remote - Region: San Francisco, CA. Job... ...SHA1, X509, LDAP) including TLS/SSL and/or LDAP reconfiguration. Develop automated solutions for ad-hoc script execution, ad-hoc report...SuggestedFull timeRemote work$130.6k - $192k
...orchestration and tracking frameworks such as Metaflow, MLflow, Dagster, or Airflow. Large-Scale Data Processing - Knowledge of Spark, Hadoop, or other distributed data processing technologies. Monitoring & Observability - Proficiency with metrics and alerting solutions...SuggestedHourly payTemporary workWork at officeLocal areaRemote workFlexible hours$375 per month
...high level of technical productivity, reliability, and simplicity by developing in Java and leveraging tools/frameworks like Docker, Kubernetes, Terraform, Java, Gradle, Jenkins, GCP, Hadoop and Spark, SQL and err on the side of shipping fast and iterating. Your team will...SuggestedWork at officeWork from homeHome officeFlexible hoursNight shift- ...Learning)Establish a consistent project management framework and develop processes to deliver high quality software, in rapid... ...and machine learning models and Experience with GCP, Python, Hadoop, Spark, Cloud, Scala, Streaming (pubsub), Kafka, SQL, data proc, data...SuggestedPermanent employmentContract workRemote workWork from home
- ...immediate past two years. Job Description Job Title: Sr. Java Developer Location: San Francisco, CA Duration: 6-12 Months Contract... ...or Go; experience working with Kafka; experience working with Spark, Hadoop, Storm or any realtime stream analysis platform Qualifications...SuggestedContract workLocal areaImmediate start
- ...project. They are also software engineers who use Python to develop Kubernetes operators and Linux open source infrastructure-as-... ...cloud infrastructure solutions like OpenStack, Kubernetes, Ceph, Hadoop and Spark either On-Premises or in Public Cloud (AWS, Azure, Google...SuggestedFull timeFreelanceWork at officeLocal areaRemote workWorldwide
- ...object-oriented programming and design skills in Python or Java; Hands-on experience with big-data technologies such as SQL, Hive, Hadoop and Spark; Experience with-or a strong desire to learn-statistical modeling and machine learning techniques; Excellent communication...SuggestedFull time
$140k - $180k
...business operations. We collectively work on developing and supporting the intricate calculations... ...with a modern data stack (Kafka, Spark, Airflow, lakehouse architectures, real-time... ...Apache Spark (including Databricks), and Hadoop and knowledge of database technologies like...SuggestedH1bWork at officeWork from homeWork visa2 days per week- ...are EvolutionaryScale’s mission is to develop artificial intelligence to understand... ...batch processing pipelines using tools like Spark and Ray, for acquiring biology datasets.... ...processing systems using technologies such as Hadoop, Spark, or Ray. Knowledge of streaming...SuggestedFull time
$138.9k - $186.2k
...& Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more - all working... ...), data engineering, SQL, and big data technologies (e.g., Spark, Hadoop). Testing Experience : Proven experience in automated testing...Suggested$132k - $162k
...and maintainable by other team members Keep up to date with developments in technologies we are using Ability to communicate and... ...Transform-Load ( ETL ) and other data pipeline technologies ( Spark, Hadoop, etc. ) Experience working in a cloud environment (AWS, Azure...SuggestedApprenticeshipWork at officeLocal areaWork from homeFlexible hours1 day per week$230k - $280k
...DataOps practices to enhance data quality and availability. Develop and optimize ETL processes for large-scale data ingestion. Collaborate... ...and large language models (LLMs). Optimize performance using SPARK and Tecton for data processing. Mentor junior engineers and...Ongoing contractLocal areaRelocationCyberCoders
San Francisco, CA4 days ago- ...complex challenges. About the Role Our client is seeking a Python Developer to develop and optimize applications that support machine... ...experience with big data processing technologies, including Spark, Hadoop, or Databricks. Proficiency in cloud platforms (AWS, GCP, or...Flexible hours
$166k - $225k
...ETL to data science. Below are some example projects: Apache Spark : Develop the de facto open source standard framework for big data. Data... ...systems, databases, and big data systems (Apache Spark, Hadoop). Pay Range Transparency Databricks is committed to fair and...Local areaWorldwide$230k - $280k
...foundation, making critical build vs. buy decisions to improve developer velocity and system reliability ~ Own the end-to-end technical... ...ML infrastructure, including data processing frameworks (e.g., Spark, Flink), MLOps tooling (e.g., Kubeflow, MLflow, Tecton),...Work at office3 days per weekQuizlet
San Francisco, CA16 days ago$178k - $195.8k
...serve customers across North America. Responsibilities Develop and maintain the data infrastructure and services that are... ...processing. ~ Familiarity with big data frameworks (Hadoop, BigQuery, Dask, Spark, Kafka, etc.). What We Value We work in the service...Full timeSeasonal workRemote workFlexible hours- ...problems in data systems & ML infrastructure. You will: Develop robust ETL (Extract, Transform, Load) processes to... ...with distributed computing frameworks (e.g. Ray/Spark/Dask) and supporting infrastructure (e.g. Hadoop, Docker, Kubernetes). Competency with at least one...Second jobLocal areaWorldwideRelocation
$130k - $220k
...in the fight against heart disease. What You’ll Do Develop robust ETL (Extract, Transform, Load) processes to... ...with distributed computing frameworks (e.g., Ray, Spark, Dask) and supporting infrastructure (e.g., Hadoop, Docker, Kubernetes). Experience with at least one...- ...popular languages and frameworks for AI, including Python and Spark, and enables governed data sharing with cryptographic verification... ...in data engineering, ETL, data applications, data science ~ Developer experience in at least one of the following. python, scala,...Full time
OPAQUE Systems
San Francisco, CA24 days ago - ...engineering and product teams as they integrate and continue to develop with Gigs, and advise them on the best implementation path. User... ...best remotely, while others rely on in-person collaboration to spark creativity and drive execution. Were remote-friendly by design,...Full timeWork at officeRemote workWork from homeHome office
Crane Venture Partners
San Francisco, CA11 days ago $200k - $250k
...modern and reliable tools and technologies. SedonaDB and Apache Spark are built in Java and Scala, with deeply optimized Python wrappers... ...-source projects such as Apache Spark, Apache Iceberg, Apache Hadoop, Apache Hive, DeltaLake, or Trino, and has a passion for open-source...Full timeWork at officeRemote work$80 per hour
...a pivotal role in shaping the technical direction and product strategy as a foundational team member Contribute to creating a developer environment that's both efficient and genuinely enjoyable to work in Support smooth day-to-day product operations by using monitoring...Ongoing contractCurrently hiringLocal areaCyberCoders
San Francisco, CA2 days ago- ...while working across the stack. In this role, you will: Build and Innovate : Design and develop high-performance applications using our modern tech stack (Java, REST, Kafka, Spark, Hadoop, Terraform, AWS). Collaborate & Grow : Work side by side with peers in code reviews,...Remote workWork from homeFlexible hours
- ...the design and implementation of data quality frameworks and automated validation pipelines using Python, Apache Spark, and Hadoop ecosystem tools. Develop, deploy, and maintain scalable ETL/ELT workflows using Apache Airflow and Apache NiFi to ensure seamless data ingestion...
$155.5k - $287.88k
...other team members across different teams. Develop alert & monitoring systems and procedures... ...computing frameworks like Apache Spark and Flink. Should be able to communicate... ...Experience in distributed computing framework - Hadoop, Spark, Flink or Storm. Experience with...Full timeTemporary workPart timeWork experience placementLocal areaRelocation package- ...resource utilization, task scheduling, and fault tolerance. # Develop integrations with modern data lake technologies such as... ...environment. Nice to have # Experience with Hadoop, Spark, Dask, Ray, or BigQuery. # Knowledge of distributed systems...Full time
