Get new jobs by email
- Overview As a Senior Spark Technical Solutions Engineer, you will provide a deep dive technical... ...and APIs for custom-built solutions developed by Databricks customers. Provide... ...following at production scale: Big Data, Hadoop, Spark, Machine Learning, Artificial Intelligence...SuggestedWorldwideWeekend workWeekday work
- ...Hadoop Application Developer - Permanent Position Our client is a leading manufacturer and supplier of metal components for the automotive industry, recently ranked 13th of the 150 Top North American Suppliers in Automotive News. A growing and vital company, client provides...SuggestedPermanent employmentPart time
MIT RESOURCE
San Francisco, CA16 hours ago - ...LLM-powered financial applications . You will be responsible for developing scalable, low-latency ingestion systems that handle millions of... ...financial documents . Requirements : Python, LLM. Knowing Spark and Databricks is a BIG plus. Typescript is also nice. Experience...SuggestedFull timeContract workWork at officeImmediate startRemote work
- Senior Database Engineer(Elastic/Mongo/Hadoop) Senior Database Engineer(Elastic/Mongo/Hadoop) Workplace Type : Remote - Region : San... ...instances with TLS/SSL and/or LDAP • Candidate must also be able to develop automated solutions for ad-hoc script execution requests, ad-...SuggestedRemote work
$375 per month
...high level of technical productivity, reliability, and simplicity by developing in Java and leveraging tools/frameworks like Docker, Kubernetes, Terraform, Java, Gradle, Jenkins, GCP, Hadoop and Spark, SQL and err on the side of shipping fast and iterating. Your team will...SuggestedFull timePart timeWork at officeWork from homeWorldwideHome officeFlexible hoursNight shiftC0035 LiveRamp, Inc.
San Francisco, CA16 hours ago$90k - $130k
...Experience building and enhance Scala framework and Spark experience Design and develop automated testing framework to perform data validation.... ...high performing and scalable data pipeline platform using Hadoop, Apache Spark, MongoDB, Kafka. Collaborate with application...SuggestedFull timeCARE IT SERVICES
San Francisco, CA3 days ago$194 per hour
...infrastructure is reliable, scalable, and developer-friendly as we continue to power... ...proficiency in Python and SQL. Hands-on Spark development experience. Expertise with modern... ...data‑infrastructure technologies such as Hadoop, Hive, Kafka (or similar streaming platforms...SuggestedWork from homeFlexible hours$100k - $232k
...leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in... ...databases; Demonstrate familiarity with big data technologies like Hadoop, Spark, or Kafka is a plus; Experience with machine learning and...SuggestedPart timeH1bPwC (US)
San Francisco, CA17 hours ago$130.6k - $192k
...orchestration and tracking frameworks such as Metaflow, MLflow, Dagster, or Airflow. Large-Scale Data Processing - Knowledge of Spark, Hadoop, or other distributed data processing technologies. Monitoring & Observability - Proficiency with metrics and alerting solutions...SuggestedHourly payTemporary workWork at officeLocal areaRemote workFlexible hours- ...complex challenges. About the Role Our client is seeking a Python Developer to develop and optimize applications that support machine... ...experience with big data processing technologies, including Spark, Hadoop, or Databricks. Proficiency in cloud platforms (AWS, GCP, or...SuggestedPart timeFlexible hours
Sustainable Talent
San Francisco, CA16 hours ago - ...on some of the most exciting big data open source technologies (Spark, Kafka, Kubernetes, etc.), at the scale of hundreds of petabytes... ...Spark ~ Deep knowledge of big data technologies (e.g. Spark, Hadoop, Parquet/ORC, Flink) ~ Experience in leading cross-team engineering...SuggestedPart timeWork at officeLocal areaRelocationRelocation package
Pinterest
San Francisco, CA6 days ago - ...immediate past two years. Job Description Job Title: Sr. Java Developer Location: San Francisco, CA Duration: 6-12 Months Contract... ...or Go; experience working with Kafka; experience working with Spark, Hadoop, Storm or any realtime stream analysis platform Qualifications...SuggestedContract workLocal areaImmediate start
- ...knowledge of object orientated programming and constructing algorithms. Knowledge of big data tools and frameworks such as Apache Spark, Hadoop, Kafka and Elasticsearch. A USA Citizen, Resident, Green card holder or possess a valid H1B. Achieved a very good degree in...SuggestedCurrently hiringH1b
$140k - $180k
...business operations. We collectively work on developing and supporting the intricate calculations... ...with a modern data stack (Kafka, Spark, Airflow, lakehouse architectures, real-time... ...Apache Spark (including Databricks), and Hadoop and knowledge of database technologies like...SuggestedH1bWork at officeWork from homeWork visa2 days per week- ...project. They are also software engineers who use Python to develop Kubernetes operators and Linux open source infrastructure-as-... ...cloud infrastructure solutions like OpenStack, Kubernetes, Ceph, Hadoop and Spark either On-Premises or in Public Cloud (AWS, Azure, Google...SuggestedFull timeFreelanceWork at officeLocal areaRemote workWorldwide
$138.9k - $186.2k
...& Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more - all working... ...), data engineering, SQL, and big data technologies (e.g., Spark, Hadoop). Testing Experience : Proven experience in automated testing...- ...object-oriented programming and design skills in Python or Java; Hands-on experience with big-data technologies such as SQL, Hive, Hadoop and Spark; Experience with-or a strong desire to learn-statistical modeling and machine learning techniques; Excellent communication...Full time
- ...we are EvolutionaryScale’s mission is to develop artificial intelligence to understand biology... ...processing pipelines using tools like Spark and Ray, for acquiring biology datasets.... ...processing systems using technologies such as Hadoop, Spark, or Ray. Knowledge of streaming...H1bVisa sponsorship
- ...unparalleled technical expertise from a distinguished team of developers with an extensive understanding of the banking and payments... ...Utilize open-source distributed data processing frameworks (e.g., Hadoop, Spark) to handle large-scale data transformations and batch...Full timeSummer workInternshipFlexible hoursShift work
$166k - $225k
...ETL to data science. Below are some example projects: Apache Spark : Develop the de facto open source standard framework for big data. Data... ...systems, databases, and big data systems (Apache Spark, Hadoop). Pay Range Transparency Databricks is committed to fair and...Local areaWorldwide- ...in the fight against heart disease. What You’ll Do Develop robust ETL (Extract, Transform, Load) processes to... ...with distributed computing frameworks (e.g., Ray, Spark, Dask) and supporting infrastructure (e.g., Hadoop, Docker, Kubernetes). Experience with at least one...
$178k - $195.8k
...and serve customers across North America. Responsibilities Develop and maintain the data infrastructure and services that are... ...data processing. Familiarity with big data frameworks (Hadoop, BigQuery, Dask, Spark, Kafka, etc.). What We Value We work in the service of others...Seasonal workRemote workFlexible hours- ...problems in data systems & ML infrastructure. You will: Develop robust ETL (Extract, Transform, Load) processes to... ...with distributed computing frameworks (e.g. Ray/Spark/Dask) and supporting infrastructure (e.g. Hadoop, Docker, Kubernetes). Competency with at least one...Second jobLocal areaWorldwideRelocation
$200k - $250k
...modern and reliable tools and technologies. SedonaDB and Apache Spark are built in Java and Scala, with deeply optimized Python wrappers... ...-source projects such as Apache Spark, Apache Iceberg, Apache Hadoop, Apache Hive, DeltaLake, or Trino, and has a passion for open-source...Full timeWork at officeRemote work$155.5k - $287.88k
...other team members across different teams. Develop alert & monitoring systems and procedures... ...computing frameworks like Apache Spark and Flink. Should be able to communicate... ...Experience in distributed computing framework - Hadoop, Spark, Flink or Storm. Experience with...Full timeTemporary workPart timeWork experience placementLocal areaRelocation package- ...innovative companies across AI, cybersecurity, healthtech, fintech, developer tools, and enterprise SaaS. We’re looking to connect... ...systems ~ Familiarity with big data tools (Apache Spark, Kafka, Hadoop) and MLOps platforms (MLflow, TFX, SageMaker) ~ Deep understanding...
SignalFire
San Francisco, CA4 days ago - ...scale elegantly and empower others to do their best work. Our mission is to remove friction, unlock speed, and create a developer experience that sparks innovation across the company. Joining this team means youll have the opportunity to influence core technical...Part timeWork at officeLocal areaRemote workWorldwideFlexible hours2 days per week
Patreon
San Francisco, CA16 hours ago $184.3k - $247.1k
...Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more all... ...and supporting infrastructure for both real-time data pipelines (Spark, Flink, Kafka, Databricks) and orchestration frameworks (Airflow...Part timeWork experience placementLocal areaThe Walt Disney Company
San Francisco, CA16 hours ago- ...reliability, and iterate based on real-world product impact. Create developer tooling that makes it easier for teams to build on and interact... .... Experience with distributed data frameworks (Kafka, Spark, Flink, etc.) is a plus. Ability to collaborate across product,...Part timeWork at officeLocal areaRemote workHome officeFlexible hours3 days per week
Benchling
San Francisco, CA16 hours ago $170k - $215k
...data architectures. Build and maintain scalable data pipelines using technologies such as GCP (or AWS), BigQuery, Python, and Spark. Develop and manage service-oriented and event-driven architectures, utilizing tools like Pub/Sub and Kafka. Collaborate with machine learning...Full timePart timeVisa sponsorshipOhalo Genetics, Inc
San Francisco, CA16 hours ago
