Average salary: $181,009 /yearly

More stats
 ...applications Experience in shipping products to millions of customers or have started a new line of product Experience with Hadoop/HBase/Pig or MapReduce/Sawzall/Bigtable/Hive/Spark Demonstrated track record of peer-reviewed scientific publications that advance... 
Suggested
Work experience placement
Immediate start
Home office
Flexible hours
Shift work

Grindr

San Francisco, CA
3 days ago
 ...) techniques relevant to telco (automation scripting, terraform, etc.) Learn model-driven operations with Juju charms for Kafka, Hadoop, PostgreSQL, MongoDB, NGINX, and more Help customers adopt advanced Bare Metal, Public, Private and Hybrid Cloud solutions Learn... 
Suggested
Holiday work
Remote job

Canonical - Jobs

San Francisco, CA
2 days ago
 ...proficiency in querying and manipulating extensive datasets for analytical purposes using SQL-like languages (experience with Hive/Hadoop/Databricks preferred). Familiarity with Python is advantageous. ~ Analytical Prowess: Possess a strong aptitude for analytical and... 
Suggested
Remote job

Russell Tobin & Associates

San Francisco, CA
2 days ago
 ...citizens and those authorized to work in the U.S. are encouraged to apply. Preferred Qualifications: Experience with Big data/Hadoop, Kafka, Hive etc. Excellent experience doing hands on development and in creating architecture for large complex development... 
Suggested
Holiday work
Full time
Temporary work
Relocation

Infosys

San Francisco, CA
4 hours agonew
 ...End to end, starting from source system to pipeline is important . ~ Practical hands-on experience with technologies like Apache Hadoop, Apache Pig, Apache Hive, Apache Sqoop & Apache Spark ~ Experience working in Dataiku is a plus but not required ~ Ability to... 
Suggested

IT Allianz Inc

San Francisco, CA
8 days ago
 ...equivalent combination of education and experience. Expert and Hands-On development in distributed computing environment using Hadoop, Scala, Spark and Apache Airflow Advanced SQL knowledge and understanding Experience architecting solutions in collaboration... 
Suggested
Worldwide

ZoomInfo Technologies LLC

San Francisco, CA
3 days ago
 ...and innovation. Requirements Who's Right for the Job: Someone with a deep understanding of big data technologies like Hadoop, Spark, Kafka, and ecosystems around them. A degree in Computer Science, Data Science, Mathematics, or a related field is... 
Suggested
Remote job
Relocation
Home office
Flexible hours

Unreal Gigs

San Francisco, CA
3 days ago
 ...down complex business problems and lead a team in resolving them. ~ Experience in data processing, including building and maintaining large-scale and/or real-time complex data processing pipelines using technologies like Kafka, Hadoop, Hive, Storm, or Zookeeper.... 
Suggested
Full time

Yeah! Global

San Francisco, CA
1 day ago
 ...Science, Deep Learning, and Neural Networks ~ Strong programming skills in Python, R, or Scala ~ Experience with big data technologies such as Hadoop, Spark, and Hive ~ Strong analytical and problem-solving skills ~ Excellent communication and teamwork skills... 
Suggested
Full time

Rad Hires

San Francisco, CA
7 hours agonew
 ...Proficiency in programming languages such as Java, Python, or Scala, and experience with big data processing frameworks such as Apache Hadoop, Apache Spark, or Apache Flink. Experience with distributed computing technologies and concepts, including MapReduce, Spark RDDs... 
Suggested
Remote job
Flexible hours

Unreal Gigs

San Francisco, CA
16 days ago
 ...in languages like Java, Scala, Python, Rust Experience in optimizing distributed data processing systems (Spark, Flink, Kafka, Hadoop, Storm) is highly desirable Knowledge of ETL processes and data warehousing Demonstrated experience building data pipelines... 
Suggested

X Corp.

San Francisco, CA
3 days ago
 ...processes and outcomes, and inform decision-making  Develop solutions in R or Python  Develop production-grade solutions  Work in Hadoop, Redshift, and Spark  Translate business and product questions into analytics projects  Communicate clearly over written and... 
Suggested
Holiday work
Local area

Logic20/20 Inc.

San Francisco, CA
2 days ago
 ...such as Apache Spark, Apache Flink, or Apache Beam. Experience with distributed computing technologies and concepts, including Hadoop, MapReduce, and distributed file systems (e.g., HDFS). Familiarity with database technologies such as SQL, NoSQL, and NewSQL databases... 
Suggested
Remote job
Flexible hours

Unreal Gigs

San Francisco, CA
19 days ago
 ...within Data Engineering, such as Python, Scala, or Java. Experience with distributed processing technologies and frameworks, such as Hadoop, Flink and distributed storage systems (e.g., HDFS, S3). Expertise with any of ETL schedulers such as Airflow, Dagster, Prefect... 
Suggested
Relocation package

OpenAI

San Francisco, CA
1 day ago
 ...systems and technologies to ingest, enrich, store and serve data (e.g. Tableau/Looker/DataStudio; Snowflake/RedShift/BigQuery; Spark/Hadoop/AWS EMR) * The ability to work cross functionally and speak multiple languages: youre equally credible as a thought partner for... 
Suggested
Full time
Temporary work
Local area

Stripe, Inc.

San Francisco, CA
7 hours ago
 ...particularly on Linux Background in database internals or building core components for large scale data processing systems (i.e. Hadoop, Spark) especially query execution/processing, and/or optimization. Experience with storage formats (i.e. Parquet, ORC, avro),... 
Full time
Flexible hours
Weekend work
3 days per week

SingleStore

San Francisco, CA
4 days ago
 ...to ML pipelines, including dataset curation, labelling, training and evaluation. - Experience with MapReduce frameworks (Apache Hadoop/Spark) or orchestration frameworks (Apache Airflow/Apache Beam//Google Dataflow/AWS Step Functions). The US yearly salary range... 
Full time
Work from home
Flexible hours

Waabi

San Francisco, CA
2 days ago
 ...through improved observability and key metrics Partner with engineering teams to support long-term scaling of their data pipelines Hadoop, …) Requirements Qualifications ~5+ years of software engineering experience ~ Strong fluency with Python ~ Strong... 
Holiday work

A Society Group, Inc.

San Francisco, CA
13 days ago
 ...Data Processing Frameworks: Lead the implementation and optimization of data processing frameworks and technologies, such as Apache Hadoop, Apache Spark, and Apache Flink, to enable efficient data processing and analysis. # Data Pipeline Development: Lead the... 
Remote job
Flexible hours

Unreal Gigs

San Francisco, CA
16 days ago
 ...in technology consulting. Must have 6 months of experience in any two of the following next gen tools and technologies: Hadoop, HIVE, Impala, Apache Drill, Pentaho, Paxata, Databricks, Tamr, Datastax, Datameer, Splunk, Sumologic, Mapreduce, Python, Scala, R,... 
Holiday work
Full time
Work experience placement
Summer holiday
Flexible hours
Monday to Friday

EY

San Francisco, CA
12 days ago
 ...engineers. ~ Proficiency in programming languages such as Java, Scala, or Python, and expertise with big data technologies such as Hadoop, Spark, Kafka, Hive, HBase, and more. ~ Strong understanding of distributed systems and parallel processing, with experience... 
Remote job
Flexible hours

Unreal Gigs

San Francisco, CA
19 days ago
 ...Experience with cloud platforms such as AWS, Azure, or Google Cloud, and familiarity with distributed computing frameworks (e.g., Spark, Hadoop). Excellent problem-solving abilities, analytical thinking, and attention to detail, with a passion for tackling complex... 
Full time
Remote job
Flexible hours

Unreal Gigs

San Francisco, CA
19 days ago
 ...clouds and applications for external customers Architect cloud infrastructure solutions like Kubernetes, Kubeflow, OpenStack, Ceph, Hadoop and Spark either On-Premises or in Public Cloud (AWS, Azure, Google Cloud) Grow a healthy, collaborative engineering culture in... 
Remote job
Worldwide

Canonical - Jobs

San Francisco, CA
2 days ago
 ...interactive reporting applications such as Alteryx and Tableau Experience in Cloud and Big Data platforms such as AWS, Snowflake, Hadoop, Hive, Pig, Apache Spark, etc. Technical understanding of data extraction, transformation, and load processing Strong communication... 
Relocation package

JPMorgan Chase

San Francisco, CA
1 day ago
 ...communicate analysis results to both technical and non-technical audiences. ~ Knowledge of relevant tools in this field such as Hadoop, Hive, Splunk, Spark, Tableau, Excel (Charting and Pivot-Tables), and Power BI. ~ Experience in product instrumentation is a... 
Full time
Temporary work

Adobe

San Francisco, CA
9 days ago
 ...efficient big data infrastructure, including data lakes, data warehouses, and streaming data platforms, leveraging technologies such as Hadoop, Spark, Kafka, and more. # Data Pipeline Development: Develop, deploy, and manage data pipelines for ingesting, processing, and... 
Remote job
Flexible hours

Unreal Gigs

San Francisco, CA
19 days ago
 ...from business executives to data scientists, analysts and IT. Working knowledge of databases and big data technologies such as Hadoop and Spark preferred. Validated results in prior role. At least 5-15 years of prior account management, customer success, consulting... 
Remote job
Flexible hours
Afternoon shift

Dataiku

San Francisco, CA
1 day ago
 ...to Haves Experience with CarPlay or Android Auto Experience with Swift, Kotlin, Java, or Objective-C Experience with Spark/Hadoop, Python Experience deploying large scale Remote Sensing applications What we offer ~ Medical, dental and vision... 
Remote job
Worldwide
Flexible hours

Hivemapper

San Francisco, CA
2 days ago
 ...experience in managing complex data engineering projects from conception to completion. Experience with: Framewords such as Hadoop, Spark, Kafka, etc. AWS Technologies: RDS, Lambda, SNS, SQS, AppSync, EventBridge Containerization and orchestration tools such... 
Remote job
Work from home

Vaco

San Francisco, CA
3 days ago
 ...machine learning (e.g., SageMaker, AI Platform, Azure ML). Knowledge of distributed computing technologies such as Apache Spark, Hadoop, or Dask, and experience with containerization and orchestration technologies such as Docker and Kubernetes. Strong problem-... 
Full time
Remote job
Flexible hours

Unreal Gigs

San Francisco, CA
19 days ago