Senior Data Platform Engineer - PySpark, Databricks, AWS
Parafin
Parafin is seeking a Senior Software Engineer to lead the Data Platform infrastructure. You will design, build, and maintain data pipelines and lakehouse architectures, collaborating with Data Science, Platform Engineering and Product Engineering teams to enable data-driven product development. In this role you will own Databricks workspaces, optimize configurations, and drive data quality, testing and observability. #J-18808-Ljbffr Parafin
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Platform Engineer - PySpark, Databricks, AWS in San Francisco, CA vacancy
$185k - $218k
...Checkr is building the data platform to power safe and... ...Checkr product. As a Senior Data Engineer, you'll lead the execution... ...in Python, PySpark, and SQL, with solid... ...data lakes, and the AWS stack (EKS, EMR, Glue... ...processing platforms such as Databricks or Snowflake. Pay Transparency...DatabricksAmazon Web ServiceSeniorWork at officeLocal areaRemote workRelocationFlexible hours3 days per weekCheckr
San Francisco, CA2 hours ago$220k - $265k
...they need through the platforms they already sell... ...seasoned software engineer to join Parafin’s Infrastructure... ...next-generation Data Platform. This role... ...businesses. As a Senior Software Engineer,... ...with PySpark, Databricks, and Airflow on AWS. Improve the data...DatabricksAmazon Web ServiceSeniorWork from homeFlexible hours$190k - $240k
...streaming TV ads. Our platform combines... ...former founders and senior leaders from companies... ...first . As a Data Platform Engineer, you will be responsible... ...engineering (AWS preferred; GCP/... ...(Spark, PySpark, or similar big data... ...data platforms (Databricks or similar — administering...DatabricksAmazon Web ServiceWork at office2 days per week$168k - $210k
Senior Software Engineer, Data Engineering Location: San Francisco, CA,... ...of the Caspian Data Platform—Ripple's centralized... ...production ETL pipelines on Databricks using Delta Live... ..., Delta Lake, and PySpark or Spark SQL as... ...validation. Solid AWS experience relevant...DatabricksAmazon Web ServiceSeniorLocal area$295k - $405.5k
About this role As the Senior Staff Machine Learning Platform Engineer, you will own the... ...that unlock data science velocity at... ...integrate emerging Databricks features Stay ahead... ...Frameworks: PyTorch, PySpark, MLFlow Big Data &... ...& Infrastructure: AWS, S3, SageMaker, Kubernetes...DatabricksAmazon Web ServiceSeniorWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week- ...technology consulting firm in California is seeking a Senior DevOps Engineer to enhance cloud-based data management platforms. The ideal candidate will have strong AWS and CI/CD skills, alongside expertise in tools like Databricks and Collibra. Duties include defining CI/CD...DatabricksAmazon Web ServiceSeniorContract work
- ...will bridge the gap between sophisticated Data Engineering architectures and cutting-edge AI/ML... ...Flink), modern data stacks (Snowflake, Databricks), and orchestration tools (Airflow, dbt... ...in at least one major cloud provider (AWS, Azure, or GCP), specifically around data...DatabricksAmazon Web ServiceSenior
$168k - $210k
Unchain Data is hiring a Senior Software Engineer to develop the Caspian Data Platform. You will design and build ETL pipelines, ensuring data quality and system scalability... ...candidate should have solid experience with Databricks, SQL, and the ability to manage complex data...DatabricksSeniorFlexible hours- ...office. We are looking for a Senior Data Engineer - Hardware & Supply Chain (... ..., firmware data, or broader platform engineering — as the team... ...architecture using Apache Iceberg, Databricks, and dbt. Support the Data... ...production data systems on AWS or equivalent cloud. Self‑...DatabricksAmazon Web ServiceSeniorWork at officeLocal areaFlexible hours
$130.9k - $220k
Senior Software Engineer - Data Platform Remote - US Samsara’s Mission Improve the safety, efficiency, and sustainability... ...work on systems such as Spark and Databricks infrastructure, Delta Lake on S3,... ...production infrastructure in AWS, including services such as S3, RDS...DatabricksAmazon Web ServiceSeniorFull timeRemote workRelocation packageFlexible hours- Gravity Engineering Services Pvt Ltd. is looking for a Senior Software Engineer for their Data Platform team in San Francisco. This role involves building and extending core data infrastructure... ...systems, and must be comfortable with AWS, Kafka, and LLMs. Strong written...Amazon Web ServiceSenior
$180k
Swish Analytics seeks a Senior Data Platform Engineer to enhance our data infrastructure for consumer and enterprise offerings. With a starting salary... ...$180,000+, this remote role demands expertise in Python, AWS, and SQL. The candidate will focus on developing database stability...Amazon Web ServiceSeniorRemote job- GSK is seeking a skilled Senior Data Platform Engineer in San Francisco, CA, to deliver high-performing data platforms and services. The role involves... ...using programming languages like Python and tools like AWS, Azure, and Kubernetes. Applicants should have a Bachelor’s...Amazon Web ServiceSenior
$170k - $240k
SentiLink in San Francisco is looking for a Senior Software Engineer to enhance the data platform supporting their identity verification products. The role focuses... ...with Python or Golang, and familiarity with AWS and database technologies. The position offers a competitive...Amazon Web ServiceSeniorRemote job- ...quantitative research, data science, and... ...a lean firm where senior practitioners do the... ...intersection of data engineering and investment analytics... ...tools (Snowflake, Databricks, dbt, Dagster, Sigma, AWS, etc.) and cutting‑... ...scalable data platforms (data warehouses, data...DatabricksAmazon Web ServiceSeniorDay shift
- Flourish Ventures is seeking a Senior Software Engineer for their San Francisco office. The role involves developing fintech software,... ...Science or a related field and extensive experience in AWS/GCP, Spark, and data handling technologies. The base salary ranges from $210...Amazon Web ServiceSeniorWork at office
$175.5k - $180k
...the implementation of scalable data architectures for cutting-... ...the design of complex feature engineering workstreams, ensuring our data... ...(Spark, LangChain, Databricks, Dask, Airflow, Dagster, Kedro... ...Terraform) across cloud providers (AWS, Azure, GCP) Exceptional time...DatabricksAmazon Web ServiceSeniorApprenticeshipWork at officeLocal areaEasy work$150k - $236k
Senior/Staff/Principal Backend Engineer, Platform & Data Ingestion Scale Clinical Platforms. Harness Unstructured Data. Advance... ..., etc.) and analytical (OLAP via Databricks, Snowflake, BigQuery, etc.) data... ..., and cloud integrations (AWS and/or GCP), including messaging/...DatabricksAmazon Web ServiceSeniorWork visaFlexible hours$140k - $200k
...foundational member of our engineering team: a highly motivated Software... ..., and evolution of our data platform. You will be part of the team... ...modern cloud technologies (AWS, GCP, or Azure). Pipeline Development... ...e.g., Delta Lake, Iceberg). Seniority level Mid-Senior level...Amazon Web ServiceSeniorFull time$155k - $235k
...expertise. About the Team The Data Platform team sits within Scribd's... ...and Unity Catalog in Databricks, to the semantic and AI layers... ...the Role We're looking for a Senior AI Data Engineer to lead the AI engineering... ..., Terraform/Spacelift, and AWS. You Have 5+ years of data...DatabricksAmazon Web ServiceSeniorLocal areaHome officeFlexible hours$180k
...predictive sports analytics data products. We believe that oddsmaking... ...is a challenge rooted in engineering, mathematics, and sports... ...Analytics team is seeking a Senior Data Platform Engineer to have a direct... ...such as Amazon Web Services (AWS), Google Cloud Platform (GCP...Amazon Web ServiceSeniorOdd jobRemote work$197.6k - $296.4k
...The Role As a Staff Data Engineer, you will be a... ...on the Data & ML Platform team, owning the architecture... ...Health. Where a Senior Data Engineer owns... ...and ML systems on Databricks. You will lead the... ..., SQL, Flink, PySpark, Kafka, Delta Lake... ...PostgreSQL, and AWS. This is a high‑ownership...DatabricksAmazon Web ServiceWork at officeLocal areaImmediate startRemote workWorldwide3 days per week- ...Onyx The Onyx Research Data Tech organization is GSK... ...leadership, data engineering, infrastructure and DevOps... ...data/metadata/knowledge platforms, and AI/ML and analysis... ...skilled and experienced Senior Data Platform Engineer... ...cloud providers such as AWS, Azure, and GCP. Experience...Amazon Web ServiceSeniorWork experience placementLocal area
- Cresset is seeking a data platform engineer to develop and maintain our cloud-based data infrastructure. You will work with AWS, Matillion, DBT, Databricks, and Snowflake to support analytics and AI-driven initiatives. Collaborating with leadership and data technologists...DatabricksAmazon Web Service
- Ripple is looking for a Staff Software Engineer to join our Data Engineering team in San Francisco.... ...direction for the Caspian Data Platform. You will be responsible for leading... ...engineering experience and deep expertise in Databricks and AWS. The position offers a competitive...DatabricksAmazon Web Service
$138.9k - $186.2k
...Sr Data Engineer Job ID 10143797 Location San Francisco,... ...building the products and platforms that will power our... ...visualization. We are hiring a Senior Data Engineer to... ...with Python, Java, Databricks, LangChain, Vector Stores... ..., pgvector ), SQL, AWS big data tech stack (like...DatabricksAmazon Web ServiceSeniorLocal areaThe Walt Disney Company
San Francisco, CA18 hours ago$138.9k - $186.2k
...global organization of engineers, product... ...designers, technologists, data scientists, and... ...the products and platforms that will power our... ...We are hiring a Senior Data Engineer to design... ...Python, Java, Databricks, LangChain, Vector... ..., pgvector), SQL, AWS big data tech stack...DatabricksAmazon Web ServiceSenior$142.6k - $176k
Octave is hiring a Sr. Data Engineer in San Francisco to evolve their data platform for AI and ML applications. The role requires extensive experience in data engineering and familiarity with cloud platforms like AWS and GCP. Responsibilities include designing scalable...Amazon Web ServiceSenior$200k - $275k
Peregrine is seeking a Staff Data Infrastructure Engineer in San Francisco. The role focuses on designing high-throughput data integration systems... ...in data infrastructure, with expertise in Apache Spark and AWS. A background in Computer Science or Engineering and skills...Amazon Web ServiceSenior$180k - $260k
A global analytics firm in San Francisco is seeking a Senior Data Engineer to design, develop, and optimize data systems using AWS technologies. You will play a crucial role in enhancing data capabilities and ensuring data performance, security, and reliability. Ideal...Amazon Web ServiceSenior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Platform Engineer - PySpark, Databricks, AWS. Be the first to apply!
Related searches
- data engineer analytics San Francisco, CA
- data engineer manager San Francisco, CA
- remote data engineer San Francisco, CA
- junior data engineer remote San Francisco, CA
- senior cloud data engineer San Francisco, CA
- data platform engineer San Francisco, CA
- data infrastructure engineer San Francisco, CA
- aws data engineer San Francisco, CA
- director data engineering San Francisco, CA
- big data developer San Francisco, CA