Data Platform Engineer (Scientific Data & Storage Migration)
AceStack LLC
Data Platform Engineer (Scientific Data & Storage Migration)
Location: San Francisco, CA Onsite
Duration: 6 months Responsibilities
Location: San Francisco, CA Onsite
Duration: 6 months Responsibilities
- Plan and implement data migration from legacy storage platforms (mostly Isilon) to strategic storage platforms (e.g. Object Storage, GPFS).
- Interaction with data owners to make agreements and plans to migrate/delete their data. Support scientific data operations activities
- Support the lifecycle and strategy for scientific data movement and archival.
- Partner with IT teams managing the physical storage platforms
- Collaborate with data engineers to build new capabilities and integrations aimed at increasing the value and reusability of scientific data.
- Collaborate with scientific data owners and users for Data Lifecycle matters including code development of policy and implementation data lifecycle practices that equally satisfy infrastructure support and business goals
- Work with data owners to define, iterate, and finalize project plans, tasks, and milestones for the project.
- Define processes and exercise sound judgment to accommodate unique storage administrator priorities and requirements (e.g., capacity limitations, data migration time windows, external communication, approvals, etc.) while balancing the need to execute the project and deliver on time and with quality.
- Perform data analytics to forecast data growth and anticipate future storage capacity requirements
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Platform Engineer (Scientific Data & Storage Migration) in San Francisco, CA vacancy
- The Lawrence Berkeley National Laboratory is hiring a Senior Scientific Data Engineer to join their Advanced Analysis Team at JGI. You will develop and enhance core scientific data systems essential for supporting genomic workflows and AI capabilities. This position requires...Scientific
$80k - $100k
...thought and experience within our team. We’re looking for a Data Migration Engineer (ETL Developer) to join our team. You’ll be at the heart of... ...of public safety data from a legacy system into the Mark43 platform Collaborated with our data migration contractors, reviewing...SuggestedFor contractorsGrabJobs
San Francisco, CA2 days ago- A leading FinTech company is looking for an Engineering Manager to lead the Data Storage team. You will manage data stores and oversee the architecture that supports both analytics and product experiences. Ideal candidates should have substantial experience in software...SuggestedFull time
- A leading financial technology platform in San Francisco seeks an Engineering Manager for its Data Storage team. This role involves owning the strategy for cloud-based data platforms, managing a team, and ensuring secure and high-performing data access. The ideal candidate...SuggestedFull time
- Lawrence Berkeley National Laboratory is seeking a Lead Scientific Data Engineer to join the Advanced Analysis Team. This role involves providing technical leadership for core scientific data platforms and developing data system architectures for AI-enabled scientific discovery...Scientific
- ...dynamic technology company is seeking a Lead Data Engineer for a hybrid role in San Francisco,... ...an offshore engineering team and drive migration from SQL to Databricks while developing... ...with SQL, Python, and cloud platforms is essential. This role offers a collaborative...
$160k - $200k
...leg up on their financial journey. ABOUT THE TEAM Data Platform Engineers at Rocket Money further our mission by building and maintaining... ...and platform teammates to ensure infrastructure changes, migrations, and improvements are delivered on schedule. Automate...Temporary workWork at officeRocket Money
San Francisco, CA1 day ago- ...A leading technology solutions firm seeks a Data Engineer to design, build, and optimize data solutions in cloud environments with a focus... ...on Azure. Responsibilities include collaborating on cloud migration initiatives, designing scalable data structures, and building...
Simera
San Francisco, CA1 day ago - Dots is seeking a detail-oriented data migration specialist to define the onboarding process for Stardex. This unique position allows you to create a seamless transition to our AI-native ATS and CRM with direct involvement from the founders. Ideal candidates will have...
$156.86k - $191.72k
...’s National Energy Research Scientific Computing Center (NERSC) is seeking a Senior Network Platform Engineer. Join us in accelerating scientific... ...of Science by advancing data movement, computation, and... ...leading network technology migrations or upgrades in high-performance...ScientificWork at officeRemote work$40 - $60 per hour
Mercor is seeking a Cloud Storage Management Expert to be part of their team in San Francisco... ...on cloud storage administration and data migration strategies. This remote position... ...skills and experience with cloud storage platforms like AWS S3 and Azure. Candidates should...Remote jobHourly pay$180k
...predictive sports analytics data products. We believe that oddsmaking... ...is a challenge rooted in engineering, mathematics, and sports... ...team is seeking a Senior Data Platform Engineer to have a direct impact... ...3 and similar ~ Own schema migration tooling and process...Remote workSwish Analytics
San Francisco, CAa month ago$168k - $210k
Ripple in San Francisco is looking for a Senior Software Engineer in Data Engineering to design and architect backend services for their... ...solutions using Java, Kotlin, or Go. You will be responsible for migrating core logic, ensuring operational excellence, and mentoring...- ...Seeking Founding Data Scientists and Machine Learning Engineers Imagine Multiplying Your Impact You've unlocked... ...inference, forecasting, agentic platforms, and more. You'll help extend... ...in production ML/DS; you balance scientific rigor with "it ships today,...Scientific
Palladio AI, Inc
San Francisco, CA2 days ago - ...months, not years, and where scientific breakthroughs happen at... .... It is a discovery engine that transforms messy biological data into insights in minutes... ...systems that serve the entire platform. Your work includes... ..., designing schemas and storage models for graph...ScientificWork at office
Mithrl
San Francisco, CA4 days ago - ...AI Co-Scientist Engineer We envision a world where... ...from messy biological data to novel insights in minutes... ...before it enters the platform. Collaborate with... ...analysis and storage systems. What You Bring... ...pipelines, ideally for scientific or lab-derived data....ScientificWork at office
Mithrl
San Francisco, CA1 day ago $204.5k - $267k
...Senior Data Engineer Formation Bio is a tech and AI driven pharma... ...Inc., has built technology platforms, processes, and capabilities... ...Senior Data Engineer to join the Scientific Data Intelligence (SDI) team... ...as the primary compute and storage engine. Conduct hands-on...ScientificWork at officeLocal areaRelocation3 days per weekFormation Bio (Formerly TrailSpark)
San Francisco, CA1 day ago$185k - $221.4k
...Build and own production data infrastructure. Design, implement... ...ingest clinical, financial, scientific, and commercial data from REST... ...the right time. Uphold high engineering standards and collaborate... ...g., managed Postgres, object storage, query engines, serverless ETL...ScientificRemote workFlexible hoursForesite Labs
San Francisco, CA4 days ago- A cutting-edge biotech company in San Francisco is seeking a Data Engineer to build AI-powered data ingestion pipelines from various sources. The role demands strong expertise in data engineering and Python, with a focus on data normalization and quality control. As part...Scientific
- DFBooking Careers is seeking a Machine Learning Engineer to manage massive datasets and improve data handling procedures in San Francisco. The role focuses on implementing distributed storage solutions, optimizing data operations, and building backend systems for versioning...
- ...leading global healthcare company in San Francisco seeks a Scientific Data Engineer to design and build AI-ready data products and... ...will have extensive experience in data engineering, cloud platforms, and must hold a degree in Computer Science or related field...Scientific
- A progressive biopharma company is seeking a Data Engineer to join their Scientific Data Intelligence team. This role involves supporting data science by building scalable data infrastructure and reliable pipelines. The ideal candidate has strong expertise in Snowflake...ScientificWork at officeRelocation
- ...changing how recruiting firms leverage their data and institutional knowledge. Our... ...executive search firms who are moving off legacy platforms — and they need someone to make that... ...TypeScript/SQL scripts to transform, clean, and migrate messy data from one system to another....Freelance
- ...intelligence company based in San Francisco, California. The Role: Data Engineer - Multimodal Systems As a Data Engineer - Multimodal... ...in well-respected venues. Postgraduate degree in a scientific subject (Computer Science, EE/EECS, Mathematics, Physics, Machine...ScientificWork at officeRelocation package
Zyphra
San Francisco, CA1 day ago $205k - $316k
...Data Platform Engineer At Quizlet, our mission is to help every learner achieve their outcomes in the most effective and delightful way. We're a $1B+ learning platform used by two-thirds of U.S. high school students and half of college students, powering over 1 billion...Work at office3 days per weekQuizlet
San Francisco, CA5 days ago$135.3k - $178.35k
...Data Infrastructure Engineer Berkeley, CA About Glyphic: At... ...proteome sequencing platform that will transform... ...Data Modeling & Storage Design and implement... ...centralized data lake on AWS, migrating from scattered... ...bioinformatics or scientific data pipelines (...ScientificWork at officeGlyphic Biotechnologies
Berkeley, CA3 days ago$158.81k - $198.49k
...Lead Scientific Data Engineer Berkeley Lab's (LBNL) Joint Genome Institute (JGI) has an opening... ...evolution of these systems and shape the platforms JGI will rely on to meet the scale,... ...experience with databases and data storage technologies including relational databases...ScientificFull timeWork at officeRemote workRelocation packageBerkely Lab
San Francisco, CA4 days ago- Thank you for your interest in Uncountable Engineering! Uncountable is seeking recent graduates interested in a career in data engineering to help manage customers datasets... ...ingest customer data for the Uncountable Web Platform where scientists enter and analyze their...Scientific
- Zyphra, an AI company in San Francisco, is seeking a Data Engineer to enhance datasets and data pipelines across various modalities. In... ...handling, Python programming, and a postgraduate degree in a scientific field. The position offers comprehensive benefits, including...Scientific
$166.5k - $266.2k
...that operates at the intersection of scientific delivery and core platform development. AI4D's mission is connecting scientists to petabyte-scale data through natural language interfaces,... ...areas. As a Scientific Data Engineer, you will close that gap. You will build...ScientificFull timeFlexible hoursEli Lilly
San Francisco, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Platform Engineer (Scientific Data & Storage Migration). Be the first to apply!
Related searches
- director data engineering San Francisco, CA
- junior big data engineer San Francisco, CA
- data engineer graduate San Francisco, CA
- senior data engineer San Francisco, CA
- data platform engineer San Francisco, CA
- sr information security engineer San Francisco, CA
- senior data integration developer San Francisco, CA
- data developer San Francisco, CA
- data engineer San Francisco, CA
- data infrastructure engineer San Francisco, CA