Senior Data Platform Engineer: Scale Petabyte Pipelines

Weights & Biases

CoreWeave is hiring a senior data engineer to design and implement scalable data systems for the integrated Weights & Biases platform. You will build batch and streaming pipelines, craft transformation frameworks, and improve data warehouse performance for large-scale analytics. You’ll collaborate with software engineers to define event schemas, telemetry, and secure data access, while shaping metadata, governance, and semantic layers for trusted self-service analytics. #J-18808-Ljbffr Weights & Biases

Apply

Vacancy posted 5 days ago

Similar jobs that could be interesting for youBased on the Senior Data Platform Engineer: Scale Petabyte Pipelines in Livingston, NJ vacancy

Senior Data Platform Engineer - Weights & Biases
$165k - $242k
...powerful end-to-end platform to develop, deploy... ...footprint of data centers covering every... ..., trained, and scaled. The integration... ...data systems and pipelines — 30%: Architect,... ...issues within multi-petabyte data environments.... ...Partner with software engineering teams to define...
Pipeline
Senior
Permanent employment
Temporary work
Casual work
Work at office
Flexible hours
Weights & Biases
Livingston, NJ
8 hours ago
Senior Data Engineer
$182k - $242k
...CoreWeave delivers a platform of technology, tools,... ...innovators to build and scale AI with confidence. Trusted... ....What You’ll Do:The Data Engineering Team builds and... ...design resilient data pipelines, scalable lakehouse systems... ...role:We're seeking a Senior Data Engineer to design...
Pipeline
Senior
Permanent employment
Full time
Temporary work
Casual work
Work at office
Flexible hours
CoreWeave
Livingston, NJ
3 days ago
Senior Data Platform Engineer
...mid-market firms, rely on SS&C for expertise, scale, and technology. Job Description Senior Data Platform Engineer Role Summary We are seeking a Senior Data Platform... ...rather than owning specific business data pipelines: our platform stack spans Airflow, Iceberg, Spark...
Pipeline
Senior
Ongoing contract
Worldwide
SS&C Technologies
Newark, NJ
2 days ago
Senior Data Engineer
...Senior Data Engineer — Contract Location: Hybrid — 3 days/week onsite in Newark... ...supporting enterprise data platform initiatives. This role... ...focuses on building scalable data pipelines, CI/CD automation, and end-... ...and quality of high-scale data applications and services...
Pipeline
Senior
Contract work
3 days per week
JSR Tech Consulting
Newark, NJ
1 day ago
Google Senior Data Engineer
...organizations modernize data ecosystems, build... ..., and responsibly scale AI. As part of... ...Cloud’s Data & AI platform—including BigQuery... ...You AreA hands-on Engineer with foundational... ...clients, supporting senior architects, and... ...design, build data pipelines and models, perform...
Pipeline
Senior
Work experience placement
Live in
Work at office
Local area
Accenture
Morristown, NJ
4 days ago
Senior Cloud Data Engineer
...Senior Cloud Data EngineerLocation: Whippany NJ Duration: 03 MonthsDesign and implement scalable, secure, and reliable data pipelines using cloud-native technologies (e.g., AWS, Azure, GCP). Develop... ...CI/CD practices for data engineering workflows. Stay current with emerging...
Pipeline
Senior
eTeam
Whippany, NJ
5 days ago
Senior Data Analyst / Data Engineer
$110k - $186k
...impact on a global scale, come make a difference... ....Job TitleSenior Data Analyst / Data EngineerAbout... ...technology. As a Senior Data Analyst / Data Engineer, you will play a... ...maintain scalable data pipelines, reporting solutions... ...cloud-based data platforms.Perform data profiling...
Pipeline
Senior
Full time
Contract work
Temporary work
For contractors
H1b
Local area
Fiserv
Berkeley Heights, NJ
3 days ago
Senior Data Engineer - PostgreSQL and MongoDB
$92.7k - $203.94k
...Senior Data EngineerWe're building a world of health around... ...Summary: Senior Data Engineer - PostgreSQL and... ...time transactional cache platform that enables APIs, digital... ...Data Capture (CDC) pipelines that replicate data from... ...supporting enterprise-scale data platforms and...
Pipeline
Senior
Hourly pay
Full time
Temporary work
Oak St. Health
Newark, NJ
3 days ago
Senior Data Engineer
Senior Data Engineer — ContractLocation: Hybrid — 3 days/week onsite in Newark... ...supporting enterprise data platform initiatives. This role focuses... ...on building scalable data pipelines, CI/CD automation, and end-to... ...and quality of high-scale data applications and servicesParticipate...
Pipeline
Senior
3 days per week
JSR Tech Consulting
Newark, NJ
2 days ago
Senior AWS Platform Engineer - Scalable Cloud Automation
...Compunnel, Inc. is seeking multiple Senior AWS Cloud Engineers for a cloud modernization initiative in the US. The role focuses on building... ...infrastructure, containerized environments, and automated delivery pipelines, with emphasis on reliability and security. The positions...
Pipeline
Senior
Compunnel
Roseland, NJ
1 day ago
Senior Director- Data Engineering
...make an impact on a global scale, come make a difference at... ....Job TitleSenior Director- Data EngineeringAbout your role:... ...You will lead talented data engineering and development teams to create... ...of scalable data pipelines, data platforms, and data products that align...
Pipeline
Senior
Full time
Temporary work
H1b
Work at office
Monday to Friday
Fiserv
Berkeley Heights, NJ
3 days ago
Senior Azure Data Engineer with Fabric
...Senior Azure Data Engineer With Microsoft FabricLocation: Newark, NJ FTE ONLYSenior... ...technologies on cloud platforms like Azure, Microsoft Fabric... ...processing and distribution using pipelines on Azure cloud services.... ...in preparation for a large-scale architectural migration...
Pipeline
Senior
AceStack LLC
Newark, NJ
5 days ago
Senior Big Data Engineer (Java, Spark, Kafka)
...Senior Big Data EngineerAs an experienced member of our Data Engineering Platform Group, you will be responsible for building and taking... ...globally.You will lead large-scale data engineering, integration... ...and own data quality for the pipelines you create.Basic...
Pipeline
Senior
Keylent Inc
Berkeley Heights, NJ
5 days ago
Senior Data Engineer - ETL | Data Integration
JerseySTEM is seeking experienced Data Engineers to stabilize and scale core data pipelines that power analytics and reporting. The current platform complexity requires ownership from engineers who can design, implement, and maintain production grade workflows across multiple...
Pipeline
Senior
Remote work
JerseySTEM
Florham Park, NJ
3 days ago
Senior Data Engineer
...store, and analyze enterprise data and data systems.... ...Collaborate closely with engineering teams to design and implement... ...scalable data solutions. Ensure platform performance, availability, and... ...building and maintaining data pipelines. ~ Hands-on experience with...
Pipeline
Senior
Full time
Apexon
Parsippany, NJ
4 days ago
Applied AI Health Data System Engineer-Senior Manager
$124k - $280k
...SummaryAt PwC, our people in data and analytics engineering focus on leveraging... ...system and health plans. As a Senior Manager, you will drive use... ...production-grade RAG pipelines, MCP connections, agentic... ...Google Cloud (Vertex AI) platforms, with an understanding of...
Pipeline
Senior
Full time
H1b
PwC
Florham Park, NJ
5 days ago
Senior Data Engineer
...client. He/ She will work as a Senior Cloud Engineer within the CDO EDP team and... ...to build and enhance the data infrastructure and... ...and determine fit for data pipelines or application architecture... ...analytics and observability platforms (Splunk, ELK, Prometheus, Grafana...
Pipeline
Senior
Full time
EXL
Newark, NJ
4 days ago
Senior Data Engineer
...row! Job Summary The Data Engineer leads the design, development... ...secure data architecture, pipelines, and systems to support the... ...innovation and best practices. The Senior Data Engineer collaborates... ...to enhance the data platform. Provide technical leadership...
Pipeline
Senior
Full time
Work at office
Local area
Work from home
DOWC
Parsippany, NJ
8 hours ago
Senior Data Engineer
...JOB SUMMARY JOB SUMMARY The Senior Data Engineer will support a strategic enterprise data transformation... ...data repository and data delivery platform as part of a broader domain activation... ...on designing and developing new data pipelines, integrating market data sources, and...
Pipeline
Senior
Compunnel
Newark, NJ
1 day ago
Senior Data Engineer
$128k - $249k
...lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data... ...Enterprise Applications, Data, and AI Platforms group, designing scalable Microsoft Fabric... ...Warehouse, and Azure AI Foundry data pipelines. Role involves mentoring staff, collaborating...
Pipeline
Senior
Full time
Temporary work
Local area
Remote work
Flexible hours
Afternoon shift
K&L Gates
Newark, NJ
1 day ago
Senior Data Engineer
$104k - $171.6k
Job Classification:Technology - Engineering & CloudAre you interested in building capabilities... ...institutions.Your Team & RoleAs a Senior Data Engineer on the FM Management... ...to build high quality data pipelines that drive platform delivery. You will implement capabilities...
Pipeline
Senior
Full time
Part time
PGIM
Newark, NJ
5 days ago
Senior Big Data Engineer (US)
...Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer... ...implementing, and maintaining data pipelines and infrastructure for our... ...with cloud-based data platforms (e.g.Azure)Experience with...
Pipeline
Senior
Zortech Solutions
Newark, NJ
5 days ago
Senior Specialist, Data Engineering and Analytics
$117k - $184.2k
...strengthening the use of data and analytics to improve technical... ...business performance. The Senior Specialist, Data Engineering and Analytics will support... ..., and enhance data pipelines, data transformations, curated... ...with platforms such as DataLynx, SEEQ, MPI...
Pipeline
Senior
Full time
For contractors
Local area
Flexible hours
Merck Sharp & Dohme (MSD)
Rahway, NJ
5 days ago
Sr. Data Engineer, Payment Operations
$127k - $160.55k
...Senior Data EngineerThe Senior Data Engineer leads the engineering workstreams that underpin... ...maintains Snowflake data pipelines; activates payment monitoring... ...across multiple platforms. As the primary Snowflake... ...performance tuning on large-scale datasets.Hands-on...
Pipeline
Senior
Full time
Work at office
Local area
Visa sponsorship
Flexible hours
Zelis
Morristown, NJ
5 days ago
Senior Data Center Electrical Engineer
$157k - $210k
...pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by... ...a highly skilled and experienced Senior Data Center Electrical Engineer to play a key role in the design and...
Senior
Permanent employment
Full time
Temporary work
For contractors
Casual work
Work at office
Flexible hours
CoreWeave
Livingston, NJ
1 day ago
Principal AI & Analytics Engineer Reporting Platform
...is building an AI-first platform for managing the... ...exceptional and passionate engineer to own the design and delivery... ...will turn complex VMS data into trusted, fast,... ...ingestion and transformation pipelines and make practical... ...about data freshness, scale, and cost. Deep understanding...
Pipeline
Full time
Flexible hours
Jobrapido
Newark, NJ
4 days ago
Senior Data Engineer
...Job Title: Senior Data Engineer Location: Short Hills, NJ (2 days Hybrid) Duration: 6 months CTH Job Description: Senior Data Engineer, building ETL pipelines daily in Azure and Databricks environment, working with SQL and Python Databricks...
Pipeline
Senior
Full time
Harvey Nash Group
Short Hills, NJ
2 days ago
Data Engineering Lead Enterprise Platform & Governance
...Novartis is seeking an Associate Director, Data Engineering in East Hanover, NJ to shape enterprise... .... You will set standards across data platforms and enable reliable, compliant data... ...for decision support. You will lead data pipeline design, enforcement of governance, and...
Pipeline
Novartis AG
East Hanover, NJ
17 hours ago
Senior AWS Data Engineer
About the job Senior AWS Data Engineer Role Overview: Lead the design, development, and optimization of large-scale, reliable, and secure data pipelines and data lake architecture on AWS. Architect... ...analytics and observability platforms (Splunk, ELK, Prometheus, Grafana...
Pipeline
Senior
Inizio Partners
Newark, NJ
2 days ago
Lead Security Platform Engineer
...Hiring a Lead Security Platform EngineerUnlock Your Career... ...-- their employee data.We are honored by this... ...Lead Security Platform Engineer, you will join a highly... ...maintaining Jenkins CI/CD pipelines Kubernetes, containers,... ...solution.Deliver at epic scale. We deliver real user...
Pipeline
ADP - Automatic Data Processing
Roseland, NJ
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Platform Engineer: Scale Petabyte Pipelines. Be the first to apply!