Senior Data Engineer
JConnect Infotech
Senior Data Engineer
Location: Sunnyvale CA (Onsite)
Duration: Long Term
Job Description:
GCP Experience • 4+ years of recent GCP experience • Experience building data pipelines in GCP • GCP Dataproc, GCS & BIGQuery experience • 10+ years of hands-on experience with developing data warehouse solutions and data products. • 6+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required • 5+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms. • Experience with programming languages: Python, Java, Scala, etc. • Experience with scripting languages: Perl, Shell, etc. • Practice working with, processing, and managing large data sets (multi TB/PB scale). • Exposure to test driven development and automated testing frameworks. • Background in Scrum/Agile development methodologies. • Capable of delivering on multiple competing priorities with little supervision. • Excellent verbal and written communication skills. • Bachelor's Degree in computer science or equivalent experience. The most successful candidates will also have experience in the following: • Gitflow • Atlassian products – BitBucket, JIRA, Confluence etc. • Continuous Integration tools such as Bamboo, Jenkins, or TFS
Roles and Responsibilities:
As a Senior Data Engineer, you will • Design and develop big data applications using the latest open source technologies. • Desired working in offshore model and Managed outcome • Develop logical and physical data models for big data platforms. • Automate workflows using Apache Airflow. • Create data pipelines using Apache Hive, Apache Spark, Apache Kafka. • Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support. • Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team. • Mentor junior engineers on the team • Lead daily standups and design reviews • Groom and prioritize backlog using JIRA • Act as the point of contact for your assigned business domain
$184k - $287.5k
...do their best work.NVIDIA has a rapidly expanding ecosystem of data center platform designs. From single node HGX/DGX systems all the... ...and HPC software stack. We are searching for a highly motivated engineer to lead performance benchmarking and optimization efforts for our...SeniorFull time$185k - $230k
The OpportunityWe are looking for a Senior Data Engineer to join our Data Platform team and build the core data foundations that power analytics, experimentation, and decision-making across the company. In this role, you will design and own foundational data models, pipelines...SeniorPermanent employment$152k - $253k
...deepen our efforts in the autonomous driving field and strive to bring sustained growth to our customers.We're looking for a Senior Data Analysis Engineer, AD critical metrics with strong technical ability to deeply understand architectures and strong scripting experience to...SeniorFull time$175k - $221k
...feed ranking decision, every recommendation, every A/B test, and every ML model we ship runs on the data infrastructure you'd own. We're looking for a senior engineer to build and scale the batch and streaming pipelines at the core of that platform — someone who takes...SeniorFull timeLocal areaWork from home- ...4-06-04Company Name:HITACHI ENERGY USA INCProfession (Job Category):Engineering & ScienceJob Schedule: Full timeRemote:NoJob Description:General information:Hitachi Energy is seeking for a Senior Data Management Engineer for it's San Jose, CA location.Your Responsibilities...SeniorFull time
$174.72k - $295.68k
...transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.We are seeking a Machine Learning Data Curation Engineer to spearhead the data pipeline development and dataset management for our core AI initiatives. You will bridge the gap between...SeniorFull time$180k - $258.75k
...project is harmonious with TRI’s robotics divisions' efforts in Diffusion Policy and Large Behavior Models.We are looking for a Senior Data Engineer to design and build the foundational data infrastructure and tools that power our autonomy research and development...SeniorFull timeLocal areaShift work$174.72k - $295.68k
...future of transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.We are looking for a Data Infrastructure Engineer with engineering background and development skills. As a Data Infrastructure Engineer, your role is to identify corner cases...SeniorFull time- ...Job Title: Senior Data Engineer (High Priority) Location: Preferably Mountain View, CA; Hybrid Start Date: Immediate Duration: 6+ months Openings: 4 Senior Engineers About the Role We are seeking Senior Data Engineers to join an experienced...SeniorImmediate start
Info Way Solutions
Mountain View, CA1 day ago - A leading technology firm is looking for a Remote Data Engineer with at least 10 years of experience, particularly in Google Cloud Platform. The role includes designing and optimizing analytical datasets, building robust data pipelines, and collaborating with product managers...SeniorRemote work
Global Channel Management
Santa Clara, CA2 days ago - ...for your reference. Recent update from client for this data engineer role / Request-ID: 13145-1 _ Bentonville, AR position is no... ...reference, which has closed with client UST. Looking for Senior Data Engineer with Spark, Scala, GCP experience. Location...Senior
Trinity Technology Solutions
Sunnyvale, CA1 day ago - ...telling what you can accomplish. We are seeking an exceptional engineer with a background in large scale software development and delivery... ...with a heavy focus on using cutting-edge technologies to build data intensive systems, designing and optimizing data models, and collaborating...Senior
Apple
Sunnyvale, CA4 days ago - ...Senior Data Engineer We are looking for a Senior Data Engineer with advanced knowledge of SQL and intermediate knowledge of Python. Nice to have (but not required) beginner or intermediate level Java experience. Your primary focus will be the writing complex SQL queries...Senior
Rootshell Inc
Santa Clara, CA4 days ago $251k - $310k
...Senior Data EngineerWaymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its... ....You have:6+ years of professional experience in data engineering or a related fieldProven track record of building complex data...SeniorFull timeRemote workWaymo
Mountain View, CA15 hours ago- ...fundamental and applied research in intelligent data analytics, hardware/co-processor... ...visualization, etc. We are leading researchers and engineers from worldwide to create adaptive and... ...publishing papers. We are recruiting senior data scientist/engineers with multi-disciplinary...SeniorFor contractorsWorldwide
Netpace
Santa Clara, CA4 days ago $150.4k - $277.6k
...telling what you can accomplish. We are seeking an exceptional engineer with a background in large scale software development and delivery... ...with a heavy focus on using cutting‑edge technologies to build data intensive systems, designing and optimizing data models, and collaborating...SeniorApple
Sunnyvale, CA1 day ago- ...Develop and enhance Python frameworks and libraries to support data processing, quality, lineage, governance, analysis, and machine... ...like Bigtable and Vertex Feature Store Contribute to shared Data Engineering tooling & standards to improve the productivity and quality of...SeniorPermanent employmentContract workLocal area
Robotics Prcocess Automation, LLC
Mountain View, CA1 day ago $184k - $287.5k
NVIDIA is seeking a Senior Data Center Cooling Systems Engineer to help develop efficient liquid-cooling solutions for high-density computing. You will work across rack, facility, and campus infrastructure to improve cooling performance, energy use, water use, reliability...SeniorFull time- CoreWeave, a leading AI cloud provider, seeks a Senior Data Engineer to own the data lake and analytics stack powering observability for its global hardware fleet. You will maintain Iceberg, Trino, Airflow, Spark, and Superset, while delivering ETL pipelines, data models...Senior
- Ethereum Technologies LLC is seeking a data engineer to develop Python data processing frameworks and scalable GCP pipelines. You will design data models for ML readiness using BigQuery, Dataflow, Vertex AI features, and Bigtable. You will implement robust monitoring, logging...Senior
- NVIDIA is seeking a Senior Data Center Cooling Systems Engineer to help develop efficient liquid-cooling solutions for high-density computing across rack, facility, and campus infrastructure. You will improve cooling performance, energy and water use, reliability, acoustics...Senior
- NVIDIA Corporation in Santa Clara, CA is seeking a Senior Software Engineer for At Scale Compute Analysis to study large-scale datacenter workloads on GPU-accelerated clusters and turn telemetry data into actionable insights. You will work with OS, container, GPU, and...SeniorRemote job
- brevian-careers is looking for an experienced Data Engineer to join our Engineering team in Sunnyvale, California. The ideal candidate will have a strong background in developing scalable, high-performance data systems, with a particular focus on enterprise data systems...Senior
- Two95 International Inc. in Sunnyvale, CA seeks a Senior Data Engineer for a 2-month contract to deliver business insights from large data sets using internal tools, databases and industry data. You will document requirements and data lineage, transform business needs...SeniorContract work
- Redolent Infotech Pvt. Ltd. in Sunnyvale, CA seeks a Sr. Big Data Engineer to design, build and operate petabyte-scale data systems, with a strong focus on real-time pipelines and ML infrastructure. You will collaborate with engineers, product managers, BI developers and...Senior
- Redolent Infotech Pvt. Ltd. is seeking a Sr. Data Engineer in Sunnyvale, CA to design and implement data pipelines using SQL and Hadoop ecosystems. The role focuses on large data sets, distributed computing, and real-time ingestion with Kafka, with development in Java,...SeniorContract work
- ...exciting area of tech and are fundamentally reshaping the data storage industry. Here, you lead with innovative thinking,... ...workflows that help surface insights with less manual effort. As a Senior Analytics Engineer, you will help drive that journey end‑to‑end. This role is...SeniorFlexible hours
Socket
Santa Clara, CA5 days ago - A leading technology firm based in Mountain View, California is seeking a Data Engineer to develop and enhance Python frameworks for data processing and build scalable data pipelines on Google Cloud Platform. The ideal candidate should have extensive experience in GCP services...Senior
- A leading autonomous technology company in Mountain View is seeking a Senior Software Engineer specializing in Perception ML Data. This role involves bridging machine learning and autonomy infrastructure, addressing complex data challenges, and developing innovative systems...Senior
$225k
...application and interviews which can be found here. Position TITLE: Senior Analytics Engineer EMPLOYER: ID.me, LLC (formerly known as: ID.me, Inc.) LOCATION: Mountain View, CA Responsibilities Support our data infrastructure which includes Snowflake, dbt, Sigma, and GCP...SeniorFull timeWork at officeRemote workID.me Inc
Mountain View, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
- data center engineer Sunnyvale, CA
- senior cloud data engineer Sunnyvale, CA
- data infrastructure engineer Sunnyvale, CA
- sr information security engineer Sunnyvale, CA
- hadoop big data developer Sunnyvale, CA
- data visualization developer Sunnyvale, CA
- remote data engineer Sunnyvale, CA
- etl data engineer Sunnyvale, CA
- data engineer analytics Sunnyvale, CA
- sr data engineer Sunnyvale, CA