Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer

JConnect Infotech

Senior Data Engineer

Location: Sunnyvale CA (Onsite)

Duration: Long Term

Job Description:

GCP Experience • 4+ years of recent GCP experience • Experience building data pipelines in GCP • GCP Dataproc, GCS & BIGQuery experience • 10+ years of hands-on experience with developing data warehouse solutions and data products. • 6+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required • 5+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms. • Experience with programming languages: Python, Java, Scala, etc. • Experience with scripting languages: Perl, Shell, etc. • Practice working with, processing, and managing large data sets (multi TB/PB scale). • Exposure to test driven development and automated testing frameworks. • Background in Scrum/Agile development methodologies. • Capable of delivering on multiple competing priorities with little supervision. • Excellent verbal and written communication skills. • Bachelor's Degree in computer science or equivalent experience. The most successful candidates will also have experience in the following: • Gitflow • Atlassian products – BitBucket, JIRA, Confluence etc. • Continuous Integration tools such as Bamboo, Jenkins, or TFS

Roles and Responsibilities:

As a Senior Data Engineer, you will • Design and develop big data applications using the latest open source technologies. • Desired working in offshore model and Managed outcome • Develop logical and physical data models for big data platforms. • Automate workflows using Apache Airflow. • Create data pipelines using Apache Hive, Apache Spark, Apache Kafka. • Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support. • Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team. • Mentor junior engineers on the team • Lead daily standups and design reviews • Groom and prioritize backlog using JIRA • Act as the point of contact for your assigned business domain

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Sunnyvale, CA vacancy
  • $184k - $287.5k

     ...do their best work.NVIDIA has a rapidly expanding ecosystem of data center platform designs. From single node HGX/DGX systems all the...  ...and HPC software stack. We are searching for a highly motivated engineer to lead performance benchmarking and optimization efforts for our... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • DescriptionGeneral information:Hitachi Energy is seeking for a Senior Data Management Engineer for it's San Jose, CA location.Your Responsibilities:Analyze and understand customer engineering, business, and software requirements, propose technically feasible solutions,... 
    Senior

    Hitachi

    Santa Clara, CA
    2 days ago
  • $117k - $234k

     ...OfficePosition Summary...What you'll do...About the TeamInternational Data Management (IDM) team powers enterprise-scale data platforms...  ...smart design and optimization strategiesDevelop AI-driven engineering solutionsBuild internal tools, utilities, and AI agents to accelerate... 
    Senior
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    2 days ago
  • $174.72k - $295.68k

     ...transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.We are seeking a Machine Learning Data Curation Engineer to spearhead the data pipeline development and dataset management for our core AI initiatives. You will bridge the gap between... 
    Senior
    Full time

    XPENG Motors

    Santa Clara, CA
    3 days ago
  • $180k - $258.75k

     ...project is harmonious with TRI’s robotics divisions' efforts in Diffusion Policy and Large Behavior Models.We are looking for a Senior Data Engineer to design and build the foundational data infrastructure and tools that power our autonomy research and development... 
    Senior
    Full time
    Local area
    Shift work

    Toyota Research Institute

    Los Altos, CA
    2 days ago
  • $174.72k - $295.68k

     ...future of transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.We are looking for a Data Infrastructure Engineer with engineering background and development skills. As a Data Infrastructure Engineer, your role is to identify corner cases... 
    Senior
    Full time

    XPENG Motors

    Santa Clara, CA
    2 days ago
  •  ...Samsung Electronics Perú is seeking a Sr. Data Engineer to contribute to scalable data pipelines and support the Performance & Reach engineering organization. You will work with large advertising datasets and collaborate with cross-functional teams to deliver data solutions... 
    Senior

    Samsung Electronics Perú

    Mountain View, CA
    1 day ago
  •  ...ID.me is seeking a Senior Analytics Engineer to support the data infrastructure in Mountain View, CA. This role involves leading efforts to develop analytics and dashboards using Snowflake and dbt. The ideal candidate has 5+ years of experience in data analytics and SQL... 
    Senior

    ID.me Inc

    Mountain View, CA
    3 days ago
  •  ...General Motors in Mountain View, CA is seeking a Senior Data Engineer to design, build, and maintain data pipelines and data infrastructure that support marketing analytics and business intelligence. You will profile data quality, integrate multiple sources, ensure scalability... 
    Senior

    Towards AI, Inc.

    Mountain View, CA
    1 day ago
  • $94.43k - $202.75k

     ...professional services firms. Spark your curiosity and ignite your career at The Lighthouse.KPMG is currently seeking a Senior Associate, Data Engineer for our Consulting practice.Responsibilities:Assist with technical design and development activities and lead a small workstream... 
    Senior
    Local area
    Visa sponsorship

    KPMG

    Santa Clara, CA
    4 days ago
  •  ...Eightfold AI is seeking a backend-focused engineer to design, build, and optimize a large-scale data platform that serves millions of users globally. You will lead architecture decisions, implement auto-scaling, fault tolerance, and ensure high performance across distributed... 
    Senior

    Eightfold LLC

    Santa Clara, CA
    3 days ago
  •  ...Job Title: Senior Data Engineer (High Priority) Location: Preferably Mountain View, CA; Hybrid Start Date: Immediate Duration: 6+ months Openings: 4 Senior Engineers About the Role We are seeking Senior Data Engineers to join an experienced... 
    Senior
    Immediate start

    Info Way Solutions

    Mountain View, CA
    3 days ago
  •  ...Sterling B2B Developer Role: Senior Data Engineer Location: Dallas, TX or Mountain View, CA Duration: Long Term Contract As part of the Mail Analytics Data Engineering team, you will be working on large-scale batch pipelines, data serving, data lakehouse,... 
    Senior
    Long term contract

    Hermitage Infotech

    Mountain View, CA
    1 day ago
  •  ...Job Summary Seeking a Data Engineer with Spark & Streaming skills to build real-time, scalable data pipelines using tools like Spark, Kafka, and cloud services (GCP) to ingest, transform, and deliver data for analytics and ML. Key Responsibilities Design, develop, and... 
    Senior

    Compunnel

    Sunnyvale, CA
    4 days ago
  •  ...is looking for supporting the planning and implementation of data design services, providing sizing and configuration assistance...  ...data solutions using Azure cloud data technologies. As a Senior Data Engineer, you will collect, aggregate, store, and reconcile data in support... 
    Senior

    NutaNXT Technologies

    Santa Clara, CA
    4 days ago
  •  ...Senior Data Engineer Initial Duration: 6 months Location: Mountain View, CA- Only Local Candidates Full onsite - 5 days in a week. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes. Optimize data storage and retrieval systems... 
    Senior
    Local area

    Socket

    Mountain View, CA
    1 day ago
  •  ...telling what you can accomplish. We are seeking an exceptional engineer with a background in large scale software development and delivery...  ...with a heavy focus on using cutting-edge technologies to build data intensive systems, designing and optimizing data models, and collaborating... 
    Senior

    Apple

    Sunnyvale, CA
    1 day ago
  •  ...Senior Data Engineer We are looking for a Senior Data Engineer with advanced knowledge of SQL and intermediate knowledge of Python. Nice to have (but not required) beginner or intermediate level Java experience. Your primary focus will be the writing complex SQL queries... 
    Senior

    Rootshell Inc

    Santa Clara, CA
    1 day ago
  •  ...Senior Data Engineer - GCP Location: Mountain View CA (Onsite) What You’ll Do Develop and enhance Python frameworks and libraries to support data processing, quality, lineage, governance, analysis, and machine learning operations. Design, build, and maintain... 
    Senior

    United IT

    Mountain View, CA
    1 day ago
  •  ...Sr. Data Engineer Mountain View, CA / Denver, CO / Remote Full-Time Position Summary: We are looking for a Sr. Data Engineer to join our growing Data Platform and Engineering teams. The ideal candidate has significant experience in building scalable data platforms... 
    Senior
    Full time
    Remote work

    1872 Consulting

    Mountain View, CA
    9 hours ago
  • $181.1k - $272.1k

     ...believe we are just getting started. Do you have a strong passion for using data to drive business decisions, generate ideas, and inspire collaborators? We are seeking for a Senior Data Engineer to join our App Store Data team and play an integral role in helping the... 
    Senior
    Relocation

    Apple

    Cupertino, CA
    22 hours ago
  • $182k - $242k

     ...Nasdaq: CRWV) in March 2025. Learn more at . What You’ll Do The Data Engineering Team builds and operates the foundational data infrastructure...  ..., and actionable at scale. About The Role We're seeking a Senior Data Engineer to design and build the foundational datasets... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    3 days ago
  •  ...millions of patients worldwide.We’re a team of engineers, clinicians, and innovators united by one...  ...in robotic surgery requires high-quality data across the robotic platform, the surgical...  ...and the operating room environment. The Senior AI/Data Science Engineer will advance the... 
    Senior
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    Sunnyvale, CA
    3 days ago
  • $117k - $234k

     ...OfficePosition Summary...What you'll do...Role summary:The Senior Software Engineer will lead the delivery of scoped features and models through...  ...’s mission and operational goals.About the team:The MarTech Data Engineering team develops scalable, multi-tenant engineering... 
    Senior
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    18 hours ago
  •  ...Senior Analytics Engineer, GTM Santa Clara, California We're in an unbelievably exciting area of tech and are fundamentally reshaping the data storage industry. Here, you lead with innovative thinking, grow along with us, and join the smartest team in the industry... 
    Senior
    Flexible hours

    Everpure LLC

    Santa Clara, CA
    1 day ago
  • Senior Software Engineer - Data Protection Software Engineering (C, C++)Infrastructure Solutions Group (ISG) builds the products that power infrastructure, solutions, and data management our customers need most. Our teams design and develop the hardware and software that... 
    Senior

    Dell Technologies

    Santa Clara, CA
    18 hours ago
  • A leading technology firm is looking for a Remote Data Engineer with at least 10 years of experience, particularly in Google Cloud Platform. The role includes designing and optimizing analytical datasets, building robust data pipelines, and collaborating with product managers... 
    Senior
    Remote job

    Global Channel Management

    Santa Clara, CA
    4 days ago
  • $203.45k - $344.3k

     ...DescriptionDefine the overall architecture of the vehicle-cloud integrated data closed-loop from a strategic perspective, making it the core...  ...of data lifecycle costs, data architecture and closed-loop engineering system.Job ResponsbilitiesResponsible for the design and... 
    Senior
    Full time
    Temporary work
    Work experience placement

    XPENG Motors

    Santa Clara, CA
    3 days ago
  • Design, develop, and maintain scalable data processing pipelines and workflows using frameworks such as Apache Spark, PySpark, and...  ..., and privacy. Collaborate with data scientists, analysts, and engineers to support analytics and ML workflows. Lead complex migration initiatives... 
    Senior

    Jobtailor

    Santa Clara, CA
    4 days ago
  • $150.4k - $277.6k

     ...telling what you can accomplish. We are seeking an exceptional engineer with a background in large scale software development and delivery...  ...with a heavy focus on using cutting‑edge technologies to build data intensive systems, designing and optimizing data models, and collaborating... 
    Senior

    Apple

    Sunnyvale, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!