Senior Data Engineer - GCP
Robotics Prcocess Automation, LLC
Responsibilities Develop and enhance Python frameworks and libraries to support data processing, quality, lineage, governance, analysis, and machine learning operations. Design, build, and maintain scalable and efficient data pipelines on GCP. Implement robust monitoring, logging, and alerting systems to ensure the reliability and stability of data infrastructure. Build scalable batch pipelines leveraging Big query, Dataflow and Airflow/Composer scheduler/executor framework on Google Cloud Platform Design our data models for optimal storage and retrieval and to meet machine learning modeling using technologies like Bigtable and Vertex Feature Store Contribute to shared Data Engineering tooling & standards to improve the productivity and quality of output for Data Engineers across the company Minimum Basic Requirements Python Expertise: Write and maintain Python frameworks and libraries to support data processing and integration tasks. Code Management: Use Git and GitHub for source control, code reviews, and version management. GCP Proficiency: Extensive experience working with GCP services (e.g., BigQuery, Cloud Dataflow, Pub/Sub, Cloud Storage). Python Mastery: Proficient in Python with experience in writing, maintaining, and optimizing data processing frameworks and libraries. Software Engineering: Strong understanding of software engineering best practices, including version control (Git), collaborative development (GitHub), code reviews, and CI/CD. Data Management: Deep knowledge of data modeling, ETL/ELT, and data warehousing concepts. Problem-Solving: Excellent problem-solving skills with the ability to tackle complex data engineering challenges. Communication: Strong communication skills, including the ability to explain complex technical details to non-technical stakeholders. Data Science Stack: Proficiency in data analysis and familiarity with tools such as Jupyter Notebook, pandas, NumPy, and other Python data analysis libraries. Frameworks/Tools: Familiarity with machine learning and data processing tools and frameworks such as TensorFlow, Apache Spark, and scikit-learn. Bachelor’s or master’s degree in computer science, Engineering, Computer Information Systems, Mathematics, Physics, or a related field or software development training program ROBOTIC PROCESS AUTOMATION LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ROBOTIC PROCESS AUTOMATION LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ROBOTIC PROCESS AUTOMATION LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract #J-18808-Ljbffr Robotics Prcocess Automation, LLC
- Ethereum Technologies LLC is seeking a data engineer to develop Python data processing frameworks and scalable GCP pipelines. You will design data models for ML readiness using BigQuery, Dataflow, Vertex AI features, and Bigtable. You will implement robust monitoring, logging...Senior
- ...technology firm based in Mountain View, California is seeking a Data Engineer to develop and enhance Python frameworks for data processing... ...Platform. The ideal candidate should have extensive experience in GCP services and strong problem-solving skills. You will contribute...Senior
- Company descriptionOverviewWe are looking for a Senior Data Engineer with strong hands-on experience designing, building, and maintaining modern data platforms using Snowflake and Google Cloud Platform (GCP). This role will focus on data migration, data integration, and...Senior
- Octans Group LLC is seeking a strong Big Data Java Engineer based in California to join our data engineering team. You will work on large-scale data processing using Java, Spark, and cloud-based big data technologies. The role focuses on building resilient data pipelines...Senior
- ...reference. Recent update from client for this data engineer role / Request-ID: 13145-1 _ Bentonville, AR position... ..., which has closed with client UST. Looking for Senior Data Engineer with Spark, Scala, GCP experience. Location: This position will be...Senior
- Compunnel, Inc. is seeking a Data Engineer in Sunnyvale, California to build scalable, real-time data pipelines. The ideal candidate will work with technologies like Spark, Kafka, and GCP to facilitate data processing for analytics and machine learning. Key responsibilities...
- Redolent Infotech Pvt. Ltd. in Sunnyvale, CA seeks a Sr. Big Data Engineer to design, build and operate petabyte-scale data systems, with a... ...Python. 6-8 years of experience, Hadoop/Spark/Kafka and cloud tech (GCP/Azure) are required. #J-18808-Ljbffr Redolent Infotech Pvt....Senior
- A leading technology firm is looking for a Remote Data Engineer with at least 10 years of experience, particularly in Google Cloud Platform. The role includes designing and optimizing analytical datasets, building robust data pipelines, and collaborating with product managers...SeniorRemote job
- Job Summary Seeking a Data Engineer with Spark & Streaming skills to build real-time, scalable data pipelines using tools like Spark, Kafka, and cloud services (GCP) to ingest, transform, and deliver data for analytics and ML. Key Responsibilities Design, develop, and...Senior
$225k
...interviews which can be found here. Position TITLE: Senior Analytics Engineer EMPLOYER: ID.me, LLC (formerly known as: ID... ...View, CA Responsibilities Support our data infrastructure which includes Snowflake, dbt, Sigma, and GCP services. Educate the organization on...SeniorFull timeWork at officeRemote work$83.98 - $111.27 per hour
...Stanford Health Care is seeking a dynamic and experienced Senior Manager of Data Engineering to lead our data engineering teams. This role is critical... ...roadmap for our cloud-based data platforms (e.g., GCP, AWS, Azure) and data warehousing solutions (e.g., Databricks...SeniorHourly payFull time$153k - $204k
...provisioning and high‑reliability operations. About The Role As a Senior Data Engineer you will own and evolve the data lake and analytics stack... ...performance tuning. Knowledge of cloud platforms (e.g., AWS, GCP, Azure) and related data services (e.g., object storage,...SeniorPermanent employmentTemporary workCasual workWork at officeFlexible hours- Walmart is seeking a Senior Software Engineer to lead the delivery of scalable, secure software solutions across collaborative... ..., Python, PySpark, and Java to build distributed data pipelines on Spark and deploy on GCP. You will monitor performance and ensure reliability...Senior
- ...Job Title: Senior Software Engineer Data Infrastructure (Python | AWS/GCP | Kubernetes) Location: Redwood City, CA (On-site) We are seeking an experienced Software Engineer Data Infrastructure to build scalable data platforms that support AI/ML applications...SeniorFull time
$185k - $230k
The OpportunityWe are looking for a Senior Data Engineer to join our Data Platform team and build the core data foundations that power analytics, experimentation, and decision-making across the company. In this role, you will design and own foundational data models, pipelines...SeniorPermanent employment$175k - $221k
...feed ranking decision, every recommendation, every A/B test, and every ML model we ship runs on the data infrastructure you'd own. We're looking for a senior engineer to build and scale the batch and streaming pipelines at the core of that platform — someone who takes...SeniorFull timeLocal areaWork from home$148.75k - $361k
...disciplines.About the teamThe mission of Roku's Data Engineering team is to develop a world-class big... ...Roku Devices.About the roleAs a Senior Data Engineer on the Viewer Product Data... ...Computer Science preferredExperience with AWS, GCP, or LookerAI literacy and an AI growth...SeniorWork at officeLocal areaRemote workWorldwideMonday to ThursdayFlexible hours$174.72k - $295.68k
...learning, and smart connectivity.We are seeking a Machine Learning Data Curation Engineer to spearhead the data pipeline development and dataset... ...with Big Data tools and cloud platforms (e.g., AWS, GCP, BigQuery).Familiarity with ML frameworks (e.g., PyTorch, Hugging...SeniorFull time$180k - $258.75k
...project is harmonious with TRI’s robotics divisions' efforts in Diffusion Policy and Large Behavior Models.We are looking for a Senior Data Engineer to design and build the foundational data infrastructure and tools that power our autonomy research and development...SeniorFull timeLocal areaShift work$128k - $249k
...our search for talented visionaries and your search for important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI Platforms group,...SeniorFull timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift- ...performant and scalable batch and stream data processing infrastructure and solutions... ...the table: 6+ years of experience as senior/software engineer Experience with Python or Golang or Java... ...with cloud infrastructure like AWS/GCP/Azure Experience with relational or non...Senior
- ...‑class leadership team: Our Heads of AI, Engineering, and Product bring extensive experience from... ...together. The Role Kai is hiring a Sr. Data Engineer to join our data infrastructure... ...agnostic deployment across Azure, AWS, and GCP. Integrate and manage cloud data services...Senior
- ...ID.me is seeking a Senior Analytics Engineer to support the data infrastructure in Mountain View, CA. This role involves leading efforts to develop analytics and dashboards using Snowflake and dbt. The ideal candidate has 5+ years of experience in data analytics and SQL...Senior
- SpaceX is seeking a Sr. Supplier Development Engineer, Data Center (Starlink) in Palo Alto to lead supplier engagement from concept to production. The role involves cross-functional collaboration with internal engineering and manufacturing teams and suppliers to implement...Senior
- Senior Director - Data Engineering Location - Remote Role OverviewThe Director / Senior Director of Data Engineering is a dual-mandate role: you are... ...Spark Streaming), and cloud infrastructure (AWS, Azure, or GCP)Strong experience designing data architectures including...SeniorRemote work
- CoreWeave, a leading AI cloud provider, seeks a Senior Data Engineer to own the data lake and analytics stack powering observability for its global hardware fleet. You will maintain Iceberg, Trino, Airflow, Spark, and Superset, while delivering ETL pipelines, data models...Senior
$148.75k - $361k
...About the team The mission of Roku's Data Engineering team is to develop a world-class big... ...Roku Devices. About the role As a Senior Data Engineer on the Viewer Product Data... ...streamdown="list-item" ~ Experience with AWS, GCP, or Looker ~ p]:inline" data-...SeniorWork at officeLocal areaRemote workWorldwideMonday to ThursdayFlexible hours- brevian-careers is looking for an experienced Data Engineer to join our Engineering team in Sunnyvale, California. The ideal candidate will have a strong background in developing scalable, high-performance data systems, with a particular focus on enterprise data systems...Senior
- Build on and extend Allocate's data lakehouse on AWS Create robust ETL/ELT pipelines to ingest, clean, and transform data Work closely with data science and engineering team for AI/ML capabilities Partner with engineering team to deliver data and AI infrastructure Collaborate...Senior
- Title: Senior Data Engineer Location: Sunnyvale, CA Position: 2 Month (Contract) Summary Provide business insights, while leveraging internal tools and systems, databases and industry data Roles & Responsibilities Ability to document requirements, data lineage, subject...SeniorContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - GCP. Be the first to apply!
- data center engineer Mountain View, CA
- senior cloud data engineer Mountain View, CA
- data infrastructure engineer Mountain View, CA
- sr information security engineer Mountain View, CA
- data visualization developer Mountain View, CA
- remote data engineer Mountain View, CA
- etl data engineer Mountain View, CA
- data engineer analytics Mountain View, CA
- sr data engineer Mountain View, CA
- junior big data engineer Mountain View, CA


