PySpark Data Engineer, Data Platform Specialist
IDC Technologies, Inc.
A technology company in California is seeking experienced Python engineers with a strong background in data engineering. Candidates must be proficient in Python and have knowledge of data structures and algorithms, as well as experience with data platforms like Apache Presto and AWS Athena. The role involves writing data collection scripts and implementing storage technologies. Familiarity with tools such as Docker and Kubernetes is a plus, and candidates will interact with the engineering team during the interview process. #J-18808-Ljbffr IDC Technologies
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the PySpark Data Engineer, Data Platform Specialist in Santa Clara, CA vacancy
- Enexus Global Inc. is seeking a Data Engineer in Sunnyvale, California, with up to 2 years of experience and a Master’s degree. The responsibilities... ...data tables. Ideal candidates will have experience with PySpark, Hadoop, Scala, and ETL. This role is focused on data...SuggestedLocal area
- A leading technology and logistics company in Sunnyvale is seeking a Software Engineer II to scale their data infrastructure. In this mid-senior role, you will work on high-performance data models, ensuring quality and reliability of data processes. The ideal candidate...Suggested
- Advanced Micro Devices, Inc. in Santa Clara is seeking a Senior Data Engineer to design, build, and optimize a modern data platform for high‑tech semiconductor operations. You will lead end‑to‑end data pipelines, implement a medallion lakehouse, and enable high‑quality...Suggested
$144k - $270.25k
At NVIDIA, we pride ourselves on data-driven decision-making, and the data science team is at the... .... We are looking for an excellent Sr. Data engineer with extensive data engineering experience for our data science platform supporting NVIDIA's cloud platform services....Suggested$212k - $318.4k
Overview Join us in building the machine learning platform that enables teams at Apple to build Apple Intelligence and many other... ...and service products. Description As a Machine Learning Data Platform Engineer, you'll design and build the scalable dataset management platform...SuggestedRelocation- What if the way an entire engineering organization worked with its data could be reinvented? On Apple’s Battery Engineering team, you’ll build the data... ...engineers work with that data. You’ll be building the platform the whole battery organization runs on. It’s a rare chance...
- CoreWeave is looking for a Senior Data Engineer to design and build the foundational datasets that will drive analytics and AI across the company. You will be instrumental in developing data models and curated products while collaborating closely with various business teams...
- ...next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems.... .... THE ROLE We are seeking a Senior Data Engineer to design, build, and optimize our next-generation data platform for high-tech semiconductor operations. You will...
- Apple is seeking a Software Data Engineer for its Games App Data Engineering team. You will shape the strategic direction of analytics solutions for game developers, working with a team dedicated to delivering insights from vast data sets while adhering to Apple's privacy...
- Walmart's Sam’s Club division seeks a Senior Engineering Manager for Agentic Data to evolve a massive data ecosystem into a semantic, context-aware layer... ...a cross-functional team bridging AI/ML, product, and platform engineering. You will shape Retrieval-Augmented...
- Qcells North America is seeking a Lead Data Engineer to architect and lead scalable, cloud‑based data platforms that support enterprise analytics and reporting. You will drive ETL/ELT frameworks, data governance, and Lakehouse patterns across Azure services. The ideal...
- ...Job Summary Seeking a Data Engineer with Spark & Streaming skills to build real-time, scalable... ..., and loading using Spark (PySpark/Scala) and streaming technologies (Kafka... ...data warehouses (BigQuery), and streaming platforms. Optimize Spark jobs, SQL queries, and...
Compunnel
Sunnyvale, CA2 days ago $85.12k
...Data Scientist $85,120.00 yearly. Full-time. Formulates... ...insights. Lead Data Engineer $114,100.00 yearly.... ...strong expertise in PySpark, distributed computing... ...training. Cloud Data Specialist (GhangorCloud) $28.00... ...data across multiple platforms, ensuring integrity and...Hourly payFull timeContract workTemporary workRemote workDay shiftPinnacle Group
Cupertino, CA4 days ago- Job Overview Need local candidates only. This position is for a Data Engineer with up to 2 years of experience and a Master’s degree.... ...experience. Master’s degree in a related field. Experience with PySpark, Hadoop, Scala, and ETL. Preferred Background in machine learning...Local area
$210.75k - $230k
Data Engineer Job ID : DEKN26 Job Location: WinWire Technologies, Inc., 5201 Great America Pkwy., Suite 259, Santa Clara, CA 95054; and various... ...from various data sources to final warehouse; Create/Modify PySpark Databricks notebooks to apply the business transformations and...Relocation- ...supporting the planning and implementation of data design services, providing sizing and... ...data technologies. As a Senior Data Engineer, you will collect, aggregate, store, and... ...with Azure Databricks Familiarity with PySpark Very good in communication, both verbal...
- ...presented as captured, with some text truncated due to incomplete source. Lead Data Engineer We are seeking a highly skilled and strategic Lead Data Engineer with strong expertise in PySpark … Data Engineer The Data Engineer is responsible for the integration build,...Remote work
$163.2k - $204k
...members. What You’ll Do: We are looking for an experienced Data Engineer to specialize in aviation data and analytics, focusing... ...in data processing technologies (e.g., Hadoop, Spark, PySpark) and real-time data platforms (e.g., Apache Kafka, Flink, Spark Streaming). Strong...Local areaArcher Aviation
San Jose, CA4 days ago$90k - $180k
Overview International Data Management (IDM) team powers enterprise‑scale data platforms across multiple global markets including... ...pipelines using Spark (Scala/PySpark), Airflow, and BigQuery.... ...strategies. Develop AI‑driven engineering solutions : Build internal tools...Temporary work- Please focus on spark/Pyspark with data experience. Must Have Skills : Python , Data Engineering Nice to have : Docker , Kuebernetes Looking for experiencedPython engineers... .... Should be familiar with modern data platforms likeApache PrestoorAWS Athena, andworkflow tools...
$210.9k - $316.9k
Apple Inc. is seeking a Data Engineering Lead in Cupertino, California. This role involves building data infrastructure and leading data modeling and ETL efforts. The ideal candidate will have extensive experience in architecting large-scale data solutions and mentoring...- ...planning and implementation of data design services, providing... ...data technologies. As a Data Engineering Consultant, you will collect,... ...experience in enterprise level data platforms involving implementation of... .... Familiarity with PySpark Very good in communication,...
$110k - $270k
...OpenData supports the industry by providing real-time reference data across the complete healthcare ecosystem, to support... ...excellence and customer success. In the role of Senior Software Engineer, Data Platform at Opendata, you'll spearhead the development of entirely new...Work at officeLocal areaRemote workWork from homeFlexible hoursGrabJobs
San Jose, CA4 days ago- Walmart's IDM team is seeking a data engineering professional to design and operate scalable data pipelines... ...markets. The role focuses on Spark/PySpark, Airflow, and BigQuery within the GCP ecosystem. You will contribute to platform modernization, cost optimization, and AI-...
- ...Azure Data Engineer As a Data Engineer on the Data Science and Platform team, you will: Develop and maintain data pipelines including solutions for data collection... ...Experience with Python, Scala. Expertise in Pyspark or Scala is a must. Hands on experience of...Work experience placement
Omega Solutions
Santa Clara, CA4 days ago - Walmart in Sunnyvale is looking for a Senior Software Engineer to lead projects and provide technical expertise in building cloud-based applications. The ideal candidate should have over 8 years of Java development experience, with a strong background in UI/UX and API...
$200k - $220k
...of experts across energy, manufacturing, data center construction, and cloud services.... ...Role: Join Crusoe Energy as a Senior Data Engineer, an early and pivotal hire on our growing... ...architect and build the foundational data platform infrastructure that powers Crusoe's AI...Full timeTemporary work- About the Role The Data Governance Platform team's mission is to build robust data platforms and establish policies that guarantee the analytics... ...You will report directly to the Data Governance Platform Engineering Manager. You must be located in the Bay Area or Seattle...Full timeTemporary workWork at officeLocal areaRemote work
- Apple is seeking a Data Engineer to build data systems and AI interfaces for its Battery Engineering team in Cupertino, California. This role involves expanding the Battery Data Warehouse (BDW) and developing BARD, the natural language interface that enhances data interaction...
- ...Ltd. (Home of Madegood) is seeking a dedicated Enterprise Data & Generative AI Engineer to bolster its data capabilities as part of its... ...engineering, integrating enterprise data with cloud lakehouse platforms. You will collaborate with various teams to implement scalable...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to PySpark Data Engineer, Data Platform Specialist. Be the first to apply!
Related searches
- data engineer analytics Santa Clara, CA
- junior data engineer remote Santa Clara, CA
- senior cloud data engineer Santa Clara, CA
- data platform engineer Santa Clara, CA
- data infrastructure engineer Santa Clara, CA
- aws data engineer Santa Clara, CA
- director data engineering Santa Clara, CA
- senior data integration developer Santa Clara, CA
- data engineer machine learning Santa Clara, CA
- data center engineer Santa Clara, CA