PySpark Data Engineer, Data Platform Specialist
IDC Technologies, Inc.
A technology company in California is seeking experienced Python engineers with a strong background in data engineering. Candidates must be proficient in Python and have knowledge of data structures and algorithms, as well as experience with data platforms like Apache Presto and AWS Athena. The role involves writing data collection scripts and implementing storage technologies. Familiarity with tools such as Docker and Kubernetes is a plus, and candidates will interact with the engineering team during the interview process. #J-18808-Ljbffr IDC Technologies
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the PySpark Data Engineer, Data Platform Specialist in Santa Clara, CA vacancy
- Enexus Global Inc. is seeking a Data Engineer in Sunnyvale, California, with up to 2 years of experience and a Master’s degree. The responsibilities... ...data tables. Ideal candidates will have experience with PySpark, Hadoop, Scala, and ETL. This role is focused on data...SuggestedLocal area
- A leading cybersecurity firm in California is seeking a seasoned Data Engineer to architect robust data frameworks. The role entails managing data projects from inception to deployment, ensuring high quality and performance. Candidates should have strong experience in SQL...Suggested
- CoreWeave is looking for a Senior Data Engineer to design and build the foundational datasets that will drive analytics and AI across the company. You will be instrumental in developing data models and curated products while collaborating closely with various business teams...Suggested
- ...supporting the planning and implementation of data design services, providing sizing and... ...data technologies. As a Senior Data Engineer, you will collect, aggregate, store, and... ...working with Azure Databricks Familiarity with PySpark Very good in communication, both verbal...Suggested
NutaNXT Technologies
Santa Clara, CA2 days ago $210.75k - $230k
...Data Engineer Job ID : DEKN26 Job Location: WinWire Technologies, Inc., 5201 Great America Pkwy., Suite 259, Santa Clara, CA 95054; and various... ...from various data sources to final warehouse; Create/Modify PySpark Databricks notebooks to apply the business transformations and...SuggestedRelocationWinWire Technologies
Santa Clara, CA4 days ago- ...Job Summary Seeking a Data Engineer with Spark & Streaming skills to build real-time, scalable... ..., and loading using Spark (PySpark/Scala) and streaming technologies (Kafka... ...data warehouses (BigQuery), and streaming platforms. Optimize Spark jobs, SQL queries, and...
Compunnel
Sunnyvale, CA2 days ago - Apple Inc. is looking for a Software Engineer (Data Solutions) in Sunnyvale, California, focused on building scalable and resilient cloud systems to power data exploration and analytics. The role involves integrating open source software with internal systems and driving...
- ...Data Engineer Rootshell Enterprise Technologies Inc. is a recognized provider of professional... ...with expertise in PL/SQL, Python, PySpark, and Scala to join our dynamic data engineering... ...and integrating with big data platforms like Apache Spark and Hadoop. Develop efficient...
Rootshell Inc
Santa Clara, CA4 days ago $179.06k - $198.95k
We are looking for a highly motivated Senior Performance Engineer to join our Data Protection and Security engineering organization. In this role... ...and resiliency initiatives across Cohesity’s distributed platform and services. You will work closely with engineering,...- ...Data Engineer Austin, TX / Sunnyvale, CA onsite Contract Role Description: Posting Title Data Engineer (Python,Java, SQL,Spark, PySpark, Java Spark) Count: 2 Description Looking for a Data Engineer who has a passion for building scalable and...Contract workImmediate start
Syntricate Technologies
Sunnyvale, CA1 day ago - ...Contract Data Engineer (API & Database Focus) We are seeking an experienced and highly skilled... ...processes (ETL/ELT) within the data platform. Manage and optimize data storage... ...ELT, and pipeline orchestration (e.g., PySpark, notebooks). Proficiency in a programming...Contract work
Mindlance
Sunnyvale, CA3 days ago $210.75k - $230k
...Assess and analyze the source system and data set expectation for data extracts. Apply... ...to final warehouse; Create/ Modify Pyspark data bricks notebooks to apply the business... ...Computer Science, Computer Science and Engineering, Computer Engineering, or related field....RelocationWinWire
Santa Clara, CA11 hours ago- 6267-Auris Health Inc. is seeking a Staff Data Engineer in Santa Clara, California. The role involves owning the data architecture and integration strategy, designing ETL/ELT pipelines, and ensuring data quality and compliance standards. A successful candidate will have...
- Please focus on spark/Pyspark with data experience. Must Have Skills : Python , Data Engineering Nice to have : Docker , Kuebernetes Looking for experiencedPython engineers... .... Should be familiar with modern data platforms likeApache PrestoorAWS Athena, andworkflow tools...
- Job Overview Need local candidates only. This position is for a Data Engineer with up to 2 years of experience and a Master’s degree.... ...experience. Master’s degree in a related field. Experience with PySpark, Hadoop, Scala, and ETL. Preferred Background in machine learning...Local area
$203.1k - $225.67k
...to work in the job location. Cohesity is a leader in AI-powered data security and management. Aided by an extensive ecosystem of... ...mission to shape the future of our industry. As a Staff Performance engineering, you will work as part of a team responsible for modeling,...Hourly payFull timeWork at office2 days per week3 days per week$200k - $220k
...of experts across energy, manufacturing, data center construction, and cloud services.... ...: Join Crusoe Energy as a Senior Data Engineer, an early and pivotal hire on our growing... ...architect and build the foundational data platform infrastructure that powers Crusoe's AI and...Full timeTemporary workWork at officeRemote workCrusoe
Sunnyvale, CA4 days ago- ...A technology solutions company seeks a skilled Back-End Engineer in Sunnyvale, California. You will design and maintain scalable data pipelines and back-end systems using Spark, Python, and Java. The role demands collaboration with data scientists and knowledge of cloud...
Robotics Prcocess Automation, LLC
Sunnyvale, CA1 day ago $184k - $287.5k
...NVIDIA’s Hardware Infrastructure organization is seeking a Senior System Software Engineer to lead the evolution of our next-generation Data & Observability Platform. We serve and collaborate directly with NVIDIA’s rapidly growing AI, HW, and SW engineering and research...NVIDIA
Santa Clara, CA3 days ago- ...Senior GCP Data Engineer Location: Sunnyvale, CA/Bentonville, AR - onsite Duration: 1... ...ecommerce / retail exp GCP, Python / scala, pyspark Requirements: GCP Experience • 4+... ...a distributed data processing platform with Hadoop, Hive or Spark, Airflow or...
Software Technology Inc
Sunnyvale, CA4 days ago - ...Azure Data Engineer As a Data Engineer on the Data Science and Platform team, you will: Develop and maintain data pipelines including solutions for data collection... ...Experience with Python, Scala. Expertise in Pyspark or Scala is a must. Hands on experience of...Work experience placement
Omega Solutions
Santa Clara, CA4 days ago $152k - $230k
...impact on the world. NVIDIA is hiring a Data Engineer within the Finance AI and Data Science... ...processing unstructured documents into our data platform, working closely with AI developers and... ...code (primarily in SQL, Python/PySpark), knowledge of scientific libraries for...Full time$181.1k - $272.1k
...California, United States Hardware What if the way an entire engineering organization worked with its data could be reinvented? On Apple's Battery Engineering... ...work with that data. You'll be building the platform the whole battery organization runs on. It's a rare chance...Relocation$153k - $222k
Decisive Point in Sunnyvale, California, is seeking a data engine team member to design and build large-scale data platforms. The role requires a Bachelor's degree in Computer Science and 2+ years of professional experience, focusing on backend engineering and cross-functional...- CoreWeave is looking for a Senior Engineer specializing in database and stream processing to enhance its data platform. This position offers the opportunity to work with a skilled team, manage data infrastructures, and contribute to exciting AI projects. The ideal candidate...
$77k - $202k
...Specialty/Competency: Data, Analytics & AI Industry/Sector: Not Applicable Time... ...PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...You Apart - Certification in Cloud Platforms [e.g., AWS Solutions Architect, AWS Data...Full timeH1bPwC
San Jose, CA3 days ago- A data analytics technology firm is seeking a skilled Back-End Engineer to design and maintain data pipelines. Key responsibilities include developing robust ETL processes using Spark, Python, and SQL while leveraging cloud technologies like AWS and GCP. Ideal candidates...
- A fast-growing healthcare data company in California seeks a talented Data Engineer to enhance their data platform. The role demands 5+ years of experience in Data Engineering, expertise in ETLs, big data, and proficiency in Python. This position offers the opportunity...
- ...outsourced product development and digital re-engineering. Leveraging our CaptiveCoE™ engagement... ...looking for a highly skilled and motivated Data Engineer with strong expertise in AWS data services to join our data platform team. The ideal candidate will have hands‑on...
- ...improvements. This position manages the installation and maintenance of mechanical systems at Data Centers and operations of specialized cooling systems. Acts as an Engineering resource for the complete H5 portfolio of mission critical facilities. Plans and monitors...Work at officeImmediate start
H5 Data Centers
Sunnyvale, CA13 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to PySpark Data Engineer, Data Platform Specialist. Be the first to apply!
Related searches
- remote data engineer Santa Clara, CA
- data engineer Santa Clara, CA
- software data engineer Santa Clara, CA
- big data cloud engineer Santa Clara, CA
- sr information security engineer Santa Clara, CA
- senior data quality engineer Santa Clara, CA
- data engineering intern summer Santa Clara, CA
- finance data engineer Santa Clara, CA
- data developer Santa Clara, CA
- data infrastructure engineer Santa Clara, CA