Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

PySpark Data Engineer, Data Platform Specialist

IDC Technologies, Inc.

A technology company in California is seeking experienced Python engineers with a strong background in data engineering. Candidates must be proficient in Python and have knowledge of data structures and algorithms, as well as experience with data platforms like Apache Presto and AWS Athena. The role involves writing data collection scripts and implementing storage technologies. Familiarity with tools such as Docker and Kubernetes is a plus, and candidates will interact with the engineering team during the interview process. #J-18808-Ljbffr IDC Technologies

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the PySpark Data Engineer, Data Platform Specialist in Santa Clara, CA vacancy
  •  ...I am reaching out to you on an exciting job opportunity with one of our client. Position: Data Engineer/ Marketing Platforms Data Specialist Location: Sunnyvale, CA (Onsite) Duration: Contract/Fulltime (Open for both) Experience : 10... 
    Suggested
    Full time
    Contract work

    Diverse Lynx

    Sunnyvale, CA
    11 hours ago
  •  ...Data Engineer Bachelor or master’s degree in computer science, Software Engineering, or...  ...Skills Needed or Required? GCP, Airflow, Pyspark, Tableau. Build and maintain robust,...  ...its advertising needs. Work on cloud platforms like Azure and Google Cloud for data... 
    Suggested
    Work at office
    2 days per week

    Samprasoft

    Sunnyvale, CA
    4 days ago
  •  ...implementation, and support of solutions big data solution in Hadoop using Hive, Spark,...  ...but preferably hybrid in Sunnyvale. Data engineer with more than 4-5 yrs.’ of experience....  ...Qualifications Have experience with Python, PySpark (Highly Used), Scala, Spark, GCP, Airflow... 
    Suggested
    Remote work

    Samprasoft

    Sunnyvale, CA
    4 days ago
  •  ...Data Engineer Sam's Cash Core Team is looking for a savvy Data Engineer to join our growing...  ...on Databricks on Azure Cloud platform, deep understanding on Delta lake, Lake...  ...experience on Python, Shell scripting, PySpark, and other data programming language.... 
    Suggested

    Samprasoft

    Sunnyvale, CA
    3 days ago
  • Enexus Global Inc. is seeking a Data Engineer in Sunnyvale, California, with up to 2 years of experience and a Master’s degree. The responsibilities...  ...data tables. Ideal candidates will have experience with PySpark, Hadoop, Scala, and ETL. This role is focused on data... 
    Suggested
    Local area

    Enexus Global Inc.

    Sunnyvale, CA
    2 days ago
  • A leading cybersecurity firm in California is seeking a seasoned Data Engineer to architect robust data frameworks. The role entails managing data projects from inception to deployment, ensuring high quality and performance. Candidates should have strong experience in SQL... 

    CrowdStrike

    Sunnyvale, CA
    4 days ago
  • $45 - $48 per hour

     ...Duration: 12+ Months  Location: Sunnyvale, CA Pay Range: $45 - $48 per hour on W2 Job Summary: We are seeking a Senior Data Engineer & Platform Architect to design, develop, and oversee a contemporary data platform aimed at enhancing engineering and manufacturing... 
    Hourly pay
    Contract work

    Akraya

    Sunnyvale, CA
    3 days ago
  •  ...professionals, they continue to develop new, minimally invasive surgical platforms and future diagnostic tools to help solve complex healthcare...  ..., Pennsylvania, South Carolina, and Tennessee. Senior Data Engineer - Data Platform & Analytics (Snowflake, Kafka, React) on a... 
    Contract work
    For contractors
    Remote work
    Flexible hours
    1 day per week

    The Mom Project

    Sunnyvale, CA
    3 days ago
  • BBG Ventures, LLC is seeking a Senior Data Engineer for their Sunnyvale, CA location. This hybrid position involves designing and operating a modern data platform to support analytics. Responsibilities include developing data pipelines, building interactive visualizations... 
    For contractors

    BBG Ventures, LLC

    Sunnyvale, CA
    2 days ago
  • A leading technology company in California seeks a Senior Software Engineer to develop innovative video analytics solutions using advanced AI technologies. The role demands strong experience in C++ and Python, along with a deep understanding of machine learning systems... 

    NVIDIA Corporation

    Santa Clara, CA
    2 days ago
  •  ...technology company specializing in robotic products seeks a Senior Data Engineer to support their analytics needs in Sunnyvale, CA. This...  ...extensive experience in data engineering, strong skills in cloud platforms, and proficient in React.js and SQL. A competitive salary and... 
    Contract work
    For contractors

    The Mom Project

    Sunnyvale, CA
    3 days ago
  • $179.06k - $198.95k

     ...location. Cohesity is a leader in AI‑powered data security and management. Aided by an...  ...for a highly motivated Senior Performance Engineer to join our Data Protection and Security...  ...initiatives across Cohesity’s distributed platform and services. You will work closely with... 
    Full time

    Cohesity

    Santa Clara, CA
    3 days ago
  •  ...Data Engineer In Sunnyvale CA IDC Technologies Inc. Please focus on spark/Pyspark with data experience. Must Have Skills: Python, Data Engineering Nice to have...  ...engineering. Should be familiar with modern data platforms like Apache Presto or AWS Athena, and... 

    IDC Technologies

    Sunnyvale, CA
    3 days ago
  • $210.75k - $230k

     ...Assess and analyze the source system and data set expectation for data extracts. Apply...  ...to final warehouse; Create/ Modify Pyspark data bricks notebooks to apply the business...  ...Computer Science, Computer Science and Engineering, Computer Engineering, or related field.... 
    Relocation

    WinWire

    Santa Clara, CA
    11 hours ago
  •  ...Data Engineer Austin, TX / Sunnyvale, CA onsite Contract Role Description: Posting Title Data Engineer (Python,Java, SQL,Spark, PySpark, Java Spark) Count: 2 Description Looking for a Data Engineer who has a passion for building scalable and... 
    Contract work
    Immediate start

    Syntricate Technologies

    Sunnyvale, CA
    11 hours ago
  •  ...experienced and highly skilled Contract Data Engineer. This role is focused on building...  ...ELT, and pipeline orchestration (e.g., PySpark, notebooks). Proficiency in a programming...  ...). Experience working with cloud platforms (e.g., AWS, Azure, GCP) where Snowflake... 
    Contract work
    Work experience placement
    Immediate start
    Remote work

    Artech

    Sunnyvale, CA
    4 days ago
  • $117k - $234k

     ...critical business initiatives with Data. You love writing and owning...  ...this data. Partner with engineering, AI/ML, and product teams to...  ...monitor products on cloud platforms with agent observability , telemetry...  ...or Scala ; experience with PySpark/Spark for distributed data... 
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    2 days ago
  •  ...services in the US. We are actively seeking Data Engineer for one of our client, Please share...  ...with expertise in PL/SQL, Python, PySpark, and Scala to join our dynamic data engineering...  ...and integrating with big data platforms like Apache Spark and Hadoop. Develop efficient... 

    Rootshell Enterprise Technologies

    Santa Clara, CA
    2 days ago
  •  ...Data Engineer Location: Sunnyvale, CA (Hybrid – 2 days on Site) Duration: 4 months Rate: DOE U.S. Citizens and those who are authorized...  ..., GitHub, Pagespeed, and Azure cloud. Additional skills: Pyspark, Azure Databricks, Azure Data Factory, Python, Structured... 

    Georgia IT Inc

    Sunnyvale, CA
    8 days ago
  •  ...Data Engineer With Python Location: Bellevue, WA or Santa Clara, CA (Onsite day 1) Duration: 6+ Months Job Description: ~6+...  ...systems engineering, infrastructure, security, networking, data & analytics) ~ Minimum 3 years’ experience with Python, PySpark... 

    Zortech Solutions

    Santa Clara, CA
    3 days ago
  • $143k - $286k

     ...Position Summary... What you'll do... Principal Data Engineer – Agentic Data Platforms The Mission As a Principal Data Engineer , you...  ...Python, Java, or Scala. Deep experience with Spark/PySpark and SQL optimization at scale. Strong systems thinking... 
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    5 days ago
  • Job Overview Need local candidates only. This position is for a Data Engineer with up to 2 years of experience and a Master’s degree....  ...experience. Master’s degree in a related field. Experience with PySpark, Hadoop, Scala, and ETL. Preferred Background in machine learning... 
    Local area

    Enexus Global Inc.

    Sunnyvale, CA
    2 days ago
  • $177.8k - $240.5k

     ...history, this is the place for you. The ASP Data Engineering Team supports the data needs of the AWS Specialist and Partner Organization, a worldwide team of specialists...  ...'s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped... 
    Local area
    Worldwide
    Flexible hours

    Amazon

    Mountain View, CA
    2 days ago
  • $198.2k - $420k

     ...design, build, and operate scalable data pipelines and platforms that enable analytics, reporting, and...  ...and combine cloud native software engineering, enterprise data engineering, and production...  ...Hands-on experience with PySpark, Databricks, and big data processing... 
    Permanent employment
    Full time
    Worldwide
    Flexible hours

    SAP

    Stanford, CA
    4 hours ago
  •  ...Data Platforms Engineer Location: Cupertino, CA, 95014 (3 Days Onsite, Tue, Wed, Thu) Duration: 10+ Months Only W2 Primary Skill...  ...modeling Big Data technologies (Spark, Kafka) Knowledge of PySpark would be excellent Basic modeling (Regression, Decision... 

    Apolis

    Cupertino, CA
    2 days ago
  • $45 per hour

     ...2026 - June 8th, 2026 - June 22nd, 2026 About the team: The Data Platform Global Live team is dedicated to empowering the growth of TikTok...  ...support to enhance live performance for streamers. As a data engineer in the Global Live team, you will have the opportunity to... 
    Hourly pay
    Summer work
    Internship
    Local area

    Tik Tok

    San Jose, CA
    4 days ago
  •  ...human speed bottlenecks. The Kai Agentic AI Platform replaces fragmented, human-limited...  ...class leadership team: Our Heads of AI, Engineering, and Product bring extensive experience...  ...the Role We are looking for a Senior Data Engineer (AI Platform) to design and build... 

    Kai Cyber, Inc.

    San Jose, CA
    3 days ago
  • $130.75k - $181k

     ...About the Role/Team Join Eightfold’s core Data Platform team to design, develop, and maintain the large-scale software platforms that...  ..., horizontal scalability, and load balancing. Performance Engineering: Drive the scaling, optimization, and innovation of the Data... 
    Permanent employment
    Work at office
    3 days per week

    Eightfold LLC

    Santa Clara, CA
    2 days ago
  • $154.85k - $196.35k

    A forward-thinking home equity firm is seeking a Senior Data Engineer to enhance its data capabilities. This role includes owning a large model dbt platform, building ETL pipelines with Airflow, and optimizing Snowflake. Candidates should have over 5 years of relevant... 
    Remote work

    Point

    Palo Alto, CA
    1 day ago
  • $200k - $220k

     ...of experts across energy, manufacturing, data center construction, and cloud services....  ...Join Crusoe Energy as a Senior Data Engineer, an early and pivotal hire on our growing...  ...architect and build the foundational data platform infrastructure that powers Crusoe's AI and... 
    Full time
    Temporary work
    Work at office
    Remote work

    Crusoe

    Sunnyvale, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to PySpark Data Engineer, Data Platform Specialist. Be the first to apply!