Data Engineer
Purple Drive
Overview: ****Preferred location is Sunnyvale, CA although will accept candidates from Bentonville, AR. Job Description: We are seeking a skilled Data Engineer with strong expertise in Big Data, Cloud platforms, and distributed data systems . The ideal candidate will have hands-on experience in designing, building, and optimizing data pipelines, API integrations, and real-time stream-processing systems. Key Responsibilities:
- Design, develop, and optimize large-scale data pipelines and ETL workflows.
- Work with Java, Python, and Scala to build scalable data solutions.
- Develop APIs and integrate with systems using Node.js, GQL, and RESTful services .
- Implement big data solutions leveraging Hadoop, Hive, Spark (Scala), Presto/Trino, and Data Lake architectures .
- Deploy and manage workflows with Airflow, Luigi, Automic , and similar orchestration tools.
- Build and maintain real-time data streaming systems using Storm, Spark-Streaming, and Kafka .
- Utilize Vertex AI and Cloud services (AWS/GCP/Azure) for advanced analytics and ML integration.
- Ensure system reliability, scalability, and performance in distributed environments.
- Collaborate with cross-functional teams (data scientists, analysts, and engineers) to deliver high-quality data solutions.
- Apply best practices in CI/CD, Kubernetes-based deployments, and monitoring.
- Strong programming skills in Java, Python, and Scala .
- Expertise in big data frameworks : Hadoop, Hive, Spark (Scala).
- Hands-on with API development (REST, GraphQL, Node.js).
- Experience with stream-processing tools : Kafka, Storm, Spark-Streaming.
- Proficiency with workflow orchestration : Airflow, Luigi, Automic.
- Knowledge of Presto/Trino and distributed SQL query engines.
- Cloud experience (AWS, GCP, or Azure), with exposure to Vertex AI .
- Strong understanding of Data Lake and data warehousing concepts .
- Experience with Kubernetes for container orchestration.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Sunnyvale, CA vacancy
$251k - $310k
...U.S. states. This role follows a hybrid work schedule and reports to Sr. Staff TLM. You will: Lead, mentor, and grow a team of data engineers responsible for the Waymo Commercialization Data Lake and associated data pipelines. Define and drive the technical vision, strategy...SuggestedFull timeRemote work- ...NewRocket is looking for an AI Data Intelligence Lead who will design AI-powered capabilities for modernizing enterprise data. This... ...entails applying machine learning, generative AI, and advanced data engineering to enrich and optimize enterprise data. Ideal candidates will...SuggestedRemote work
- ...Lead Data Engineer RadiumOne is seeking a Lead Data Engineer to join our Data Technology team with the responsibility of designing and implementing scalable data infrastructure, as well as implementing data transformations developed by data scientists as scalable and...Suggested
- ...Hi, Position: Lead Data Engineer Location: Sunnyvale, CA/ Austin, TX (Onsite) Ex-Apple is preferred but if we don't find non-ex-apple are also ok. Job Description: Role Overview We are seeking a highly skilled and strategic Lead Data Engineer...Suggested
- ...Role: Lead Data Engineer Location: Mountain View, CA / Dallas, TX (Onsite) About the Role Data team builds and operates the data marts and pipelines that power HR/Workforce reporting and analytics across Intuit. We're looking for a hands-on Data Engineer...Suggested
$73 per hour
...Data Engineer MAHIN-JOB-35556 We are looking for Data Engineer in Sunnyvale,CA Day 1 onsite ( 3 days a week hybrid) FTE- 130k per annum + benefits Subcon-73 $ per hour ( no layers are accepted) Job Description: Strong Python development and software...Hourly pay3 days per week1 day per week$135k - $180k
...PlusAI in Santa Clara is seeking a talented Software Engineer to create and maintain an optimal data processing pipeline architecture. You will build the required infrastructure, automate processes, and provide actionable insights into business performance metrics. The...- ...growing, and we are looking for a highly motivated Principal Software Engineer who is a self-starter and will play a critical role in the... ...Technology team, you will be building highly scalable and reliable APIs, data-pipelines, services, and applications which will drive the next...Local area
- ...Job Title Primary Responsibilities: Expertise in SQL: You possess a deep understanding of SQL for data manipulation, querying, and performance optimization across various database systems. Proficiency in Python: Your Python skills are crucial for building...
- ...test and deploy cutting edge solutions at scale, impacting millions of customers worldwide drive value from data at Walmart Scale Interact with Walmart engineering teams across geographies to leverage expertise and contribute to the tech community. Engage with...Worldwide
- ...Data Engineer Location: Mountainview, CA (Hybrid 3 days' work from office) C2C pay rate: $70-75/hr for both the roles. Role Summary: Responsible for designing and building graph data models, knowledge graphs, and data pipelines optimized for GraphRAG and reasoning...Work at office
- ...Apple in Santa Clara, CA is seeking an experienced Data Engineering Manager to lead data programs, architectures, and pipelines across large‑scale data products. You will guide delivery, collaborate with cross‑functional teams, and mentor engineers to ensure high quality...
- ...Data Strategy Understands, articulates, and applies principles of the defined strategy to routine business problems that involve a single function. Data Transformation and Integration Extracts data from identified databases. Creates data pipelines and transform...
- ...TekWissen is seeking an onsite 1st shift Systems Design Engineer for a global semiconductor client in Austin. You will debug HW/SW, monitor... ...Linux scripting, GPU/firmware debugging, and experience with data center platforms. Collaboration with OEMs and vendors is essential...Day shift
$210.75k - $230k
...Data Engineer Job ID : DEKN26 Job Location: WinWire Technologies, Inc., 5201 Great America Pkwy., Suite 259, Santa Clara, CA 95054; and various unanticipated locations in the US Assess and analyze the source system and data set expectations for data extracts. Apply the...Relocation- ...Job Description Launch Your Data Career with Proof, Not Promises-At SynergisticIT If you're serious about starting a high-impact, high-paying career in Data Science, Analytics, or Engineering , it's time to stop guessing and start choosing results. At SynergisticIT...
- ...Data Engineer Location: Santa Clara, CA Client: Intuit Duration: 6 months Rate: Max $56-58/hr on C2C All visa documents to be submitted along with submission Required Skills: ~ SQL – Must have, need to be strong ~ ETL skills – must have ~ Infa...
- ...Position- Data Engineer Duration- Contract Location- Cupertino, CA JD Minimum 6+ years of experience working as a Data Engineer Experience building data pipelines with Python and R Willingness to learn new technologies and implement POCs...Contract workImmediate start
- Coupang is seeking a skilled Database Engineer in Mountain View, California, to join the Customer Success team. You will be responsible for ensuring the reliability and performance of databases in a high-traffic e-commerce environment. The role requires strong expertise...
$111.8k - $134.3k
...and CE Offline teams to execute on the following projects Key Responsibilities Migrate 2 Bureau Gateway Report Service into Partner Data Service (Experian Gateway Report Service and Equifax Gateway Report Service) Test coverage – 100% when the migration is done Onboard...Contract workWork at office- ...Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking Data Engineer for one of our client, Please share your resume with current location & full contact info Role:Data Engineer Location...
- • 10+ years of overall experience in data management space and at least 5 years of working in large data sets in a data lake environment : • Highly proficient in SQL, • Solid understanding of Spark including performance tuning. • Solid understanding of the AWS Platform...
- ...Role Overview: This role focuses on comprehensive data management, from strategy and source identification to transformation, modeling, and governance. The Data Engineer will be responsible for developing data pipelines, designing data models, writing code for solutions...
- ...Data Engineer Cupertino, CA ***Only share profile, who is interested to appear for face to face interview in Cupertino, CA*** • 8+ years of experience in Data Engineering with advanced SQL skills • Good with Python programming and experience with Data...
- ...PlusAI is seeking a data engineer to create and maintain optimal data processing pipeline architecture in Santa Clara, California. The role involves building infrastructure for data extraction, transforming, and loading, while also automating manual processes and optimizing...
- ...Data Engineer Location: Austin, TX/Sunnyvale, CA Job Description We are seeking an experienced Data Engineer with proven, hands-on expertise in migrating enterprise database workloads from Oracle to PostgreSQL. The ideal candidate will lead/support end-to-end...
- ...time platform that transforms continuous streams of multimodal data (including structured, image, and log data) into an intelligent... ...QUALIFICATIONS Masters Degree 10+ years of experience in data engineering, including building and maintaining large-scale ETL/ELT data pipelines...
- ...Samsung Electronics Perú is seeking a Sr. Data Engineer to contribute to scalable data pipelines and support the Performance & Reach engineering organization. You will work with large advertising datasets and collaborate with cross-functional teams to deliver data solutions...
- ...Dexian is seeking a Data Engineer for a 100% remote, 4+ month engagement. You will build and maintain dashboards, Hive tables, and scalable ETL/ELT data pipelines for a ProdOps team. The role requires 3+ years of experience with strong SQL (Presto/Hive), Python, data warehousing...Remote workWorldwide
- ...Title: Snowflake Data Engineer Location: Sunnyvale, CA (Hybrid) Duration: 6 months (possibility of extension) Implementation Partner: Infosys End Client: To be disclosed JD: Required Skills Snowflake Keystone AI/ML skills...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- software data engineer Sunnyvale, CA
- entry level big data engineer Sunnyvale, CA
- big data developer Sunnyvale, CA
- senior data quality engineer Sunnyvale, CA
- sr data engineer Sunnyvale, CA
- junior big data engineer Sunnyvale, CA
- big data cloud engineer Sunnyvale, CA
- senior cloud data engineer Sunnyvale, CA
- data developer Sunnyvale, CA
- data science developer Sunnyvale, CA

