Data Engineer
InterSources Inc
Azure Databricks Technical Lead We are looking for a highly skilled Senior Azure Databricks (ADB) Developer to join our Data Engineering team. This role involves developing large-scale batch and streaming data pipelines on Azure Cloud. The ideal candidate will have strong expertise in Python, Databricks Notebooks, Apache Spark (including Structured Streaming), and real-time integration with Kafka. You will work with both relational databases like DB2 and NoSQL systems such as MongoDB, focusing on performance optimization and scalable architecture. Key Responsibilities: Design and Develop: Create real-time and batch data pipelines using Azure Databricks, Apache Spark, and Structured Streaming. Data Processing: Write efficient ETL scripts and automate workflows using Python. Data Integration: Integrate with various data sources and destinations, including DB2, MongoDB, and other enterprise-grade data systems. Performance Optimization: Tune Spark jobs for optimal performance and cost-effective compute usage on Azure. Collaboration: Work with platform and architecture teams to ensure secure, scalable, and maintainable cloud data infrastructure. CI/CD Support: Implement CI/CD for Databricks pipelines and notebooks using tools like GitHub and Azure DevOps. Stakeholder Communication: Interface with product owners, data scientists, and business analysts to translate data requirements into production-ready pipelines. InterSources
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Pleasanton, CA vacancy
- Title: Lead Data Engineer - Data & AI, Supply Chain Client: Gap Location: Onsite - Pleasanton, CA Duration: 6-12 months Visa: USC/GC Rate: $68/hr W2 Interview Process: 1 video interview followed by onsite interview Mandatory: Retail/fashion industry experience required...Suggested
- ...About the role The Project Engineer provides end-to-end technical leadership for assigned customer deployments, from requirements discovery... ...technical certifications (CCNP, CCDP, JNCIP) in networking, data center infrastructure, servers, storage, virtualization, audiovisual...SuggestedWorldwide
Computacenter AG & Co. oHG
Livermore, CA17 hours ago - Job-ID15409644Reference21-00142Objective & Deliverables The Big Data Engineer shall lead the Big Data Engineering team. The consultant will play the role of technical lead and provide professional services to support the long term IT strategy and planning to include high...SuggestedWork experience placement
Intelliswift
Pleasanton, CAa month ago - Purple Drive DATA ENGINEER Share Contractual Pleasanton, CA PDT - 9329 12-15 Job Summary: The Senior Data Engineer will be responsible for designing, building, and maintaining robust data pipelines and architectures on AWS to support scalable data processing, storage, and...Suggested
- Bachelor's degree or equivalent experience in computer science, applied math, physics, engineering, statistics, economics or related field. 3+ years of industry experience in Data Engineering 3+ years of work experience including hands-on technical experience with SQL...SuggestedWork experience placement
- ...Job Description In this role as Data Analytics Engineer, In this role, you will build and maintain data pipelines, tools, and visualizations to enable organizational insights. You'll develop KPI reports, partner with engineers on data architecture, investigate metric...Remote workFlexible hours
Venturesoft
Pleasanton, CA2 days ago - Remote - CST Hours, Within US only Max Vendor Rate - *** Senior/Lead Data Engineer Position Summary Seeking a hands-on Senior/Lead Data Engineer with 8+ years of experience to design, build, and support scalable cloud data solutions for healthcare reporting, analytics,...Remote work
- ...below job requirement and let me know if you are good to submit with the below details filled and your latest resume ASAP. Lead Data Engineer - Data & AI, Supply Chain Location: Pleasanton CA Duration - 12 months Key Responsibilities Design, develop, and implement scalable...Immediate start
- DBT / SQL Developer - Data Engineering Our client, a IT Services and Consulting company, is looking for a DBT / SQL Developer - Data Engineering for their Pleasanton, CA - Hybrid (50% onsite) location. Responsibilities: We are seeking a Senior Data Engineer / DBT Developer...
- InfoVision Inc. seeks a Lead Data Engineer to design and implement scalable data pipelines on Google Cloud Platform, delivering data products for analytics and operations in a Pleasanton, CA location. You will lead data engineering initiatives, collaborate with cross-functional...
- Data Piper in Pleasanton, California is seeking a full-time developer experienced in Palantir Foundry. The role involves architecting solutions, collaborating across global teams, and developing frameworks for client-specific offerings. The ideal candidate will have hands...Full time
- ...Mandatory Skills: Azure Databricks (ADB), Azure Data Factory (ADF), Azure Analysis Service (AAS), SQL Job Summary We are seeking a skilled Azure Data Engineer with strong hands-on expertise in Azure Databricks (ADB), Azure Data Factory (ADF), and SQL...
Omni Inclusive
Pleasanton, CA2 days ago - Computacenter (UK) Ltd in the United States, California, Livermore seeks a Project Engineer to provide end-to-end technical leadership for customer deployments. You will translate customer requirements into executable designs and oversee build, validation, and technical...
- ...customer relationships. This position offers the chance to work in a fast-paced, dynamic environment that’s constantly evolving.The Data Engineering team at Albertsons is looking for people who are excited about reimagining the grocery experience by harnessing the power of...Minimum wageLocal areaFlexible hoursShift work
Albertsons Companies
Pleasanton, CA6 days ago - Purple Drive Data Platform Engineer Share Contractual Pleasanton, CA PDT - 7314 8-14 Overview: Key Skills required: Snowflake, Fivetran, NewRelic, Apache Kafka, Plunk, Monte Carlo, Atlan, AWS, S3, Kubernetes, OAuth 2.0, Private link. Purple Drive
$55.1k - $137.5k
...an inclusive environment, empowering our employees to be their authentic selves. We are actively seeking an experienced Data Center Engineer for our Infrastructure Reliability team. This person will be responsible for building and installing multiple hardware components...Temporary workWork at officeRemote workWorldwideFive9
San Ramon, CA4 days ago- ...network inefficiency, API delays, identifying and resolving issues, providing solutions for IOT devices such as PDU/UPS deployed in data centers. Use different possible troubleshooting methods, tools to isolate network and service issues to identify the cause via splunk...
Kaav Inc.
Fremont, CA5 days ago - ...JOB DESCRITION: Role: Python With Data Engineer Client: Mizuho Bank Location: New York city, NY - Hybrid Duties • Integration engineer responsible for daily support and project based development of credit risk management systems. • ETL developers...Full time
Info Way Solutions
Fremont, CA3 days ago $114k - $180k
What this Job Entails: We are looking for a Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional...Full timeTemporary workWork at officeRemote workAstreya
Fremont, CA13 days ago- A technology service provider is looking for a candidate to develop security data-analytics solutions, including creating Splunk APPS and maintaining the life-cycle of custom applications. The role involves integrating web frameworks for dashboards and reports as per customer...
- Data EngineerAs an Azure Data Engineer you should have subject matter expertise integrating, transforming, and consolidating data from various structured and unstructured data systems into structures that are suitable for building integration and analytics solutions.Responsibilities...
- ...MatchPoint is a fast-growing, young, energetic global IT-Engineering services company with clients across the US. We provide technology solutions... .... We look forward to hearing from you! Role: Senior Data Engineer Contract Length: 12+ Months Location: San...Contract workLocal area1 day per week
Match Point Solutions
San Ramon, CA2 days ago $60k - $148.5k
Job Title: Data Engineer City: Fremont State/Province: California Posting Start Date: 8/12/26 Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most...Minimum wageLocal area- Job Title : Data Engineer Location : Dublin, CA Hybrid Onsite 2-3 days Roles & Responsibilities Provide L3 escalation support for existing production systems and assist with related enhancement activities. Ensure proper testing and adherence to business change management...
- Job Description: The Data Engineer will be based in Fremont, California. In this position, you will report to the Senior Manager of Systems Architecture. We are looking for a talented, early-career data engineer to help us build and maintain the data pipelines that ingest...Work experience placementWorldwide
- Create and maintain optimal data pipeline architecture Assemble large, complex data sets that meet functional / non-functional business requirements Identify, design, and implement internal process improvements, including automating manual processes, optimizing data delivery...Work at office
$105k - $131.26k
...your skills and knowledge to make a difference in our members' lives, Patelco could be the perfect fit for you. Overview The Data Engineer is a key contributor to Our Data & Analytics Strategy to transform Patelco as a Data-driven organization and position Credit Union...Full timeTemporary workPart timeWork experience placement- ...Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking Data Engineer for one of our direct client in Fremont, CA . Please share your resume with current location & full contact info Job role: Data...Remote work
- Data Engineer The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. Responsibilities: Identify, design...
- Workday in Pleasanton, CA seeks an experienced data engineer to develop large-scale distributed systems that provide real-time insights across platforms. The role requires deep expertise in software development, including Java, Python, and machine learning. Candidates should...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data engineer machine learning Pleasanton, CA
- data science developer Pleasanton, CA
- finance data engineer Pleasanton, CA
- data engineer analytics Pleasanton, CA
- data center engineer Pleasanton, CA
- data engineer Pleasanton, CA
- senior cloud data engineer Pleasanton, CA
- senior data center engineer Pleasanton, CA
- data developer Pleasanton, CA
- data engineering intern summer Pleasanton, CA