Azure Data Engineer
Omega Solutions
Azure Data Engineer
As a Data Engineer on the Data Science and Platform team, you will:
- Develop and maintain data pipelines including solutions for data collection, management and usage.
- Work closely with Data Scientists to optimize and reengineer model code to be modular, efficient and scalable, and to deploy models to production.
- Maintain and enhance our data and computation platform.
- Develop and implement solutions for data quality validation and continuous improvement.
- Manage, execute and monitor weekly and monthly production operations; resolve and escalate production issues as appropriate.
- Partner with business stakeholders to understand business and technical requirements, plan and execute projects, and communicate status, risks and issues.
- Perform root cause analysis of system and data issues and develop solutions as required.
Qualifications
- BA/BS in business, computer science or other technical field or 5+ years of appropriate work experience
- Proficient in Azure SQL Data Warehouse, T-SQL and database architecture.
- Implement data warehouses and analysis services as part of a modern data warehouse (MDW) design
- Experience working with cloud-based technologies, including relational databases, data warehouse, big data (Spark), orchestration/data pipeline tools, data frames concepts, Spark Streaming and Spark SQL
- Experience with Azure Analytics stack, Azure Data Lake, Azure Databricks, Azure Data Factory.
- Experience with ETL data pipelining concept.
- Proficient in Power BI
- Experience working in software engineering, and can demonstrate best practices for project management, quality control, and product development.
- Proven track record of collaborative development in an agile team environment.
- Experience with Python, Scala. Expertise in Pyspark or Scala is a must.
- Hands on experience of writing notebooks in Databricks using python for complex data aggregations, transformations, schema operations.
Preferred:
- Experience with Cosmos DB
- Significant experience with utilizing Azure Analysis Services
- Experience with Airflow
- Elastic Search
- Experience in Java
- Experience building APIs and services using REST
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer in Santa Clara, CA vacancy
- ...Azure Principal Data Engineer Work mode: Hybrid Onsite Location(s): Valencia, CA, US, 91355 Additional Location(s): US-CA-Santa Clara; US-MN-Arden Hills Diversity - Innovation - Caring - Global Collaboration - Winning Spirit - High Performance At Boston Scientific,...SuggestedFull timeWork at officeLocal areaRelocation package3 days per week
Boston Scientific
Santa Clara, CA1 day ago - ...Data Engineering Lead Responsibilities: Design, develop, test, and deploy Data Engineering pipelines on Azure cloud platform. Provide technical leadership and guide the team. Analyze and profile the data to understand and resolve the data quality issues. Participate...Suggested
Omega Solutions
Santa Clara, CA4 days ago $210.75k - $230k
Winwire Technologies is seeking a Data Engineer in Santa Clara, CA. The role requires assessing source systems, developing ETL solutions in Azure, and automating data extraction from SAP. An ideal candidate will have a Bachelor's degree in Computer Science and 5 years of...Suggested- ...Medium is looking for an ETL Data Engineer to join their dynamic team in San Jose, CA. This role focuses on developing and maintaining data integration processes using Python (PySpark) and Azure Synapse Analytics, ensuring data accuracy and availability for insights. As...SuggestedRemote work
Medium
San Jose, CA2 days ago - ...Azure & Snowflake Data Platform Engineer At Staffworxs, we don't just connect talent — we power transformation. Headquartered in Frisco, TX, with teams in Bengaluru and Hyderabad, we combine global reach with deep expertise. Our Digital & Data Analytics practice drives...SuggestedContract work
Staffworxs Inc
San Jose, CA4 days ago - ...Job Summary Apple is seeking a detail-oriented and people-focused User Study & Data Collection Engineer to join the Human Engineering Validation team . This role supports cutting-edge technology development by facilitating in-person user studies, managing study...
Prophecy Technologies
Sunnyvale, CA2 days ago - ...Remote Data Engineer needs 10 years experience Must be local top Santa Clara Cloud Platform Expertise (GCP Focus): Extensive hands-on experience working in dynamic cloud environments, with a strong preference for Google Cloud Platform (GCP) services, specifically: BigQuery...Local areaRemote work
Global Channel Management
Santa Clara, CA19 hours ago - ...Position: Data Engineer II Location: Sunnyvale, California Duration: Contract Job ID: 175305 Job Overview: We are seeking a skilled and detail... ...systems. Familiarity with cloud platforms such as AWS, Azure, or Google Cloud. Excellent problem-solving and communication...Full timeContract work
Pinnacle Group
Sunnyvale, CA2 days ago $100k - $155k
...other. Ready to join a mission that matters? The future of cybersecurity starts with you. About the Role We are seeking a seasoned Data Engineer with expertise in Go To Market domain to join our team. You will be responsible for architecting and building robust data...Full timeWork at officeLocal areaRemote workCrowdStrike
Sunnyvale, CA3 days ago- ...WinWire Technologies seeks Data Engineer in Santa Clara, CA & various unanticipated locations in U.S.: Create/ Modify Azure Data Factory solution. Extract data from SAP & integrate it w/ non-SAP data sources. Req. Bach.’s/frgn. eqv. + 5 yrs. exp. w/ relev. skills + trvl...
WinWire Technologies
Santa Clara, CA2 days ago - ...Job Title: Data Engineer . Location: Sunnyvale, CA. Direct Client: Req. Key Qualifications: ~ Data Engineer (TERMINUS) ~3+ years of hands-on Data Warehousing and Data Engineering experience. ~ Database design and development...
Numeric
Sunnyvale, CA3 days ago - ...Data Engineer Austin, TX / Sunnyvale, CA onsite Contract Role Description: Posting Title Data Engineer (Python,Java, SQL,Spark, PySpark, Java Spark) Count: 2 Description Looking for a Data Engineer who has a passion for building scalable and...Contract workImmediate start
Syntricate Technologies
Sunnyvale, CA4 days ago - ...Data Engineer We are seeking a highly skilled Data Engineer to join our team, focusing on building, maintaining, and optimizing our data... ...). ~ Hands-on experience with cloud platforms (e.g., AWS, Azure, GCP) and cloud data storage solutions. ~ Programming skills...
Omni Inclusive
Santa Clara, CA3 days ago - ...Join to apply for the Junior Data Annotation Engineer (Remote) role at Jobright.aiJoin to apply for the Junior Data Annotation Engineer (Remote) role at Jobright.aiGet AI-powered advice on this job and more exclusive features.Jobright is an AI-powered career platform...Remote work
jobright.com
Santa Clara, CA1 day ago $71.06 - $81 per hour
...impactful contributions, where your work directly influences critical data infrastructure and decision-making processes. Are you a... ..., lifecycle management, and master data governance. * Engineer, operationalize, secure, and monitor advanced data processing systems...Hourly payTemporary workSkill Corp
Sunnyvale, CA4 days ago- ...Description: The Data Engineer will own and strengthen the data foundation that powers Customer Success for Evergreen//One, our subscription offering. This role is responsible for building and maintaining scalable data pipelines, improving and restructuring...Remote work
ObjectWin Technology
Santa Clara, CA3 days ago $184k - $287.5k
...their best work. NVIDIA has a rapidly expanding ecosystem of data center platform designs. From single node HGX/DGX systems all the... ...and HPC software stack. We are searching for a highly motivated engineer to lead performance benchmarking and optimization efforts for...Remote workNVIDIA
Santa Clara, CA19 hours ago- ...Bentonville, AR. Job Description: We are seeking a skilled Data Engineer with strong expertise in Big Data, Cloud platforms, and... ...Kafka . # Utilize Vertex AI and Cloud services (AWS/GCP/Azure) for advanced analytics and ML integration. # Ensure...
Purple Drive
Sunnyvale, CA19 hours ago $50 - $60 per hour
...Bigdata Engineer Location: Phoenix, AZ Duration: 12+ Months Client: Client / Impetus Pay Rate: $50 to $60 Max depends on experience on... ...Bachelors Year and university Total Exp US Exp. Big Data Exp. Current Location Open for Travel Open for Relocation...RelocationOmega Solutions
Santa Clara, CA19 hours ago- ...Hi, Sample profile attached for your reference. Recent update from client for this data engineer role / Request-ID: 13145-1 _ Bentonville, AR position is no longer available. We can submit profiles for Sunnyvale, CA. Going forward, pls share profiles only...
Texas State Library and Archives Commision
Sunnyvale, CA4 days ago - ...Data Engineer II Rootshell Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking Data Engineer II for one of our client. Role: Data Engineer II Location: Santa Clara, CA Duration: Long Term...
Rootshell Inc
Santa Clara, CA2 days ago - ...Role Overview: We are looking for a Data Engineer having proficiency in SQL coding, Python coding and Spark. Key Responsibilities: ~ We are looking for a Data Engineer having proficiency in SQL coding, Python coding and Spark Required Skills:...
Prophecy Technologies
Sunnyvale, CA2 days ago - ...Title: Senior Data Engineer Location: Sunnyvale, CA Position: 2 Month (Contract) Summary Provide business insights, while leveraging internal tools and systems, databases and industry data Roles & Responsibilities Ability to...Contract work
TWO95 International
Sunnyvale, CA19 hours ago $105k - $110k
...Job Requirements POSITION: Data Analyst / Engineer Who We Are: Quest Global delivers world-class end-to-end engineering solutions by leveraging our deep industry knowledge and digital expertise. By bringing together technologies and industries, alongside the...Temporary workWork experience placementQuEST Global
Sunnyvale, CA3 days ago- ...We are seeking an experienced and highly skilled Contract Data Engineer. This role is focused on building robust data pipelines, primarily... ...Python). Experience working with cloud platforms (e.g., AWS, Azure, GCP) where Snowflake and Databricks are deployed....Contract workWork experience placementImmediate startRemote work
Artech
Sunnyvale, CA3 days ago - ...Snowflake. Overview: We are seeking an experienced Senior Data Engineer with at least 8 years of industry experience and strong... ...applications. ~ Experience with cloud platforms (e.g., AWS, Azure, GCP) for data engineering and machine learning. ~...
E-Solutions
Sunnyvale, CA19 hours ago - ...master's degree in computer science, Software Engineering, or a related field. Proven experience (7+ years) as a data Engineer, preferably with a focus on software... ...Computing Services such as Google GCP and Microsoft Azure, as well as Distributed Storage Systems like...Work at office
Kaav Inc.
Sunnyvale, CA2 days ago $146.3k - $244.1k
...Data Engineer, Operations Finance The Operations Finance team is looking for a passionate and highly motivated Data Engineer to drive our financial data platform forward. We work with logistics and supply-chain business to understand current and future processes and...Work experience placementRelocationFlexible hoursApple
Sunnyvale, CA4 days ago- ...Data Engineer Rootshell Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking a Data Engineer for one of our clients. Location: Santa Clara, CA - Onsite We are seeking a highly skilled and...
Rootshell Inc
Santa Clara, CA2 days ago - ...Benefits: 401(k) matching Dental insurance Health insurance AWS Healthcare Data Engineer 100% Remote Skills:- We are looking for a Senior Data Engineer with strong Databricks and streaming experience to build the core ingestion layer of a modern healthcare...Remote work
Rapid Eagle Inc
Sunnyvale, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer. Be the first to apply!
Related searches
- azure specialist Santa Clara, CA
- cloud engineer azure Santa Clara, CA
- azure developer Santa Clara, CA
- data visualization developer Santa Clara, CA
- data science developer Santa Clara, CA
- senior data center engineer Santa Clara, CA
- sr information security engineer Santa Clara, CA
- junior big data engineer Santa Clara, CA
- entry level big data engineer Santa Clara, CA
- aws data engineer Santa Clara, CA