Azure Data Engineer
Omega Solutions
Azure Data Engineer
As a Data Engineer on the Data Science and Platform team, you will:
- Develop and maintain data pipelines including solutions for data collection, management and usage.
- Work closely with Data Scientists to optimize and reengineer model code to be modular, efficient and scalable, and to deploy models to production.
- Maintain and enhance our data and computation platform.
- Develop and implement solutions for data quality validation and continuous improvement.
- Manage, execute and monitor weekly and monthly production operations; resolve and escalate production issues as appropriate.
- Partner with business stakeholders to understand business and technical requirements, plan and execute projects, and communicate status, risks and issues.
- Perform root cause analysis of system and data issues and develop solutions as required.
Qualifications:
- BA/BS in business, computer science or other technical field or 5+ years of appropriate work experience
- Proficient in Azure SQL Data Warehouse, T-SQL and database architecture.
- Implement data warehouses and analysis services as part of a modern data warehouse (MDW) design
- Experience working with cloud-based technologies, including relational databases, data warehouse, big data (Spark), orchestration/data pipeline tools, data frames concepts, Spark Streaming and Spark SQL
- Experience with Azure Analytics stack, Azure Data Lake, Azure Databricks, Azure Data Factory.
- Experience with ETL data pipelining concept.
- Proficient in Power BI
- Experience working in software engineering, and can demonstrate best practices for project management, quality control, and product development.
- Proven track record of collaborative development in an agile team environment.
- Experience with Python, Scala. Expertise in Pyspark or Scala is a must.
- Hands on experience of writing notebooks in Databricks using python for complex data aggregations, transformations, schema operations.
Preferred:
- Experience with Cosmos DB
- Significant experience with utilizing Azure Analysis Services
- Experience with Airflow
- Elastic Search
- Experience in Java
- Experience building APIs and services using REST
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer in Santa Clara, CA vacancy
- ...go up a couple of USD; however, please negotiate as much as possible since cost accounts for 30% of the total evaluation) Azure Data Engineer 100% Remote - Jackson, Mississippi Long Term Contract Shift Start Time - 8:00 AM to 5:00 PM (CST) Position Description...SuggestedLong term contractRemote workShift work
PeopleNTech
San Jose, CA1 day ago - ...Roche, where every voice matters.The PositionAs a Senior Data Scientist - ML Engineering, you will join the Global Analytics and Technology Center... ...Automation: Implement cloud-native ML infrastructure across AWS, Azure, or GCP, systematically automating manual tasks and...SuggestedFull timeRelocation package
Roche
San Jose, CA20 hours ago - ...holistic well-being for you and your family.What you'll doYou will work in cross-functional agile teams alongside data scientists, machine learning engineers, product managers, and industry experts to innovate with clients and consulting teams, developing new or...SuggestedApprenticeshipWork at officeLocal areaEasy workShift work
McKinsey & Company
San Jose, CA2 days ago - Position: Data Engineer IILocation: Sunnyvale, CaliforniaDuration: ContractJob ID: 175305Job Overview: We are seeking a skilled and detail... ...database systems.Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.Excellent problem-solving and communication...SuggestedFull time
Pinnacle Group
Sunnyvale, CA2 days ago - Company: Tredence Inc. Position Title: Senior Data Engineer Location: 1900 Camden Ave., Suite 66, San Jose, CA 95124 Position Responsibilities: Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders...SuggestedRemote work
Tredence
San Jose, CA20 hours ago $130k - $200k
Santa Clara, CAData Engineering - Data Infrastructure /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver software for factory-built autonomous trucks. Headquartered in Silicon Valley with operations in the United States and Europe, Plus...Full timePlus.ai
Santa Clara, CA2 days ago- ...for managing an organization.Job DescriptionPrimary Skills:Big Data experience8+ years exp in Java, Python and ScalaWith Spark and... ..., calling APIs, write SQL queries, etc.).Work closely with our engineering team to integrate and build algorithmsProcess unstructured data...
Comtech
San Jose, CA2 days ago - ...4-06-04Company Name:HITACHI ENERGY USA INCProfession (Job Category):Engineering & ScienceJob Schedule: Full timeRemote:NoJob Description:General information:Hitachi Energy is seeking for a Senior Data Management Engineer for it's San Jose, CA location.Your Responsibilities...Full time
Hitachi
Santa Clara, CA20 hours ago $63 - $68 per hour
...| USD 63-68 / Hourly (C2C)Employment Type: Full TimeClient: TechMContact: Meghana GorusuCompany: SRI Tech SolutionsJob Title: Data Engineering & AnalyticsLocation: Cupertino, CA (Hybrid) / Austin, TX / Seattle, WAAbout the Role:We build data systems that power innovation...Hourly payFull timeSRI Tech
Cupertino, CA20 hours ago$117k - $234k
..., test, and deploy scalable, intelligent data solutions that support millions of Sam’s... ...consume and act on this data. Partner with engineering, AI/ML, and product teams to ensure data... ...experience with cloud platforms such as GCP or Azure, including services like BigQuery,...Walmart
Sunnyvale, CA2 days ago$138k - $189.75k
Introduction to the jobThe senior lead SQA engineer is responsible for leading validation activities for shared Data & Compute platform capabilities across multiple products. The role focuses on validating new functionality and platform enhancements in areas such as Data...Full timeASML Holding
San Jose, CA4 days ago$75 - $85 per hour
Position: Battery Data Engineer III Location: Cupertino, California Duration: Contract Job ID: 171364 Job Description:This will be a data engineer role for processing battery testing data to facilitate battery algorithm delivery and support battery algorithm simulations...Full timeContract workPinnacle Group
Cupertino, CA20 hours ago$184k - $287.5k
...autonomous-driving simulation. NuRec converts real-world sensor data into high-fidelity, simulation-ready driving environments. Cosmos... ...the original sensor path. We seek a Senior Synthetic Data Engineer to join the NVIDIA DRIVE team and contribute to automotive innovation...Full timeRemote workNvidia
Santa Clara, CA1 day ago- ...roleGridmatic’s business is complex, and we need to build a robust data layer to be able to answer core questions around profit and loss... ...our renewable supply.We’re looking for a startup-minded data engineer who can wear a lot of hats, work with multiple teams, and build...Work at officeHome officeFlexible hours3 days per week
Gridmatic
Cupertino, CA20 hours ago - ...We are seeking an experienced Kinaxis Data Migration Engineer with 8–10 years of experience in data migration, supply chain systems, data analysis, and enterprise data integration. The ideal candidate will have strong knowledge of supply chain planning processes, data...Full time
Long Finch Technologies
San Jose, CA14 days ago - ...7801708Reference26-07957Remote100% Remote Job Title: Contract Data Engineer (API & Database Focus) Role Summary: We are seeking an experienced... ...Python). Experience working with cloud platforms (e.g., AWS, Azure, GCP) where Snowflake and Databricks are deployed....Contract workRemote work
Mindlance
Sunnyvale, CA3 days ago - ...Data Engineer Rootshell Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking a Data Engineer for one of our clients. Location: Santa Clara, CA - Onsite We are seeking a highly skilled and...
Rootshell Inc
Santa Clara, CA4 days ago $133.1k - $236.4k
...JOB LEVEL P40 EMPLOYEE ROLE Individual Contributor The Opportunity Join Adobe as a Sr Data Science Engineer and be part of a team that is crafting the future of digital experiences. This is your chance to work on brand new projects that impact millions of users...Temporary workLocal areaWorldwideRelocationAdobe
San Jose, CA4 days ago- ...Data Engineer Location: Austin, TX/Sunnyvale, CA Job Description We are seeking an experienced Data Engineer with proven, hands-... ...Familiarity with cloud database services (AWS RDS/Aurora PostgreSQL, Azure, GCP Cloud SQL) is a plus. ~ Scripting skills in Shell,...
Futran Tech Solutions Pvt. Ltd.
Sunnyvale, CA3 days ago - ...Role: Data Engineer 3 Location: Hybrid, Santa Clara, CA Visa: USC/GC only Duration: 6+ months Mode of interview: Zoom... ...Cloud Platforms: Familiarity with cloud platforms such as AWS, Azure, or Google Cloud, and their data services (e.g., S3, AWS...
InterSources
Santa Clara, CA4 days ago $50 - $60 per hour
...Bigdata Engineer Location: Phoenix, AZ Duration: 12+ Months Client: Client / Impetus Pay Rate: $50 to $60 Max depends on experience on... ...Bachelors Year and university Total Exp US Exp. Big Data Exp. Current Location Open for Travel Open for Relocation...RelocationOmega Solutions Inc
Santa Clara, CA1 day ago- ...Job Title Primary Responsibilities: • Expertise in SQL: You possess a deep understanding of SQL for data manipulation, querying, and performance optimization across various database systems. • Proficiency in Python: Your Python skills are crucial for building data...
Yochana
Sunnyvale, CA4 days ago - ...ACL Digital Title: Data Engineer Work Location: Blue Ash, OH (Hybrid 3 days onsite and candidate can work from Cincinnati, OH office... ...recommendations with techniques. Cloud environments: Azure & GCP Key Responsibilities: Lead and participate...Contract workWork at office
PeopleNTech
San Jose, CA1 day ago - ...Data Engineer San Jose, CA/PST Zone Duration: 1 year # of Positions: 2 Responsibilities Designing, developing & tuning data products, applications and integrations on large scale data platforms (Hadoop, Kafka Streaming, Hana, SQL server etc) with an emphasis...
Central Business Solutions
San Jose, CA4 days ago $182k - $242k
...Senior Data Engineer Livingston, NJ / New York, NY / Sunnyvale, CA / San Francisco, CA / Bellevue, WA CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
Sunnyvale, CA3 days ago- ...Data Engineer Minimum 10 years of experience Responsibilities: Data Pipeline Development: Design, build, and maintain scalable, efficient, and reliable ETL/ELT data pipelines for batch and real-time processing using GCP services (e.g., Dataflow, Dataproc, Cloud...
Yochana
San Jose, CA4 days ago - ...Data Engineer II Rootshell Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking Data Engineer II for one of our client. Role: Data Engineer II Location: Santa Clara, CA Duration: Long Term...
Rootshell Inc
Santa Clara, CA4 days ago - ...Data Engineer Austin, TX / Sunnyvale, CA onsite Contract Role Description: Posting Title Data Engineer (Python,Java, SQL,Spark, PySpark, Java Spark) Count: 2 Description Looking for a Data Engineer who has a passion for building scalable and...Contract workImmediate start
Syntricate Technologies
Sunnyvale, CA1 day ago - ...Job Title: Data Engineer . Location: Sunnyvale, CA. Direct Client: Req. Key Qualifications: ~ Data Engineer (TERMINUS) ~3+ years of hands-on Data Warehousing and Data Engineering experience. ~ Database design and development...
Numeric
Sunnyvale, CA17 hours ago - ...We are urgently looking for Data Analyst / Data Engineer (AI) professionals for an onsite opportunity in Sunnyvale, CA . Ex-Apple candidates are highly preferred , and profiles from top product companies are strongly encouraged. Please re-submit previously...
RIT Solutions, Inc.
Sunnyvale, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer. Be the first to apply!
Related searches
- big data cloud engineer Santa Clara, CA
- entry level big data engineer Santa Clara, CA
- senior data quality engineer Santa Clara, CA
- senior cloud data engineer Santa Clara, CA
- software data engineer Santa Clara, CA
- data infrastructure engineer Santa Clara, CA
- senior data center engineer Santa Clara, CA
- principal data engineer Santa Clara, CA
- data center engineer Santa Clara, CA
- senior data engineer Santa Clara, CA