Azure Data Engineer
Omega Solutions
Azure Data Engineer
As a Data Engineer on the Data Science and Platform team, you will:
- Develop and maintain data pipelines including solutions for data collection, management and usage.
- Work closely with Data Scientists to optimize and reengineer model code to be modular, efficient and scalable, and to deploy models to production.
- Maintain and enhance our data and computation platform.
- Develop and implement solutions for data quality validation and continuous improvement.
- Manage, execute and monitor weekly and monthly production operations; resolve and escalate production issues as appropriate.
- Partner with business stakeholders to understand business and technical requirements, plan and execute projects, and communicate status, risks and issues.
- Perform root cause analysis of system and data issues and develop solutions as required.
Qualifications:
- BA/BS in business, computer science or other technical field or 5+ years of appropriate work experience
- Proficient in Azure SQL Data Warehouse, T-SQL and database architecture.
- Implement data warehouses and analysis services as part of a modern data warehouse (MDW) design
- Experience working with cloud-based technologies, including relational databases, data warehouse, big data (Spark), orchestration/data pipeline tools, data frames concepts, Spark Streaming and Spark SQL
- Experience with Azure Analytics stack, Azure Data Lake, Azure Databricks, Azure Data Factory.
- Experience with ETL data pipelining concept.
- Proficient in Power BI
- Experience working in software engineering, and can demonstrate best practices for project management, quality control, and product development.
- Proven track record of collaborative development in an agile team environment.
- Experience with Python, Scala. Expertise in Pyspark or Scala is a must.
- Hands on experience of writing notebooks in Databricks using python for complex data aggregations, transformations, schema operations.
Preferred:
- Experience with Cosmos DB
- Significant experience with utilizing Azure Analysis Services
- Experience with Airflow
- Elastic Search
- Experience in Java
- Experience building APIs and services using REST
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer in Santa Clara, CA vacancy
$174.72k - $295.68k
...transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.We are seeking a Machine Learning Data Curation Engineer to spearhead the data pipeline development and dataset management for our core AI initiatives. You will bridge the gap between...SuggestedFull time$140.25k - $210.38k
Introduction to the jobThe senior lead SQA engineer is responsible for leading validation activities for shared Data & Compute platform capabilities across multiple products. The role focuses on validating new functionality and platform enhancements in areas such as Data...SuggestedFull time$152k - $253k
...our efforts in the autonomous driving field and strive to bring sustained growth to our customers.We're looking for a Senior Data Analysis Engineer, AD critical metrics with strong technical ability to deeply understand architectures and strong scripting experience to...SuggestedFull time- DescriptionGeneral information:Hitachi Energy is seeking for a Senior Data Management Engineer for it's San Jose, CA location.Your Responsibilities:Analyze and understand customer engineering, business, and software requirements, propose technically feasible solutions,...Suggested
$75 - $85 per hour
Position: Battery Data Engineer III Location: Cupertino, California Duration: Contract Job ID: 171364 Job Description:This will be a data engineer role for processing battery testing data to facilitate battery algorithm delivery and support battery algorithm simulations...SuggestedFull timeContract work$117k - $234k
...OfficePosition Summary...What you'll do...Role summary: As a Senior Data Engineer, you will design, develop, and maintain scalable data... ...experience with cloud-based data platforms such as Snowflake, Azure, or Google BigQuery.In-depth knowledge of data governance, quality...Full timeTemporary workPart time$148.75k - $361k
...streamers around the world while gaining meaningful experience across a variety of disciplines.About the teamThe mission of Roku's Data Engineering team is to develop a world-class big data platform that enables internal and external customers to leverage data to grow their...Work at officeLocal areaRemote workWorldwideMonday to ThursdayFlexible hours$63 - $68 per hour
...| USD 63-68 / Hourly (C2C)Employment Type: Full TimeClient: TechMContact: Meghana GorusuCompany: SRI Tech SolutionsJob Title: Data Engineering & AnalyticsLocation: Cupertino, CA (Hybrid) / Austin, TX / Seattle, WAAbout the Role:We build data systems that power innovation...Hourly payFull time$135k - $180k
Santa Clara, CAData Engineering - Backend Engineering /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver... ...fast-growing teams.Responsibilities: Create and maintain optimal data processing pipeline architectureBuild the infrastructure...Full time- Position: Data Engineer IILocation: Sunnyvale, CaliforniaDuration: ContractJob ID: 175305Job Overview: We are seeking a skilled and detail... ...database systems.Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.Excellent problem-solving and communication...Full time
- Company: Tredence Inc. Position Title: Senior Data Engineer Location: 1900 Camden Ave., Suite 66, San Jose, CA 95124 Position Responsibilities: Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders...Remote work
$168k - $270.25k
The NVIDIA Operations organization is seeking an experienced data engineering professional for the position of Senior Data Engineer, Engineering Data Analytics. As a member of our team, you will be an integral part of building cloud-based data platforms that support engineering...Full time$148k - $224.25k
...record in technology and the skills for GPU product definition for Data Center. We are a small, dynamic, and motivated team that... ...experience in technology with previous product management, AI related engineering, design or development experience highly valuedBS or MS or...Full time- ...for managing an organization.Job DescriptionPrimary Skills:Big Data experience8+ years exp in Java, Python and ScalaWith Spark and... ..., calling APIs, write SQL queries, etc.).Work closely with our engineering team to integrate and build algorithmsProcess unstructured data...
$130k - $200k
Santa Clara, CAData Engineering - Data Infrastructure /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver software for factory-built autonomous trucks. Headquartered in Silicon Valley with operations in the United States and Europe, Plus...Full time$133.1k - $236.4k
...finance, we strive to introduce the finance of the future! We seek a data scientist to join the Creativity & Productivity finance team to... ...or resolve operational problems to create processes to reverse engineer existing data flows and source-to-target mappings and work with...Full timeTemporary workWork experience placementWork at officeLocal areaWorldwide- ...7801708Reference26-07957Remote100% Remote Job Title: Contract Data Engineer (API & Database Focus) Role Summary: We are seeking an experienced... ...Python). Experience working with cloud platforms (e.g., AWS, Azure, GCP) where Snowflake and Databricks are deployed....Contract workRemote work
$184k - $287.5k
Senior Data Center Performance Engineer - Benchmarking and Optimization page is loaded## Senior Data Center Performance Engineer - Benchmarking and Optimizationlocations: US, CA, Santa Clara: US, Remotetime type: Full timeposted on: Posted Yesterdayjob requisition id:...NVIDIA Corporation
Santa Clara, CA9 hours ago$108.22k - $162.1k
...semiconductor solutions are the essential building blocks of the data infrastructure that connects our world. Across enterprise,... ...dashboards and visualizations to enable AE/FAE and validation engineers to quickly interpret test results and debug issuesCloud-Based Analytics...Permanent employmentFull timeInternshipWork from home- ...develop our analytics platform.As a power company driven by ML and data, your scope would include automating gross margin, domain... ...a good fit if you:Have had 3+ years of experience in analytics engineering or similar roles.Have strong technical skills in SQL, dbt, and...Work at officeHome officeFlexible hours3 days per week
$207.4k - $259.2k
...RoleArcher is building the future of urban air mobility, and our data platform is what makes intelligent decisions possible — from... ...operations to flight analytics. We're looking for a Senior Staff Data Engineer who brings deep expertise in data modeling and warehouse design:...Local area$143k - $286k
...Segment: Home OfficePosition Summary...What you'll do...Principal Data Engineer - Agentic Data PlatformsThe MissionAs a Principal Data... ...ExpertiseStrong experience in cloud-native ecosystems (GCP or Azure preferred), including BigQuery, Dataflow, Pub/Sub, or equivalent...Full timeTemporary workPart time$174.72k - $295.68k
...future of transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.We are looking for a Data Infrastructure Engineer with engineering background and development skills. As a Data Infrastructure Engineer, your role is to identify corner cases...Full time$143k - $286k
...time / Regular/PermanentCompany: WalmartBusiness Segment: Home OfficePosition Summary...What you'll do...Role summary: As a Staff Data Engineer at Walmart, you will design and implement scalable data solutions that support complex business needs across multiple domains....Full timeTemporary workPart time- ...than join something — you'll add something. Description We are seeking a highly experienced and strategic Machine Learning Data Engineer to drive our machine learning data with a strong focus on quality. In this role, you will transform ambiguous data challenges...
Apple
Cupertino, CA2 days ago $110k - $120k
...interested in working with the World's leading AI-powered Quality Engineering Company? Ready to advance your career, team up with global... ...difference every day? Join us at QualityAI! We are looking for a Data Engineer to join our growing team in United States Location...Casual workLocal areaRemote workFlexible hoursQualiTest Group
Santa Clara, CA2 days ago$133.1k - $236.4k
...Senior Data Engineer Firefly is Adobe's family of creative generative AI products — and it's growing fast. Our data team sits at the center... ..., Spark SQL, dbt, Airflow, and cloud platforms (AWS and/or Azure) ~ Demonstrated experience crafting scalable data...Temporary workLocal areaImmediate startWorldwideAdobe
San Jose, CA5 days ago- ...Positions: 2 Responsibilities Designing, developing & tuning data products, applications and integrations on large scale data... ...standards, frameworks and reusable components for various data engineering functions/areas. Collaborate with key stakeholders including...
Central Business Solutions
San Jose, CA5 days ago - ...Principal Big Data Engineer As a Principal Big Data Engineer, you will be an integral member of our data ingestion and processing platform team responsible for architecture, design and development. Having the dynamic ability to adapt to conventional big-data frameworks...
Omni Inclusive
Santa Clara, CA1 day ago $117k - $234k
...Summary... What you'll do... About the Team International Data Management (IDM) team powers enterprise-scale data platforms... ...smart design and optimization strategies Develop AI-driven engineering solutions Build internal tools, utilities, and AI agents to accelerate...Full timeTemporary workPart timeWalmart
Sunnyvale, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer. Be the first to apply!
Related searches
- aws data engineer Santa Clara, CA
- big data devops engineer Santa Clara, CA
- big data developer Santa Clara, CA
- software data engineer Santa Clara, CA
- data center engineer Santa Clara, CA
- big data cloud engineer Santa Clara, CA
- director data engineering Santa Clara, CA
- big data engineer Santa Clara, CA
- senior data integration developer Santa Clara, CA
- data developer Santa Clara, CA