Data Engineer

Omni Inclusive

Job role and responsibilities:
We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing, and delivering scalable data solutions using Azure Databricks, Azure Data Lake, and Azure Cosmos DB. This role will involve coaching data engineers technically on topics like Azure databricks, optimizing data workflows, and collaborating with internal teams on various aspects.
Requirements :
1. Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.
2. 7+ years of experience in data engineering or related roles.
3. 5+ years of experience in Azure Databricks, Azure Data Lake, and Azure Cosmos DB proven track record of building data engineering solutions
4. Proficient in programming languages such as Python, SQL, and Scala.
5. Experience with big data technologies including Apache Spark, Hadoop, and Hive.
6. Hands-on experience with cloud platforms, particularly Microsoft Azure.
7. Proficiency in ETL processes, data warehousing, and data modeling.
8. Proficient in using Azure Cosmos DB for graph-based data analysis.
9. Knowledge of tools and technologies such as Azure Data Factory, Azure Synapse Analytics, and Apache Kafka.
10. Solid understanding of CICD pipelines and hands-on experience with DevOps tools such as Git for continuous integration and deployment.
11. Excellent problem-solving skills and the ability to troubleshoot complex data issues.
12. Strong coaching abilities, Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.

Must to have
Hands on programming Python and pyspark
Big dataTech Worked on Big Data Technology
Databricks and notebooks scripting
Experienced in ADF
Data analysis and modelling

Nice to Have
Data Architecting
Power BI Reporting
Mentoring team and coaching adhering to best practices
CI/CD Pipelines

Preferred Qualifications:
Microsoft Certified: Azure Data Engineer Associate.
Databricks Certified Associate Developer for Apache Spark.
Experience with data governance and data security practices.
Knowledge of Docker and Kubernetes for containerization and orchestration. Please find the below points to cover in addition to the job spec for senior data engineer contract role

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Data Engineer in Minneapolis, MN vacancy

Lead Data Engineer (Hybrid)
$105k - $196k
...Lead Data Engineer (Hybrid) Lead Data Engineer (Hybrid) Apply locations Saint Paul, MN Campus time type Full time posted on Posted 7 Days Ago job requisition id R-009043 Position Summary: Securian Financial offers an exciting opportunity for an experienced and passionate...
Suggested
Full time
Work at office
Flexible hours
3 days per week
Securian Financial
Saint Paul, MN
4 days ago
Lead Data Engineer
$188.25k - $230.08k
...private, public, government or military experience to a 3M career. The Impact You'll Make in this Role: We are seeking a Lead Data Engineer with strong experience in AI/ML data pipelines, feature engineering, and scalable data architectures. This role will lead the...
Suggested
Full time
H1b
Remote work
Relocation
Flexible hours
3M
Saint Paul, MN
8 hours ago
Lead Data Engineer
$110k - $204.2k
...Lead Data Engineer We are seeking a highly skilled and strategic Lead Data Engineer to join our team. In this advanced individual contributor role, you will spearhead the development of sophisticated, insightful, and visually compelling reporting solutions using tools...
Suggested
Work at office
Local area
Flexible hours
2 days per week
3 days per week
Thomson Reuters
Eagan, MN
1 day ago
Data Engineer
$120k - $140k
...partner with our customers to consistently provide a successful working relationship as a high-performance team. We are adding Data Engineers to influence the direction of data modernization for our customers. We are looking for engineers, senior engineers, and leaders...
Suggested
Full time
Temporary work
Work experience placement
Local area
Work visa
Solution Design Group
Minneapolis, MN
2 days ago
Data Engineer I (Snowflake)
$109.3k - $180.2k
...performance-based cash incentive awards. Salary Range $109,300.00 - $180,200.00 Target Openings 1 What Is the Opportunity? Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you...
Suggested
Contract work
Work experience placement
H1b
Local area
Immediate start
020 Travelers Indemnity Co
Saint Paul, MN
1 day ago
Data Engineer
...The Data Engineer will play a critical role in developing the data infrastructure that supports design, planning, construction analytics, and business operations across the firm. This role focuses on building robust data pipelines, integrating architecture and design software...
Work from home
Flexible hours
Nelson Worldwide
Minneapolis, MN
3 days ago
Lead Data Engineer
$117.6k - $161.7k
...Become a part of our caring community This role leads the architecture, engineering, and operationalization of the centralized Finance reporting data platform supporting CenterWell Finance reporting, analytics, and month-end close processes. We are looking for deep...
Bi-weekly pay
Full time
Temporary work
Apprenticeship
Work at office
Remote work
Work from home
Home office
Humana
Saint Paul, MN
8 hours ago
Data Engineer
$90k - $113k
**Job Description:**Ryan Companies has an immediate need for a Data Engineer. This is an **IN-OFFICE** opportunity (4 days per week, 1 day work-from-home) in our Minneapolis headquarters office.The Data Engineer will play a foundational role in building and maintaining...
Temporary work
Work at office
Immediate start
Work from home
Flexible hours
Ryan Companies
Minneapolis, MN
3 days ago
Data Engineer
...(2-3 days on-site) Must haves/focus areas: • Proficiency in DBT, Airflow, and Postgres (or equivalent tools) • Strong experience in data modeling and governance • A demonstrated ability to bring standards and processes around data quality and security into an organization...
Full time
Contract work
Remote work
Flexible hours
York Solutions, LLC
Saint Paul, MN
2 days ago
Data Engineer III
$100.3k - $172k
...for. We're a team that owns our work with accountability, makes data-driven decisions, embraces continuous learning, and celebrates... ...integration, data quality, and governance workflows In addition to engineering responsibilities, the Data Generalist component of this role...
Work experience placement
Work at office
3 days per week
Medica
Minnetonka, MN
3 days ago
Data Engineer
...Commodities International ( is a global leader in energy commodity trading and asset investment. Our Data Science & Technology team is central to our success, engineering the high-performance systems and innovative tools that power our commercial decision-making. We...
Work experience placement
Work at office
Dormont Manufacturing Company
Saint Paul, MN
2 days ago
Data Engineer
...Overview As a Data Engineer, you will have the unique opportunity to design and establish a modern data engineering function within our organization. You will take the lead in building the data infrastructure that enables analytics, self‑service reporting, and AI‑ready...
Coloplast
Minneapolis, MN
1 day ago
Data Engineer
$102k - $130.63k
...together the talents of Hypergiant, Forward Slope, Systems Innovation Engineering, SoarTech, and Highbury Defense Group under one mission, with... .... Job Description Full Time Onsite/Hybrid Preferred Data Engineer provides technical leadership, analytical expertise, and...
Full time
Contract work
Temporary work
For subcontractor
Internship
Remote work
Accelint
Saint Paul, MN
2 days ago
Lead Data Engineer
...We are seeking a Senior Data Engineer (open to Principal level) to lead the modernization and ownership of a critical data pipeline within a large-scale healthcare analytics environment. This role will focus on transitioning legacy SAS-based pipelines to modern Python/...
Perficient
Minneapolis, MN
22 hours ago
Data Engineer
$72.8k - $130k
...healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers,...
Minimum wage
Full time
Work experience placement
Local area
Remote work
Optum
Eden Prairie, MN
1 day ago
Data Engineer
...Edeniq is looking for a Management Information Systems (MIS) Specialist to take ownership of our data infrastructure and reporting workflows. This role will focus on building and maintaining a centralized system (Access or similar software) and creating standardized reports...
Edeniq
Maple Grove, MN
2 days ago
DATA ENGINEER
...identity providers: mayo.edu, globus.org, approved external institutions) Two internally hosted Compute Engine VMs running Globus Connect Server (GCS v5) in the GCP Data DMZ GCP ingress and egress S3 storage buckets with a defined 30-day data lifecycle/retention rule...
For contractors
Talent Software Services
Saint Paul, MN
1 day ago
Looking for Lead Data Engineer in Minneapolis Minnesota
...Role: Lead Data Engineer Location: Minneapolis, Minnesota Duration: 6+ Months Job Description Roles & Responsibilities : • Sr. Developer Bachelors in science engineering or equivalent. • Understand requirements build codes support testing and fix...
3B Staffing LLC
Minneapolis, MN
1 day ago
2 Openings Data Engineer IV
...CRM Operations Data Analyst The CRM Operations team is responsible for managing email, direct mail, text, and push customer communications. Positions in other companies may refer to the team as Campaign Operations or Marketing Operations. This project entails supporting...
E-Solutions
Minneapolis, MN
4 days ago
Data Engineer
...Data Engineer Minneapolis, MN, Long Term Minimum 5 - 6 years of hands on experience in Core Java and Hadoop development. Responsibilities: Develop and integrate software applications using suitable development methodologies and...
Futran Tech Solutions Pvt. Ltd.
Minneapolis, MN
1 day ago
Data Engineer II
$99k - $149k
...Day to Day This role’s primary responsibility is to integrate data from a variety of sources into common data domain models,... ...learning new technologies Demonstrated experience in software engineering fundamentals and coding Salary Range Transparency Tier 1...
Work experience placement
Local area
Indeed Inc.
Saint Paul, MN
19 days ago
Data Engineer
...Is an expert in working with large databases, BI applications, data quality, and performance tuning Has expert knowledge of developing... ...in Cerner, EPIC and Lawson systems 5 years of Secure Data Engineering and scripting (Shell, Python) 5 years experience in...
Omni Inclusive
Edina, MN
8 hours ago
Data Engineer
$95k - $120k
...The Data Engineer will be responsible for a wide variety of tasks which include all aspects of the development and delivery of data solutions and maintaining the enterprise data warehouse. You will work closely with business analysts, product managers, quality assurance...
Full time
Work at office
Flexible hours
Two Harbors Investment Corp
Minneapolis, MN
8 hours ago
Data Engineer
...Job Title: Senior Data Engineer Location: Wayzata, Minnesota (Hybrid - Onsite 3 days/week) Job Description: Responsible for designing, building, and operating high-performance data-centric solutions using enterprise big data platforms. This role supports analytics...
Local area
3 days per week
My3Tech Inc
Wayzata, MN
4 days ago
Data Engineer
...Spring batch, J2EE 5+ years' experience in Hadoop, Hive, SQL and noSQL databases Roles & Responsibilities: ~ Data Engineering ETL role Design, code, test, debug, document, maintain, and modify computer programs of high complexity, significance, and...
Work experience placement
Syntricate Technologies
Minneapolis, MN
4 days ago
Data Engineer
$100.79k - $160.26k
...Piper is a place you can engage in meaningful work and grow your career. Let's see what we can achieve. Together. Summary The Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into...
Full time
Work at office
Remote work
Relocation
Visa sponsorship
Relocation package
Shift work
DLA Piper
Minneapolis, MN
2 days ago
Data Engineer - INTL
...We are seeking a highly skilled Data Engineer to design, build, and maintain robust, scalable data pipelines within a Microsoft Azure-first environment. This role supports data powering a missioncritical mobile application used across the transportation supply chain industry...
Insight Global
Saint Paul, MN
8 hours ago
Data Engineer (LATAM)
...Data Engineer The team requires: Minimum 5 years of hands-on experience in data engineering roles, proven track record of successfully delivering complex data projects. Advanced proficiency in Python, with a focus on data engineering, familiar with libraries such as...
Software Technology Inc
Minneapolis, MN
2 days ago
Data Engineer
$72.8k - $130k
...outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find... ...Growing together. We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data and AI platforms...
Minimum wage
Full time
Work experience placement
Local area
Remote work
Optum
Eden Prairie, MN
1 day ago
Snowflake Data Engineer
...Sr Data Engineer This position manages data sourcing for WFM/CALL/AARP in the Enterprise Reporting & Analysis team. In this role, the employee will write, optimize, and schedules ETL packages to source data for ERA. Candidate will be working on WFM/CALL/AARP activities...
For contractors
Software Technology Inc
Eden Prairie, MN
8 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!