8281 - Data Engineer
Core Centre Of Resource Excellence Inc
JOB SUMMARY
Data Engineer
Location: 7000 Target Pkwy N Brooklyn Park Minnesota JOB DESCRIPTION
Senior Engineer Fraud and Abuse Data Engineering Design, build, and operate scalable batch and streaming data pipelines (Kafka) and ETL/ELT workflows across Hadoop and Google Cloud Platform (GCP); implement monitoring/alerting to meet reliability and SLA targets. Develop high-performance distributed processing with Python, Spark, and Hive; optimize jobs,storage, and throughput for large-scale, high-volume datasets and cost efficiency.
Deliver curated, trustworthy datasets for analytics, reporting, and ML with strong data quality, lineage, and governance. Partner with data scientists to operationalize ML on GCP (e.g., Vertex AI), building MLOps pipelines for training, deployment, CI/CD, monitoring, and automated retraining. Integrate on-prem Hadoop data lakes with GCP services to enable seamless hybrid data and model
workflows. Collaborate with analysts and product engineers to ensure data is accessible, high-quality, and actionable; provide technical mentorship to junior engineers. Uphold security, privacy, and regulatory compliance across all data engineering practices. Continuously evaluate technologies and design patterns, and drive improvements in performance, scalability, and cost across Hadoop and GCP environments. BA/BS or equivalent; 4+ years building large-scale data systems. Proficient in core platforms; writes organized, maintainable code across multiple languages and distributed frameworks. Skilled in package configuration/deployment and building custom solutions. Designs robust tests; troubleshoots and resolves routine and non-routine issues independently. Delivers high-performance, scalable, secure solutions (high throughput/low latency). Operates effectively in Agile: communicates clearly with partners, aligns team priorities, and understands guest/business impact.
Influences and applies data/engineering standards and policies; maintains expertise and stays current through ongoing learning. Technical Skills:
Strong proficiency in Python and SQL.
Hands-on experience with Apache Spark and the Hadoop ecosystem (HDFS, Hive, Pig, Oozie,
Sqoop, YARN).
Experience with real-time data streaming technologies (Kafka, Flink, Spark Streaming).
Expertise with GCP services: BigQuery, Dataflow, Dataproc, Pub/Sub, Vertex AI (AI Platform).
Experience building and maintaining MLOps pipelines for deploying and scaling ML models. Hybrid- 2 days a week in TNC
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the 8281 - Data Engineer in Brooklyn Park, MN vacancy
- Edeniq is looking for a Management Information Systems (MIS) Specialist to take ownership of our data infrastructure and reporting workflows. This role will focus on building and maintaining a centralized system (Access or similar software) and creating standardized reports...Suggested
- ...Role: Lead Data Engineer Location: Minneapolis, Minnesota Duration: 6+ Months Job Description Roles & Responsibilities : • Sr. Developer Bachelors in science engineering or equivalent. • Understand requirements build codes support testing and fix...Suggested
- ...Lead Storage & Data Protection Engineer At HDR, our employee-owners are fully engaged in creating a welcoming environment where each of us is valued and respected, a place where everyone is empowered to bring their authentic selves and novel ideas to work every day...SuggestedMonday to FridayShift work
- ...Data Engineer We are seeking an experienced Data Engineer to join our team and contribute to the design, development, and optimization of data solutions supporting enterprise-level initiatives. The successful candidate will work on large-scale data processing, transformation...Suggested
$100.3k - $172k
...Data Engineer III Medica is a nonprofit health plan with more than a million members that serves communities in Minnesota, Nebraska, Wisconsin, Missouri, and beyond. We deliver personalized health care experiences and partner closely with providers to ensure members...SuggestedWork experience placementWork at office3 days per week$90k - $113k
...Job Description: Ryan Companies has an immediate need for a Data Engineer. This is an IN-OFFICE opportunity (4 days per week, 1 day work-from-home) in our Minneapolis headquarters office. The Data Engineer will play a foundational role in building and maintaining...Temporary workWork at officeImmediate startWork from homeFlexible hours- ...Job role and responsibilities: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing, and delivering scalable data solutions using Azure Databricks, Azure Data...Contract work
$65 per hour
...Data Engineer Max Bill Rate: $65 Top 3 Must Haves: PL SQL Hadoop Cassandra Job Summary: Design and put in place Azure data protection features. Deploy virtual machines in a highly available setting. Create virtual networks with high levels of...$100.79k - $160.26k
...Piper is a place you can engage in meaningful work and grow your career. Let's see what we can achieve. Together. Summary The Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into...Work at officeRemote workVisa sponsorshipShift work- ...Role - Data Engineer Location - Minneapolis, MN(Remote) Job Details: Databricks, Azure Data Factory, Databricks workflows, PySpark, Python, Databricks SQL Config driven data pipelines Databricks Genie conversational tool for AI driven insights using no...Remote work
$120k - $140k
...Data Engineers SDG is a high-performance software community. We are a team of collaborative and creative consultants who build and deliver custom software for some of the most recognizable local and national brands. In this role, you will be asked to leverage your...Full timeTemporary workWork experience placementLocal areaWork visa- ...Spring batch, J2EE 5+ years' experience in Hadoop, Hive, SQL and noSQL databases Roles & Responsibilities: ~ Data Engineering ETL role Design, code, test, debug, document, maintain, and modify computer programs of high complexity, significance, and...Work experience placement
$60k - $135k
...Job Title: Data Engineer City: Minneapolis State/Province: Minnesota Posting Start Date: 6/1/26 Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative...Minimum wageContract workLocal area- ...Data Engineer The team requires: Minimum 5 years of hands-on experience in data engineering roles, proven track record of successfully delivering complex data projects. Advanced proficiency in Python, with a focus on data engineering, familiar with libraries such as...
- ...Is an expert in working with large databases, BI applications, data quality, and performance tuning Has expert knowledge of developing... ...in Cerner, EPIC and Lawson systems 5 years of Secure Data Engineering and scripting (Shell, Python) 5 years experience in...
- ...Data Engineer Minneapolis, MN, Long Term Minimum 5 - 6 years of hands on experience in Core Java and Hadoop development. Responsibilities: Develop and integrate software applications using suitable development methodologies and...
- ...CRM Operations Data Analyst The CRM Operations team is responsible for managing email, direct mail, text, and push customer communications. Positions in other companies may refer to the team as Campaign Operations or Marketing Operations. This project entails supporting...
$70k - $100k
...Data Engineer The Data Engineer will play a critical role in developing the data infrastructure that supports design, planning, construction analytics, and business operations across the firm. This role focuses on building robust data pipelines, integrating architecture...Temporary workWork from homeFlexible hours$88k - $131k
...Job Duties NO SPONSORSHIP, LOCAL CANDIDATES to Minneapolis/St. Paul ONLY Under the direction of the Data & BI lead, the Data Engineer will play a key role in designing, developing, and maintaining our data architecture and business intelligence capabilities. The...Work at officeLocal areaRemote workShift work- ...Aurora. Expert knowledge of SQL, Python Experience with data profiling, data quality reporting, and data cleansing Strong... ...Responsibilities: This role is a part of the Treasury Services' Data Engineering team for a large-scale program. You would be responsible for...Work experience placement
$95k - $120k
...The Data Engineer will be responsible for a wide variety of tasks which include all aspects of the development and delivery of data solutions and maintaining the enterprise data warehouse. You will work closely with business analysts, product managers, quality assurance...Full timeWork at officeFlexible hours- ...Job Title Qualifications: • 10+ years working on designing and developing data pipelines and data storage using cloud technologies • AWS experience including DynamoDB and Redshift. Tableau, SQL. • Experience with data migration for large programs such as migrating...Work experience placement
$100k
...Cloud World/Oracle Java One (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023 ll Positions are open for... ...developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions with clients. Who Should Apply...Full timeH1b$100k
...Cloud World/Oracle Java one (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023... ...developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions with clients. Who Should Apply Recent...Full timeH1b$91.7k - $163.7k
...healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best.Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits...Minimum wageFull timeWork experience placementLocal areaRemote work- ...Job Summary: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing, and delivering scalable data solutions using Azure Databricks, Azure Data Lake, and Azure Cosmos...
- ...Senior Data Ops Engineer Location: Charlotte, NC; Irving, TX; Chandler, AZ; Columbus, OH; Des Moines, IA; or Minneapolis, MN. Rate: DOE Term: 12+ Months This role is an opportunity to be part of a high-performing team passionate about data, focusing on building a...
- ...Senior Data Engineer Our client, an IT Services and Consulting company, is looking for a Senior Data Engineer for their Blaine, MN/Hybrid location. Responsibilities: Design robust enterprise data models that align with business capabilities and support scalable...
- ...Data Engineer Senior HealthPartners is hiring a Data Engineer Senior. POSITION PURPOSE: Our mission is to provide simple and affordable healthcare. HealthPartners teams use data to improve patient and member experience, improve health, and reduce the per capita...Local area
$125k - $159.4k
...opportunities to learn and grow? A position at Xcel Energy could be just what you're looking for. Position Summary The Sr. Data Engineer is responsible for leading technical aspects of IT solution delivery, cloud-based data platform engineering and data product...Temporary workFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to 8281 - Data Engineer. Be the first to apply!
Related searches
- clinical data Brooklyn Park, MN
- clinical data coordinator remote Brooklyn Park, MN
- data network cabling Brooklyn Park, MN
- provider data management Brooklyn Park, MN
- data Brooklyn Park, MN
- data analysis part time Brooklyn Park, MN
- data tech Brooklyn Park, MN
- data loss prevention engineer Brooklyn Park, MN
- data modeling Brooklyn Park, MN
- ibm data engineer

