8281 - Data Engineer
Core Centre Of Resource Excellence Inc
JOB SUMMARY
Data Engineer
Location: 7000 Target Pkwy N Brooklyn Park Minnesota JOB DESCRIPTION
Senior Engineer Fraud and Abuse Data Engineering Design, build, and operate scalable batch and streaming data pipelines (Kafka) and ETL/ELT workflows across Hadoop and Google Cloud Platform (GCP); implement monitoring/alerting to meet reliability and SLA targets. Develop high-performance distributed processing with Python, Spark, and Hive; optimize jobs,storage, and throughput for large-scale, high-volume datasets and cost efficiency.
Deliver curated, trustworthy datasets for analytics, reporting, and ML with strong data quality, lineage, and governance. Partner with data scientists to operationalize ML on GCP (e.g., Vertex AI), building MLOps pipelines for training, deployment, CI/CD, monitoring, and automated retraining. Integrate on-prem Hadoop data lakes with GCP services to enable seamless hybrid data and model
workflows. Collaborate with analysts and product engineers to ensure data is accessible, high-quality, and actionable; provide technical mentorship to junior engineers. Uphold security, privacy, and regulatory compliance across all data engineering practices. Continuously evaluate technologies and design patterns, and drive improvements in performance, scalability, and cost across Hadoop and GCP environments. BA/BS or equivalent; 4+ years building large-scale data systems. Proficient in core platforms; writes organized, maintainable code across multiple languages and distributed frameworks. Skilled in package configuration/deployment and building custom solutions. Designs robust tests; troubleshoots and resolves routine and non-routine issues independently. Delivers high-performance, scalable, secure solutions (high throughput/low latency). Operates effectively in Agile: communicates clearly with partners, aligns team priorities, and understands guest/business impact.
Influences and applies data/engineering standards and policies; maintains expertise and stays current through ongoing learning. Technical Skills:
Strong proficiency in Python and SQL.
Hands-on experience with Apache Spark and the Hadoop ecosystem (HDFS, Hive, Pig, Oozie,
Sqoop, YARN).
Experience with real-time data streaming technologies (Kafka, Flink, Spark Streaming).
Expertise with GCP services: BigQuery, Dataflow, Dataproc, Pub/Sub, Vertex AI (AI Platform).
Experience building and maintaining MLOps pipelines for deploying and scaling ML models. Hybrid- 2 days a week in TNC
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the 8281 - Data Engineer in Brooklyn Park, MN vacancy
- Edeniq is looking for a Management Information Systems (MIS) Specialist to take ownership of our data infrastructure and reporting workflows. This role will focus on building and maintaining a centralized system (Access or similar software) and creating standardized reports...Suggested
$119k - $206k
...About this role: Wells Fargo is seeking a Lead Data Engineer in the Technology Analytics team. This lead engineer will combine hands-on data engineering with advanced analytics to drive operational insights for senior technology leadership. This engineer will build...SuggestedWork experience placementRelocation package- ...We are seeking a senior, hands-on Data Engineer with strong experience building production-grade data pipelines in fast-moving environments. The ideal candidate will have deep data engineering experience, a strong understanding of data quality, reliability, and operational...Suggested
- ...Role: Lead Data Engineer Location: Minneapolis, Minnesota Duration: 6+ Months Job Description Roles & Responsibilities : • Sr. Developer Bachelors in science engineering or equivalent. • Understand requirements build codes support testing and fix...Suggested
$90k - $113k
**Job Description:**Ryan Companies has an immediate need for a Data Engineer. This is an **IN-OFFICE** opportunity (4 days per week, 1 day work-from-home) in our Minneapolis headquarters office.The Data Engineer will play a foundational role in building and maintaining...SuggestedTemporary workWork at officeImmediate startWork from homeFlexible hours$120k - $140k
...partner with our customers to consistently provide a successful working relationship as a high-performance team. We are adding Data Engineers to influence the direction of data modernization for our customers. We are looking for engineers, senior engineers, and leaders...Full timeTemporary workWork experience placementLocal areaWork visa- ...Overview As a Data Engineer, you will have the unique opportunity to design and establish a modern data engineering function within our organization. You will take the lead in building the data infrastructure that enables analytics, self‑service reporting, and AI‑ready...
$95k - $120k
...The Data Engineer will be responsible for a wide variety of tasks which include all aspects of the development and delivery of data solutions and maintaining the enterprise data warehouse. You will work closely with business analysts, product managers, quality assurance...Full timeWork at officeFlexible hours- ...CRM Operations Data Analyst The CRM Operations team is responsible for managing email, direct mail, text, and push customer communications. Positions in other companies may refer to the team as Campaign Operations or Marketing Operations. This project entails supporting...
- ...Data Engineer Minneapolis, MN, Long Term Minimum 5 - 6 years of hands on experience in Core Java and Hadoop development. Responsibilities: Develop and integrate software applications using suitable development methodologies and...
- ...Is an expert in working with large databases, BI applications, data quality, and performance tuning Has expert knowledge of developing... ...in Cerner, EPIC and Lawson systems 5 years of Secure Data Engineering and scripting (Shell, Python) 5 years experience in...
- ...Data Engineer We are seeking an experienced Data Engineer to join our team and contribute to the design, development, and optimization of data solutions supporting enterprise-level initiatives. The successful candidate will work on large-scale data processing, transformation...
$88k - $131k
...Data Engineer ***NO SPONSORSHIP, LOCAL CANDIDATES TO MINNEAPOLIS/ST. PAUL ONLY*** Under the direction of the Data & BI lead, the Data Engineer will play a key role in designing, developing, and maintaining our data architecture and business intelligence capabilities...Work at officeLocal areaRemote work- ...Spring batch, J2EE 5+ years' experience in Hadoop, Hive, SQL and noSQL databases Roles & Responsibilities: ~ Data Engineering ETL role Design, code, test, debug, document, maintain, and modify computer programs of high complexity, significance, and...Work experience placement
$100.79k - $160.26k
...Piper is a place you can engage in meaningful work and grow your career. Let's see what we can achieve. Together. Summary The Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into...Full timeWork at officeRemote workRelocationVisa sponsorshipRelocation packageShift work$70k - $100k
...Data Engineer The Data Engineer will play a critical role in developing the data infrastructure that supports design, planning, construction analytics, and business operations across the firm. This role focuses on building robust data pipelines, integrating architecture...Temporary workWork from homeFlexible hours- ...Data Engineer the team requires: Minimum 5 years of hands-on experience in data engineering roles, proven track record of successfully delivering complex data projects. Advanced proficiency in Python, with a focus on data engineering, familiar with libraries such...
- ...Job role and responsibilities: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing, and delivering scalable data solutions using Azure Databricks, Azure Data...Contract work
$65 per hour
...Data Engineer Max Bill Rate: $65 Top 3 Must Haves: PL SQL Hadoop Cassandra Job Summary: - Design and put in place Azure data protection features. - Deploy virtual machines in a highly available setting. - Create virtual networks with high levels...- ...Role - Data Engineer Location - Minneapolis, MN(Remote) Job Details: Databricks, Azure Data Factory, Databricks workflows, PySpark, Python, Databricks SQL Config driven data pipelines Databricks Genie conversational tool for AI driven insights using no...Remote work
- ...Role : Data Engineer Location: Minneapolis, MN Its day 1 onsite Duration: Long term Bill rate : $70/hr on C2C Role Summary A Data Engineer is responsible for designing, building, and maintaining the systems and infrastructure...
$100k
...Cloud World/Oracle Java One (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023 ll Positions are open for... ...developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions with clients. Who Should Apply...Full timeH1b$100k
...Cloud World/Oracle Java one (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023... ...developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions with clients. Who Should Apply Recent...Full timeH1b$50 - $57 per hour
...Job Title: Senior Data Engineer Location: Minneapolis, MN ( Onsite ) Position : ( C2C Role ) Duration : ( 6+ Months) Pay Range : $50 - 57/Hr Skills: Microsoft, Python, PySpark, ETL Process, Data Integration, Azure Job Description: • Responsible...Work experience placementFlexible hours- ...Senior Data Ops Engineer Location: Charlotte, NC; Irving, TX; Chandler, AZ; Columbus, OH; Des Moines, IA; or Minneapolis, MN. Rate: DOE Term: 12+ Months This role is an opportunity to be part of a high-performing team passionate about data, focusing on building a...
- ...Job Summary: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing, and delivering scalable data solutions using Azure Databricks, Azure Data Lake, and Azure Cosmos...
- ...Skills: Snowflake Azure Databricks Azure Data Factory Pyspark Python SQL Job Details: Design,... ...experience and skills : ~ Bachelor's degree in Computer Science, Engineering, or a related field. ~ Proven experience working with Azure...
- ...Senior Data Engineer Job Location Minneapolis, MN (Hybrid Model)-3 days onsite & 2 Days remote Duration: Full Time Job Description: MUST HAVE (Minimum Qualifications) · AWS Platform: Working experience with AWS data technologies, including S3 · Programming Languages...Full timeWork experience placementRemote workWork visa
- ...Job Description We are seeking a Senior Data Engineer with strong experience in data extraction, transformation, and analytics to support enterprise reporting and system modernization initiatives. This role will play a critical part in sunsetting legacy systems, extracting...Remote work
$106.9k - $176.5k
...take your career wherever you want it to go. Join EY and help to build a better working world. Technology – Data and Decision Science – Data Engineering – Senior We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering...Summer holidayFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to 8281 - Data Engineer. Be the first to apply!
Related searches
- data analysis part time Brooklyn Park, MN
- data Brooklyn Park, MN
- clinical data Brooklyn Park, MN
- data network cabling Brooklyn Park, MN
- provider data management Brooklyn Park, MN
- data modeling Brooklyn Park, MN
- clinical data coordinator remote Brooklyn Park, MN
- data tech Brooklyn Park, MN
- vp data engineering
- senior cloud data engineer

