Data Engineer
HonorVet Technologies
Job Title: Data Engineer
Location: Appleton, WI Job Description
Job Description:
We are building out an Enterprise Data Platform (EDP) entirely on the cloud, utilizing Databricks on AWS. The project involves two teams focused on data ingestion, with a framework already established using Python and Spark for processing. The platform leverages DBT for data modeling. Our goal is to enhance data transformation capabilities while maintaining high standards for testing and data quality.
Key Responsibilities:
Required Skills and Experience:
Interview Process:
Location: Appleton, WI Job Description
- Must have: PySpark, Python Databricks
Job Description:
We are building out an Enterprise Data Platform (EDP) entirely on the cloud, utilizing Databricks on AWS. The project involves two teams focused on data ingestion, with a framework already established using Python and Spark for processing. The platform leverages DBT for data modeling. Our goal is to enhance data transformation capabilities while maintaining high standards for testing and data quality.
Key Responsibilities:
- Lead Data Ingestion: Oversee and guide the data ingestion process, ensuring efficient and accurate data integration.
- Mentorship: Mentor junior engineers, promoting engineering excellence and improving delivery processes.
- Data Expertise: Utilize extensive knowledge of various data structures (Oracle, DB2, Mainframe, MongoDB, DynamoDB) to optimize data ingestion and transformation.
- Data Profiling: Analyze structured, unstructured, and semi-structured data to determine the best methods for profiling and ingestion.
- Ownership: Take full ownership of data sources and datasets, determining the best methods for ingestion and understanding the data thoroughly.
- Collaboration: Work closely with staff engineers and other team members to schedule and conduct interviews, ensuring a collaborative and proactive work environment.
Required Skills and Experience:
- Technical Proficiency: Strong experience with Databricks, AWS, Python, Spark, and DBT.
- Cloud Migration: Proven track record in cloud migration projects, particularly moving on-premises systems to the cloud.
- Data Modeling: Expertise in data modeling and transformation, with a focus on the Medallion architecture.
- Leadership: Demonstrated ability to lead teams, mentor junior engineers, and drive engineering excellence.
- Data Structures: In-depth knowledge of various data structures, including Oracle, DB2, Mainframe, MongoDB, and DynamoDB.
- Data Profiling: Experience with profiling structured, unstructured, and semi-structured data to optimize ingestion processes.
- Soft Skills: Accountable, collaborative, and proactive, with strong communication and interpersonal skills.
Interview Process:
- Round 1: Technical interview with staff engineers.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Appleton, WI vacancy
- ...set of technologies and practices for transforming business information into actionable reports and visualizations. The Senior Data Engineer transforms data into a useful format for analysis and is focused on the design and architecture. A Senior Data Engineer is the...Suggested
- GCP Data Engineer – (Subcontract at an NRI) Summary As a Data Engineer on the Data Analytics Data Platform (DADP) team, you analyze, develop, and deliver business intelligence solutions primarily using Google Cloud Platform (GCP) data platform‑related services. The Data...SuggestedWork experience placement
NRI North America
Menasha, WI2 days ago - ...Data Engineering Manager You've discovered something special. A company that cares. Cares about leading the way in construction, engineering, manufacturing and renewable energy. Cares about redefining how energy is designed, applied and consumed. Cares about thoughtfully...SuggestedFull timeWork experience placementWork at officeRemote workMonday to FridayFlexible hours
Faith Technologies
Menasha, WI1 day ago $22 per hour
Requisition #: 20821Functional Area: Client ServiceEmployment Type: Full-TimeWork Options: In Office / Partial Remote from Neenah/Appleton/Oshkosh area #LI-HybridWork Hours: M-F 9:30am-6:00pm CSTPosition Summary J. J. Keller is looking for a Technical Support Specialist...SuggestedFull timeWork at officeLocal areaRemote workFlexible hours- ...POSITION SUMMARY As the most senior individual contributor on our Data Science team, you will set the technical direction for how U.S.... ...—while shaping the analytical strategy, raising the bar on engineering rigor, and developing the next generation of data scientists....SuggestedPermanent employmentFull timeWork experience placementH1bRemote work
U.S. Venture
Appleton, WI4 days ago - ...company that cares. Cares about leading the way in construction, engineering, manufacturing and renewable energy. Cares about redefining how... ...of the business tactics, initiatives and strategies.Conducts data gathering and analysis to understand requirements.Coordinates or...Full timeWork at officeMonday to FridayFlexible hours
Faith Technologies
Menasha, WI1 day ago - Network Health WI is seeking a Database Administrator to design and maintain databases, ensuring high data availability. This position involves implementing security policies and monitoring database performance, with occasional travel to the Menasha office. Candidates...Full timeWork at officeRemote work
Network Health Plan (Wisconsin)
Menasha, WI3 days ago $26 - $29 per hour
...Title Regulatory Reporting Analyst Job Description The Product Reporting Analyst supports regulatory reporting, statistical data submissions, rating maintenance, and data management activities for insurance-related products. This role ensures that all required...Permanent employmentContract workTemporary workWork at officeRemote workMonday to FridayFlexible hoursAston Carter
Neenah, WI3 days ago$600 per month
...nurture and strengthen relationships with municipal and business leaders to grow business segment reach and market. McMahon provides engineering services to cities, villages, townships, utility districts, sewerage districts, counties, WisDOT, school districts, businesses,...Full timeLocal area$20 per hour
Remote Work - Looking for Online Respondents We are looking for self-motivated individuals who have the ability to set aside a few hours a week to complete market research studies online. Top companies and national brands are looking for real feedback from...Remote workHAUS
Appleton, WI1 day ago- ...portfolio analytics with risk management to optimize loan growth while maintaining prudent risk controls. The ideal candidate has 2+ years in consumer lending or risk analytics, strong quantitative skills, and experience with data visualization tools. #J-18808-Ljbffr...
Community First Credit Union
Neenah, WI1 day ago - ...optimism and focus. We don't settle until we give our best and know that we're making a difference. We're looking for a Senior Civil Engineer to join our Advanced Manufacturing group, and you'll have the chance to work on projects including state of the art industrial and...Work at officeLocal area
Jacobs
Freedom, WI3 days ago $80k - $85k
...Pay: $80,000 - $85,000 / year Job Functions: Promotes and fosters a safe and secure operating environment. Performs engineering support and liaison functions with equipment manufacturers. Assists in technical acceptance of aircraft being added to fleet. Performs technical...Night shiftWeekend workAir Wisconsin Airlines
Appleton, WI2 days ago- ...coordinating technical investigations, maintaining product and quality data, facilitating laboratory testing and reporting, and... ...Qualifications Associate's degree in Quality, Chemistry, Engineering, Technical Sciences, Business, or a related field; Bachelor's degree...Work at office
M2S Group
Appleton, WI2 days ago $22 - $28 per hour
IT Support Analyst Ready to take ownership of technical challenges while supporting users, systems, and workplace technology? SEEK Careers/Staffing is recruiting an experienced IT Support Analyst for a hands-on role supporting employees, equipment, applications, networks...Full timeTemporary workWork at officeLocal areaImmediate startRemote workShift workDay shiftSEEK Careers/Staffing
Neenah, WI5 days ago$80 - $85 per hour
...Talent Acquisition Lead | Certified Tech Recruiter Job Title: AWS Data Architect Location: Neenah, WI or Oconomowoc, WI (Day 1 Onsite... ..., secure, and reliable data flow. Collaborate with data engineers, analysts, and business stakeholders to translate business requirements...Contract work- ...push boundaries, elevate standards, and deliver with purpose. As a senior subject matter expert within our Data Center team, you’ll lead structural engineering efforts across a portfolio of data center projects, including new builds and retrofits. As part of the vision...Contract workFor contractorsRemote work
Jacobs
Freedom, WI3 days ago - ...-effective and transformative projects to the electric vehicle, data center, consumer goods and products, metals, pulp and paper and... ...every location. We're looking for a high-energy, Mechanical HVAC Engineer to focus on our Data Center market. Join us, and you'll impact...Work at officeRemote work
Jacobs
Freedom, WI5 days ago - ...security controls, security infrastructure, and have the opportunity to work with new technologies to protect all credit union systems and data. If this sounds like a perfect fit for you, we'd like to talk! As our Senior Information Security Analyst, you will:...Temporary workLive outWork at officeWork from homeHome office
Community First Credit Union
Neenah, WI3 days ago - ...expertise. As our Information Security Analyst, you’ll be part of the team responsible for maintaining the security and integrity of all data and systems in our Community First enterprise environment. This is an entry-level position where excellent mentorship and real-world...Temporary work
Community First Credit Union | Wisconsin
Neenah, WI1 day ago - ...similar discipline required, preferably in a healthcare or health insurance environment Proficiency using UI Path and/or working in data warehousing practices, systems and technologies Experience working on and leading teams leveraging lean, scrum, or object-...Work at officeLocal areaWork from homeHome officeMonday to Friday
Network Health
Menasha, WI3 days ago - ...reference architectures into detailed designs and implementation plans for infrastructure, networking, and identity management. Engineer scalable, high-availability platforms aligned with business objectives and disaster recovery requirements. Automate deployment...Weekly payTemporary workFlexible hours
Experis/Manpower Group
Appleton, WI4 days ago - ...architectural decisions. The ideal candidate will have a Bachelor's degree in Computer Science and over 10 years of experience in software engineering, including substantial expertise in Microsoft Azure and architecture for AI-augmented delivery. Hybrid work options available....Full time
U.S. Venture, Inc
Appleton, WI8 hours ago - ...software configuration that optimizes and streamlines the application functionality to meet end user and business requirements. Provides data or application expertise for projects and key initiatives. Works collaboratively with end users and other information services...Work at officeShift work
ThedaCare
Appleton, WI4 days ago $97.9k - $146.9k
...$97,900.00 - $146,900.00 The Role We are expanding our technical operations in Neenah and seeking a skilled Cloud Platform Engineer to join our growing team. This is a hybrid role; candidates should be local to the Neenah area and able to work onsite at least three...Work experience placementLocal area3 days per weekPlexus
Neenah, WI3 days ago$16 - $30 per hour
About the position Hello and thank you for your interest! We’re looking for folks nationwide who are great at data entry and typing. We offer a flexible work from home remote position that allows you to stay home with the family! The pay range is flexible from $16/hr to...Remote jobHourly payPart timeWork at officeWork from homeFlexible hours- A data management company is seeking a Data Entry Assistant to remotely ensure the accuracy and integrity of data within their systems. Responsibilities include inputting data, performing regular quality checks, and collaborating with team members to meet deadlines. The...Remote jobWork at office
- About the job Data Entry Assistant (100% Remote) As a Data Entry Associate, you will play a crucial role in maintaining and updating accurate information within our database systems. Your primary responsibilities will include inputting data from various sources into our...Remote jobWork at office
- ...experience in development, systems design, technical analyst, or similar discipline required Proficiency using UI Path and/or working in data warehousing practices, systems and technologies Experience working on and leading teams leveraging lean, scrum, or object-oriented...
- RPA Developer Responsible for developing RPA use cases in Automation Anywhere A360.21 environment. Must have developed use cases using the 11.3 version to assist with migration effort to A360.21. Must have used Python 3.1 in the creation of RPA bots. Responsible for...
Software Technology Inc
Appleton, WI1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data analysis part time Appleton, WI
- data Appleton, WI
- data labeling Appleton, WI
- data technician Appleton, WI
- data internship Appleton, WI
- clinical data coordinator remote Appleton, WI
- data visualization Appleton, WI
- sap master data Appleton, WI
- health data Appleton, WI
- data collection researcher Appleton, WI