Technology Lead/Data Engineer
Diverse Lynx
Title: Technology Lead/Data Engineer
Duration: 12 Month
Location: Peoria, IL 61630 DETAILED JOB DESCRIPTION:
• Design Responsibilities
Solution & Technical Design
1. Translate business requirements into scalable, maintainable, and secure technical designs across DataStage, SnapLogic, AWS, Python, and Snowflake ecosystems.
2. Create high-level and low-level design documents covering data flows, mappings, process orchestration, and integration patterns.
3. Develop data models, transformation logic, and interface specifications for batch, real-time, and event-driven pipelines.
4. Ensure designs align with enterprise architecture standards, security guidelines, and best practices.
5. Collaborate with product owners, analysts, and architects to finalize solution design and validate technical feasibility.
• Senior Development Responsibilities
Hands-on Development & Implementation
1. Build and enhance ETL/ELT pipelines in IBM DataStage, SnapLogic, and Python.
2. Develop scalable Snowflake SQL, stored procedures, and performance-optimized ELT logic.
3. Implement AWS services (Lambda, S3, SNS, SQS, IAM, CloudWatch,Cloudformation, EventBridge) as part of cloud-native data pipelines.
4. Code reusable frameworks, utilities, and components to accelerate team productivity.
5. Conduct peer code reviews, mentor team members, and establish coding standards.
Must Have Skills:
• SnapLogic
• AWS
• Python
• Snowflake
• DataStage
Nice to Have Skills:
• GitHub CI/CD integration Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Duration: 12 Month
Location: Peoria, IL 61630 DETAILED JOB DESCRIPTION:
• Design Responsibilities
Solution & Technical Design
1. Translate business requirements into scalable, maintainable, and secure technical designs across DataStage, SnapLogic, AWS, Python, and Snowflake ecosystems.
2. Create high-level and low-level design documents covering data flows, mappings, process orchestration, and integration patterns.
3. Develop data models, transformation logic, and interface specifications for batch, real-time, and event-driven pipelines.
4. Ensure designs align with enterprise architecture standards, security guidelines, and best practices.
5. Collaborate with product owners, analysts, and architects to finalize solution design and validate technical feasibility.
• Senior Development Responsibilities
Hands-on Development & Implementation
1. Build and enhance ETL/ELT pipelines in IBM DataStage, SnapLogic, and Python.
2. Develop scalable Snowflake SQL, stored procedures, and performance-optimized ELT logic.
3. Implement AWS services (Lambda, S3, SNS, SQS, IAM, CloudWatch,Cloudformation, EventBridge) as part of cloud-native data pipelines.
4. Code reusable frameworks, utilities, and components to accelerate team productivity.
5. Conduct peer code reviews, mentor team members, and establish coding standards.
Must Have Skills:
• SnapLogic
• AWS
• Python
• Snowflake
• DataStage
Nice to Have Skills:
• GitHub CI/CD integration Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Technology Lead/Data Engineer in Peoria, IL vacancy
$128.47k - $192.71k
...Career Area: Engineering Job Description: Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're... ...living in it. Caterpillar's Earthmoving Division is hiring for Lead Data Engineer - MG/MTP in Peoria, IL. Role Summary Drive data...SuggestedPart timeWork at officeRelocationRelocation packageFlexible hours- ...PROFILES WITHOUT THE REQUIRED DETAILS and TIME SLOTS will be REJECTED. Job Title: Technology Lead | Database Administration | Teradata Administration -- Senior Data & Integration Engineer/Designer/Architect Work Location & Reporting Address: Peoria, IL 61630 (Onsite-...SuggestedHourly payPermanent employmentContract workImmediate startRelocation
- ...Data Management Specialist Perform all necessary data related tasks which could include... ...' experience in data management or data engineering or data operations (data design, data... ...data analytics. Knowledge of data technology products and components for Big Data and...SuggestedShift workWeekend work
- ...Job Title Dealer data ingestion, processing, normalization, storage, and consumption. Typical Day daily standup, collaborate... ...verbal communication, experience working as a member of agile engineering team, ability to commit to and deliver work within allocated...SuggestedWork experience placementLocal areaRemote work
- ...understanding detailed manufacturing process data, executing statistical analysis of... ...maintenance of existing statistical models Lead moderately complex process improvement... ...: • Associates degree or equivalent in engineer, math, or science required. (Bachelors degree...SuggestedRemote work
- ...tools and methods. Maintain and improve data quality scorecard measurements.... ...Four years or more of experience in data engineering and/or software development. Three years... ...Javascript, C++, Scala, etc Knowledge of data technology products and components for Big Data and...
- ...Data Engineer Location: Peoria, IL Duration: 12 months Rate: DOE U.S. Citizens and those who are authorized to work independently... ...Data Engineering Support role ~ Knowledge of data technology products and components for Big Data and Cloud (AWS, Data Lakes...Shift work
- ...Job Title: Data Engineer 3 Requisition ID: 77753-1 Location: Peoria, IL - On-Site Duration: 24 months Typical task breakdown: Develop and maintain data pipelines using Python, SQL, and Snowflake. utomate data processing tasks and reporting...Internship
- ...Data Engineer Basic qualifications: A 4-year degree from an accredited college or university or equivalent experience 3 years or... ...Transformation, Load (ETL) or ELT development skills Knowledge of data technology products and components for Big Data and Cloud (AWS, Data...
- ...support for all our offboard/onboard systems to the field across Construction & E&T industries. Escalate issues to product service engineers and/or CPI find it engineers for assistance. Engagement with engineering teams, PPG and product groups. Field visits to...
- ...algorithms, analytical models, or applications that use product data. This position performs complex analysis work, identifies design... ...telematics data to enhance product performance and efficiency within engine development, and to provide customers’ value-added services,...Internship
- ...Description: Our customer has an exciting opportunity for a Data Scientist . As the Sales and Marketing arm of various heavy... ...Warehouse,SQL Basic Qualification : Additional Skills : AWS Engineer,ETL Developer,Data Scientist,Marketing Analytics Manager,Statistical...Worldwide
- ...Description: Data Scientist role to develop and deliver analytics models for Client's equipment condition monitoring for... ...Learning model development experience - Familiarity with engineering/IOT systems, telematics/timeseries data analysis, and multiprocessing...
- ...Data Visualization Specialist In Parts Pricing As a Data Visualization Specialist in Parts Pricing, you will use methods in visualization... ...discipline (I.e. statistics, economics, mathematics, engineering, finance, computer science/information systems, business analytics...
- Diversified Services Network, Inc. (DSN) is seeking a full-time Data Test Engineer to join our team in Chicago, IL OR Peoria,IL! We offer full... ...Helios data test, working with roughly 5 individuals. Plus 2 leads/mgr from data engineering. EDUCATION & EXPERIENCE REQUIRED:...Full time
- ...Data Engineer The main function of a data engineer is to ensure that the data assets of an organization are supported by an architecture that supports the organization in achieving its strategic goal. A typical data engineer is responsible for setting enterprise standards...
- ...Data Governance Operations Principal Be part of the client’s Digital team exciting... ...experience designing and driving Systems Engineering programs with solid hands-on experience... ...-depth knowledge including business and technology issues related to implementation and approaches...Work at office
- ...implement, and maintain security processes, technologies, and systems. The position monitors... .... Typical day: Performs engineering of security capabilities within Salesforce... ...the Salesforce.com platform Experience leading remediation efforts across a complex IT...Work experience placement
- ...Data Engineer 2 The main function of a data engineer is to ensure that the data assets of an organization are supported by an architecture... ...is typically directed by a direct supervisor, project or team lead. ~ Decisions on routine, medium risk issues that may affect...Work at officeRemote work
- ...Telematics/Data Engineer Location: Onsite in Mossville, IL Job Overview: The Telematics... ...at Caterpillar, working on innovative technologies that enable the monitoring and management... .... Key Responsibilities: Lead data analytics projects and initiatives...Remote work
- ...accelerate issue detection and correction. Transformation of data to enable machine learning and/or monitoring of anomalies.... ...Required (Required) Four years or more of experience in data engineering and/or software development. Three years or more of...
- ...Data Engineer Mossville, IL 1 Year+ No C2C *This req requires successful skills test completion. Candidates must be committed to the testing to be submitted 1. Object-oriented programming and Data modeling 2. 6+ years experience as a Developer...
- ...requires a Secret security clearance. Maximus TCS (Technology and Consulting Services) Internal Job Profile Code... ...operational systems - Prepares and structures data for machine learning pipelines, feature engineering, and model lifecycle management - Implements...Minimum wageFull timeContract workTemporary workFor contractorsWork experience placementRemote work
- ...approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with... ...problems executing on a high throughput system with dynamic data. About the Job: Design, develop, and deploy machine learning...Permanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
$107.66k - $161.7k
...working on our Poe product. About the Team and Role: Our small engineering team works on challenging problems every day. We have a culture... ...end ownership of Machine Learning systems -- from prototyping, data pipelines and training, to realtime LLM application at scale...Remote jobFull timeWork experience placementInternship- ...We use machine learning and Internet-scale data to elevate customer experience, improve efficiency... ...at Instacart works alongside world-class engineers, data scientists, and product managers to shape the future of search technology at Instacart. They collaborate on building...Remote jobPermanent employmentWork experience placementInternshipWork at officeWork from homeFlexible hours
- ...Bachelor's degree in Mechanical, Electrical, or Computer Engineering plus 1-2 years of experience No Associate's degrees Preferred... ...Experience with programming languages such as Python, Matlab, or SQL, data visualization tools such as Tableau, or Power BI, and working...
- ...output datasets and convert them into 'IT owned production code/data tables'] Working closely with IT group to interpret and... ...Education Requirement: Bachelor's degree in an Industrial Engineering, Supply Chain Management, Data Science, Business Analytics, Mathematics...Work at office
- ...Diversified Services Network, Inc. (DSN) is seeking a full-time Data Scientist to join our team in Mossville, IL! We offer full... ...an analytical problem-solver eager to apply ML/AI to real-world engine health and performance challenges within an extremely reputable,...Full timeInternshipWork at office
$175k - $210k
...computational expression generation all the way to data modeling, and you'll have a lot of... ...make key decisions. We're looking for engineers who are product-minded and can think... ...Job function Engineering and Information Technology Industries IT Services and IT...Full timeLocal areaRemote workWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Technology Lead/Data Engineer. Be the first to apply!


