Data Engineer
PROLIM Corporation
We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data platforms. The ideal candidate will have strong expertise in Python, SQL, Spark, ETL processes, and cloud technologies to support data-driven decision-making and advanced analytics.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
- Build and optimize data processing solutions using Python, SQL, and Apache Spark (PySpark).
- Develop batch and real-time data ingestion pipelines.
- Work with structured and unstructured datasets from multiple data sources.
- Design and implement cloud-based data solutions using Azure, AWS, or GCP.
- Develop and maintain data models, data lakes, and enterprise data warehouses.
- Integrate data from APIs, databases, and streaming platforms.
- Optimize data pipeline performance and ensure data quality.
- Collaborate with Data Scientists, Business Analysts, and Software Engineers.
- Implement CI/CD pipelines and DevOps best practices for data engineering.
- Troubleshoot production issues and provide ongoing support.
- Ensure compliance with data governance, security, and privacy standards.
- 5+ years of experience as a Data Engineer.
- Strong programming skills in Python .
- Excellent SQL skills.
- Hands-on experience with Apache Spark / PySpark .
- Experience with ETL/ELT development.
- Strong knowledge of Data Warehousing concepts.
- Experience with Hadoop ecosystem (Hive, HDFS).
- Experience with Databricks.
- Experience with Apache Kafka.
- Hands-on experience with Apache Airflow or similar workflow orchestration tools.
- Experience working on Linux/Unix environments.
- Knowledge of Git and CI/CD pipelines.
Experience with one or more of the following:
- Microsoft Azure (ADF, ADLS, Synapse)
- Amazon Web Services (AWS)
- Google Cloud Platform (GCP)
- Snowflake
- Delta Lake
- Docker
- Kubernetes
- Terraform
- Scala or Java
- Power BI or Tableau
- REST APIs
- Agile/Scrum methodology
- Experience working with large-scale enterprise data platforms
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer in Peoria, IL vacancy
$112.71k - $183.14k
...with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.As a Senior Data Engineer on the Helios Data Engineering team, you will be responsible for developing Python data pipelines that build business data...SuggestedFull timePart timeFlexible hours- ...anomalies, using a variety of tools and methods.Maintain and improve data quality scorecard measurements.Employee is also responsible for... ...Required(Required)Four years or more of experience in data engineering and/or software development.Three years or more of experience...Suggested
Samprasoft
East Peoria, IL1 day ago - ...designing, gathering and understanding detailed manufacturing process data, executing statistical analysis of product demand, analyzing... .../Experience Requirements:• Associates degree or equivalent in engineer, math, or science required. (Bachelors degree nice to have)• 3+...SuggestedRemote work
Software Technology Inc
Peoria, IL1 day ago - ...Data Management SpecialistPerform all necessary data related tasks which could include data design, data quality, data triage, data... ...Skills Required5-7 years' experience in data management or data engineering or data operations (data design, data quality, metadata,...SuggestedShift workWeekend work
Samprasoft
Peoria, IL1 day ago - ...Job Title: Data Engineer 3 Requisition ID: 77753-1 Location: Peoria, IL - On-Site Duration: 24 months Typical task breakdown: Develop and maintain data pipelines using Python, SQL, and Snowflake. utomate data processing tasks and reporting...SuggestedInternship
Kasmo Global
Peoria, IL3 days ago - ...Software Engineer Typical task breakdown: daily standup, collaborate with peers, work independently to complete sprint commitments, participate in agile ceremonies. Candidates local to Peoria would be onsite hybrid. 100% remote candidates ok - please note preference...Local areaRemote work
Software Technology Inc
Peoria, IL4 days ago $112.71k - $183.14k
...Senior Data Engineer – Helios Data Engineering team at Caterpillar Inc. You will develop Python data pipelines that build business data objects to support applications. Responsibilities Perform all programming, project management, and development assignments without close...Part timeRelocation packageFlexible hoursCaterpillar Brazil
Peoria, IL1 day ago- ...Data Engineer 2The main function of a data engineer is to ensure that the data assets of an organization are supported by an architecture that supports the organization in achieving its strategic goal. A typical data engineer is responsible for setting enterprise standards...Work at office
Software Technology Inc
Morton, IL1 day ago - ...Data Engineer Mossville, IL 1 Year+ No C2C *This req requires successful skills test completion. Candidates must be committed to the testing to be submitted 1. Object-oriented programming and Data modeling 2. 6+ years experience as a Developer...
3B Staffing LLC
Mossville, IL2 days ago - ...Data Engineer The main function of a data engineer is to ensure that the data assets of an organization are supported by an architecture that supports the organization in achieving its strategic goal. A typical data engineer is responsible for setting enterprise standards...
Samprasoft
Mossville, IL16 hours ago - Deloitte is seeking an experienced Data Engineer to join its technology team and work on enterprise-level data solutions. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, data platforms, and analytics solutions....
$60 - $61 per hour
...address you have provided. These communications may include information about potential opportunities and information. Message and data rates may apply. Message frequency may vary. You represent and warrant that the email address(es) and/or telephone number(s) you...Hourly payFull timeLocal areaFlexible hoursAditi Consulting
East Peoria, IL4 days ago$89.21k - $133.81k
...living in it.Caterpillar Inc. seeks Aftermarket Insights Sales Data Scientist at its facility located at 501 SW Jefferson Ave, Peoria... ...a Master’s degree, or foreign equivalent, in Industrial Engineering, Mechanical Engineering, Computer Engineering, or a related field...Full timePart timeRemote workFlexible hours$97.53k - $158.48k
...With over 1.5 million connected assets worldwide, our teams use data, technology, advanced analytics, telematics and AI capabilities... ...in statistics, applied mathematics, data science, analytics, engineering, computer science, or a similar field with quantitative courseworkProven...Full timePart timeWorldwideFlexible hours- ...Development, Software Consultancy and Information Technology Enabled Services.Job DescriptionPreferred• At least 4 years experience of Data warehousing concepts, dimensional Star Schema and Snowflakes Schema methodology.• At least 4 years of Expertise in Data Warehousing...Permanent employmentFull timeH1b
- ...will contribute to the understanding, implementation, and flow of data through manufacturing processes. This position will work... ...understanding and skills Database design principles Database Reverse Engineering Skills OLAP/Database connections Identifying missing...Full timeRemote work
Software Technology Inc
East Peoria, IL4 days ago - ...Data Scientist Location: Peoria, Illinois, USA | | Job Code: PAN-00000048 About the Opportunity This role offers an exciting... ...with statistical analysis, machine learning, and feature engineering Proficiency in data visualization tools such as Power BI or...Flexible hours
Rose INT
Peoria, IL1 day ago $100k
...Job Title: AI Engineer Location: Peoria, IL Work Environment: IN-OFFICE ONLY (Peoria, IL) Not a remote or hybrid position. Job... ...Build and maintain end-to-end machine learning pipelines, from data ingestion and preprocessing to model training, evaluation, and deployment...Full timeWork at officeIt360 Inc
Peoria, IL16 hours ago- ...IAM, Certificate Manager, ELB, EBS, ECS, CloudFront/WAF, SQS, SNS, SES. Experience troubleshooting issues related to UI / API & Data flow Expertise with high availability architecture Experience in Monitoring Tools (Ex: Thousand Eyes, AppDynamics, Grafana etc...Work experience placementShift workWeekend work
Samprasoft
Peoria, IL16 hours ago - ...service level agreements. • Serves as the primary point of contact for Tier 1 for the lines of business the Digital /Prod Service Engineering supports. • Supports continuous improvement efforts. • Creates and updates self service and Tier 1 support knowledge articles...Worldwide
Kaav Inc.
Peoria, IL3 days ago - ...Development, Software Consultancy and Information Technology Enabled Services. Job DescriptionHadoop Support Analyst:--> Workflow and data load monitoring--> Issue management (identification and investigation, troubleshooting, escalation and resolution).--> Be able to...
$120.52k - $175.65k
...challenges.Principal Duties & ResponsibilitiesDesign, develop, test, and deploy enterprise AI applications using modern software engineering practices.Build intelligent solutions utilizing Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI agents, and...Full timeWork at officeLocal area- Role: Java Developer Location: Peoria, IL Duration: 12 months Job Description: Client wants a Strong front end Mid/Sr level Java Developer Must have Angular 2, Typescript, Bootstrap, Spring MVC and Full Stack Development experience...Immediate startRelocation
3B Staffing LLC
Peoria, IL2 days ago $175k - $210k
...You'll work on exciting problems in computational expression generation all the way to data modeling, and you'll have a lot of autonomy to make key decisions. We're looking for engineers who are product-minded and can think creatively to solve core problems. What We're...Full timeLocal areaRemote workWork from home$128.47k - $192.71k
...Earthmoving Division is seeking a Machine Development Lead R & D Engineer to lead a team of multi-disciplinary test engineers developing... ...making skillsExperience using Microsoft tools for automation and data analysisUnderstanding of Lean principles and continuous improvementExperience...Full timePart timeWork at officeRelocation packageFlexible hours$46k - $50k
Technical Support Specialist At Illinois Mutual, our culture is built around our four core values. These values shape how we operate and define our expectations of each team member's contributions: Be honest, reliable and respectful Think of other first Work...Immediate start2 days per week1 day per weekIllinois Mutual
Peoria, IL1 day ago$36k - $50k
...issues involving desktops, applications, printers, basic networking, and end-user support — while collaborating with Tier 2 and Tier 3 engineers as needed. Key Responsibilities Provide Tier 1 technical support for desktops, laptops, printers, and core Microsoft...Full timeWork at officeIT360
Peoria, IL16 hours ago$91k - $121k
...of competitive analysis, market positioning, salary structures, data maintenance, as well as developing compensation reports to... ...century, we’ve been at the forefront of designing, building, and engineering premium, award-winning products. Today, Marvin is also proud to...Temporary workRelocationRelocation packageMarvin
Peoria, IL11 hours ago- Company Description At Northwestern Medicine, every patient interaction makes a difference in cultivating a positive workplace. This patient-first approach is what sets us apart as a leader in the healthcare industry. As an integral part of our team, you'll have the...Part timeWork at office
Northwestern Memorial Healthcare
Peoria, IL16 hours ago $147.76k - $240.11k
...governing scalable AWS and Azure solutions for the Global Finance Services Division. You will partner with AI architects, software and data engineers, cybersecurity, and business stakeholders to deliver secure, resilient, cost-effective cloud platforms that power enterprise-...Full timePart timeRelocationFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- junior data engineer remote Peoria, IL
- data engineering intern summer Peoria, IL
- data network cabling Peoria, IL
- data capturer Peoria, IL
- clinical data coordinator remote Peoria, IL
- data tech Peoria, IL
- data technician Peoria, IL
- provider data management Peoria, IL
- data recovery Peoria, IL
- data visualization Peoria, IL