Data Engineer
PROLIM Corporation
We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data platforms. The ideal candidate will have strong expertise in Python, SQL, Spark, ETL processes, and cloud technologies to support data-driven decision-making and advanced analytics.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
- Build and optimize data processing solutions using Python, SQL, and Apache Spark (PySpark).
- Develop batch and real-time data ingestion pipelines.
- Work with structured and unstructured datasets from multiple data sources.
- Design and implement cloud-based data solutions using Azure, AWS, or GCP.
- Develop and maintain data models, data lakes, and enterprise data warehouses.
- Integrate data from APIs, databases, and streaming platforms.
- Optimize data pipeline performance and ensure data quality.
- Collaborate with Data Scientists, Business Analysts, and Software Engineers.
- Implement CI/CD pipelines and DevOps best practices for data engineering.
- Troubleshoot production issues and provide ongoing support.
- Ensure compliance with data governance, security, and privacy standards.
- 5+ years of experience as a Data Engineer.
- Strong programming skills in Python .
- Excellent SQL skills.
- Hands-on experience with Apache Spark / PySpark .
- Experience with ETL/ELT development.
- Strong knowledge of Data Warehousing concepts.
- Experience with Hadoop ecosystem (Hive, HDFS).
- Experience with Databricks.
- Experience with Apache Kafka.
- Hands-on experience with Apache Airflow or similar workflow orchestration tools.
- Experience working on Linux/Unix environments.
- Knowledge of Git and CI/CD pipelines.
Experience with one or more of the following:
- Microsoft Azure (ADF, ADLS, Synapse)
- Amazon Web Services (AWS)
- Google Cloud Platform (GCP)
- Snowflake
- Delta Lake
- Docker
- Kubernetes
- Terraform
- Scala or Java
- Power BI or Tableau
- REST APIs
- Agile/Scrum methodology
- Experience working with large-scale enterprise data platforms
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Peoria, IL vacancy
$112.71k - $183.14k
...with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.As a Senior Data Engineer on the Helios Data Engineering team, you will be responsible for developing Python data pipelines that build business data...SuggestedFull timePart timeFlexible hours- ...Job Title Dealer data ingestion, processing, normalization, storage, and consumption. Typical Day daily standup, collaborate... ...verbal communication, experience working as a member of agile engineering team, ability to commit to and deliver work within allocated...SuggestedWork experience placementLocal areaRemote work
Samprasoft
Peoria, IL3 days ago $112.71k - $183.14k
Senior Data Engineer - Helios Data Engineering team at Caterpillar Inc. You will develop Python data pipelines that build business data objects to support applications. Responsibilities Perform all programming, project management, and development assignments without close...SuggestedPart timeRelocation packageFlexible hours- Deloitte is seeking an experienced Data Engineer to join its technology team and work on enterprise-level data solutions. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, data platforms, and analytics solutions....Suggested
$97.53k - $158.48k
...With over 1.5 million connected assets worldwide, our teams use data, technology, advanced analytics, telematics and AI capabilities... ...in statistics, applied mathematics, data science, analytics, engineering, computer science, or a similar field with quantitative courseworkProven...SuggestedFull timePart timeWorldwideFlexible hours$89.21k - $133.81k
...living in it.Caterpillar Inc. seeks Aftermarket Insights Sales Data Scientist at its facility located at 501 SW Jefferson Ave, Peoria... ...a Master’s degree, or foreign equivalent, in Industrial Engineering, Mechanical Engineering, Computer Engineering, or a related field...Full timePart timeRemote workFlexible hours$128.47k - $208.77k
...With over 1.5 million connected assets worldwide, our teams use data, technology, advanced analytics, telematics and AI capabilities... ...better, more sustainable world.Job Summary:The Cloud Analytics Engineering team within Advanced IoT Analytics is seeking a talented and...Full timePart timeWorldwideFlexible hours- ...Development, Software Consultancy and Information Technology Enabled Services.Job DescriptionPreferred• At least 4 years experience of Data warehousing concepts, dimensional Star Schema and Snowflakes Schema methodology.• At least 4 years of Expertise in Data Warehousing...Permanent employmentFull timeH1b
- ...Data Scientist Location: Peoria, Illinois, USA | | Job Code: PAN-00000048 About the Opportunity This role offers an exciting... ...with statistical analysis, machine learning, and feature engineering Proficiency in data visualization tools such as Power BI or...Flexible hours
Rose INT
Peoria, IL4 days ago $100k
...Job Title: AI Engineer Location: Peoria, IL Work Environment: IN-OFFICE ONLY (Peoria, IL) Not a remote or hybrid position. Job... ...Build and maintain end-to-end machine learning pipelines, from data ingestion and preprocessing to model training, evaluation, and deployment...Full timeWork at officeIt360 Inc
Peoria, IL1 day ago- ...Development, Software Consultancy and Information Technology Enabled Services. Job DescriptionHadoop Support Analyst:--> Workflow and data load monitoring--> Issue management (identification and investigation, troubleshooting, escalation and resolution).--> Be able to...
$120.52k - $175.65k
...challenges.Principal Duties & ResponsibilitiesDesign, develop, test, and deploy enterprise AI applications using modern software engineering practices.Build intelligent solutions utilizing Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI agents, and...Full timeWork at officeLocal area$65k - $70k
...building frontline agent processes Analyze customer behavior data and make recommendations based on findings Test and utilize... ...Follow the link to our website for a list of job openings in Engineering, IT, Project Management, and more! Expected Compensation...Full timeDiversified Services Network, Inc.
Peoria, IL7 days ago$175k - $210k
...You'll work on exciting problems in computational expression generation all the way to data modeling, and you'll have a lot of autonomy to make key decisions. We're looking for engineers who are product-minded and can think creatively to solve core problems. What We're...Full timeLocal areaRemote workWork from home$16 per hour
...various lines of the business. Assist Specialists and other employees with customer follow-up. Input, cross-reference, and retrieve data from multiple internal and external databases. Maintain detailed notes within a customer tracking system. Other duties as...Hourly payFull timeWork experience placementInternshipWork at officeLocal areaRemote workShift workCarvana
Peoria, IL4 days ago$46k - $50k
Job Description Job Description Description: Job Title: Technical Support Specialist Department: Information Technology Reports To: AVP Infrastructure & Operations Location: Home Office Job Type: Full Time Commitment to Core Values At Illinois...Full timeImmediate startHome office2 days per week1 day per weekIllinois Mutual Life Insurance Company
Peoria, IL8 days ago$36k - $50k
...issues involving desktops, applications, printers, basic networking, and end-user support — while collaborating with Tier 2 and Tier 3 engineers as needed. Key Responsibilities Provide Tier 1 technical support for desktops, laptops, printers, and core Microsoft...Full timeWork at officeIT360 Inc
Peoria, IL16 days ago- Company Description At Northwestern Medicine, every patient interaction makes a difference in cultivating a positive workplace. This patient-first approach is what sets us apart as a leader in the healthcare industry. As an integral part of our team, you'll have the...Part timeWork at office
Northwestern Memorial Healthcare
Peoria, IL1 day ago - ...production implementation of integration solutions. This role will work with a global team to develop back end integrations that move data between systems while providing web based real time status reporting. Development work will be on AWS lambda technology using...Long term contractFull timeContract workRelocationFlexible hours
Swoon Staffing West Coast Skilled
Peoria, IL8 days ago $147.76k - $240.11k
...governing scalable AWS and Azure solutions for the Global Finance Services Division. You will partner with AI architects, software and data engineers, cybersecurity, and business stakeholders to deliver secure, resilient, cost-effective cloud platforms that power enterprise-...Full timePart timeRelocationFlexible hours- ...Software Development, Software Consultancy and Information Technology Enabled Services. Job Description--> Develop and implement new data ingestion and asset creation processes on CDH 5;--> Optimize Hadoop performance and availability; and --> Develop and implement data...Work experience placement
- ...Business Oriented IT environment with rich involvement in technology innovation, ERP and CRM counselling, Product Engineering, Business Intelligence, Data Management, SOA, BPM, Data Warehousing, SharePoint Consulting and IT Infrastructure. Our other offerings include modified...Worldwide
$97.53k - $146.29k
...With over 1.5 million connected assets worldwide, our teams use data, technology, advanced analytics, telematics and AI capabilities... ...works closely with business stakeholders, support teams, and engineering partners to ensure the successful operation of Digital Marketing...Full timePart timeWorldwideFlexible hoursShift work$112.71k - $183.14k
...This role owns the overall design, configuration, maintenance, data inputs, and reporting outputs of the Apptio platform. This role... ...construction and mining equipment, off-highway diesel and natural gas engines, industrial gas turbines and diesel-electric locomotives. Backed...Full timePart timeRelocationFlexible hours- ...the GS-1805-9 level, some of your typical work assignments may include: Gathering, researching, and analyzing various types of data from federal, state, local and public agencies. Providing administrative support and assistance to USMS Criminal Investigators in...Local area
Department of Justice
Peoria, IL1 day ago $91k - $121k
...of competitive analysis, market positioning, salary structures, data maintenance, as well as developing compensation reports to... ...century, weve been at the forefront of designing, building, and engineering premium, award-winning products. Today, Marvin is also proud to...Temporary workRelocationRelocation packageMarvin
Peoria, IL4 days ago- Req ID: 31587At NTT DATA Services, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our company’s growth, market presence and our ability to help our clients stay a step ahead...For contractorsWeekend work
- ...Data Entry Operator Operates data entry equipment to record and/or verify data from source documents. Keys in alpha and numerical characters. May also answer phones, file, duplicate, and process single forms, etc. Work location in Caterpillar at 500 N. Morton Ave in...
- .... There are several actions that could trigger this block including submitting a certain word or phrase, a SQL command or malformed data. What can I do to resolve this? You can email the site owner to let them know you were blocked. Please include what you were doing...
- ...Data Entry Operator | Junior (Remote) Peoria, IL, United States Job Openings Data Entry Operator | Junior (Remote) A Data Entry Clerk, is responsible for inputting data and making changes to existing data figures in digital databases. Their duties include inputting...Remote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data engineering intern summer Peoria, IL
- data network cabling Peoria, IL
- data capturer Peoria, IL
- clinical data coordinator remote Peoria, IL
- data tech Peoria, IL
- data technician Peoria, IL
- provider data management Peoria, IL
- data recovery Peoria, IL
- data visualization Peoria, IL
- data analysis part time Peoria, IL