Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer

PROLIM Corporation

We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data platforms. The ideal candidate will have strong expertise in Python, SQL, Spark, ETL processes, and cloud technologies to support data-driven decision-making and advanced analytics. Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL/ELT workflows. Build and optimize data processing solutions using Python, SQL, and Apache Spark (PySpark). Develop batch and real-time data ingestion pipelines. Work with structured and unstructured datasets from multiple data sources. Design and implement cloud-based data solutions using Azure, AWS, or GCP. Develop and maintain data models, data lakes, and enterprise data warehouses. Integrate data from APIs, databases, and streaming platforms. Optimize data pipeline performance and ensure data quality. Collaborate with Data Scientists, Business Analysts, and Software Engineers. Implement CI/CD pipelines and DevOps best practices for data engineering. Troubleshoot production issues and provide ongoing support. Ensure compliance with data governance, security, and privacy standards. Required Skills 5+ years of experience as a Data Engineer. Strong programming skills in Python . Excellent SQL skills. Hands-on experience with Apache Spark / PySpark . Experience with ETL/ELT development. Strong knowledge of Data Warehousing concepts. Experience with Hadoop ecosystem (Hive, HDFS). Experience with Databricks. Experience with Apache Kafka. Hands-on experience with Apache Airflow or similar workflow orchestration tools. Experience working on Linux/Unix environments. Knowledge of Git and CI/CD pipelines. Cloud Skills Experience with one or more of the following: Microsoft Azure (ADF, ADLS, Synapse) Amazon Web Services (AWS) Google Cloud Platform (GCP) Preferred Skills Snowflake Delta Lake Docker Kubernetes Terraform Scala or Java Power BI or Tableau REST APIs Agile/Scrum methodology Experience working with large-scale enterprise data platforms PROLIM Corporation

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Peoria, IL vacancy
  • Job Title Dealer data ingestion, processing, normalization, storage, and consumption. Typical Day daily standup, collaborate with peers...  ...verbal communication, experience working as a member of agile engineering team, ability to commit to and deliver work within allocated... 
    Suggested
    Work experience placement
    Local area
    Remote work

    Samprasoft

    Peoria, IL
    4 days ago
  • $89.21k - $144.96k

     ...can all enjoy living in it. Career Area Technology, Digital and Data What You Will Do Responsibilities of the incumbents are across...  ...and resolution Interprets design requirements for engineering implementation Building and deploying CICD pipelines Implementing... 
    Suggested
    Part time
    Relocation package
    Flexible hours

    Caterpillar Inc.

    Peoria, IL
    3 days ago
  • Description: Perform all necessary data related tasks which could include data design, data quality, data triage, data governance...  ...Skills Required: 5-7 years' experience in data management or data engineering or data operations (data design, data quality, metadata,... 
    Suggested
    Shift work
    Weekend work

    Kaav Inc.

    Peoria, IL
    4 days ago
  • $97.53k - $158.48k

    ## Data EngineerApply: Peoria, Illinois: Chicago, Illinois: Full time: Posted Yesterday: R0000393553**Career Area:**Technology, Digital...  ...our customers build a better, more sustainable world*As a Data Engineer on the Platform Data Engineering team, you will be responsible... 
    Suggested
    Full time
    Part time
    Worldwide
    Relocation package
    Flexible hours

    Caterpillar Brazil

    Peoria, IL
    3 days ago
  • Job Title: Data Engineer 3 Requisition ID: 77753-1 Location: Peoria, IL - On-Site Duration: 24 months Typical task breakdown: Develop and maintain data pipelines using Python, SQL, and Snowflake. utomate data processing tasks and reporting workflows using Snowflake scripts... 
    Suggested
    Internship

    Kasmo Global

    Peoria, IL
    4 days ago
  •  ...full potential of embodied intelligence. We go beyond typical data-driven(1) approaches or pure transformer-based architectures, and...  ..., and turn them into the ranked problem list that drives our engineering roadmap. About the Job As a Data Platform Engineer, Infrastructure... 
    Work at office
    Flexible hours

    FieldAI

    Peoria, IL
    2 days ago
  •  ...designing, gathering and understanding detailed manufacturing process data, executing statistical analysis of product demand, analyzing...  .../Experience Requirements:• Associates degree or equivalent in engineer, math, or science required. (Bachelors degree nice to have)• 3+... 
    Remote work

    Software Technology, Inc.

    Peoria, IL
    4 days ago
  • Deloitte is seeking an experienced Data Engineer to join its technology team and work on enterprise-level data solutions. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, data platforms, and analytics solutions.... 

    Lonvec Technologies Private Limited

    Washington, IL
    3 days ago
  • Data Engineer Mossville, IL 1 Year+ No C2C *This req requires successful skills test completion. Candidates must be committed to the testing to be submitted 1. Object-oriented programming and Data modeling 2. 6+ years experience as a Developer/Data Engineer 3. 3+ years... 

    3B Staffing LLC

    Mossville, IL
    4 days ago
  • Data Engineer The main function of a data engineer is to ensure that the data assets of an organization are supported by an architecture that supports the organization in achieving its strategic goal. A typical data engineer is responsible for setting enterprise standards... 
    2 days per week

    My3Tech Inc

    Morton, IL
    2 days ago
  •  ...to accelerate issue detection and correction. Transformation of data to enable machine learning and/or monitoring of anomalies....  ...Required: (Required) Four years or more of experience in data engineering and/or software development. Three years or more of experience... 

    Samprasoft

    Mossville, IL
    4 days ago
  • Data Engineer The main function of a data engineer is to ensure that the data assets of an organization are supported by an architecture that supports the organization in achieving its strategic goal. A typical data engineer is responsible for setting enterprise standards... 

    Samprasoft

    Mossville, IL
    4 days ago
  • $100k

     ...Cloud World/Oracle Java one (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023. All positions are open for all...  ..., data analysts/data scientists, and machine learning engineers for full-time positions with clients. Who should apply? Recent... 
    Full time
    H1b

    SynergisticIT

    Peoria, IL
    2 days ago
  •  ...Snowflake Database Administration (implementing, debugging/troubleshooting/tracing, issue resolution) ~ Data Governance and Architecture ~ Strong SQL and query engineering / Data pipeline / ETL development (view/query authoring, troubleshooting, performance tuning) ~... 
    Hourly pay
    Long term contract
    Full time
    Contract work
    Relocation
    Flexible hours

    Swoon Staffing West Coast

    Peoria, IL
    14 days ago
  •  ...Job Title: Data Analyst / BI Analyst – Snowflake, Tableau, Power BI Work Location: Peoria, IL, (Hybrid) Work Auth: All visas accepted...  ...Work with AI-enabled workflows, including data pipeline engineering and prompt engineering Collaborate with business stakeholders... 
    Work visa

    Xcelo Group

    Peoria, IL
    2 days ago
  •  ...Job Description What You'll Get To Do Design and build the data platform, frameworks, and developer tooling that power ingestion...  ...Have ~ Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field. ~3–5+ years of experience in... 

    FieldAI

    Peoria, IL
    2 days ago
  •  ...will contribute to the understanding, implementation, and flow of data through manufacturing processes.This position will work...  ...understanding and skillsDatabase design principlesDatabase Reverse Engineering SkillsOLAP/Database connectionsIdentifying missing datasets to... 
    Full time
    Remote work

    Software Technology Inc

    East Peoria, IL
    2 days ago
  • $100k

     ...Job Title: AI Engineer   Location: Peoria, IL   Work Environment: IN-OFFICE ONLY (Peoria, IL) Not a remote or hybrid position. Job...  ...Build and maintain end-to-end machine learning pipelines, from data ingestion and preprocessing to model training, evaluation, and deployment... 
    Full time
    Work at office

    It360 Inc

    Peoria, IL
    8 hours ago
  • Data Scientist Our customer has an exciting opportunity for a Data Scientist. As the Sales and Marketing arm of various heavy equipment division, operates all around the globe to support customers and dealers in a highly competitive environment. This role supports the... 
    Worldwide

    Samprasoft

    Peoria, IL
    4 days ago
  • $105.79k - $141.05k

     ...the trusted network for the AI‑powered world, connecting people, data, and applications through our expansive fiber network and...  ...the U.S. The Role At Lumen, the Lead Information Security Engineer owns the development, maintenance, and defensibility of the security... 
    Full time
    Temporary work
    Remote work

    Lumen

    Peoria, IL
    4 days ago
  • $89.21k - $144.96k

     ...building a better world, so we can all enjoy living in it.Launch your data science or technical analyst career by building AI and...  ...data, and advanced analytics while partnering with experienced engineers and data scientists.  Cat Digital is the digital and technology... 
    Full time
    Part time
    Internship
    Relocation
    Flexible hours

    Caterpillar

    Peoria, IL
    8 hours ago
  • $136.49k

     ...based on company performance Visa sponsorship Senior Business Data Analyst Cintal, Inc. (Peoria, IL) needs Senior Business Data...  ...using historical and current business data. Partner with data engineering and IT teams to ensure appropriate data models, data availability... 
    Temporary work
    Local area
    Relocation
    Visa sponsorship

    Cintal Inc

    Peoria, IL
    5 days ago
  •  ...Job Description Job Description Senior Software Engineer – Java/AWS Hybrid – Chicago, IL or Peoria, IL (2 Days Onsite/Week) Diversified...  ...~ Solid knowledge of computer science fundamentals, including data structures and algorithms. Soft Skills Ability to work... 
    Full time
    Shift work
    Weekend work
    2 days per week

    Diversified Services Network, Inc.

    Peoria, IL
    8 days ago
  •  ...Data Entry OperatorOperates data entry equipment to record and/or verify data from source documents. Keys in alpha and numerical characters. May also answer phones, file, duplicate, and process single forms, etc. Work location in Caterpillar at 500 N. Morton Ave in Morton... 

    Trice Healthcare

    Peoria, IL
    2 days ago
  •  ...Data Entry Operator | Junior (Remote)Peoria, IL, United States Job Openings Data Entry Operator | Junior (Remote)A Data Entry Clerk, is responsible for inputting data and making changes to existing data figures in digital databases. Their duties include inputting data... 
    Remote work

    Only Data Entry

    Peoria, IL
    1 day ago
  • Role: Java Developer Location: Peoria, IL Duration: 12 months Job Description: Client wants a Strong front end Mid/Sr level Java Developer Must have Angular 2, Typescript, Bootstrap, Spring MVC and Full Stack Development experience. Please Fill up following details...
    Immediate start
    Relocation

    3B Staffing LLC

    Peoria, IL
    4 days ago
  • $36k - $50k

     ...issues involving desktops, applications, printers, basic networking, and end-user support — while collaborating with Tier 2 and Tier 3 engineers as needed. Key Responsibilities Provide Tier 1 technical support for desktops, laptops, printers, and core Microsoft... 
    Full time
    Work at office

    IT360 Inc

    Peoria, IL
    24 days ago
  • $46k - $50k

    Job Description Job Description Description: Job Title: Technical Support Specialist Department: Information Technology Reports To: AVP Infrastructure & Operations Location: Home Office Job Type: Full Time Commitment to Core Values At Illinois...
    Full time
    Immediate start
    Home office
    2 days per week
    1 day per week

    Illinois Mutual Life Insurance Company

    Peoria, IL
    24 days ago
  •  ...supply chain planning resources to proactively address material requirements changes resulting from new product introduction and engineering / product change control. Analyzes engineering releases for changes and/or new releases and coordinates effective release dates to... 

    My3Tech Inc

    Peoria, IL
    2 days ago
  • $50 - $60 per hour

     ...living skills. Implement strategies to reduce maladaptive behaviors and promote positive behavior changes. Collect and analyze data on behavior and progress to evaluate the effectiveness of interventions and make data-driven decisions. Maintain detailed records... 

    Brightspring Home Health - Pensacola

    Peoria, IL
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!