Big Data Engineer
Keylent Inc
Big Data Engineer Chicago IlVisa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp or 3rd Parties: Yes. Senior candidates only with 10+ years experience. Initially remote but they should be open to relocate post COVID situation.Roles/Responsibilities:Create and maintain optimal data pipeline architectureAssemble large, complex data sets that meet functional / non-functional business requirementsIdentify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability etc.Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'Big data' technologiesBuild analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metricsWork with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needsCreate data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leaderRequired Qualifications:5+ years of experience (Sr-level)Strong Programming experience with object-oriented/object function scripting languages: Scala5+ years of experience (Mid-level)Experience with big data tools: Hadoop, Apache Spark etc1+ years of strong technical Experience with AWS cloud services and DevOps engineering: S3, IAM, EC2, EMR, RDS, Redshift, Cloudwatch with Docker, Kubernetes, GitHub, Jenkins, CICDExperience with stream-processing systems: Python, Spark-Streaming, etc. (Nice to have)1+ Years of experience with relational SQL or, Snowflake and NoSQL databases, like Postgres and Cassandra.
$110k - $125k
...Big Data EngineerWe are seeking an experienced Big Data Engineer to design, develop, and optimize enterprise-scale big data solutions. The ideal candidate will have strong hands-on expertise in the Hadoop ecosystem, Spark, Scala, Hive, Apache NiFi, and Kafka, along with...Big dataWork from homeFlexible hoursSelect Minds LLC
Chicago, IL1 day ago- ...motivated candidate to join our talented Team. Job Title: Sr. Data Engineer Location(s): Chicago, IL (Hybrid) Key Skills: AWS (EMR,... ...extensive experience in data engineering, cloud services, and big data technologies, with a strong focus on AWS services, Python...Big dataLocal areaRemote work
Ampcus
Chicago, IL5 days ago - ...Sr. Data Engineer This role is responsible for providing technical expertise and leadership to design and deliver end-to-end data engineering... ...highly optimal codebase and perform Spark optimizations for Big Data use cases. Design, develop and deploy optimal...Big dataFor contractorsRemote work
1872 Consulting
Oak Brook, IL10 hours ago - ...Senior Data Engineer Chicago, IL ONSITE FROM DAY 1 We need a STRONG database candidate who has good experience in Databricks + Python... ...or data engineer with experience developing and deploying big data analytics applications using Databricks on the Azure platform...Big data
Zortech Solutions
Chicago, IL4 days ago $150k - $200k
...and software systems are continually re-engineered, optimized, and maintained to stay on top... ...Belvedere Trading is looking for a proven Senior Data Engineer to work directly with our... ...NeedExperience designing and developing big data warehouses and ETL pipelines.Proven...Big dataFull timeBelvedere Trading
Chicago, IL2 days ago$128.01k - $152.18k
...risks with confidence.Job DescriptionAI-First Data Strategy for P&C Insurance Carrier | Lead... ...SolutionsWe are seeking a Senior Data Engineer to spearhead our transition to a modern, first... ...platforms (e.g., Snowflake; Databricks, big data, analytics) relevant to P&C insurance...Big dataFull timeWork at officeLocal areaArgo Group
Chicago, IL3 days ago- ...Data Engineer Visa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp... ...experience in Strong Spark/ Scala or Python coding. Job Title - Big Data Engineer Roles/Responsibilities: Create and...Big data
Keylent Inc
Chicago, IL1 day ago - ...Role : Sr Data Engineer Location : Chicago IL (look for Nearby candidates) Hybrid (3 days office, 2 days WFH) Must... ...into a new Data Lake • Strong understanding of RDBMS, NoSQL, big data, SQL, and ETL tools. • Experience programming with at least...Big dataWork at officeWork from home
Concord IT Systems
Chicago, IL2 days ago $135.04k - $202.56k
Sr Staff Data Engineer - GE07DEStaff Data Engineer - GE07CEWe’re determined to make a difference and are proud to be an insurance company that... .../Hybrid architecturesResearch, experiment, and utilize leading big data methodologies (AWS, Hadoop/EMR, Spark, Kafka, Snowflake)...Big dataFull timeTemporary workWork at office3 days per weekThe Hartford Financial Services Group
Chicago, IL2 days ago- ...We're looking for an experienced, driven Principal Data Engineer to join our Chicago office. You'll do well here if you enjoy a fast-moving... ...financial markets. What You'll Do Design, build and roll out our Big Data platform (Kafka, Hadoop, Dremio, etc.) Develop, deploy...Big dataWork at office
Fintal Partners
Chicago, IL11 hours ago $46.07 - $68.64 per hour
...internal equity and industry specific market data. The pay range for each role reflects Rush... ...of each case. Summary: The Data Engineer is responsible for designing and implementing... ...Combines, optimizes, and manages multiple big data sources. • Builds data...Big dataHourly payFull timeRemote workShift workRush University
Chicago, IL2 days ago$215.2k - $244.7k
...This is an excellent opportunity to work with clients developing Big Data strategy and roadmaps, while gaining exposure to a variety of... ...-on experience with Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation...Big dataLocal areaImmediate startFlexible hoursWest Monroe Partners
Chicago, IL2 days ago$135k - $165k
Job Description As a Senior Data Engineer/ Lead Engineer, you will be responsible for designing, developing, and maintaining scalable Big Data solutions. You will work with large datasets, real-time processing frameworks, and cloud-based data platforms to enable data-driven...Big dataContract workSapient
Chicago, IL2 days ago- ...Description: Data Specialist to assist with enabling BI (Business Intelligence) datasets to support Tableau dashboards.... ...5+ years experience Required Skills : Snowflake,Data Analysis,Tableau,ETL,SQL Additional Skills : Storage Engineer,BI Analyst,Big DataBig data
Kaav Inc.
Chicago, IL3 days ago - ...Staff Data EngineerAt IMO, a core team of clinicians, software developers, and data scientists... ...We are currently in need of a Staff Data Engineer to join this team! The Staff Data Engineer... ...of data sources using SQL and AWS ‘big data’ technologies.Builds analytics tools...Big dataRemote work
Software Technology Inc
Chicago, IL1 day ago - Publicis Sapient in Chicago Hybrid is seeking a Senior Associate Data Engineer to design, develop, and maintain scalable Big Data solutions across batch and streaming pipelines on cloud platforms. You will work with clients to translate requirements into data architectures...Big data
$145k
...on collaboration, cutting-edge technology, data driven solutions, and automation. We... ...and Singapore.What you’ll do as a Software Engineer on the Data Engineering team at Akuna:We are... ...collect and transform our rapidly growing Big Data set within our hybrid cloud architecture...Big dataInternshipWork at officeAkuna Capital
Chicago, IL5 days ago- ...healthcare. This position requires extensive data and integration experience. Required... ...Talend Data Integration, Talend Big Data migration platform Edition 6.2.1 or... ...outages, unexpected data, etc., as well as engineering the code base for straightforward extensions...Big dataWork experience placement
Samprasoft
Chicago, IL5 days ago - ...Mathematics, Applied Statistics, Electrical Engineering, Mechanical Engineering or related... ...modeling. Should have very good experience of data tuning on Green Plum or other MPP... ...data movement technologies. Expertise on big data technologies such as HDFS, PIG, HIVE...Big dataFull time
$175k - $225k
We are seeking a dedicated and experienced Data Engineer to join our Chicago team. The ideal candidate is energized by working in a cutting‑... ...markets. Core Responsibilities Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.) Build, deploy,...Big dataPermanent employmentFull time- ...Job Description Job Description Data Engineer Employment Type: Full-Time, Mid-level Department: Business Intelligence CGS is... ...manipulate data (Python, R, SQL, SAS). -Strong knowledge of big data analysis and storage tools and technologies. -Strong understanding...Big dataFull timeFlexible hours
Contact Government Services, LLC
Chicago, ILa month ago - ...Description Job Description Description: Hybrid at least 2 days per week in office in Chicago, IL Our client seeks a Staff Data Engineer to set technical direction for large-scale data processing in a privacy-preserving attribution platform. The role will architect...Big dataHourly payWork at officeLocal area2 days per week
Eliassen Group
Chicago, ILa month ago - ...Role: Big Data Developer Location: Chicago, IL Duration: 6 - 24 Months REQUIRED SKILLS: ~ Development ~ Design/architecture ~ Hadoop Talend Hortonworks ~ Pig ~ Hive ~ Kafka Spark Job...Big dataH1bRelocation
3B Staffing LLC
Chicago, IL2 days ago - Tredence is a global analytics services and solutions company. Our capabilities range from Data Engineering, Visualization, Data Management to Advanced analytics, Big Data, Cloud and Machine Learning. Our uniqueness is in bringing the right mix of technology and business...Big data
$80.25k - $133.75k
Overview How You’ll Make an Impact As a Senior Software Engineer on Publicis’s Data Warehouse projects, you will design, build, and optimize large... ...ETL/ELT design and optimization skills. Expertise in big data processing using Apache Spark (preferably Databricks),...Big dataLocal areaFlexible hours- Azure - Data Factory, Databricks, Synapse, ADLS Senior Data Engineer - 8+ Years Experience Job Type: Full-Time Work Model: Hybrid Experience: 8+ Years Employment:... ...Technical Environment Languages: Python, SQL, Scala/Java Big Data: Apache Spark, PySpark, Hadoop Cloud: AWS /...Big dataFull timeWork at officeRemote work
$90k - $200k
..., a list that spans across the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and maintain advanced data... ...tools (git, Jenkins, CI/CD, Jira) Fundamental understanding of big data, open source, and data streaming concepts Ability to...Big dataWork at officeRemote workVisa sponsorshipWork visaFlexible hoursCapTech
Chicago, IL4 days ago$209k - $238.5k
Senior Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast... ...delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real...Big dataFull timePart timeInternshipLocal area$145k - $190k
AI ENGINEER/ DATA SCIENTISTWHO IS SPR?SPR helps companies implement the right technology that helps them balance users’ expectations today... ...including competitive salary, bonuses, generous vacation time, big fitness incentives, and medical/dental/vision insurance. By joining...Big dataTemporary workCasual workInternshipLocal areaFlexible hoursSPR
Chicago, IL5 days ago- ...Analyze data to identify trends, detect variances, explain root causes, and support defect remediation using statistical and regression... ...regression analysis and statistics. · Experience with Python, SQL, Big Data, Hadoop, and data visualization tools. · Machine learning...Big dataContract work
Long Finch Technologies
Berkeley, IL19 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
- data engineer machine learning Chicago, IL
- aws data engineer Chicago, IL
- big data developer Chicago, IL
- sr data engineer Chicago, IL
- big data cloud engineer Chicago, IL
- finance data engineer Chicago, IL
- junior big data engineer Chicago, IL
- entry level data engineer Chicago, IL
- sr information security engineer Chicago, IL
- data center engineer Chicago, IL