Sr Data Engineer

Role : Sr Data Engineer


Location : Chicago IL (look for Nearby candidates)


Hybrid (3 days office, 2 days WFH)


Must to have: Azure, Databricks, ETL, Python or Hadoop, INFORMATICA or Abinitio, Data lake, SQL,


- AWS S3 and Databricks are top 2 skills needed - MUST HAVE If they don't know databricks, they have to be able to pick it up quickly
- Python & Spark Hadoop/Abinitio/Informatica would be helpful Will be working with pipelines and archiving the data May be moving the data into a new Data Lake
• Strong understanding of RDBMS, NoSQL, big data, SQL, and ETL tools.
• Experience programming with at least one modern language such as Java, Python, Unix Shell.


Below are skills for the two data engineer positions:


Required qualifications, capabilities, and skills:
• BS degree in Computer Science or certification on software engineering.
• Proficient in data analysis, data engineering, data modeling, and database management.
• Strong understanding of RDBMS, NoSQL, big data, SQL, and ETL tools.
• Experience programming with at least one modern language such as Java, Python, Unix Shell.
• Proficiency in REST APIs, microservices, distributed systems and cloud (hybrid) computing .
• Strong understanding of Agile methodologies with ability to work in at least one of the common frameworks.
• Strong understanding of techniques such as CI/CD, TDD, cloud development, resiliency, and security.
• Proven experience with business analysis, design, development, testing, deployment, maintenance, and improvement.


Preferred qualifications, capabilities, and skills:
• Experience working with data intensive software (such as big data, data warehouses, data lakes).
• AWS experience with developing on AWS, S3, Lambda, MSK, EC2, IAM, and related data products.
• Experience with Databricks, Amazon RDS, Oracle, Hadoop/Cloudera, HUE, Hive, Impala.
• Experience with GraphQL.