Data Engineer

Data Engineer New York, New York, United States About The Job Required Qualifications: Strong in Python with 3+ years hands-on coding experience 3+ years experience in designing and building Microservices 3+ years experience with REST API design and development using Python 3+ years experience with deployment/scaling of apps on containerized environment (i.e., Kubernetes, AKS) 3+ years experience with real-time and streaming technology (i.e., Azure Event Hubs, Azure Functions Kafka, Spark Streaming) 3+ years experience with cloud-based platforms (i.e., Azure, GPC, AWS) Experience building automated big data pipelines Experience performing data analysis and data exploration Experience working in an agile delivery environment Experience with Snowflake Experience with RDBMS and NoSQL Databases and hands-on query tuning/optimization Experience working in multi-developer environment, using version control (i.e., Git) Experience with orchestrating pipelines using tools (i.e., Airflow, Azure Data Factory) Experience with data modeling and system architecture design Experience partnering cross-functionally with other technical teams (i.e., data ingestion, data science, operational systems) to align priorities and achieve deliverable outcomes Experience with setting coding standards, performing code reviews, and mentoring junior developers Exposure/understanding DevOps best practice and CICD (i.e., Jenkins) Ability to understand complex systems and solve challenging analytical problems Strong critical thinking, communication, and problem-solving skills and a quick learner Preferred Qualifications: Experience in Azure/GCP. Solid understanding of Kafka architecture and building consumers for high volume data streams. Experience with bash shell scripts, UNIX utilities & UNIX Commands Previous healthcare experience and domain knowledge Education: Bachelors degree in computer science, Engineering, Statistics, Physics, Math, or related field or equivalent experience Preferred: masters degree with coursework focused on advanced algorithms, mathematics in computing, data structures, etc. Preferred Locations: Dallas/Irving, Chicago, Boston/Wellesley, NYC, Hartford CT, Blue Bell PA, Scottsdale AZ, or Woonsocket RI. Inizio Partners