Data / DevOps Engineer

Data / DevOps Engineer

An immediate opening for a Data / DevOps Engineer: build CI/CD pipelines for Azure DW (ADF / Synapse Analytics) w/ Azure, Docker / AKS, Python, etc.

This role can be done remotely from the US by those authorized for work in the US. You must work PST / PDT time zone though 5 days a week, including Fridays.

Responsibilities

• Design and develop data pipelines using Linux, Windows, Azure, Docker, Kubernetes / AKS, Jenkins, GitHub w/ Azure Data Factory, Python, etc.
• Pipelines enable data to be pulled from the Azure DW (Synapse Analytics, ADF) and into Power BI so that the business can do self-service reporting
• Overseeing the day-to-day remediation of critical issues and building processes and efficiencies to eliminate the recurrence of the issue
• Understand and articulate business needs into actionable non-functional requirements

Requirements

• Bachelor's degree in Computer Science or related is a plus
• Relevant certifications are a plus
• 2-5 years of Data Engineering / DevOps engineering that includes building/automating data pipelines w/ Azure Data factory in an enterprise Azure DW (Synapse Analytics) environment
• Experience building data pipelines and developing / maintaining continuous integration and continuous deployment and version control technologies
• Experience w/ the following:
• Knowledge of Linux & Windows systems admin
• Experience in designing and developing deploying cloud-native data solutions
• Display proficiency in Azure infrastructure - Virtual Machines, Azure Storage, Azure App Service, and Database offerings
• Azure DevOps
• Experience with containerization tools, Docker
• Experience with orchestration tools, including Kubernetes or Azure Kubernetes
• Jenkins
• Experience with the use of version control systems for code management and artifact tracking, including GitHub or JIRA
• An understanding of data warehousing and Kimball style dimensional modeling techniques
• Azure Data Factory - ability to create basic data pipelines w/ it preferred.
• Azure DW / Synapse Analytics preferred (in the context of automating deployments)
• Experience w/ data streaming a plus
• Experience w/ Databricks as plus.
• Experience with RDBMS including Microsoft (SQL / Azure SQL) and Oracle flavors (both preferred)
• Experience working with columnar file structures like Parquet/Orc is helpful
• Experience with programming languages, including Python, R, etc.
• Familiarity w/ data visualization tools like Power BI helpful
• Mulesoft experience is a plus
• Azure Monitor or App Services is a plus.
• Experience with software development life cycle processes or Agile development, including Scrum
• An understanding of coding practices and DRY principles
• Strong understanding of project life cycle methodology and procedures
• Excellent verbal and written communication skills and experience, including presentations to senior management, peer groups, and associates
• Experience working in a team-oriented, collaborative environment demonstrating strong teamwork and interpersonal skills.