DevOps Engineer

DevOps Engineer

This role is W2 only and cannot work corp to corp/1099.

Role Overview

As an Analytics Platform Engineer, you will support Azure and AWS Databricks from a DevOps perspective. This role requires a hybrid skill set spanning cloud infrastructure management, deployment, automation, and CI/CD practices. You will be responsible for developing the foundation for Databricks as an analytics platform, which includes creating automation via Terraform modules and implementing a CI/CD solution in GitLab.

Key Responsibilities

• Implement CI/CD Pipelines: Design and maintain continuous integration and continuous deployment pipelines using tools like GitLab, Azure DevOps, or GitHub Actions.
• Infrastructure as Code (IaC): Provision and manage Azure Analytics services, such as Databricks, using tools like Terraform, ARM templates, or Bicep.
• Platform Operations: Deploy, manage, and optimize the performance and resource utilization of Azure data services. This includes monitoring and troubleshooting data pipeline failures and performance issues.
• Automation & Scripting: Automate routine operational tasks and application deployments using scripting languages like Python, PowerShell, or Bash.
• Security & Compliance: Implement security best practices, including identity and access management (IAM), data encryption, and compliance with data governance policies.
• Collaboration: Work with data engineers, data scientists, and business analysts to translate data requirements into technical solutions.
• Change Management: Follow processes for Change Requests, incidents, vulnerabilities, and problem records.

Required Qualifications

Experience: 4+ years of experience developing APIs and integrating with 3rd party APIs. Experience with version control systems (Git, GitHub, GitLab) and knowledge of CI/CD pipelines and DevOps best practices are required.

Technical Skills: Strong SQL skills (SQL Server or Oracle) and familiarity with scripting languages (Python, Bash, PowerShell). Proficiency with Azure Databricks, Terraform Module Development, and CI/CD tools such as Jenkins or GitLab CI/CD is necessary. Experience with Azure AD, OAuth, JWT, Microsoft Teams SDK, building apps for Teams, Azure AD B2C, BOT, SignalR, AKS, App Registrations, and App Insights is also required.

Preferred Qualifications

• An understanding of workflow automation is a plus.
• Background or exposure to ELT, data engineering, and Database Administration concepts is helpful.

Everforth Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Everforth Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law.