System Administrator/DevOps Engineer

Job Description Summary:

As a System Administrator/DevOps Engineer, you will be responsible for the deployment, maintenance, and optimization of our AWS-based data warehouse application. You will work closely with our development, data engineering, and business intelligence teams to ensure the reliability, scalability, and security of our systems. Your role will involve managing cloud infrastructure, automating deployment processes, monitoring system performance, and troubleshooting issues.

Job Responsibilities:
• Infrastructure Management:

o Design, deploy, and manage AWS infrastructure for our data warehouse application, including EC2 instances, RDS, Redshift, S3, Lambda, and other AWS services.

o Implement and maintain infrastructure as code (IaC) using tools like Terraform or CloudFormation.

o Ensure high availability, scalability, and security of the data warehouse environment.
• DevOps Practices:

o Develop and maintain CI/CD pipelines for automated deployment of applications and infrastructure changes.

o Collaborate with development teams to integrate DevOps best practices into the software development lifecycle.

o Automate routine tasks and processes using scripting languages (e.g., Python, Bash) and configuration management tools (e.g., Ansible, Puppet).
• Monitoring and Performance Optimization:

o Implement and manage monitoring and alerting systems (e.g., CloudWatch, Prometheus, Grafana) to ensure system health and performance.

o Analyze system performance and optimize resource utilization to reduce costs and improve efficiency.

o Troubleshoot and resolve infrastructure and application issues in a timely manner.
• Security and Compliance:

o Implement and enforce security best practices, including IAM policies, encryption, and network security configurations.

o Ensure compliance with industry standards and regulations (e.g., GDPR, HIPAA) related to data storage and processing.

o Conduct regular security audits and vulnerability assessments.
• Collaboration and Support:

o Work closely with data engineers, analysts, and other stakeholders to understand their requirements and provide infrastructure support.

o Provide technical guidance and mentorship to junior team members.

o Participate in on-call rotations to provide 24/7 support for critical systems.

Required Credentials and Experience:

o Bachelor's degree in computer science, Information Technology, or a related field, or equivalent work experience.

o 5+ years of experience in system administration, DevOps, or a related role.

o Proven experience with AWS services, particularly EC2, RDS, Redshift, S3, Lambda, and IAM.

o Strong understanding of CI/CD pipelines and tools (e.g., Jenkins, GitLab CI, CircleCI).

o Experience with infrastructure as code (IaC) tools such as Terraform or CloudFormation.

o Proficiency in scripting languages (e.g., Python, Bash) and configuration management tools (e.g., Ansible, Puppet).

o Familiarity with monitoring and logging tools (e.g., CloudWatch, Prometheus, Grafana, ELK Stack).

o Strong problem-solving skills and the ability to troubleshoot complex issues.

o Excellent communication and collaboration skills.

o Ability to work independently and as part of a team.

o Strong attention to detail and a commitment to delivering high-quality work.

Preferred Credentials and Experience:
• AWS Certified Solutions Architect, DevOps Engineer, or SysOps Administrator.
• Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
• Knowledge of data warehousing concepts and tools (e.g., Snowflake, BigQuery).
• Familiarity with data pipeline and ETL tools (e.g., Apache Airflow, Glue).