Azure Data Engineer

Request ID: 109502
Job Title: Azure Data Engineer
Location: Las Vegas, NV, 89101
Duration: 6 months (Extendable)
Pay Range: $45.00-54.00/Hour on W2/C2C (All Inclusive)

Role Descriptions:
Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow, Python and PySpark to ensure the efficient and reliable delivery of data.
Design and implement custom connectors to facilitate the ingestion of diverse data sources into our platform, including structured and unstructured data from various document formats.
Collaborate closely with cross-functional teams to gather requirements, understand data needs, and translate them into technical solutions.
Implement DataOps principles and best practices to ensure robust data operations and efficient data delivery.
Design and implement data CI/CD pipelines to enable automated and efficient data integration, transformation, and deployment processes.
Monitor and troubleshoot data pipelines, proactively identifying and resolving issues related to data ingestion, transformation, and loading.
Conduct data validation and testing to ensure accuracy, consistency, and compliance of data.
Stay up to date with emerging technologies and best practices in data engineering.
Document data workflows, processes, and technical specifications to facilitate knowledge sharing and ensure data governance.

SKILLS: Digital: Python for Data Science, Digital: Snowflake, Digital: PySpark, MySQL

Required Skills & Qualifications:
Bachelor's degree in computer science, Engineering, or a related field
8 years of experience in data engineering, ELT development, and data modeling
Proficiency in using Apache Airflow and Spark for data transformation, data integration, and data management
Strong understanding of SQL and database concepts, with the ability to write efficient queries and optimize performance
Experience implementing DataOps principles and practices, including data CI/CD pipelines
Prior work experience at client or in client's industry
Applicants must be able to work directly for Artech on W2

Preferred Skills & Qualifications:
Familiarity with data visualization tools like Apache Superset and dashboard development
Understanding of distributed systems and working with large-scale datasets
Knowledge of data streaming and real-time data processing technologies (e.g., Apache Kafka)

Company Benefits & Culture:
Competitive salary and benefits package.
Opportunities for professional growth and advancement.
Dynamic and collaborative work environment.
Appreciate your quick response and please feel free to reach me out for any query you may have.