Data Engineer

Job Description

Our client is seeking a Data Engineer to design, build, and optimize enterprise data solutions within the Azure ecosystem. This individual will develop scalable data pipelines, data lake and warehouse solutions, and advanced data transformations using Azure Synapse, Apache Spark, T-SQL, Python, and/or Scala. Responsibilities include data modeling, ETL/ELT development, performance tuning, monitoring platform health, and implementing governance and security best practices. The engineer will partner closely with business analysts, data scientists, and stakeholders to deliver reliable, high-performing data platforms while working in an Agile environment utilizing DevOps and CI/CD practices.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to View email address on click.appcast.io learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

Skills and Requirements

Bachelor's degree in Computer Science, Information Systems, Engineering, or equivalent experience

Strong experience with Azure Synapse Analytics and Azure Data Lake Storage

Advanced T-SQL development and performance tuning experience

Hands-on experience with Apache Spark using Python and/or Scala

Experience designing and building enterprise ETL/ELT data pipelines

Data warehouse and data modeling experience

Experience with Git source control and CI/CD pipelines in Azure DevOps

Strong communication skills and ability to work with technical and business stakeholders

Experience supporting large-scale cloud-based data platforms Azure Data Factory experience

Azure Data Lake Gen2 expertise

Dedicated and Serverless SQL Pool experience

Azure Databricks

Azure Functions, Event Hubs, Logic Apps, Key Vault, and Power BI

Azure Data Engineer Associate or Azure Solutions Architect certifications

Delta Lake or Lakehouse architecture experience

Knowledge of data governance, security, compliance, NERC/FERC, GDPR, or CCPA standards