Sr Data Engineer

Sr Data EngineerResource Informatics Group, Inc. is actively seeking a skilled Senior Data Engineer to join our team in Irving, Texas. This role involves contributing significantly to data processes, collaborating within our team, and innovating technically in various data engineering projects. Develop and execute ETL processes for data extraction, transformation, and loading into warehouses and data lakes. Architect data warehousing solutions using Azure Synapse Analytics for efficient querying and reporting. Optimize query performance, data processing speed, and resource utilization within Azure environments. Construct seamless data pipelines across Azure services utilizing Azure Data Factory, Databricks, and SQL Server Integration Services. Collaborate with stakeholders, including data scientists and analysts, to understand data requirements and deliver effective solutions. Manage large data volumes leveraging the Hadoop ecosystem for diverse source collection and loading. Design, maintain, and optimize data processing jobs using Hadoop MapReduce, Spark, and Hive, with coding in Java or Python for custom applications. Monitor job and cluster performance using tools like Ambari and custom monitoring scripts, scaling and maintaining Hadoop clusters and Azure data services. Ensure adherence to data security measures and governance standards. Integrate cross-cloud data with AWS and GCP services. Minimum Requirements: Bachelor's or Master's degree in Computer Science, Engineering, or related fields. Strong expertise in data engineering and cloud-based solutions. 6+ years of experience in data engineering, architecture, and implementation of large-scale data solutions. Proficiency in designing and implementing data models, data structures, and algorithms. Advanced knowledge of SQL and NoSQL databases. Demonstrated expertise in optimizing data pipelines and improving data reliability, efficiency, and quality. Excellent problem-solving capabilities with a keen attention to detail. Strong communication and collaboration skills, with the ability to work effectively across diverse teams. Relevant certifications in cloud technologies (Azure, AWS, or GCP) advantageous.