SR. Data Engineer

Senior Data EngineerRequired Skills & ExperienceBachelor's degree (or equivalent experience) in Computer Science, Mathematics, Statistics, Physics, or a related quantitative field. Proficiency in Python and strong expertise in Scala (preferred) or Java. Hands-on experience with Big Data tools, especially Spark and familiarity with the Hadoop ecosystem. Proficiency in building ETL pipelines and working with AWS services (S3, Lambda, Redshift, EMR). Strong knowledge of SQL and relational databases, plus familiarity with NoSQL. Experience implementing monitoring solutions and deployment pipelines. Ability to work with distributed systems and manage complex data storage solutions.YOE per educational level: PhD: 3+ years Master's: 6+ years Bachelor's: 8+ yearsNice to Have Skills & ExperienceExperience with Linux-based operating systems. Familiarity with text analysis and text mining techniques.Job DescriptionA client of Insight Global, a leading telecommunications provider serving millions of customers, is seeking a Senior Data Engineer to join its Network Analytics team. This role is pivotal in designing and maintaining the data infrastructure that powers enterprise-scale network operations. You will lead efforts to build scalable ETL pipelines using Spark, optimize data storage solutions, and ensure data quality and availability for advanced analytics. Leveraging AWS cloud technologies, you will implement robust monitoring and alerting systems, manage deployment pipelines for continuous integration, and collaborate across teams to align data solutions with business objectives. Beyond technical execution, you will provide strategic guidance on data engineering best practices, document standards, and communicate insights effectively to stakeholders with diverse technical backgrounds. This position offers the opportunity to drive innovation, enhance operational efficiency, and influence data-driven decision-making at scale.This role will pay between $60-70 per hour based on experience.