Data Engineer

Job Description Senior Software Engineer Direct Hire, Permanent Role Herndon, VA (20171)- 100% onsite AMAZING BENEFITS - including 100% employer paid healthcare benefits for employee, paid overtime, 401k match, etc Rate: Up to$190k salary (some flexibility) Key Responsibilities: Architect and Develop: Lead the design, development, and maintenance of complex, scalable data pipelines. Optimize and Troubleshoot: Ensure performance, reliability, and scalability of data pipelines. Collaborate: Work closely with engineers and analysts to understand data requirements and deliver high-quality data solutions. ETL Processes: Implement and manage ETL processes using advanced tools like Apache Airflow, Spark, or similar. Data Quality: Ensure data quality and consistency through rigorous testing, validation, and governance practices. Cloud Infrastructure: Deploy, monitor, and maintain data infrastructure in cloud environments (AWS, GCP, Azure). DevOps Practices: Implement DevOps practices to streamline data workflows, including CI/CD pipelines, Docker, and Kubernetes. Mentorship: Mentor and provide guidance to junior data engineers, fostering a culture of continuous improvement and collaboration. Innovation: Stay up-to-date with industry trends and emerging technologies to drive innovation within the data engineering team. Qualifications: Educational Background: Bachelor's or Master's degree in Computer Science, Engineering, or a related field. Experience: 7+ years of experience in data engineering or related roles. Technical Skills: Advanced proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL). Big Data Technologies: Extensive experience with big data technologies (e.g., Hadoop, Spark). Cloud Platforms: Deep understanding of cloud platforms (AWS, GCP, Azure) and their data services. DevOps Expertise: Strong understanding and practical experience with DevOps practices and tools (CI/CD, Docker, Kubernetes). Problem-Solving: Proven ability to optimize and troubleshoot complex data systems and pipelines. Communication: Excellent problem-solving skills and attention to detail. Leadership: Strong communication and leadership abilities, with experience mentoring junior engineers. Preferred Qualifications: NoSQL Databases: Experience with NoSQL databases (e.g., MongoDB). Programming Languages: Proficiency in programming languages such as Python, Java, or Kotlin. Data Visualization: Experience with data visualization tools (e.g., Tableau, Power BI). Data Governance: Strong understanding of data governance and security practices. Agile/Scrum: Experience working in Agile/Scrum environments. #J-18808-Ljbffr