Data Engineer II

Data Engineer II

Location: Arlington, Virginia, USA | Employment Type: W2, Full-Time 

About the Opportunity

This role focuses on designing, implementing, and maintaining scalable enterprise ETL processes and robust data pipelines for a global client base. You will leverage big data frameworks like Apache Spark and Hadoop, along with SQL and Python, to optimize data processing and ensure high data quality.

Why Join Us?

• Work on enterprise-scale data engineering projects with global impact
• Collaborate with cross-functional teams in a dynamic, professional environment
• Opportunity to apply industry best practices including version control and code reviews
• Contribute to high-value data solutions across various industries and clients

Key Responsibilities

• Design, implement, and maintain data pipelines using ETL frameworks and distributed data processing engines
• Develop scalable and efficient code to process data, ensuring availability and accessibility
• Optimize data processing using SQL and other database technologies to handle large datasets efficiently
• Automate routine data tasks and streamline processes to improve operational efficiency
• Collaborate with senior engineers to address data challenges while maintaining high data quality standards

Qualifications

• 8+ years of hands-on data engineering experience building large-scale ETL pipelines
• Strong proficiency in Apache Spark (PySpark, Spark SQL, Spark Streaming), Hadoop ecosystem (HDFS/Ozone, Hive, YARN), Python, and SQL
• Experience with data modeling concepts and database design for scalable data solutions
• Ability to analyze and troubleshoot data issues with minimal supervision
• Knowledge of testing and validating data to ensure accuracy and consistency in data pipelines
• Excellent verbal and written communication skills for technical and non-technical stakeholders
• Bachelor's degree in Engineering, Mathematics, Finance, Business, or related field (or equivalent practical experience)

Ready to Apply?

Local candidates preferred. U.S. Citizens or Green Card holders only.

Contact: Show email

Phone: View phone number on product.excelhire.com

Take the next step in your career!