Data Engineer (SME) CK22

Fuel

Data Engineer (SME), McLean

Duties and Responsibilities:

• Create and maintain a data pipeline architecture.
• Assemble large, complex data sets that meet mission requirements.
• Identify, design, and implement improvements, including re-designing infrastructure for scalability, optimizing data delivery, and automating manual processes.
• Build infrastructure for efficient extraction, transformation, and loading of data from various sources using AWS, SQL, NiFi technologies.
• Develop analytical tools to utilize data pipelines, providing actionable insights into data performance, operational efficiency, and customer acquisition.
• Collaborate with mission stakeholders to address data-related technical issues.
• Support technology stakeholders' data infrastructure needs and assist with technical issues.

Skills and Experience:

• Proficiency in building and optimizing data sets, 'big data' pipelines, and architectures.
• Ability to perform root cause analysis on processes and data to identify improvements and answer questions.
• Strong analytical skills working with unstructured datasets.
• Experience in building processes supporting data transformation, workload management, data structures, dependencies, and metadata.

• Bachelor’s degree in information systems, informatics, statistics, or computer science/software engineering.
• Minimum of five years of experience with tools such as:

• Big data tools like Kafka, Spark, Hadoop.
• Relational, NoSQL, and SQL databases including Cassandra and PostgreSQL.
• Workflow management and pipeline tools such as Airflow, Luigi, and Azkaban.
• AWS services including Redshift, RDS, EMR, and EC2.
• Stream-processing systems like Spark-Streaming and Storm.
• Object-oriented scripting languages including Scala, C++, Java, and Python.
• Data workflow orchestration tools like PentaO or Apache NiFi.

About Fuel

Fuel Consulting LLC helps clients create the path to their future. Clients receive expertise that requires no ramp-up time to deliver best practices, customized tools, and methodologies to help them achieve their vision and leave a legacy. If helping others and working with a talented team excites you, then Fuel is the place for you. Fuel offers... #J-18808-Ljbffr