Senior Data Engineer

Job Title

**Active TS/SCI w/Polygraph REQUIRED**. Please do not apply if you do not currently possess this level of clearance.

Basic Requirements:

• 20 years of experience as a software engineer
• Bachelor's degree in a technical discipline
  • 4 additional years of experience as a software engineer may be substituted for a degree

Job Description:

• The project supports a suite of web-based applications that automate data management for IC data custodians. The products facilitate the capture of information and approvals that allow for the movement of data through the customer mission space in a compliant manner. These products are critical to standardize and simplify data movement as well as data reuse and integration with downstream tools.
• Devise strategies to extract meaning and value from structured and unstructured data.
• Leverage statistical methods and/or machine learning to discover patterns and behaviors of entities.
• Use query and visualization tools, such as DataXplorer and GMAE, to present question focused datasets in a story-like manner.
• Work with various domains of metadata to develop new methodologies and techniques for automated data characterization.
• Analyze and develop requirements to support the characterization and ingestion of new and existing data types.
• Collaborate with customer teams to understand direct mission needs and requirements.
• Devise strategies to extract meaning and value from structured and unstructured data and collaborate with customer teams to understand mission needs.
• Recommend new technologies and processes for complex software projects and serve as the technical lead of multiple software development teams.
• Select the software development process in coordination with the customer and system engineering.
• Ensure quality control of all developed and modified software. Delegate programming and testing responsibilities to one or more teams and monitor their performance.
• Develop simple data queries for existing or proposed databases or data repositories.

Required Experience:

• Minimum of 6 recent years of development experience.
• Knowledgeable with data enrichment/conversion methods, familiar with data ontologies/schemas, strong knowledge of structured data types (XML, CSV, JSON), and has database experience.
• JAVA, analytic development experience, and working knowledge of NIFI are highly desired.

Desired Experience:

• Analytic development experience using scripting languages such as Python and Scala to use statistical libraries against data.
• Skilled with big data processing frameworks such as Pig, MapReduce and Spark to scale algorithms over large volumes of data.
• Experience employing combination (2 or more) of analysis, computer science, mathematics, and software engineering skills to devise strategies for extracting meaning and value from large datasets.
• Experience with predictive analytics, machine learning, and data mining.
• Skilled with data flows, Pig scripting, Hadoop MapReduce, and various analytic tools.
• Skilled working with development and SE teams, other stakeholders agencies, and leadership.
• Knowledge of data indexing and analytic development.
• Experience working with cloud service providers and data stewards.
• Demonstrated experience in network metadata processing, manipulation, and analysis in support of intelligence analysis
• Experience with the following:
  • Java
  • DBA development
  • SQL
  • Query creation
  • PostGreSQL
  • ElasticSearch aggregations

Salary: $230,000 - $240,000 annually. Excellent benefits package including 25 days PTO, 11 paid holidays, 100% employer-paid healthcare for employees and dependents – available day 1, 8% 401(k) employer match – immediate vesting.

Disclaimer: The salary range provided is an estimate based on current market conditions and may be adjusted based on factors such as experience, skills, and qualifications. The final salary offer will be determined after a thorough review of the candidate's background and alignment with the role. Shield Consulting Solutions is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.