Data Engineer Jobs

What Impact You'll Have GRVTY's team provides tactical data engineering solutions. We embed skilled Data Engineers, Data Scientists, and ETL Developers directly into intelligence analyst groups to be their go-to data wranglers. We develop new tools, code, and services to execute data engineering activities. Our engineers work to collect, process, and feed analytic tools, turning data into intelligence in response to immediate mission needs, with direct impact on real world situations. You will see your work used here on a daily basis, and you'll have the opportunity to support a variety of Sponsor mission organizations and mission partner organizations. This is a time of development and growth on the program, with an increasing number of missions being supported. The work is high impact and important, and the customer moves quickly. The environment is fast-paced, flexible, and open to innovation - you'll have more latitude here in choosing how to achieve results than on many other projects. The customer cares more about what you can do as opposed to your years of experience, and work hours are typically quite flexible - roll up your sleeves, get things done, and no one cares much about the specific hours that you work. The work space itself is also quite nice, and there is an excellent cafeteria! The tech stack on this team is rather huge and includes Python (Pandas, numpy, scipy, scikit-learn, standard libraries, etc.), Python packages that wrap Machine Learning (packages for NLP, Object Detection, etc.), Linux, AWS/C2S, Apache NiFi, Spark, pySpark, Hadoop, Kafka, ElasticSearch, Solr, Kibana, neo4J, MariaDB, Postgres, Docker, Puppet, and many others. Work on this program takes place in McLean, VA and in various field offices throughout Northern VA (we cannot support remote work) and requires a TS/SCI + Polygraph clearance (acceptable to this customer). What You'll Be Owning GRVTY is seeking a Data Engineer with a TS/SCI + Poly clearance (applicable to this customer) to join one of our top projects in Chantilly, VA. Responsibilities Develop new tools, code & services to execute data engineering activities. Activities include the following tasks: Movement of structure & unstructured data using approved methods. Execute data ingestion activities for storing data in a local or enterprise level location. View data in its source format. Develop code to format data that supports exploration. Analyze source data formats & work with Data Scientists & partners to determine the formats & transforms that best meet mission objectives. Develop code and tools to provide one-time & on-going data formatting & transformations into enterprise or boutique data models. Implement existing ETL code & best practices/standards. Develop an ETL Code Transition Plan. Develop & deliver documentation for each project including ETL mappings, code use guide, code location & access instructions. Facilitate Code Reviews. Provide consulting services to support data transport, ingestion, conditioning, access, & management. What You Must Have Active TS/SCI with Polygraph Clearance Ability and willingness to quickly learn a new tool Strong communication skills with both your teammates, and your leads SQL, Python, Pyspark experience. Willingness to do development type work when needed (junior level development at best) Ability to be a self starter and ask questions when needed Comfortable working with and manipulating data in compliance with the offices workflow Extract, Transform and Load (ETL) tools and processes. AWS APIs Linux Geospatial tools/data What Would Be Nice to Have Palantir Foundry Experience Kubeflow Experience with OCR and text extraction of PDFs. Experience with data validation / data quality after ETLing to be sure it's ready for end users Docker Jenkins Hadoop/Spark Kibana Kafka NiFi ElasticSearch GRVTY