Big Data Developer

Data EngineerLocation: Must be on-site 3 days a week in McleanQualifications2+ years experience in the following: Big Data and distributed programming models and technologies and techniques such as Hadoop, Spark, Map Reduce, Sqoop, Hive, Hadoop Distributed File System (HDFS), Distributed Indexing and Databases (HBase, Hive, Cassandra, Vertica), Serialization Formats (JSON, Avro, Parquet), Pyspark, Spark, Scala, Hive Tuning, Bucketing, Partitioning.Knowledge of database structures, theories, principles, and practices (both SQL and NoSQL).Experience and working knowledge in Kafka, Spark streaming, Sqoop, Oozie, Airflow/ Control-M/Autosys.Experience with Python and Shell Scripting and basic system admin knowledge on Linux environments.Bachelors degree in Information Technology, Computer Science, Engineering or related field or equivalent combination of education and work experience.Well versed with Information and application security including LDAP, certificates, public key encryption, SSH, access credentials, etc.Knowledge or experience in Jira, Confluence, Bitbucket & ServiceNow.Ability to assist with production incidents, triage across multiple teams, and apply short-term / long-term fixes.Ability to independently perform all duties from analysis to deployment to postproduction defect fixing.Experience with data corrections made to production data stores.Experience in ELK stack, Splunk or any other monitoring systems a plus.Experience working in Agile, Lean/Kanban, or Scaled Agile organization a plus.Experience on one or more ETL/ELT tools like DataStage, Talend etc. a plus.