Senior Software Engineer (Big Data) Job Description Template
Our company is looking for a Senior Software Engineer (Big Data) to join our team.
Responsibilities:
- Design and develop big data and real-time analytics solutions using industry standard technologies;
- Work with data architects to ensure that Big Data solutions are aligned with company-wide technology directions;
- Develop web services that make big data available in real-time for in-product applications;
- Lead fast moving development teams using agile methodologies;
- Serve as technical “go to” person for our core technologies – Hadoop, Spark, AWS, Vertica, Tableau, Cassandra, Graph Databases and others.
Requirements:
- Knowledge of Data science technologies, Machine Learning, R;
- Experience with varios offerings from AWS, including S3, EMR, Redshift, Data Pipeline, Athena and Kinesis;
- Strong project leadership experience, including 5 or more years leading multiple complex software development projects using agile methodologies;
- At least 5 years working with production code in immediately relevant field;
- BS in Computer Science. MS Preferred. Or equivalent work experience acceptable;
- Experience in people management or interest in people management is a plus;
- Experience programmer in Java and Python;
- Experience with big-data technologies like hadoop, spark, druid, kafka;
- Knowledge of enacting service level agreements and the appropriate escalation and communication plans to maintain them;
- Experience with Hadoop, Hive, HBase, Spark, Kafka, Storm, Druid, Cassandra, Columnar Databases and Graph Databases;
- Experience working with open-source software is a plus;
- Familiarity with Deep Learning frameworks like TensorFlow & Keras;
- Experience troubleshooting production deployment;
- Experience with Cloud technologies for scaling like Linux containers, Kubernetes, Virtual Machines etc. a plus;
- Programing in any one of C/C++ or Scala will be considered a positive.