Senior Data Engineer

About the job Senior Data Engineer

Salary: $6,000 - $7,000 per month


Location : New York, USA

Employment option: Remote

Job type: Full time, Part time

Job Summary:


Were looking for a strong Senior Software Engineer with Data Engineering experience. Someone who is proficient in building robust, scalable, maintainable and thoroughly monitored data pipelines on cloud environments.

As a young and ambitious company in an extremely dynamic space, we pride ourselves on being independent, accountable, and organized, have a self-starter attitude, and be willing to get their hands dirty with day-to-day work that might be out of their official scope, while keeping an eye on their goals and the big picture.

Skills

Must Have

Hard skills:
- novice in: AWS, Database Design
- beginner in: MS SQL Server, Linux
- competent in: Databases, Performance Tuning, SQL, Microservices
- proficient in: ETL, Prometheus, Database Management, Service Level Agreement SLA, Snowflake, Data Pipelines, JAVA, Grafana
Nice-to-have

Hard skills:
- novice in: Automation
- beginner in: Oracle
- proficient in: ClickHouse
Soft skills:
- proficient in: Communication Skills

Job Description


Additional Requirements

Required skills

• Education - BSc. in Computer Sciences from a top university, or equivalent.
• Java - Strong background as a software engineer with at least 2+ years experience with Java.
• DB - 8+ years in data engineering, and data pipeline development on high-volume production environments.
• Tools - 2+ years experience with monitoring systems (Prometheus, Grafana, Zabbix, Datadog).
• Experience in object-oriented development. Should have strong software engineering foundations.
• Experience with data-engineering cloud technologies as Apache Airflow, K8S, Clickhouse, Snowflake, Redis, cache technologies and Kafka.
• Experience with relational and non-relational DBs. Proficient in SQL and query optimizations.
• Experience with designing infrastructure to maintain high availability SLAs.
• Experience with monitoring and managing production environments.
• Strong communication skills.

Nice to have - Experience working in fintech or trading industries.

Responsibilities

• Design and develop the data's team micro services - Java services running on K8S.
• Tackle data duplication, velocity, schema adherence (and schema versioning), high availability, data governance, and more.
• Develop, design, and maintain end-to-end ETL workflows, including data ingestion and transformation logic, involving different data sources.
• Enrich financial data through third-party data integrations.
• Develop and maintain our data pipeline written mostly in Java and running on K8S in a micro-service architecture.
• Plan and communicate integrations with other teams that consume the data and use it for insights creation.
• Ongoing improvement of the way data is stored and served. Improve queries and data formats to make sure the data is optimized for consumption by a variety of clients.

Benefits
- Profit sharing
- Food provided

About Company


Company Overview

Enabling Safer Crypto Markets

Our mission is to enable safer crypto trading throughout the investment journey across all centralized and DeFi markets. As the founder of industry leading initiatives like the Crypto Market Integrity Coalition and DACOM Summit, and in everything we do, Solidus is deeply committed to ushering the financial markets of tomorrow.