Sr. Data Engineer with Data Bricks

Job Title

7 years or more relevant software development experience with a fairly "Full Stack" profile

Experience of delivery within a trading environment.

Experience working in fast-paced project delivery using AGILE methods

Strong software development skills, knowledge of best practices (SOLID, CI/CD, etc.)

Python 3

Creating applications and packages

Writing reliable unit and end-to-end tests with PyTest

Data manipulation with Pandas

Web development with Python

MS Azure: virtual networks, key vaults and storage, security

MS DevOps pipelines

Kubernetes containers

ReactJS front end development experience

MS SQL backend development experience

Experience in developing API's in python using FastAPI

Hands on in ADF and Azure Databricks

Desirable:

Knowledge of physical commodities trading markets and organisations (esp. Client/ gas/oil).

Useful to have Data Engineering experience blended along with core software engineering experience

Experience of working directly with traders on trader models.

Python: Bokeh visualization, Tornado web framework, asyncio programming, Azure Python API

Hashicorp Terraforms (azurerm)

Kafka Confluent

Conda package management

Basic knowledge in numerical calculus, such as multi-dimensional function interpolation, numerical differentiation

Basic understanding of the WebSockets protocol

Knowledge of the OAuth2 and web security

Basic knowledge of modern JavaScript, TypeScript, Node.js

Personal Attributes:

A determined focus on the user and user experience when problem-solving

Team player and able to collaborate, proactively communicates and shares understanding and experience within a team

Clear communicator and able to work in a multicultural/lingual environment

Uses initiative and owns their deliverables end-to-end

Brings ideas to the table, is inquisitive and excited by new technology

Used to working in a flexible, independent manner on a mixture of small unstructured and large structured items

Provides regular, considered feedback and regularly strives to improve their own ways of working