AI Data Engineer

Role: AI Data Engineer


Type: Contract


Location: Remote

Very hands on and skilled developer/engineer:


AI skilled data engineer who designs, builds, and maintains scalable data pipelines, architectures, and systems (data lakes/warehouses/rules registry) to collect, store, and process raw data for analytical, AI, and machine learning use. He/she would model, extract the rules from different data sources such as code base, SQL or PL/SQL, pdf, excel documents etc. and create a knowledge graph / GraphRag. He/she ensure data quality, security, and accessibility, using tools like SQL, Python, and big data technologies (Spark/Kafka) to optimize data performance.

Key Responsibilities:

* Pipeline Development: Design, build, and maintain robust ETL/ELT pipelines for batch and real-time data ingestion.


* Data Extraction/Mapping: Rules extraction using tools such as AWS Bedrock Data Automation (BDA) or Neo4j etc.


* Collaboration: Work with business analysts to understand data needs and build tools that provide insights.

Skills:


* Programming Languages: Proficiency in Python, Java, or Scala.


* Database Systems: Strong SQL knowledge and experience with database management (e.g., PostgreSQL, MySQL).


* Data Modeling: Understanding of data warehouse design and data modeling techniques.


* AWS AI Technologies: Knowledge in AWS Bedrock, SageMaker would be added plus