AI Data Engineer

AI Data EngineerWe are seeking an experienced AI Data Engineer to design, develop, and manage scalable data platforms that enable advanced analytics, Machine Learning, and Generative AI solutions. The ideal candidate will build robust data pipelines, ensure data quality, and integrate AI/ML capabilities into enterprise data ecosystems.Key ResponsibilitiesDesign, develop, and maintain scalable ETL/ELT pipelines for structured and unstructured data.Build and optimize data lakes, data warehouses, and AI-ready data platforms.Develop ingestion, transformation, and orchestration frameworks using cloud-native technologies.Prepare, cleanse, and engineer datasets for AI/ML and Generative AI workloads.Integrate Large Language Models, vector databases, embeddings, and RAG (Retrieval-Augmented Generation) pipelines into enterprise solutions.Implement data governance, security, lineage, and quality controls.Collaborate with Data Scientists, AI Engineers, Business Analysts, and Solution Architects.Monitor, troubleshoot, and optimize data pipelines and platform performance.Automate deployment, testing, and monitoring of data engineering workflows.Create technical documentation and data dictionaries for enterprise data assets.Required Skills Technical SkillsPython, SQL, PySparkETL/ELT developmentData Modeling (Star Schema, Snowflake Schema)Apache Spark, DatabricksAirflow, Dataflow, Informatica, ADF, Synapse, or equivalent toolsRelational & NoSQL DatabasesData Warehousing conceptsREST APIs and MicroservicesGit, CI/CD, DevOps practicesAI & GenAI SkillsMachine Learning fundamentalsData preparation for AI modelsVector Databases (Pinecone, ChromaDB, FAISS)LLM Integration (OpenAI, Azure OpenAI, Gemini, Claude, etc.)RAG ArchitectureEmbeddings and Semantic SearchPrompt Engineering fundamentalsDiverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence, and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.