Python - Big Data Engineer

Job Title: Lead Consultant | Analytics - Packages | Python - Big Data
Work Location: New YorkNY10004(Prefer local candidate due to drop experience from past)












Job Details:




Must Have Skills
Cortex AI, Agentic AI, Snowflake, Gen AI, MCP, PySpark




Nice to have skills:
Azure




Detailed Job Description
Design and build the Cortex Skills library, agent capabilities, skill packages, and reusable tools
Good hands-on experience working in Python, Spark ETL projects
Build the AI query engine on Cortex Analyst: map business questions to certified semantic views, generate governed SQL
Partner with the Semantic Modelling Lead so agents bind to certified semantic views rather than raw tables
Integrate AI agents with enterprise systems, APIs, databases, knowledge repositories, CI/CD pipelines, and event-driven architectures to create end-to-end intelligent automation frameworks.
Set engineering standards for the pod - prompt versioning, skill packaging, code review, CI/CD for AI assets
Present agent design and demos to client stakeholders at sprint reviews and milestone gates
Good to have: Financial services domain exposure, especially General Ledger, revenue reporting or spend analytics. Understanding of Knowledge graph, ontology concepts
Required Skill/Expertise




Snowflake and Cortex




Hands-on Snowflake Cortex: Cortex Analyst, Cortex Search, Cortex Agents, COCO, semantic views
Strong Python, SQL and Snowflake platform depth - dynamic tables, RBAC, masking policies, warehouse performance, and cost tuning
Understanding of how semantic layers constrain and ground LLM query generation




Minimum years of experience
>10 years




Certifications Needed :No




Top 3 responsibilities you would expect the Subcon to shoulder and execute
Coding
Testing
Deployment




Interview Process (Is face to face required?)
No