Databricks Integration and Python Developer
c1advantage.com
Job Title: Databricks Integration and Python Developer - Cloud & Front Office Support Location: New York City, NY (Hybrid - 3 days onsite) Overview: We are seeking a Cloud Integration and Python Developer to join the IT Derivatives team in New York City . This hybrid role (3 days onsite) combines Databricks cloud integration and operational platform support with Python development for Front Office financial applications . You will work closely with quantitative analysts, trading desks, and infrastructure teams to industrialize a Python-based pricing solution in Azure Databricks , orchestrate production workflows, and ensure performance, stability, and reliability in a mission-critical environment. Key Responsibilities: Cloud Integration & Operations
- Configure and manage Azure Databricks clusters , including autoscaling, authentication, and security
- Orchestrate production jobs via Tidal scheduler and implement CI/CD pipelines
- Set up logging, alerting, and packaging for production-ready execution
- Design and implement Python solutions supporting Front Office applications
- Integrate an existing Python-based pricing program into Databricks
- Maintain and improve code quality through static/dynamic analysis and CI/CD quality gates
- Provide approximately 30% application support for production issues (job failures, data errors, user errors, etc.)
- Provide occasional weekend support for critical job runs
- Partner with quants, infrastructure teams, DBAs, and cloud engineering to deliver robust solutions
- Communicate proactively and resolve issues collaboratively across business and technical teams
- 3-8 years of experience in Python development and cloud integration
- Strong hands-on experience with Azure Databricks , including cluster setup, autoscaling, job orchestration, and monitoring
- Proficiency in Python for scripting, packaging, and integration
- Knowledge of Azure fundamentals , including compute, authentication, and security
- Experience with CI/CD pipelines, logging, and alerting
- Background in financial services , ideally Fixed Income (maturities, coupons, yield curves, etc.)
- Excellent communication skills and ability to succeed in a collaborative environment
- Experience with Tidal scheduling tools
- Basic SQL or Snowflake experience
- Exposure to vendor tools such as PyXLL, Xltrail, QuestDB, or CityVision
- Experience with REST APIs and enterprise authentication
- Bachelor's degree in Computer Science, Engineering, or Mathematics
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Databricks Integration and Python Developer in New York, NY vacancy
- ...Counterparty Credit Risk (CCR) Data Integration Engineer to assume end-to-... ...: Design, develop, maintain and optimize scalable... ...strong programming experience in Python and advanced SQL, with a focus... ...of hands-on experience with Databricks and PySpark for large scale ETL...DatabricksPermanent employmentTemporary workFixed term contract
Compu-Vision Consulting
New York, NY1 day ago - ...Python Developer- Timeseries As part of the Risk Technology Department, the senior developer... ...take part in local development and integration work, related to the local and global... ...in Programming languages using Python; Databricks/PySpark. Strong testing and troubleshooting...DatabricksLocal area
Euclid
New York, NY21 hours ago - ...Description: At least 9+ years of Experience in Python development / Azure Databricks Experience in Python testing and code analysis... ...frameworks like Django, Flask, Pyramid, or Tornado. Integration experience (ETL, ELT) with Python Familiarity with...DatabricksFull time
Texas State Library and Archives Commision
New York, NY2 days ago - ...Job Title: Senior Data Integration Engineer Location: New York, NY Important... ...Data Integration Engineer to design, develop, and support scalable data integration... ...candidate will have strong experience with Python, SQL, Databricks, and PySpark, and a proven background...DatabricksPermanent employment
Navitas Healthcare LLC
New York, NY3 days ago - ...Job Title: Senior Data Integration Engineer - Credit Risk Location... ...Integration Design, develop, and optimize scalable data pipelines... ...~10+ years of experience in Python and advanced SQL (data... ...of hands-on experience with Databricks and PySpark ~ Experience working...DatabricksPermanent employmentWork at office
Navitas Healthcare LLC
New York, NY4 days ago - ...systems Strong proficiency in Python and/or TypeScript/Node.js... ...APIs, GraphQL, and various integration patterns Understanding of JSON... ...SDKs, libraries, or developer tools Knowledge of security... ...enterprise platforms (Splunk, Databricks, Zendesk, Salesforce, Jira)...Databricks
$195.42k - $370.53k
...a Director, Banking and Payments IT M&A – Due Diligence, Integration and Separation – Strategy to join our KPMG Strategy practice... ..., familiarity with key data platforms such as Snowflake, Databricks etc.) Develop and executego-to-market strategies for Technology Mergers...DatabricksFull timeH1bLocal areaKPMG
New York, NYa month ago- ...Python Data Integration Developer Basic Information ~ Experience Level: 5-10 years Required Skills Strong Python 3.x experience for data ingestion and transformation. DataFrame processing expertise (Polars preferred, Pandas acceptable...Temporary work
SysMind Tech
New York, NY4 days ago $90k - $145k
...define how data is applied, integrated, and operationalized across complex... ..., and POCs using SQL, Python, or BI tools Validate use... ...Expertise & GTM Collaboration Develop deep expertise in key... ...data ecosystems (Snowflake, Databricks, AWS/GCP) Experience building...DatabricksWork at officeWork from homeSimilarWeb
New York, NY4 days ago- ...focused environment ~ Independently develop software primarily to support the Extract... ...that data. ~ Write software using Python and Spark to automate data ingestion and... ...including database design ~ Experience in Databricks, Snowflake, Tableau ~ Excellent...DatabricksWork experience placement
Texas State Library and Archives Commision
New York, NY2 days ago - ...Software Engineer (C++ & Python) Choosing Capgemini means choosing... ...understand the models and develop GUI around the models. Familiarity... ...database experience SQL Databricks and Snowflake Grid computing... .... Technical background in integration development and or...DatabricksPermanent employmentFull timeContract workLocal areaFlexible hours
Capgemini
New York, NY6 days ago - ...Senior Machine Learning Engineer (AI Integration) New York, New York, United States $... ...edge team. As part of this role, you will develop, implement, and integrate machine learning... ...integration. ~ Strong proficiency in Python, TensorFlow, PyTorch, and other ML...
Recroot
New York, NY3 days ago $221.41k - $280.07k
...Executive, Associate Director - SAP (Tax Integration) Our Sales & Strategic Pursuits (S&SP)... ...result of having a team who have developed a deep understanding of: The highly complex... ...Alliance strategies including SAP with MS, Databricks, and Snowflake as well as EY’s broader...DatabricksSummer holidayFlexible hours- ...Internal Alpha Capture (IAC) is developing scalable quantitative equity... ...by benchmarking and integrating in-house and cloud technologies... ...Strong programming experience in Python with production-level coding... ...computing, ideally AWS and Databricks Experience with numerical...DatabricksSummer workInternship
Point72
New York, NY4 days ago - ...Green Key Resources is looking for a Python Software Engineer in New York City to support and enhance its internal trading technology stack. The role focuses on building system integrations, ensuring high-quality data flows, and collaborating with various teams to deliver...
Green Key Resources
New York, NY2 days ago - ...contract Job Description Data Engineer with Python and hands on experience using MLFlow - the... ...candidate will have experience working with MLflow, Databricks, and open-source machine learning frameworks, enabling seamless integration, experiment tracking, model management, and...DatabricksContract work
- ...Executive, Associate Director - SAP (Tax Integration) Opportunity To support our continued... ...of our SAP Tax Integration practice to develop innovative campaigns, initiatives, and... ...Alliance strategies including SAP with MS, Databricks, Snowflake, and EY’s broader multi‑...DatabricksFlexible hours
- ...This role is centred on developing and deploying advanced machine... ...teams, and domain experts to integrate AI-driven insights into real... ...ETL pipelines using SQL and Python. Exploratory Analysis & Feature... ...technologies such as Spark, Databricks, or Snowflake. Experience...DatabricksFull timeVisa sponsorship2 days per week
Hayward Hawk
New York, NY2 days ago - ...memory, context persistence, MCP tool integrations, and guardrails. Collaborate... ...engineers to optimize agent behavior. Develop high quality Python code and integrate with data and... ...technologies such as Snowflake, Databricks, and Lakehouse architectures....Databricks
Compu-Vision Consulting
New York, NY1 day ago $270k - $410k
About the Role Ads Integration Engineering team at Netflix is focused on accelerating product adoption by providing seamless, repeatable... ...audience activation strategies. Programming - Proficiency in Java or Python and advanced SQL knowledge for data preparation, log‑level...Flexible hours$27 per hour
...Advisory team at Guy Carpenter as an AI Integration Specialist. This role will be based in... ...We will count on you to: Help develop AI-enabled tooling to automate and streamline... ..., Alteryx, large-language models, or Databricks Prior experience with software best...DatabricksHourly payMinimum wagePermanent employmentFull timeWork experience placementWork at officeLocal areaRemote workFlexible hours3 days per week1 day per weekGuy Carpenter
New York, NY2 days ago$120k - $140k
...Senior Data Engineer (API & Platform Integration) Key Responsibilities Platform & Data... ...transformation, storage, and serving layers. Develop scalable batch and streaming pipelines... ...APIs Programming languages: Java, Python AWS cloud services used for data...Full timeTemporary workLocal areaImmediate startPearson
Hoboken, NJ9 days ago- ...have over 5 years of experience in Data Engineering within the insurance domain, with strong skills in Databricks, AWS, and Python. They will ensure data integrity and compliance while documenting architectural standards. A bachelor's degree in engineering or MCA is required...Databricks
Mphasis
New York, NY2 days ago - ...seeks a Senior Data Engineer in New York City to own and build integration capabilities critical for product expansion. You will explore... ...in data or backend engineering, strong programming skills in Python and SQL, and familiarity with cloud environments and CI/CD practices...
$200k - $300k
...dashboards for leadership Develop automated data pipelines and... ...drive continuous improvement Integrate third-party data sources and... ..., and data mining using Python, R, or similar programming languages... ...frameworks, such as Spark or Databricks ~ Strong skills in data...DatabricksWork experience placementPoint72
New York, NY3 days ago- ...Responsibilities: Design, develop, and maintain scalable data pipelines... ...-scale ETL/ELT workflows using Python and PySpark Work extensively with Databricks and Snowflake for enterprise... ...Collaborate with AI/ML teams to integrate RAG and LLM-based solutions into...Databricks
Group Nine LLC
New York, NY4 days ago - ...Role: ML/AI Developer (This role is open to US Citizens, Green Card... ...functional collaborations to integrate Generative AI models into our... ...on platforms such as AWS, Databricks, Azure, Google Cloud and OpenAI... ...experience with Deep Learning, LLM, Python, TensorFlow, PyTorch and...DatabricksRemote workVisa sponsorshipRelocation package
Adidev Technologies Inc
New York, NY3 days ago - ...About the job Python Developer Job Title: Python Developer Location: NYC Job Type: Full-Time Job Summary We are... ..., and reusable code following best practices. Design and integrate RESTful APIs for seamless communication between systems....Full time
SelekIT
New York, NY4 days ago - ...development, including propensity modeling and integration with data engineering pipelines, while... ...agile and iterative approaches. Develop and deploy AI/ML models, including... ...sets. Loading of data into S3 as well as tabular schemas. Databricks experience preferred.Databricks
campus4tech
New York, NY1 day ago $120k - $140k
Senior Data Engineer (API & Platform Integration) Key Responsibilities Platform & Data Engineering... ..., storage, and serving layers. Develop scalable batch and streaming pipelines that... ...Web APIs Programming languages: Java, Python AWS cloud services used for data platforms...Full timeTemporary workLocal areaImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Integration and Python Developer. Be the first to apply!
Related searches
- system integration engineer New York, NY
- integration software engineer New York, NY
- integrations engineer New York, NY
- senior data integration developer New York, NY
- data integration engineer New York, NY
- senior systems integration engineer New York, NY
- senior integration developer New York, NY
- integration developer New York, NY
- python programmer New York, NY
- freelance python developer New York, NY