Databricks Python Developer
PB Consulting
Must Have Technical/Functional Skills
• 10+ years of experience in Data Engineering, Data Warehousing, or Big Data development.
• 5+ years of hands-on experience with Databricks, Python, and PySpark.
• Strong hands-on experience in Databricks, Python, and PySpark development.
• Experience building and supporting large-scale ETL/ELT data pipelines.
• Strong knowledge of Spark SQL, Delta Lake, and Data Lakehouse architecture.
• Experience working with structured and unstructured data from multiple sources.
• Strong SQL skills and experience with relational databases.
• Experience with data modeling, data transformation, and data quality processes.
• Knowledge of orchestration tools such as Airflow, ADF, or similar.
• Experience with Git, CI/CD, and Agile development methodologies.
• Strong analytical, debugging, and performance tuning skills.
• Excellent verbal and written communication skills.
Roles Responsibilities
• Design, develop, and maintain data pipelines using Databricks, Python, and PySpark.
• Build scalable data ingestion, transformation, and integration solutions.
• Collaborate with Data Architects, Analysts, and business teams to deliver data solutions.
• Develop and optimize batch and real-time data processing workflows.
• Ensure data quality, integrity, security, and governance standards are met.
• Monitor, troubleshoot, and resolve production data pipeline issues.
• Optimize Spark jobs, SQL queries, and Databricks workloads for performance.
• Participate in data modeling, code reviews, and platform enhancement activities.
• Create technical documentation and support production deployments.
• Participate in Agile ceremonies and contribute to continuous improvement initiatives.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Databricks Python Developer in New York, NY vacancy
- ...DescriptionJob DescriptionSenior Technical Lead – Python, Microservices, Cloud Django backend... ...backend development using Django and Databricks — designing scalable, secure APIs and... ...management. Collaborate with front-end developers, product managers, and stakeholders to deliver...Databricks
TechDigital Corporation
New York, NY2 days ago - ...Position :: Senior Python Engineer Location :: Downers Grove, IL (Chicago area) On-site... ...investment platforms. Snowflake, Redshift, Databricks or BigQuery. AI-enabled development,... ...assisted SDLC. Responsibilities Design, develop and maintain production-grade Python applications...DatabricksWork at office2 days per week3 days per week
K-Tek Resourcing LLC
New York, NY2 hours ago - ...is up to date, and that you have read the job specs first. Python developer with react front-end and Python backend experience, responsible... ...with AWS, AZURE, or other cloud providers. Experience with Databricks, ADF, Glue, ETL’s, and ELT’s. xuwmhxw Shown ability to work...Databricks
Hays CPA LLC
New York, NY1 day ago - ...& Account Management | India | North America | Canada Python Full Stack Developer Location: 4 World Trade Center, NY (51st floor) (2 days... ...web applications, integrating with data platforms (Databricks, Snowflake, AWS, Azure), and delivering end-to-end solutions...DatabricksContract work2 days per week
MethodHub
New York, NY14 hours ago - ...architecture and technical design activitiesDesign, develop, and maintain production grade Python applicationsRefactor and modernize applications originally... ...cloud data platforms (e.g. Snowflake, Redshift, Databricks, BigQuery)Experience working with data intensive applications...DatabricksContract work
DataArt
New York, NY3 days ago - ...across Snowflake, dbt, Apache Airflow, SQL, Python, and CI/CD who has previously worked... ...supporting investment and financial data. Develop and optimize modern data architecture... ...warehouses . Exposure to platforms such as Databricks, AWS, Azure, Power BI, Sigma, iLevel, or...DatabricksRemote work
The Phoenix Group
New York, NY3 days ago $140k - $200k
...the Role: BIP is hiring Quantitative Python Engineers to support a high-profile... ...generation model lifecycle systems, integrating Databricks, MLflow, and agentic AI frameworks (AMPS... ...validation, deployment, monitoring). Develop Python-based data and ML pipelines using...DatabricksTemporary workRemote workWorldwideBIP US
New York, NY2 days ago$127.1k - $211.9k
...you will play a key role in designing and developing highly scalable backend services, data... ...failures.The ideal candidate is a strong Python backend engineer with deep experience... ...technologies such as Snowflake, Airflow, Databricks, or similar ecosystems.Understanding of...DatabricksWork at officeWork from home2 days per week3 days per weekLPL Financial
New York, NY2 days ago- ...lakehouse) • Hands-on experience with cloud data platforms (Azure, AWS or GCP) and tools such as Databricks, Snowflake or Synapse • Strong SQL and familiarity with Python • Experience with data governance, MDM, and data quality frameworks • Excellent communication...DatabricksWork at office3 days per week
CloudIngest
New York, NY2 days ago - ...pipeline development. You will build and maintain feature pipelines in Databricks, integrate multiple data sources, and support ML model training and deployment with MLflow. The role requires strong Python and SQL skills, hands-on Spark experience, and the ability to...Databricks
CEDENT
New York, NY3 days ago - ...Evals.Key Skills:Agentic AI & LLM-based WorkflowsMCP (Model Context Protocol)LangGraph & LangChainCortex AI & EvalsData Engineering & ETL/ELT Pipelines xhyhwjd Snowflake, Databricks & HadoopSQL, Cloud Data Platforms & AnalyticsData Migration, Governance & VisualizationDatabricks
Lorven Technologies
New York, NY2 days ago - ...Have Skills Gen AI, AI/ML, RAG, LangChain, Python, Spark, Snowflake Nice to have skills Azure Detailed Job Description Design and develop scalable AI-powered data platforms and... ...engineering pipelines using Python, Spark, Databricks, Snowflake, SQL, and cloud-native...Databricks
eTeam
New York, NY2 days ago $200k - $250k
...the context of forecasting and pricingFind and develop your own roadmaps with business partners and... ...(e.g., SparkSQL, BigQuery, Snowflake, Databricks), with high proficiency with query languages like SQLExpert in Python or R and numerical and scientific libraries used...DatabricksWork at officeRemote workWorldwideFlexible hoursStubHub
New York, NY4 days ago- ...leveraging the latest capabilities within the Databricks ecosystem, including Genie AI and MLflow... ...production deployment on Databricks. Develop and operationalize machine learning and... ..., and AI safety practices. Strong Python development skills with experience...DatabricksFull time
Harnham
New York, NY2 days ago - ...end data science projects using agile and iterative approaches. Develop and deploy AI/ML models, including propensity modeling. Drive... .... Structured and unstructured data sets. Loading of data into S3 as well as tabular schemas. Databricks experience preferred....Databricks
Macpower Digital Assets Edge Private Limited
New York, NY2 days ago - ...Peraton seeks a Junior Data Engineer to support a federal data migration program, developing and deploying ETL pipelines in a cloud data lakehouse, focusing on Databricks Delta Live Tables, GIS and geospatial data. This fully remote role requires U.S. citizenship and...DatabricksRemote work
Peraton
New York, NY1 day ago - ...Engineering Design and deploy scalable ML pipelines using Python and cloud-based platforms (Azure, Databricks, or equivalent) Productionize predictive and... ...practices Generative AI & Advanced Modeling Develop and operationalize LLM-powered applications...Databricks
Kces
New York, NY5 days ago - ...applying for this opportunity.SKILLS REQUIREDPrimary (Must-Have):• Python or R• Machine Learning (scikit-learn, TensorFlow, PyTorch)•... ...Have):• Generative AI & Large Language Models (LLMs)• Azure | Databricks | PySpark | Synapse | Lakehouse Architectures• MLOps | Model Monitoring...Databricks
Pacer Group
New York, NY2 days ago - ...Python DeveloperLocation: New York, NY Duration: 06 Month RTHClient: JPMC Location: New York Rate: $75 W2 Interview: Zoom (may ask for... ...plus)Java Spring Boot (good to have)Job Description:Designs, develops, and deploys advanced conversational agents using RASA and other...
Saxon Global
New York, NY2 hours ago - ...with 5+ years of experience to design, build, and optimize scalable data pipelines and cloud data platforms. Proficiency in Python, SQL, Databricks, Apache Spark, and ETL/ELT is required. Hands-on with at least one cloud platform (AWS, Azure, or GCP) is expected. You...Databricks
ATC, Inc.
New York, NY2 days ago - ...data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast one relational data stores (... ...Dimensional, Data Vault, Kimball, Inmon, etc.), Agile methodology (develop PI plans and roadmaps), TDD (or BDD) and CI/CD tools (Jenkins,...Databricks
HAN Staffing
New York, NY3 days ago - ...migration, Agentic AI, Cortex, LangGraph, LangChain, Hadoop, Databricks Role Overview We are seeking a highly skilled Agentic AI... ...Platforms . The ideal candidate will be responsible for designing, developing, and deploying enterprise-scale AI solutions, data...Databricks
Purple Hires Inc
New York, NY1 day ago - ...Amalgamated Bank seeks an experienced Senior AI Engineer to lead hands-on development of governed, auditable AI agents on the Databricks platform. The role blends production engineering with architectural judgment to translate business needs into scalable AI capabilities...Databricks
Amalgamated Bank
New York, NY3 days ago $40 - $60 per hour
...Responsibilities Feature Engineering Data Integration Develop and maintain feature engineering... ...processing and analytics Proficient in Python for data manipulation and SQL for query... ...like PII Mandatory Skills Apache Spark Databricks Java Python Scala SparkSQL Compensation...DatabricksHourly payContract workRemote workCedent
New York, NY14 hours ago- ...ecosystem by bringing together advertisers, app developers, and device partners, to create a unique... ..., time-series)Fluency in SQL and Python (or R), and comfort working with large-... ...stakeholdersNice to haveExperience with Databricks, Spark, or semantic-layer / metrics platformsBackground...DatabricksFull timeWorldwideFlexible hours
Fyber
New York, NY3 days ago $72.39k - $109.48k
...campaign strategies and new business pursuits.Build Python-based data science solutions and deploy to Databricks, AWS and Azure environments to scale strategic... ...into end-to-end communication planning.Evolve and co-develop proprietary audience intelligence tools in...DatabricksTemporary workFreelanceFlexible hoursShift workPublicis Groupe Holdings B.V
New York, NY1 day ago- ...Databricks is seeking an senior engineer in NYC to help build CustomerLake, a data platform enabling enterprise ML personalization at-scale. You will work on production ML/LLM models, analyze model behavior, and drive real business value through personalization features...Databricks
Databricks
New York, NY2 days ago - ...AI-driven insights across the firm, including work within our Databricks environment.Required Qualifications5+ years of experience in data... ...learning, or advanced analytics rolesAdvanced proficiency in Python, with demonstrated experience building production-grade data, ML...DatabricksRemote work
ESR Healthcare
New York, NY1 day ago $200k - $225k
...Build scalable data platforms, pipelines and ML infrastructure Develop and deploy production AI solutions, including LLMs, RAG... ...systems Strong knowledge of modern data technologies such as Databricks, Spark, Kafka, Airflow and Delta Lake Excellent software engineering...DatabricksFull timeWork at officeHarnham
New York, NY3 days ago- Job Requirements Full Stack Engineer (Python must):Design, develop, test, deploy, and support end-to-end AI-powered enterprise applications and digital solutions.Build modern frontend applications using React, Angular, TypeScript, HTML5, CSS, and responsive UI frameworks...
Virtusa
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Python Developer. Be the first to apply!
Related searches
- python programmer New York, NY
- python developer remote New York, NY
- full stack / python developer (remote) New York, NY
- python developer data analytics New York, NY
- python developer New York, NY
- backend python developer New York, NY
- python developer internship New York, NY
- python engineer New York, NY
- senior python developer New York, NY
- databricks New York, NY