Data Engineer - Databricks
Cloud Analytics Technologies LLC
Job description
Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory.Integrate and process Bloomberg market data feeds and files into trading or analytics platforms.
Monitor, troubleshoot, and resolve data and system issues related to trading applications and market data ingestion.
Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL.
Manage FTP/SFTP file transfers between internal systems and external vendors.
Ensure data quality, completeness, and timeliness for downstream trading and reporting systems.
Collaborate with operations, application support, and infrastructure teams to resolve incidents and enhance data workflows. 10+ years of experience in data engineering or production support within financial services or trading environments.
Hands-on experience with Azure Databricks, Azure Data Factory, and Azure Storage, Logic Apps, Fabric.
Strong Python and SQL programming skills.
Experience with Bloomberg data feeds (BPIPE, TSIP,SFTP).
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - Databricks in New York, NY vacancy
- ...Data Engineers - this is one worth paying attention to. I’m working on a Data Engineering opportunity in NYC where you’ll help build... ...global data platform from the ground up. The big focus? Databricks. You’ll take real ownership of the data environment, building...DatabricksFull time
Saragossa
New York, NY1 day ago - Job ID: 25546234Reference Number: 25-00476Title: Data EngineerLocation: New York, NYPosted Date: 2025-05-19Contact: Rishabh PandeyContact... ...data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast one relational data stores (...Databricks
HAN Staffing
New York, NY4 days ago $74 per hour
DescriptionKforce's client in NYC is seeking a highly skilled Data Engineer with strong hands-on experience in Apache Spark/PySpark, AWS EMR, Databricks, and Snowflake. The Data Engineer will be responsible for designing and building scalable, high-volume data pipelines...DatabricksKForce
New York, NY4 days ago- ...We are actively hiring Fulltime AWS, Databricks, GCP, and Snowflake Data Engineers and AI Engineers for hybrid roles (3 days per week in-office) based in New York City, NY, or New Jersey. Candidates must meet the following qualifications: Note: This position requires...DatabricksFull timeInternshipWork at office3 days per week
Capgemini
New York, NY1 day ago - ...We’re hiring a hands-on Data Engineer to build scalable data platforms across key corporate functions including Finance, Compliance, Facilities... ...’ll Do Design and optimize data pipelines using Azure + Databricks Build ETL/ELT workflows for structured and unstructured...DatabricksContract work
GQR
New York, NY3 days ago - ...growing global financial services firm is looking for a Senior Data Engineer as they expand their Enterprise Data Team in the US. With... ...architecture Work with a modern tech stack including Databricks, AWS, Python, SQL, Spark and CI/CD Build scalable data pipelines...DatabricksFull time
twentyAI
New York, NY8 hours ago $100k - $150k
...New York, United States Permanent Data Catalog EngineerNew York, NY - Hybrid (3... ...) My client is seeking a Data Catalog Engineer to join a growing Data Governance team focused... ...catalog platforms like Atlan, Collibra, Databricks Unity Catalog, Alation, Informatica or...DatabricksPermanent employmentWork at office3 days per weekApollo Solutions
New York, NY3 days ago$70k - $80k
...without sponsorship. Job Summary Aaratech Inc. is seeking a Data Engineer to help build and maintain data pipelines on cloud platforms.... ...& warehouses: SQL Server, PostgreSQL, Snowflake, or Databricks. • Languages: SQL and Python. • Version control: Git. •...DatabricksFull timeAARATECH
New York, NY8 hours ago- ...Senior Data Engineer The ideal candidate is a hands-on engineer with strong experience across Snowflake, dbt, Apache Airflow, SQL, Python... .../ data warehouses . Exposure to platforms such as Databricks, AWS, Azure, Power BI, Sigma, iLevel, or similar financial/data...DatabricksFull time
The Phoenix Group
New York, NY3 days ago - ...EXL is seeking a Senior Data Engineer to join our Data & Analytics practice and support strategic client engagements. This role will be... ...and PySpark. ~ Extensive experience working with Snowflake, Databricks, or similar cloud-native data platforms. ~ Proven experience...DatabricksFull timeLocal areaRelocation
EXL
New York, NY1 day ago $45 per hour
...Summer 2027 Data Engineer Intern – Alternative Data Location: New York, NY | Hybrid Program Duration: Summer 2027 (10-12 Weeks) (... ...retrieval systems. Work with cloud-based technologies (AWS, Databricks, Snowflake) to process structured and unstructured datasets....DatabricksHourly payPart timeSummer workInternshipSummer internshipWork at officeM Science
New York, NY3 days ago- ...3 Must Have Skills:Informatica workflow design and implementation requiredAWS data engineering (Glue, Lambda, EventBridge Cradle, S3) highly preferredFormer Informatica experience, Databricks, SnowflakeNice to Haves:Apache AirflowSomeone who is fun and exciting with lots...DatabricksWork at office
Ampcus
New York, NY4 days ago $100 - $130 per hour
A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hrUS Citizens or GC Holders OnlyNo c2c - W2 OnlyQualifications:A Bachelor's Degree in Computer Science, Management Information Systems, Computer Engineering...DatabricksRemote workOpen Systems Technologies
New York, NY3 days ago- ...Sr Data Protection Engineer, Fortune Insurance Company, 165k plus bonus, Manhattan 3 days on site MUST HAVE STRONG PYTHON/SQL SKILLSET... ...solutions and data governance workflows using platforms such as Databricks, Securiti.ai, Anomalo, & Atlan. Working closely with...DatabricksFull time
Insurance Company
New York, NY3 days ago - ...As a Senior Data Engineer you will own the design and delivery of complex data engineering solutions that power enterprise analytics, AI... ...of ELT/ETL frameworks using SQL, Python, Azure Data Factory, Databricks, and Azure Synapse Analytics. Establish pipeline reliability...DatabricksFull time
PRI Technology
New York, NY1 day ago $140k - $155k
...Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and... ...and business users. Python/SQL Server/Snowflake/Databricks application development and system design. Develop and...DatabricksFull timeTemporary workFlexible hoursSynechron
New York, NY3 days ago$10k
...relationship, for all. About the Role: As a Senior Data Engineer at Hinge, you will create essential data processes and contribute... ..., BigQuery). and CI/CD technologies (CircleCI), Spark, Databricks Factors such as scope and responsibilities of the position...DatabricksFull timeWork experience placementHinge
New York, NY2 days ago- ...you'll doYou will build the foundational data infrastructure that powers cutting-edge... ...learn to translate simple hypotheses into engineered features, manage secure data... ...reliability with commonly used data platforms (Databricks, Snowflake, BigQuery, PSQL, etc.) and data...DatabricksApprenticeshipWork at officeLocal areaEasy work
McKinsey & Company
New York, NY1 day ago $100k - $140k
...bonusesResponsibilitiesWe are hiring a hands-on senior level Data Engineer to build trustworthy, well governed data products and turn them... ...with modern lakehouse platforms (e.g., Microsoft Fabric, Databricks, Snowflake, AWS)Experience building data solutions in cloud environments...DatabricksWork at officeRemote work3 days per weekGUARD Insurance Group
New York, NY2 days ago- ...compensation.Job DescriptionSenior Analytics Engineer OverviewThe Senior Analytics Engineer... ...Provide hands-on technical expertise in data modeling, statistical methodologies, and... ...orchestration tools; familiarity with Databricks and CI/CD pipelines.Experience defining...DatabricksRemote work
Green Key Resources
New York, NY5 days ago - ...Senior Consultant, Data Engineering (L4) About Vivanti Vivanti is a home for high-performing technologists who drive measurable impact... ...~ Demonstrated proficiency in SQL, Python, AWS, Azure, GCP, Databricks, Snowflake, GIt, CI/CD, ML/AI, Spark, Airflow, ETL/ELT ~6–...DatabricksFull timeWork at officeWork from homeFlexible hoursShift work
Vivanti Consulting
New York, NY8 hours ago $175k - $240k
...successful and growing investment management firm seeking a Senior Data Engineer to help modernize and transform its enterprise data platform.... ...dbt experienceExperience with Azure, Azure Data Factory, Databricks, or SynapsePower BI or similar business intelligence...DatabricksRemote workSolomon Page
New York, NY4 days ago$190k - $220k
...role and will be assessed during the interview process.The Data Engineering team builds tools and systems that make Gusto's data consistent... ...on cloud platforms like Snowflake, Redshift, BigQuery, or Databricks.Experience implementing CI/CD pipelines, automated testing,...DatabricksFull timeWork at officeLocal area2 days per week3 days per weekGusto
New York, NY2 days ago- ...ResponsibilitiesOur Product DE organization is looking for a Senior Data Engineer reporting to the Senior Data Engineering Manager. You will be... ...framework or similar scheduling tools.Experience with Databricks and its APIs.Experience with modern databases (Redshift, Dynamo...DatabricksWork at officeLocal area
Atlassian
New York, NY3 days ago $176k - $179.5k
...QuantumBlack, AI by McKinsey, as a senior software engineer, building AI that transforms Pharma and... .... You will design and manage scalable data pipelines and secure analytics platforms... ...with commonly used data platforms (Databricks, Databricks Asset Bundles, Snowflake,...DatabricksApprenticeshipEasy workShift workMcKinsey & Company
New York, NY1 day ago$128.01k - $152.18k
...with confidence.Job DescriptionAI-First Data Strategy for P&C Insurance Carrier | Lead... ...SolutionsWe are seeking a Senior Data Engineer to spearhead our transition to a modern,... ...modern data platforms (e.g., Snowflake; Databricks, big data, analytics) relevant to P&C insurance...DatabricksFull timeWork at officeLocal areaArgo Group
New York, NY1 day ago$180k - $220k
...unlocks the magic of frictionless experiences.We’re looking for a Data Engineer II to help us build the next generation of products which... ..., Luigi, etcBig data tools like Spark, Kafka, Snowflake, Databricks, etcCollaboration, integration, and deployment tools like Github...DatabricksCasual workWork at officeFlexible hoursSecure Identity
New York, NY2 days ago- ...Data Engineers – Global Investment Firm | New York & London Build the data platform behind trading, research and risk at a top-tier investment... ...Must-haves ~ Hands-on experience with both Snowflake and Databricks ~ Excellent Python (including PySpark) and SQL, plus Spark,...DatabricksFull timeVisa sponsorship
$30 Global Investment Firm
New York, NY2 days ago - ...WithAt Slalom, we co-create custom software, data, AI, and cloud solutions with clients... ...organizations.Our Data Architecture & Engineering team sees data as the foundation for decision... ...Azure, Google Cloud Platform (GCP), Databricks, and Snowflake, along with the...DatabricksTemporary workWork at officeLocal area
Slalom
New York, NY4 days ago $137.4k - $161.7k
...you ready to make an impact?West Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role, you will design... ...and business intelligence. Working with technologies such as Databricks, Snowflake, and Microsoft Fabric, you will help clients modernize...DatabricksLocal areaImmediate startFlexible hoursWest Monroe Partners
New York, NY3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Databricks. Be the first to apply!
Related searches
- data systems engineer New York, NY
- finance data engineer New York, NY
- data engineer contract New York, NY
- big data devops engineer New York, NY
- sr data engineer New York, NY
- senior data engineer New York, NY
- entry level big data engineer New York, NY
- principal data engineer New York, NY
- data engineer graduate New York, NY
- etl data engineer New York, NY