Data Engineer - Databricks
Quantum Technologies. LLC
Overview Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory. Integrate and process Bloomberg market data feeds and files into trading or analytics platforms. Monitor, troubleshoot, and resolve data and system issues related to trading applications and market data ingestion. Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL. Manage FTP/SFTP file transfers between internal systems and external vendors. Ensure data quality, completeness, and timeliness for downstream trading and reporting systems. Collaborate with operations, application support, and infrastructure teams to resolve incidents and enhance data workflows. Qualifications 10+ years of experience in data engineering or production support within financial services or trading environments. Hands-on experience with Azure Databricks, Azure Data Factory, and Azure Storage, Logic Apps, Fabric. Strong Python and SQL programming skills. Experience with Bloomberg data feeds (BPIPE, TSIP, SFTP). QUANTUM TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. QUANTUM TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will QUANTUM TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract #J-18808-Ljbffr Quantum Technologies. LLC
- ...Job Title- Data Engineer Location- New York, NY 10112 Reporting Type- Onsite Duration: 10 months Summary... ...databases. Structured and unstructured data sets. Loading of data into S3 as well as tabular schemas. Databricks experience preferred.Databricks
- ...Overview: **Mandatory skills / Required Experience**- Azure (Bigdata Azure), DataBricks , Scala, Java, Spark, Pyspark, Python,**Job Description: -**- 11+ years of experience with Azure Data Factory and Databricks with Big Data ecosystem tools (e.g. Hadoop, Hive) and...Databricks
- ...Position Responsibilities Data Engineer Location : Jersey City, NJ / Columbus, OH ( 3 days onsite 2 days remote)... ...This is an AWS Migration project - MUST BE STRONG IN AWS. Databricks is a plus, if it's on the resume they MUST be able to speak to...DatabricksRemote work
- ...Data Engineer – Gen AI & RAG We are seeking an experienced Data Engineer with strong expertise in Generative AI, RAG architecture, and... ...workflows using Python and PySpark Work extensively with Databricks and Snowflake for enterprise data processing Collaborate with...Databricks
- ...Role: Sr. Data Engineer Location: New York,NY Longterm Client: Mphasis | JPMC Rate: $60/Hr on C2C... ...data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast one relational data stores (Postgres...Databricks
$125k - $163.8k
A leading gaming technology company is seeking a Data Engineer in New York City. This role involves designing and delivering scalable data platforms using technologies like Databricks and Apache Airflow. The ideal candidate will have extensive experience in data engineering...Databricks- ...Data Engineer Location: NJ / NY onsite USA (local to NJ or NY) Must have: (AWS, Azure, or GCP), and/or on-prem (MS SQL, SSIS, Oracle) and (RedShift, Snowflake, Databricks, Informatica, SSAS etc.) Requirements: ~ Bachelor's degree in Computer Science, Data...DatabricksLocal area
- ...Senior Data Engineer Jersey City, New Jersey, United States Role Overview Hands-on experience with Azure Services: Databricks, Data Factory and DevOps Proficient in Python, Apache Spark, and PySpark Write advance and complex SQL queries with solid experience...Databricks
- ...Data Foundations Engineer The Data Foundations Engineer designs and scales modern data architectures powering Wallet, Payments, and Commerce... ...in rotating on-call. ~ Experience with Snowflake, Databricks, Trino, OLAP/NRT systems, Superset or Tableau. ~ Familiarity...Databricks
- A technology consultancy is looking for a Data Engineer specializing in retail supply chain solutions in Yorklyn, DE. The ideal candidate... ...will have 8-10 years of experience and must be proficient in Databricks and EDI. Candidates should also possess strong knowledge of...DatabricksContract work
- ...About the job Senior Data Engineer - Databricks Job Overview: We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for development and optimization of data pipelines, implementing robust data checks, and ensuring...Databricks
- ..., a leading global alternative investment firm, is seeking a Data Engineer. The role involves designing and maintaining data pipelines to... ...research and trading. Candidates should have expertise in Databricks and a strong programming background in Python and SQL, along...Databricks
$160k - $200k
...As a Senior Data Engineer at Rearc, you'll be the technical anchor on complex, client-facing data engineering engagements, someone who... ...build a solution. You'll bring deep, hands-on expertise with Databricks and the broader modern data stack, and you'll set the technical...DatabricksWork experience placement- A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks Lakehouse architecture and advanced experience with PySpark and Spark SQL. Ideal applicants will possess a deep knowledge of AWS services and data orchestration tools...Databricks
- A high end technical consulting firm is seeking a Senior Big Data Developer based in NYC. The ideal candidate will have extensive experience... ...Data technologies and will be responsible for developing data engineering solutions in a fast-paced investment banking environment....Databricks
- ...atuará em soluções baseadas em IA Generativa, focando na integração e análise de dados cadastrais. Com experiência em Python, SQL, Databricks e técnicas de Machine Learning, o candidato ideal deverá desenvolver soluções escaláveis e efetivas de dados, contribuindo para a...Databricks
- ALLTECH CONSULTING SVC INC seeks an experienced Data Engineer / Support Analyst in New Jersey to manage and support data pipelines, integrate... ...years in financial services with strong technical skills in Databricks and Azure Data Factory. Excellent problem-solving and...Databricks
- Overview Unlock your potential as a Data Engineer with a focus on innovation and impact in Venus's Team. This permanent, hybrid role offers... ...the opportunity to work with cutting-edge technologies like DataBricks, aiming to enhance data architectures and drive analytics...DatabricksPermanent employment
- ...firm located in New York is looking for an experienced Senior Data Engineer to design and develop ETL/ELT pipelines for banking... ...3 years in the banking sector, with expertise in Snowflake, Databricks, and Python. The role entails optimizing data warehouses and...Databricks
$150k
...Our client is seeking a highly skilled Senior Data Engineer who can balance deep technical execution with growing leadership responsibilities... ...This position requires strong expertise in SQL, PySpark, and Databricks, including job scheduling and orchestration using tools such...Databricks- Bitbybit Solutions is seeking a skilled data engineer to build and manage robust data pipelines using AWS and Databricks. The ideal candidate will be proficient in Scala, Spark, and Kafka, and experienced in designing scalable systems with observability and logging. You...Databricks
- A technology company in New York is seeking a skilled Data Engineer with over 10 years of experience in financial services or trading environments... ...and supporting batch processes and data pipelines in Azure Databricks and Azure Data Factory, integrating and processing Bloomberg...Databricks
- A technology solutions company is seeking a Data Engineer with extensive experience in retail and supply chain. The ideal candidate will have a minimum of 8-10 years of experience and expertise in Databricks, Azure, and EDI. Proficiency in Delta Lake and Databricks SQL...DatabricksContract work
- ...Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are... .... We are seeking an experienced Data Engineer to join our data team. In this role, you... ...processing and transformation workflows using Databricks, Apache Spark, and SQL to support...DatabricksLocal area
- S&P Global is looking for a Data Engineer to build and maintain scalable data processing pipelines that support critical data sourcing and... ...in Python, SQL, and data ecosystems like PySpark and Databricks. You will contribute to various data solutions that have a significant...Databricks
- HTEC Group is seeking an experienced Data Engineer to enhance their data infrastructure. The ideal candidate will have over 7 years of relevant experience, strong hands-on capabilities with Databricks and Apache Spark, and proficiency in Python or Scala. Responsibilities...Databricks
- A technology solutions company is seeking a Senior Data Engineer based in New York. The ideal candidate will have over 12 years of experience and strong skills in Python, SQL Server, Databricks, and Snowflake. Responsibilities include understanding technical specifications...Databricks
- A global SaaS technology company is seeking a Data Engineer to develop and optimize data pipelines for analytics and machine learning. This fully remote role requires experience in Data Engineering and proficiency in Python and SQL. The ideal candidate will collaborate...DatabricksRemote job
- Qualifications Strong expertise in Databricks Lakehouse architecture on AWS. Advanced hands-on experience with PySpark, Spark SQL, Delta... ...and scheduling Strong knowledge of AWS services used in data platforms Familiarity with data reconciliation, observability,...Databricks
- A data solutions company in the United States is looking for a Data Engineer to design and implement data pipelines and governance frameworks for enterprise clients. This... ...with cloud platforms like Snowflake and Databricks. You will collaborate with data scientists to...DatabricksRemote jobFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Databricks. Be the first to apply!
- staff data engineer New York, NY
- data engineering intern summer New York, NY
- senior data integration developer New York, NY
- data engineer graduate New York, NY
- data engineer contract New York, NY
- data science developer New York, NY
- senior data center engineer New York, NY
- software data engineer New York, NY
- hadoop big data developer New York, NY
- data developer New York, NY

