Data Engineer Databricks / Python / Database
Cloud Analytics Technologies LLC
Overview:
We are seeking an experienced Data Engineer with strong expertise in Databricks, Python, and Database engineering. The ideal candidate will design, build, and optimize scalable data pipelines, ensure data quality, and support advanced analytics and business intelligence initiatives across the organization.
- Design, build, and maintain ETL/ELT workflows on Databricks.
- Develop scalable data pipelines using Python and Spark.
- Optimize data transformation logic for performance and cost efficiency.
- Work with structured and unstructured data from various sources.
- Develop and manage data models, schemas, and tables across databases (SQL/NoSQL).
- Implement data quality, validation, and monitoring frameworks.
- Collaborate with Data Scientists, Analysts, and Cloud Engineers to support analytics and ML workloads.
- Ensure data security, governance, and compliance in all solutions.
- Troubleshoot pipeline failures and continuously improve pipeline reliability.
- Integrate data from APIs, streaming sources, and cloud storage.
Required Skills:
Core Technical Skills:-
- Databricks (mandatory) – Delta Lake, Notebooks, Spark SQL, Jobs, Workflows
- Python – Data processing, Spark APIs, automation, optimization
- Database Engineering – Strong SQL, query tuning, schema design, stored procedures
- Apache Spark – RDDs/DataFrames, optimisation, partitioning
- Cloud Platforms (one or more): AWS / Azure / GCP
- ETL/ELT tools: ADF, Glue, Dataflow, or equivalent
- Experience working with large-scale datasets
- CI/CD for data pipelines (Git, DevOps, Jenkins, etc.)
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer Databricks / Python / Database in Jersey City, NJ vacancy
- ...We are seeking a skilled Data Engineer to design, develop, and support... ...strong expertise in Snowflake, Python, SQL, AWS, Oracle, and Apache Airflow... ..., RAG architectures, or vector databases. Experience with Spark, Kafka, or Databricks. SnowPro and/or AWS...DatabricksDatabase
- ...consultants bring deep expertise in Data Science, Machine Learning and... ...seeking an experienced Data Engineer to join our data team. In... ...workflows using Databricks, Apache Spark, and SQL to support... ...~ Familiarity with vector databases, embeddings, and Retrieval-Augmented...DatabricksDatabaseLocal area
- Job ID: 25956017Reference Number: 25-00834Title: Python PySpark/ Data EngineerLocation: Columbus, OH and Jersey City, NJPosted... ...experience building/implementing data pipelines using Databricks or similar cloud database.Expert level knowledge of using SQL to write complex,...DatabricksDatabaseWork experience placement
- ...cloud technologies, and big data processing. This role involves... ...data storage solutions. Skills: Python, SQL, cloud data tools... ...junior developers. Optimize database performance and manage data storage... ..., Python, Azure Cloud, Azure Databricks, Delta Lake and Delta tables,...DatabricksDatabase
- ...the perfect software engineering opportunity for you.... ...JPMorganChase within the AI/ML Data Platforms , you are... ...Experience in Python developing, debugging,... ...programming languages and database querying languages... ...Exposure to AWS & Databricks Platform administration...DatabricksDatabase
$116k - $152.25k
...name on it As an Analytics Engineer for our Sports Modeling &... ...maintaining, and improving the data models, datasets and data... ...data into properly thought-out databases (SQL, Delta Lakes, etc.)... ...databases ~ Proficient in SQL, Databricks, R/Python, Tableau, AWS s3 buckets,...DatabricksDatabaseTemporary workLocal areaWorldwide$156.75k - $215k
...As a Lead Software Engineer within the JP Morgan Credit Risk Technology organization... ...Advanced proficiency in Java or Python Strong knowledge of relational databases/ Transact SQL (Oracle/Sybase/SQL Server) Strong Knowledge of Databricks Experience in developing,...DatabricksDatabaseFull time- ...supporting enterprise data, regulatory reporting,... ...take ownership, guide engineering decisions, and collaborate... ...applications using Python and Django. Build... ...solutions using Azure Databricks, PySpark, Delta Lake,... ...Improve SQL and NoSQL database performance, data quality...DatabricksDatabaseWork at office
- ...Data Engineer II Description Textron is a renowned global multi-industry... ...programming skills in Python, Java, Scala, or similar languages... ..., NoSQL, and cloud-based databases (e.g., PostgreSQL, MongoDB,... ...orchestration tools (such as Databricks, Airflow, Synapse, or similar...DatabricksDatabaseFull timeWorldwideRelocationShift workDay shift
$140k - $160k
...Company Overview Pantheon Data (a Kenific Holding... ...technology, software engineering, program management, strategic... ...candidate has strong Python and SQL skills,... ...between transactional databases, analytical stores, object... ...with PySpark, Spark, Databricks, EMR, Snowflake,...DatabricksDatabaseWork at officeLocal areaRemote work- ...About This Opportunity As a Data Engineer I, you’ll help develop and maintain... ...architecture using Azure Databricks and Delta Lake. Develop and... .../ELT processes using SQL, Python, PySpark, and Spark SQL.... ...Understanding of relational databases, data modeling concepts, and...DatabricksDatabaseImmediate startRemote workFlexible hours
$80k - $133k
## Senior Data EngineerApply: US - TX, San Antonio... ...seeks a Senior Data Engineer to design, develop, and... ...engineering solutions using Python, SQL, Spark, and... ...leveraging AWS, Azure, Databricks, and other modern... ...relational and non-relational databases, including data...DatabricksDatabaseFull timeContract workTemporary workFlexible hours$82k - $152.2k
## Data EngineerApply: On-Site: Burlington, Vermont... ...is looking for a Data Engineer to support our Federal... ...programming language (Python, Java, R, etc),... ...and view creation, and database performance tuning* Experience... ..., particularly Databricks, MS SQL Server, Snowflake...DatabricksDatabaseAgency workFull timeContract workWork at officeLocal areaRemote workFlexible hours- ...that specializes in cybersecurity, Big Data/databases, software development, systems testing,... ...company. Job Overview: The AI Data Engineer is responsible for building and... ...or equivalent cloud certifications. -Databricks and/or Snowflake certifications Knowledge...DatabricksDatabaseFull time
$61k - $101k
...or certification in software engineering concepts along with 5+ years... ...Spring Boot, Spring MVC, Spring Data), RESTful APIs, microservices... ...data models for relational databases. We require experience working... ...product engineering such as Databricks, Data Mesh, Unity Catalog,...DatabricksDatabaseFull time$65 - $70 per hour
Position: Data Engineer- AWSLocation: Jersey City, New JerseyDuration:... ...Engineer III specializing in Python, Spark, and Data Lake... ...frequently and understand NoSQL databases and their applications.Contribute... ...such as AWS Data Lake, Databricks, or Hadoop.Proficiency in relational...DatabricksDatabaseFull time- ...opportunity for you to take your software engineering career to the next level. As a... ...reporting from large, diverse data sets in service of continuous... ...modern programming languages and database querying languagesAWS, Databricks & Python experience Overall knowledge of the...DatabricksDatabase
- ...what's possible. As a Lead Software Engineer Data Platform & Entitlements at JPMorganChase... ...data models for relational databases. Experience working on Cloud platforms... ...platforms / data product engineering such as Databricks– Data Mesh, Unity Catalog, Lake house,...DatabricksDatabase
- ...highly motivated Security Data Architect & Governance... ...Functions:Data architecture, engineering and analytics using various databases, scripting and AI/... ...such as S3, Snowflake, Databricks, SQL databases, no-SQL databases... ...:KQL, SQL, JavaScript, Python, Claude, Co-...DatabricksDatabaseFull timeWork experience placementWork at officeLocal areaRemote work
- ...a CIB wide Marketing and Events Data Platform. We are looking for Big Data Software Engineer with skills and experience implementing... ...- 3+ years of Experience with Python is preferred- 2+ years of... ...to automate file preparation and database loads- Experience in data quality...DatabricksDatabase
- ...As a Lead Software Engineer at JPMorgan Chase, within... ...Investment Banking – Data Analytics – Payments Technology... ...languages(s); Python, Java and SQL Hands... ...operating data pipelines on Databricks using orchestration... ...architectures, vector databases, and embedding-based...DatabricksDatabase
- As a Lead Software Engineer within the JP Morgan Credit Risk Technology organization, you are an integral part of an agile team that... ...stabilityAdvanced proficiency in Java or PythonStrong knowledge of relational databases/ Transact SQL (Oracle/Sybase/SQL Server)Strong Knowledge of...DatabricksDatabase
- ...possible. As a Lead Software Engineer - Python, Full Stack / AI at JPMorgan... ...build out of an end-to-end data platform to manage Capital,... ...ETL on data platforms such as Databricks and SnowflakeExecutes... ...modern programming languages and database querying languagesExperience...DatabricksDatabase
- ...Job Title: Sr. Data Engineer Location: Jersey City, NJ Onsite role W2 Candidates only Minimum Experience: 10+ Years Must have required skills Pyspark, Databricks, Python, Gen AI, LLM s, AI Solution Primary Skill Required For The Role Experienced Data Engineer or Application...Databricks
- ...possible.As a Lead Software Engineer at JPMorgan Chase,... ...Investment Banking - Data Analytics - Payments... ...programming languages(s); Python, Java and SQLHands-on... ...data pipelines on Databricks using orchestration tools... ..., MCP, vector databases, and embedding-based retrieval...DatabricksDatabase
- ...NJBuilds systems that gather, store, and process large volumes of data for analysis.ResponsibilitiesDevelop ETL pipelines, ensure data... ...ingestion, transformation, and storage pipelines across DataBricks Medallion Layers, Azure Data Factory, SQL Server, and staging/data...Databricks
- ...), is searching for a Python/PySpark Developer for... ...processes to handle large data volumes using the... ..., PySpark, Kafka and Databricks ecosystem. Develop... ...continuous improvement of data engineering processes, standards,... ...various relational databases. Deep...DatabricksDatabase
- ...Role: Data Ops Engineer Location: Jersey City, NJ FTE only Job Description... ...with HDFS, Spark, Hive/Impala, and Python-based data processing. Expertise in... ...tasks. Basic understanding of Azure/Databricks jobs, clusters, storage. Functional...Databricks
$104k - $157.7k
...efforts to develop and deliver complex data solutions to accomplish technology and business... ...stakeholders and Product and Software Engineering teams to implement data requirements,... .... Position Summary The Data Management, Database Specialist will help execute regulatory...DatabaseWork at officeFlexible hoursShift workDay shift- ...Data Engineer Our client, a leading organization in the data-driven industry, is seeking... ...transformation, and storage pipelines across DataBricks Medallion Layers, Azure Data Factory,... ...What's Needed? Proficiency in Python and SQL for data manipulation and pipeline...DatabricksWeekly payTemporary workFlexible hours3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer Databricks / Python / Database. Be the first to apply!
Related searches
- data engineer contract Jersey City, NJ
- big data cloud engineer Jersey City, NJ
- big data developer Jersey City, NJ
- finance data engineer Jersey City, NJ
- software data engineer Jersey City, NJ
- hadoop big data developer Jersey City, NJ
- data engineer machine learning Jersey City, NJ
- senior data quality engineer Jersey City, NJ
- data visualization developer Jersey City, NJ
- aws data engineer Jersey City, NJ


