Data Engineer Databricks / Python / Database
Cloud Analytics Technologies LLC
Overview:
We are seeking an experienced Data Engineer with strong expertise in Databricks, Python, and Database engineering. The ideal candidate will design, build, and optimize scalable data pipelines, ensure data quality, and support advanced analytics and business intelligence initiatives across the organization.
- Design, build, and maintain ETL/ELT workflows on Databricks.
- Develop scalable data pipelines using Python and Spark.
- Optimize data transformation logic for performance and cost efficiency.
- Work with structured and unstructured data from various sources.
- Develop and manage data models, schemas, and tables across databases (SQL/NoSQL).
- Implement data quality, validation, and monitoring frameworks.
- Collaborate with Data Scientists, Analysts, and Cloud Engineers to support analytics and ML workloads.
- Ensure data security, governance, and compliance in all solutions.
- Troubleshoot pipeline failures and continuously improve pipeline reliability.
- Integrate data from APIs, streaming sources, and cloud storage.
Required Skills:
Core Technical Skills:-
- Databricks (mandatory) – Delta Lake, Notebooks, Spark SQL, Jobs, Workflows
- Python – Data processing, Spark APIs, automation, optimization
- Database Engineering – Strong SQL, query tuning, schema design, stored procedures
- Apache Spark – RDDs/DataFrames, optimisation, partitioning
- Cloud Platforms (one or more): AWS / Azure / GCP
- ETL/ELT tools: ADF, Glue, Dataflow, or equivalent
- Experience working with large-scale datasets
- CI/CD for data pipelines (Git, DevOps, Jenkins, etc.)
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer Databricks / Python / Database in Jersey City, NJ vacancy
- ...We are seeking a skilled Data Engineer to design, develop, and support... ...strong expertise in Snowflake, Python, SQL, AWS, Oracle, and Apache Airflow... ..., RAG architectures, or vector databases. Experience with Spark, Kafka, or Databricks. SnowPro and/or AWS...DatabricksDatabase
- Job ID: 25956017Reference Number: 25-00834Title: Python PySpark/ Data EngineerLocation: Columbus, OH and Jersey City, NJPosted... ...experience building/implementing data pipelines using Databricks or similar cloud database.Expert level knowledge of using SQL to write complex,...DatabricksDatabaseWork experience placement
- ...consultants bring deep expertise in Data Science, Machine Learning and... ...seeking an experienced Data Engineer to join our data team. In... ...workflows using Databricks, Apache Spark, and SQL to support... ...~ Familiarity with vector databases, embeddings, and Retrieval-Augmented...DatabricksDatabaseLocal area
- ...cloud technologies, and big data processing. This role involves... ...data storage solutions. Skills: Python, SQL, cloud data tools... ...junior developers. Optimize database performance and manage data storage... ..., Python, Azure Cloud, Azure Databricks, Delta Lake and Delta tables,...DatabricksDatabase
- Data Engineer Proven experience as a Data Engineer with experience in... ...Factory Azure Lake Gen 2 Azure Databases Azure Data Fabric API... ...Functions Well versed with Azure Databricks Strong SQL skills with RDMS... ...FastAPI or similar frameworks in Python Familiarity with the DevOps...DatabricksDatabase
- ...the perfect software engineering opportunity for you.... ...JPMorganChase within the AI/ML Data Platforms , you are... ...Experience in Python developing, debugging,... ...programming languages and database querying languages... ...Exposure to AWS & Databricks Platform administration...DatabricksDatabase
$116k - $152.25k
...name on it As an Analytics Engineer for our Sports Modeling &... ...maintaining, and improving the data models, datasets and data... ...data into properly thought-out databases (SQL, Delta Lakes, etc.)... ...databases ~ Proficient in SQL, Databricks, R/Python, Tableau, AWS s3 buckets,...DatabricksDatabaseTemporary workLocal areaWorldwide$156.75k - $215k
...As a Lead Software Engineer within the JP Morgan Credit Risk Technology organization... ...Advanced proficiency in Java or Python Strong knowledge of relational databases/ Transact SQL (Oracle/Sybase/SQL Server) Strong Knowledge of Databricks Experience in developing,...DatabricksDatabaseFull time- ...supporting enterprise data, regulatory reporting,... ...take ownership, guide engineering decisions, and collaborate... ...applications using Python and Django. Build... ...solutions using Azure Databricks, PySpark, Delta Lake,... ...Improve SQL and NoSQL database performance, data quality...DatabricksDatabaseWork at office
- ...casualty insurance and risk engineering services; affluent and high... ...skilled and experienced lead data engineer to join our dynamic... ...experience in Informatica IICS, Databricks Python, ADF, snowflake and other... ...programming experience in database management, ETL processes, data...DatabricksDatabaseWork experience placementLocal area
- ...Karthik Consulting is seeking a talented and driven Data Engineer to join its enterprise data and cloud engineering... ...Scope The engineer will leverage Azure Data Factory, Databricks, Oracle, SQL Server, and Azure Database services to build and sustain enterprise data...DatabricksDatabase
- The owner of the POD’s data backbone - the Atlas Data Lake, the Graph Database that underpins the Ontology... ...Atlas Data Lake and Databricks for FedEx, customer and... ...with the AI Engineer. Implement data governance... ...equivalent). Strong SQL and Python; Spark (batch and structured...DatabricksDatabase
- Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+ Months... .... Your expertise in Java, Python, Spark cluster management,... ...development, and knowledge of Databricks and Delta Lake will be... ...experience with relational databases (e.g., Snowflake, Delta Tables...DatabricksDatabase
- ...key responsibility. Advanced Data Engineering and Solution Design (80%)... ...AWS SageMaker, Glue ML, or Databricks for feature engineering and... ...programming and scripting languages (Python, SQL, PySpark) for building... .... Certifications in cloud, database, and programming are a plus....DatabricksDatabase
$110k - $120k
Senior Data Engineer Fort Eustis / Hybrid (3 days per week onsite) CLEARANCE... ...relational and cloud-based databases (Azure SQL, Synapse, or... .... Proficiency in SQL, Python, or Scala for data transformation... ...SKILLS: Experience with Databricks, Spark, or big data processing...DatabricksDatabaseFlexible hours3 days per week- ...seeking an experienced Senior Data Engineer - EpicClarity with 8+ years... ...with EpicClarity databases and healthcare data structures... ...solutions. Experience with Python for dataprocessing and automation... ...Epic Caboodle. Experience with Databricks,Snowflake, Synapse, Azure Data...DatabricksDatabase
- ...Position Summary Curant Health is seeking a Data Engineer II to design, develop, and support... ...logic. Design and support relational databases, data warehouses, and dimensional data... ...as Azure Data Factory, Azure SQL, Azure Databricks, Azure Synapse Analytics, and Azure Functions...DatabricksDatabase
- ...About This Opportunity As a Data Engineer I, you’ll help develop and maintain... ...architecture using Azure Databricks and Delta Lake. Develop and... .../ELT processes using SQL, Python, PySpark, and Spark SQL.... ...Understanding of relational databases, data modeling concepts, and...DatabricksDatabaseImmediate startRemote workFlexible hours
$140k - $160k
...Company Overview Pantheon Data (a Kenific Holding... ...technology, software engineering, program management, strategic... ...candidate has strong Python and SQL skills,... ...between transactional databases, analytical stores, object... ...with PySpark, Spark, Databricks, EMR, Snowflake,...DatabricksDatabaseWork at officeLocal areaRemote work$80k - $133k
## Senior Data EngineerApply: US - TX, San Antonio... ...seeks a Senior Data Engineer to design, develop, and... ...engineering solutions using Python, SQL, Spark, and... ...leveraging AWS, Azure, Databricks, and other modern... ...relational and non-relational databases, including data...DatabricksDatabaseFull timeContract workTemporary workFlexible hours- ...Limited Company (DTLC) is hiring an ETL Data Engineer on behalf of the District of Columbia... ...frameworks such as Azure Data Factory, Synapse, Databricks, and Informatica, gathering... ...Develop complex programs and reports in database query language. Data Governance and Quality...DatabricksDatabaseContract workWork at office
- The Lead Data Engineer will work across data engineering and analytical responsibilities... ...role requires strong expertise in Databricks, PySpark, Python, SQL, Delta Lake, data modeling, and... ...PostgreSQL, Delta Tables, or NoSQL databases. Experience with Scala. Experience with...DatabricksDatabase
$82k - $152.2k
## Data EngineerApply: On-Site: Burlington, Vermont... ...is looking for a Data Engineer to support our Federal... ...programming language (Python, Java, R, etc),... ...and view creation, and database performance tuning* Experience... ..., particularly Databricks, MS SQL Server, Snowflake...DatabricksDatabaseAgency workFull timeContract workWork at officeLocal areaRemote workFlexible hours- ...rest of UT to provide data and analytics solutions... ...need. Senior Data Engineer The Senior Data Engineer... ...ETL/ELT pipelines using Databricks and Azure Data Factory... ...systems (e.g., SQL Databases, Databricks) to ensure... ...programming languages such as Python Understanding of data...DatabricksDatabaseWork at office3 days per week
$150k - $200k
## Data EngineerApply: Hybrid: New York, NY: Full time... ...a highly skilled Data Engineer to join our dynamic... ...utilizing Snowflake and Databricks platforms. The role demands expertise in Python, deep familiarity with... ...(RAG)s, and/or vector databases.* Knowledge of fundamental...DatabricksDatabaseFull time- ...operations, enable efficient data exchange, and support... ...Summary The Data Engineer is responsible for... ...based storage platforms, databases, and data services that... ...Synapse Analytics, Databricks, or similar cloud data... ...transactions. Experience with Python, PowerShell, C#, or...DatabricksDatabase
$65 - $70 per hour
Position: Data Engineer- AWSLocation: Jersey City, New JerseyDuration:... ...Engineer III specializing in Python, Spark, and Data Lake... ...frequently and understand NoSQL databases and their applications.Contribute... ...such as AWS Data Lake, Databricks, or Hadoop.Proficiency in relational...DatabricksDatabaseFull time$72k - $96k
## Data Engineer IApply: Honolulu: Full time: Posted Yesterday: R3781**Must reside on Oahu... ...Data Engineer I works with tools such as Databricks, Python, SQL, data orchestration, warehousing,... ...programming + Experience working with database integrations and the ability to import...DatabricksDatabaseFull timeWork from home1 day per week$61k - $101k
...or certification in software engineering concepts along with 5+ years... ...Spring Boot, Spring MVC, Spring Data), RESTful APIs, microservices... ...data models for relational databases. We require experience working... ...product engineering such as Databricks, Data Mesh, Unity Catalog,...DatabricksDatabaseFull time- ...that specializes in cybersecurity, Big Data/databases, software development, systems testing,... ...company. Job Overview: The AI Data Engineer is responsible for building and... ...or equivalent cloud certifications. -Databricks and/or Snowflake certifications Knowledge...DatabricksDatabaseFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer Databricks / Python / Database. Be the first to apply!
Related searches
- data engineer contract Jersey City, NJ
- big data cloud engineer Jersey City, NJ
- big data developer Jersey City, NJ
- finance data engineer Jersey City, NJ
- software data engineer Jersey City, NJ
- hadoop big data developer Jersey City, NJ
- data engineer machine learning Jersey City, NJ
- senior data quality engineer Jersey City, NJ
- data visualization developer Jersey City, NJ
- aws data engineer Jersey City, NJ


