Azure Databricks Engineer
Damco
Azure Databricks Engineer
Position: Azure Databricks Engineer
Client: Client/Telecommunication
Location: Atlanta / Alpharetta – Onsite
Duration: 6 Month
Responsibilities:
- Design, build, and maintain scalable and robust ETL or ELT pipelines using Databricks.
- Ingest data from various sources (databases, APIs, streaming services, cloud storage) into the Databricks environment.
- Implement data transformations and cleansing processes to ensure data quality and consistency.
- Utilize Databricks features like Delta Live Tables (DLT) for declarative pipeline development and efficient data processing.
- Manage and optimize data storage within Databricks
- Translate business needs into technical specifications for data solutions.
Skills:
- Deep understanding and hands-on experience with the Databricks platform, including Databricks notebooks, clusters, jobs, Delta Lake, Unity Catalog, and Databricks Programming languages.
- Experience with major cloud provider such as Azure, as Databricks runs on these infrastructures
- Working Experience with streaming data technologies
- Solid understanding of data warehousing principles, dimensional modeling, and various ETL/ELT methodologies.
- Familiarity with Git or other version control systems for collaborative code development.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Azure Databricks Engineer in Atlanta, GA vacancy
$116.2k - $229.1k
Position Summary Join Deloitte’s AI & Engineering practice and help organizations modernize enterprise cloud and data platforms on Azure. As an Azure/Databricks Infrastructure Engineer, you will design, implement, and optimize secure, scalable Azure and Databricks...DatabricksLocal areaVisa sponsorship- Job Title: .Net - Azure Architect Location :Atlanta, GA (Onsite - Hybrid)Job Description... ...including LLM integration prompt engineering frameworks retrievalaugmented generation... ...working with Azure OpenAI Cognitive Services Databricks and AIML platformsAbility to define reference...Databricks
- ...NAVA Software solutions is looking for an Azure Data Architect Details: Azure Data Architect Location: Atlanta... ...SQL, Azure Data Lake, HD Insights, Hadoop, CosmosDB, Synapse, Databricks ~ Experience with Big Data Technologies such as Spark, Hadoop...DatabricksRemote work
Nava Software Solutions
Atlanta, GA2 days ago - ...-to-end modern data architecture on the Azure cloud platform, including data lakes, data... ...Factory, Synapse Analytics, ADLS Gen2), Databricks, and dbt.Data Modeling Warehousing... ...Collaboration Mentorship Work closely with data engineers, analysts, and business stakeholders to...Databricks
Purple Drive
Atlanta, GA4 days ago - ...the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and... ...using Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP) Advising... ...Jenkins Additional Technologies: Spark, Databricks, Kafka, Kinesis, Hadoop, Lambda, EMR...DatabricksWork at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and... ...one cloud-based solution/platform (AWS, Azure, GCP) Advanced level proficiency with at... ...lake solutions like Snowflake, Redshift, Databricks 5+ years of experience with SQL or NoSQL...DatabricksWork at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...Senior Data Architect (AWS, Azure, GCP) CapTech is an award-winning consulting firm... ...requirements are met Leading teams of data engineers and other technical team members through... ...warehouse tools including Snowflake and DataBricks ~ Advanced proficiency in end-to-end...DatabricksWork at officeRemote workVisa sponsorshipWork visaFlexible hours
CapTech Consulting
Atlanta, GA22 hours ago - ...VetsEZ is currently looking for a Senior Azure Integration Engineer for a 100% remote position supporting a large federal government healthcare... ...cloud-native solutions using Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, and modern DevSecOps practices...DatabricksRemote jobFull time
- ...must include designing end-to-end cloud data architectures on AWS/Azure and/or hybrid environments, ensuring secure, scalable, and high... ...usage of Cloud native and agnostic platforms using Snowflake/Databricks and underlying Data governance components and its integration...Databricks
VBeyond
Atlanta, GA2 days ago - ...mindlance.comContact Phone: (***) ***-****Company: Mindlance Modern Data Engineer (Enterprise + Lakehouse + AI‐Assisted) Experience 5+ years... ...through Power BI Experience with Spark-based platforms, with Databricks Lakehouse as the primary future-state technology Data...Databricks
$175.3k - $322.9k
...and eager to develop and maintain a highly desired knowledge of Databricks solutions and Business Use Cases in the Consumer Industry.... ...services (Amazon Web Services, Google Cloud Platform, Microsoft Azure, Databricks)Deploying dynamically scalable, available, fault-tolerant...DatabricksLocal area$94.43k - $202.75k
...currently seeking a Senior Associate, Data Engineer for our Consulting practice.... ...implementation of large-scale data solutions in Databricks to support multiple use cases (delta lake... ...infrastructure and services, such as AWS, Azure, or GCP; hands-on technical experience...DatabricksLocal areaVisa sponsorship- ...Integration & Data Architecture Design and implement integrations with: Shopify, Espresa, Paymentech, SendGrid Databricks Lakehouse for Pet Registry and Microchip Registry Azure Integration Services and Microsoft Dataverse Enable and govern Dual-write integration between D365 CE...DatabricksFull time
$142.8k - $274.8k
...about cloud computing technology and driving growth in one of Microsoft's core businesses? Then the Engineering Operations (EngOps) Team is for you!The Prinipal Azure Customer Engineer (ACE) Manager is accountable for end-to-end engineering support delivery for an assigned...Ongoing contractLocal areaImmediate startShift work3 days per week- ...Mohammed , Jhansi Bugatha, Vamsi SattaruCompany: SRI Tech SolutionsJob Summary (Senior ML Data Engineer) - Lead the design and maintenance of scalable data pipelines using Databricks, Spark, and Airflow. - Develop and manage Feature Stores to support machine learning and...DatabricksHourly pay
- ...ETL/Data Warehouse Testing experience Hands-on experience with Databricks Strong SQL skills Experience validating ETL pipelines and data... ...Financial Services experience (State Street experience is a plus) Experience with Azure Databricks Knowledge of Data Warehousing conceptsDatabricks
- OverviewJob PurposeWe're looking for a lead engineer to lead the design and evolution of our Trading Analytics platform, the set of services... ...CD pipelines.Hands-on experience building ETL pipelines using Databricks and developing notebooks and jobs in PySpark for large-scale...Databricks
- Primary Responsibilities:The Azure Architect will be provided an overall architecture roadmap to perform enterprise-level cloud VM patch management and deployment for our client, a global manufacturing company.Must be able to clearly communicate and plan out processes for...
- We are seeking a Full Stack AI Platform Engineer to join our Data Engineering, AI & ML Platform... ...deploying containerized models from Azure to edge devices using Azure IoT Edge or... ...with cloud-native data platforms (Databricks, BigQuery, Azure Data Lake, Kubernetes)....DatabricksPermanent employmentTemporary workLocal areaFlexible hours
- ...and people. The the company Search AI Platform, use… 1h ago J-J4KCS6 Databricks Technology Req ID: CSQ427R97 Location: Tokyo, Japan Mission We are FDEs! The Forward Deployed Engineering team is a highly specialized, customer-facing unit within the company. We...DatabricksFull time
United States Digital Space LLC
Atlanta, GA3 days ago $99k - $232k
Industry/Sector Not Applicable Specialism Managed Services Management Level Manager Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced...DatabricksFull timeH1b- ...learning methods based on project needs.• Use Databricks and Apache Spark to process large... ...forecasting applications.• Practical knowledge of Azure Databricks and Apache Spark, including a... ...techniques. • Working knowledge of data engineering concepts, including ETL processes, SQL...Databricks
- ...partnering with senior leadership, data engineering, and AI/ML teams to transform an optimized... ...like Snowflake Semantic Views, Databricks Unity Catalog/Liquid Clustering, Fabric... ...alongside cloud ecosystems like AWS or Azure. ~ Advanced skill in Data Modeling across...DatabricksFlexible hours
Warner Bros. Discovery
Atlanta, GA1 day ago - ...comContact Phone: (***) ***-****Company: Mindlance Required: 3-5 Years. Proficient in Python or SQL, experienced in writing queries in Databricks, able to create data visualizations in Power BI that are connected directly to Databricks catalog and queries. Ability to...Databricks
- ...routing, technical relationship craft across the customer's engineering org). The 70% is the center of gravity. Credibility is earned... ...background as a Forward Deployed Engineer at Palantir, Resident SA at Databricks, Principal SA at Snowflake/Confluent, or Customer Engineer at...Databricks
NX1
Atlanta, GA22 hours ago - ...and develop data-driven solutions. Data Engineering: Design, develop, and maintain data pipelines... ...to modern data platforms such as Databricks or Snowflake. Experience with AI-assisted... ...with cloud computing platforms (e.g., AWS, Azure, Google Cloud, Snowflake). Domain...DatabricksContract work
Socket
Atlanta, GA3 days ago - ...data products for the enterprise. The Data Engineer, Senior will report to the Sr Manager,... .... Expertise with cloud platforms (Azure preferred) and services such as ADLS, Synapse... ...data stack tools such as dbt, Snowflake, Databricks, Airflow, or Tidal. Solid knowledge of...Databricks
Blue Shield of CA
Atlanta, GA22 hours ago - ...Team and uphold these hallmarks.Job OverviewThe AI/ML Platform Engineer is responsible for the foundational platform capabilities... ..., and distributed data processing frameworks.Experience with Azure Databricks, including Unity Catalog, Delta Lake, MLflow, Feature Store,...DatabricksLocal areaFlexible hours
- ...Apache Spark (PySpark, Scala, or Spark SQL). • Proficiency with Databricks, Delta Lake, and notebook based development. • Experience... ...SQL skills with experience in relational database systems (e.g., Azure SQL, SQL Server, PostgreSQL). • Experience with data modeling concepts...Databricks
- ...claims advocacy and client servicingDrive AI integration across Azure Databricks Python ML and legacy NET systems to modernise broker... ...triage quote comparison document ingestion IDP recommendation engines agent assist client insightsDefine enterprise AI patterns standards...Databricks
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Databricks Engineer. Be the first to apply!
Related searches