Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Azure Databricks Engineer

Software Technology Inc

Data Engineer

Key Responsibilities:

  • Design and implement scalable data processes focused on fulfilling product requirements.
  • Large complex components; influencing overall product architecture and patterns.
  • Autonomously implement component design in line with pre-defined Data and (ELT/ETL) architectural patterns.
  • Partner with Business, Technical and Strategic Product stakeholders to manage project commitments in an agile framework; rapidly delivering value to our customers via technology solutions.
  • Develop, construct, test, document and maintain data pipelines.
  • Identify ways to improve data reliability, efficiency, and quality.
  • Design and develop resilient, reliable, scalable and self-healing solutions to meet and exceed customer requirements.
  • Ensure that all parts of the application eco-system are thoroughly and effectively covered with telemetry.
  • Focus on automation, quality and streamlining new and existing data processing.
  • Create data monitoring capabilities for each business process and work with data consumers on updates to data processes.
  • Develop data pipelines using Python, Spark and/or Scala.
  • Automate and orchestrate data pipelines using Azure Data Factory or Delta Live Tables
  • Help maintain the integrity and security of the company data.
  • Communicate clearly and effectively in oral and written forms and be able to present and demonstrate work to technical and non-technical stakeholders.

Required Qualifications:

  • Undergraduate degree or equivalent experience
  • Minimum 5 to 7 years of IT experience in Software Engineering.
  • Minimum 3 to 5 years of experience in big data processing for batch and/or streaming data; data includes file systems, data structures/databases, automation, security, messaging, movement, etc.
  • Minimum 3 to 5 years of experience with Python and Spark in developing data processing pipelines.
  • Minimum 3 to 5 years of ETL programming experience in Databricks using Scala/Java.
  • Minimum 3 to 5 years of supporting extensive data analysis using advanced SQL concepts and window functions
  • Minimum 2 to 3 years of experience working on large scale programs, with multiple concurrent projects.
  • Minimum 2 to 3 years of experience with Agile methodologies and Test-Driven Development.
  • Experience with Continuous Development/ Integration (CI/CD) /DevOps skills, (Jenkins, Git, Azure DevOps/ Git Actions).
  • Strong written and oral communications along with presentation and interpersonal skills
  • Ability to lead and delegate work across other members of the data engineering team

Preferred Qualifications:

  • Minimum 2 to 3 years of cloud experience, preferably Azure.
  • Minimum 2 to 3 years experience with Databricks or other big data platforms.
  • Minimum 2 to 3 years automation/orchestration experience using Azure Data Factory
  • Experience and familiarity with data across Healthcare Provider domains (i.e. Patient, Provider, Encounter, Billing, Claims, Eligibility etc.)
  • Familiarity/Experience with Clinical data exchange formats like HL7, FHIR, CCD etc.
  • Familiarity/experience with FHIR resources and data model
  • Experience in Big data processing in healthcare domain
  • Cloud development and computing.
  • Knowledge of cutting to edge technologies (AI, ML, Blockchain, Wearables, IOT).
  • Knowledge/Experience with Microservice design, Java Spring, Kafka, RabbitMQ.
Vacancy posted 15 hours ago
Similar jobs that could be interesting for youBased on the Azure Databricks Engineer in Washington DC vacancy
  •  ...We are seeking an experienced Azure Data Engineer with strong expertise in Microsoft Azure, Azure Databricks, Microsoft Fabric, Python, PySpark, PL/SQL, and Power BI. The candidate will be responsible for building scalable data ingestion pipelines, transforming and standardizing... 
    Databricks
    Full time

    Techvilla Solutions

    Washington DC
    26 days ago
  •  ...Job : Data Platform Engineer/Azure Data Engineer (Synapse/ Azure Data Bricks/ Apache Spark & Scala) Location : Redmond, WA (Hybrid...  ...time|| Min.Exp Req : 10+ Years Primary Skills Azure Databricks Azure Synapse Analytics PySpark Apache Spark Scala... 
    Databricks
    Full time

    Programmers.io

    Washington DC
    11 hours ago
  •  ...Job Title: Data Platform Engineer with Azure Location: Redmond, WA- Onsite role Type: Full-Time- onsite role Mandatory Skills: Data Engineering Azure Databricks, Spark/PySpark Azure Synapse Analytics, Azure Data Factory ADLS Gen2, Delta Lake SQL... 
    Databricks
    Full time

    Programmers.io

    Washington DC
    1 day ago
  •  ...Hi, Azure Cloud Security Engineer Location: Washington, DC metro area | Hybrid, four days onsite per week Employment: Full-time Clearance...  ...access, and tenant isolation to services such as Azure Databricks and AI workloads. Guide audit and diagnostic logging... 
    Databricks
    Full time

    PeopleFirst Resources

    Washington DC
    2 days ago
  •  ...Job Description Job Description . Job Title: Senior Azure Data Engineer Location: Redmond, WA 98052 Work Setup: Hybrid Duration...  ...expertise in Python, SQL, Apache Spark, PySpark, and Azure Databricks . The candidate will be responsible for developing and... 
    Databricks

    eTeam Inc.

    Washington DC
    21 days ago
  • $60 - $65 per hour

     ...Job Description Job Description Role : Azure Data Engineer with Databricks Expertise Location : Iselin , NJ (Hybrid) Rate: $60/hr to $65/hr Job Summary: We are seeking highly skilled Azure Data Engineer with strong expertise in SQL, Python, Datawarehouse... 
    Databricks

    PeopleNTech LLC

    Alexandria, VA
    2 days ago
  • $120k - $130k

     ...Description Job Description LightFeather is seeking an Azure Cloud Security Engineer to help secure an enterprise Azure platform for a federal...  ...Zero Trust principles to emerging services such as Azure Databricks and AI workloads. That includes least privilege, mutual... 
    Databricks
    Full time
    Contract work
    Local area

    LIGHTFEATHER IO LLC

    Washington DC
    9 days ago
  •  ...and data mining techniques. Must have strong expertise in the Azure Cloud environment Strong proficiency in Python or similar...  ...(e.g., Azure, Data Lake, Synapse Analytics, Machine Learning, Databricks, Logic Apps, AI Foundry). ~ Proficiency in programming languages... 
    Databricks
    Remote work

    Sparibis

    Washington DC
    2 days ago
  •  ...Job Description Job Description Azure Data Architect Location: Arlington, VA...  ...Analytics, Azure Data Factory (ADF), and Databricks , along with proven experience in data...  ...data platforms. Collaborate with data engineers, developers, business stakeholders, and... 
    Databricks

    Echo IT Solutions, Inc

    Arlington, VA
    23 days ago
  •  ...Job Description Job Code: JPC - 4078 Job Title : Azure Data/Search Engineer Experience : Min 8 Years Location : Irving, TX (Hybrid...  ...Software Engineer with strong expertise in Python, Databricks, SQL, Elasticsearch, Kafka , and Azure , responsible for... 
    Databricks
    Contract work
    Work at office

    PeopleNTech LLC

    Alexandria, VA
    23 days ago
  •  ...#54593Location: Washington, DC, 20001, United StatesJob Tite: Azure Data Solutions ArchitectLocation: Washington, DC (20001) OnsiteInperson...  ...; working with SQL, SSRS, SSIS, SSAS, Azure Data Factory, Databricks, Python, and DAX; and senior level understanding of health care... 
    Databricks
    Permanent employment

    InstantServe

    Washington DC
    3 days ago
  •  ...releases. Help power a federal agency’s data mission. Your engineering decisions shape how teams deploy, secure, and operate production data systems. In this role, you’ll take ownership of Azure Databricks environments and the automation that moves work reliably from... 
    Databricks
    Full time
    Temporary work
    Immediate start
    Remote work
    Flexible hours
    2 days per week
    1 day per week

    FSR, LLC.

    Washington DC
    21 days ago
  •  ...Azure Data ArchitectLocation: McLean VA 22102Skills: Data Architect, ETL, SSIS/SSRS,...  ...reporting, while working closely with Data Engineering, BI, and Data Science teams.Key...  ...ELT solutions using Azure Data Factory, Databricks, Informatica, SSIS.Guide ETL automation,... 
    Databricks

    United IT

    McLean, VA
    3 days ago
  •  ...PID: 26-14-09P-066-WSU Summary E-INFOSOL LLC is seeking a motivated and results-driven Azure Cloud Engineer to be a full-time employee in Washington, DC to join our innovative and customer solutions focused team. Position Overview E-INFOSOL is seeking... 
    Full time
    Contract work
    Temporary work
    Local area

    E-InfoSol LLC

    Washington DC
    3 days ago
  •  ...Experience with Cloud based data architectures, messaging, and analytics. • Experience with developing and deploying ETL pipelines using Databricks Pyspark. Minimally a BA/BS degree within an engineering and/or computer science discipline. • Master’s degree preferred.... 
    Databricks

    Saxon Global

    Washington DC
    5 days ago
  •  ...Developer We are seeking a highly experienced Data Integration and Business Intelligence (BI) Developer with deep expertise in Databricks, AWS cloud technologies, and Tableau. The ideal candidate will have a strong background in designing and implementing scalable... 
    Databricks

    Software Technology Inc

    Bethesda, MD
    15 hours ago
  •  ...degree in Computer Science, Data Analytics, Engineering, Mathematics, Business, or related field...  ...to detail. ~ Experience with Azure infrastructure especially Azure Data Lake...  ...Azure Data Factory. ~ Experience using Databricks for machine learning algorithm... 
    Databricks

    Anveta

    Arlington, VA
    3 days ago
  • **Job Title: Azure Architect Location: Washington, DC Experience: 15+ Years** **Job Summary...  ...Vault, Service Bus, Azure Data Factory, Databricks, and Cosmos DB. Lead .NET application...  ...-making. Mentor developers, cloud engineers, and technical teams on Azure architecture... 
    Databricks
    Full time

    Amaze Systems

    Washington DC
    3 days ago
  • $98.5k - $206.8k

    Job Title: Azure IaaS Engineer Job Category: Information Technology Time Type: Full time Minimum Clearance Required to Start: None Employee Type: Regular Percentage of Travel Required: None Type of Travel: None * * * The Opportunity: CACI is seeking... 
    Full time
    Contract work
    Work experience placement
    Flexible hours

    CACI International, Inc.

    Arlington, VA
    11 hours ago
  •  ...applications using AWS cloud services.Insights: Work with AWS engineering and support teams to convey partner and customerneeds and...  ...data analytics services (e.g. Redshift, Glue, LakeFormation, Databricks, dbt, Spark)Preferred qualification - AWS experience preferred... 
    Databricks

    Amazon

    Washington DC
    2 days ago
  • $70 - $75 per hour

     ...Detailed Job Description Build end to end full stack web Apps, integrating UIUX, backend services, and customer data across Azure and Databricks. Build endtoend fullstack web Apps, integrating UIUX, backend services, and customer data across Azure and Databricks.... 
    Databricks
    Contract work

    Long Finch Technologies

    Washington DC
    29 days ago
  • $86.8k - $198k

     ...Job Number: R0252608 AWS & Databricks Cloud Platform Engineer, Senior The Opportunity: Everyone is trying to "harness the cloud," but not everyone...  ...field AWS DevOps Engineer, AWS SysOps Administrator, Azure DevOps Engineer, Red Hat Certified Engineer (RHCE), or... 
    Databricks
    Full time
    Contract work
    Part time
    Local area
    Remote work

    Booz Allen Hamilton

    Alexandria, VA
    1 day ago
  • $90 - $100 per hour

     ...Role Summary The Data Platform Engineer will support the Enterprise Data team in...  ...governance, and AI-readiness across the Databricks Lakehouse. This role covers PHI/PII protection...  ...Develop Databricks applications. Optimize Azure and Databricks access, including... 
    Databricks
    Hourly pay
    Contract work
    Remote work

    WideNet Consulting Group

    Washington DC
    2 days ago
  •  ...will have extensive experience managing Tableau Server environments and integrating business intelligence platforms with Snowflake, Databricks, and Oracle. This role requires strong architectural expertise, technical leadership, and the ability to modernize enterprise... 
    Databricks
    Contract work

    2T Consulting

    Washington DC
    8 days ago
  •  ...Integration: Collaborate with cross-functional teams such as IT and engineering to integrate data from various sources into the customer data...  ...Python. Experience working within data platforms like Databricks/Snowflake, and analytics modeling platforms such as Tableau... 
    Databricks
    Full time

    FocusKPI

    Largo, MD
    3 days ago
  •  ...Big Data Engineer Location: Arlington, VA (3 Days onsite/week) Ability to easily move between business, data management, and technical...  ...modeling, tuning, evaluating, monitoring, and presenting Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required... 
    Databricks
    3 days per week

    Futran Tech Solutions Pvt. Ltd.

    Arlington, VA
    3 days ago
  •  ...Candidates should have 12 or more years of experience in data engineering, platforms, or analytics, including at least five years...  ...in modern cloud data platforms and tools such as Snowflake or Databricks, dbt, Spark, SQL, orchestration, and streaming, as well as experience... 
    Databricks

    Confidential

    Washington DC
    11 hours ago
  •  ...this role, candidates in other locations will be considered.At Databricks, our mission is to simplify and democratize data and AI so...  ...will collaborate with internal stakeholders including product, engineering, sales, and finance to develop and optimize strategic... 
    Databricks
    Worldwide

    DataBricks

    Washington DC
    11 hours ago
  •  ...Senior AWS Data Engineer | Onsite, Washington DC Area | TS/SCI Required About the Role Our client, a federal services contractor...  ...Airflow/MWAA or Step Functions orchestration Exposure to Databricks, Snowflake, or Informatica Streaming experience with Kafka... 
    Databricks
    Full time
    For contractors

    Oxenham Group

    Washington DC
    2 days ago
  •  ...DriveDeveloping and maintaining technical solutions that adhere to engineering principles while meeting business requirements. Performing...  .... Building and deploying base infrastructure components (e.g., Azure capabilities including Virtual Machines, ASE, AKS, Blob storage... 

    Purple Drive

    Laurel, MD
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Azure Databricks Engineer. Be the first to apply!