Azure Databricks Engineer
Software Technology Inc
Data Engineer
Key Responsibilities:
- Design and implement scalable data processes focused on fulfilling product requirements.
- Large complex components; influencing overall product architecture and patterns.
- Autonomously implement component design in line with pre-defined Data and (ELT/ETL) architectural patterns.
- Partner with Business, Technical and Strategic Product stakeholders to manage project commitments in an agile framework; rapidly delivering value to our customers via technology solutions.
- Develop, construct, test, document and maintain data pipelines.
- Identify ways to improve data reliability, efficiency, and quality.
- Design and develop resilient, reliable, scalable and self-healing solutions to meet and exceed customer requirements.
- Ensure that all parts of the application eco-system are thoroughly and effectively covered with telemetry.
- Focus on automation, quality and streamlining new and existing data processing.
- Create data monitoring capabilities for each business process and work with data consumers on updates to data processes.
- Develop data pipelines using Python, Spark and/or Scala.
- Automate and orchestrate data pipelines using Azure Data Factory or Delta Live Tables
- Help maintain the integrity and security of the company data.
- Communicate clearly and effectively in oral and written forms and be able to present and demonstrate work to technical and non-technical stakeholders.
Required Qualifications:
- Undergraduate degree or equivalent experience
- Minimum 5 to 7 years of IT experience in Software Engineering.
- Minimum 3 to 5 years of experience in big data processing for batch and/or streaming data; data includes file systems, data structures/databases, automation, security, messaging, movement, etc.
- Minimum 3 to 5 years of experience with Python and Spark in developing data processing pipelines.
- Minimum 3 to 5 years of ETL programming experience in Databricks using Scala/Java.
- Minimum 3 to 5 years of supporting extensive data analysis using advanced SQL concepts and window functions
- Minimum 2 to 3 years of experience working on large scale programs, with multiple concurrent projects.
- Minimum 2 to 3 years of experience with Agile methodologies and Test-Driven Development.
- Experience with Continuous Development/ Integration (CI/CD) /DevOps skills, (Jenkins, Git, Azure DevOps/ Git Actions).
- Strong written and oral communications along with presentation and interpersonal skills
- Ability to lead and delegate work across other members of the data engineering team
Preferred Qualifications:
- Minimum 2 to 3 years of cloud experience, preferably Azure.
- Minimum 2 to 3 years experience with Databricks or other big data platforms.
- Minimum 2 to 3 years automation/orchestration experience using Azure Data Factory
- Experience and familiarity with data across Healthcare Provider domains (i.e. Patient, Provider, Encounter, Billing, Claims, Eligibility etc.)
- Familiarity/Experience with Clinical data exchange formats like HL7, FHIR, CCD etc.
- Familiarity/experience with FHIR resources and data model
- Experience in Big data processing in healthcare domain
- Cloud development and computing.
- Knowledge of cutting to edge technologies (AI, ML, Blockchain, Wearables, IOT).
- Knowledge/Experience with Microservice design, Java Spring, Kafka, RabbitMQ.
Vacancy posted 15 hours ago
Similar jobs that could be interesting for youBased on the Azure Databricks Engineer in Washington DC vacancy
- ...We are seeking an experienced Azure Data Engineer with strong expertise in Microsoft Azure, Azure Databricks, Microsoft Fabric, Python, PySpark, PL/SQL, and Power BI. The candidate will be responsible for building scalable data ingestion pipelines, transforming and standardizing...DatabricksFull time
- ...Job : Data Platform Engineer/Azure Data Engineer (Synapse/ Azure Data Bricks/ Apache Spark & Scala) Location : Redmond, WA (Hybrid... ...time|| Min.Exp Req : 10+ Years Primary Skills Azure Databricks Azure Synapse Analytics PySpark Apache Spark Scala...DatabricksFull time
- ...Job Title: Data Platform Engineer with Azure Location: Redmond, WA- Onsite role Type: Full-Time- onsite role Mandatory Skills: Data Engineering Azure Databricks, Spark/PySpark Azure Synapse Analytics, Azure Data Factory ADLS Gen2, Delta Lake SQL...DatabricksFull time
- ...Hi, Azure Cloud Security Engineer Location: Washington, DC metro area | Hybrid, four days onsite per week Employment: Full-time Clearance... ...access, and tenant isolation to services such as Azure Databricks and AI workloads. Guide audit and diagnostic logging...DatabricksFull time
- ...Job Description Job Description . Job Title: Senior Azure Data Engineer Location: Redmond, WA 98052 Work Setup: Hybrid Duration... ...expertise in Python, SQL, Apache Spark, PySpark, and Azure Databricks . The candidate will be responsible for developing and...Databricks
$60 - $65 per hour
...Job Description Job Description Role : Azure Data Engineer with Databricks Expertise Location : Iselin , NJ (Hybrid) Rate: $60/hr to $65/hr Job Summary: We are seeking highly skilled Azure Data Engineer with strong expertise in SQL, Python, Datawarehouse...Databricks$120k - $130k
...Description Job Description LightFeather is seeking an Azure Cloud Security Engineer to help secure an enterprise Azure platform for a federal... ...Zero Trust principles to emerging services such as Azure Databricks and AI workloads. That includes least privilege, mutual...DatabricksFull timeContract workLocal area- ...and data mining techniques. Must have strong expertise in the Azure Cloud environment Strong proficiency in Python or similar... ...(e.g., Azure, Data Lake, Synapse Analytics, Machine Learning, Databricks, Logic Apps, AI Foundry). ~ Proficiency in programming languages...DatabricksRemote work
- ...Job Description Job Description Azure Data Architect Location: Arlington, VA... ...Analytics, Azure Data Factory (ADF), and Databricks , along with proven experience in data... ...data platforms. Collaborate with data engineers, developers, business stakeholders, and...Databricks
- ...Job Description Job Code: JPC - 4078 Job Title : Azure Data/Search Engineer Experience : Min 8 Years Location : Irving, TX (Hybrid... ...Software Engineer with strong expertise in Python, Databricks, SQL, Elasticsearch, Kafka , and Azure , responsible for...DatabricksContract workWork at office
- ...#54593Location: Washington, DC, 20001, United StatesJob Tite: Azure Data Solutions ArchitectLocation: Washington, DC (20001) OnsiteInperson... ...; working with SQL, SSRS, SSIS, SSAS, Azure Data Factory, Databricks, Python, and DAX; and senior level understanding of health care...DatabricksPermanent employment
- ...releases. Help power a federal agency’s data mission. Your engineering decisions shape how teams deploy, secure, and operate production data systems. In this role, you’ll take ownership of Azure Databricks environments and the automation that moves work reliably from...DatabricksFull timeTemporary workImmediate startRemote workFlexible hours2 days per week1 day per week
- ...Azure Data ArchitectLocation: McLean VA 22102Skills: Data Architect, ETL, SSIS/SSRS,... ...reporting, while working closely with Data Engineering, BI, and Data Science teams.Key... ...ELT solutions using Azure Data Factory, Databricks, Informatica, SSIS.Guide ETL automation,...Databricks
- ...PID: 26-14-09P-066-WSU Summary E-INFOSOL LLC is seeking a motivated and results-driven Azure Cloud Engineer to be a full-time employee in Washington, DC to join our innovative and customer solutions focused team. Position Overview E-INFOSOL is seeking...Full timeContract workTemporary workLocal area
- ...Experience with Cloud based data architectures, messaging, and analytics. • Experience with developing and deploying ETL pipelines using Databricks Pyspark. Minimally a BA/BS degree within an engineering and/or computer science discipline. • Master’s degree preferred....Databricks
- ...Developer We are seeking a highly experienced Data Integration and Business Intelligence (BI) Developer with deep expertise in Databricks, AWS cloud technologies, and Tableau. The ideal candidate will have a strong background in designing and implementing scalable...Databricks
- ...degree in Computer Science, Data Analytics, Engineering, Mathematics, Business, or related field... ...to detail. ~ Experience with Azure infrastructure especially Azure Data Lake... ...Azure Data Factory. ~ Experience using Databricks for machine learning algorithm...Databricks
- **Job Title: Azure Architect Location: Washington, DC Experience: 15+ Years** **Job Summary... ...Vault, Service Bus, Azure Data Factory, Databricks, and Cosmos DB. Lead .NET application... ...-making. Mentor developers, cloud engineers, and technical teams on Azure architecture...DatabricksFull time
$98.5k - $206.8k
Job Title: Azure IaaS Engineer Job Category: Information Technology Time Type: Full time Minimum Clearance Required to Start: None Employee Type: Regular Percentage of Travel Required: None Type of Travel: None * * * The Opportunity: CACI is seeking...Full timeContract workWork experience placementFlexible hours- ...applications using AWS cloud services.Insights: Work with AWS engineering and support teams to convey partner and customerneeds and... ...data analytics services (e.g. Redshift, Glue, LakeFormation, Databricks, dbt, Spark)Preferred qualification - AWS experience preferred...Databricks
$70 - $75 per hour
...Detailed Job Description Build end to end full stack web Apps, integrating UIUX, backend services, and customer data across Azure and Databricks. Build endtoend fullstack web Apps, integrating UIUX, backend services, and customer data across Azure and Databricks....DatabricksContract work$86.8k - $198k
...Job Number: R0252608 AWS & Databricks Cloud Platform Engineer, Senior The Opportunity: Everyone is trying to "harness the cloud," but not everyone... ...field AWS DevOps Engineer, AWS SysOps Administrator, Azure DevOps Engineer, Red Hat Certified Engineer (RHCE), or...DatabricksFull timeContract workPart timeLocal areaRemote work$90 - $100 per hour
...Role Summary The Data Platform Engineer will support the Enterprise Data team in... ...governance, and AI-readiness across the Databricks Lakehouse. This role covers PHI/PII protection... ...Develop Databricks applications. Optimize Azure and Databricks access, including...DatabricksHourly payContract workRemote work- ...will have extensive experience managing Tableau Server environments and integrating business intelligence platforms with Snowflake, Databricks, and Oracle. This role requires strong architectural expertise, technical leadership, and the ability to modernize enterprise...DatabricksContract work
- ...Integration: Collaborate with cross-functional teams such as IT and engineering to integrate data from various sources into the customer data... ...Python. Experience working within data platforms like Databricks/Snowflake, and analytics modeling platforms such as Tableau...DatabricksFull time
- ...Big Data Engineer Location: Arlington, VA (3 Days onsite/week) Ability to easily move between business, data management, and technical... ...modeling, tuning, evaluating, monitoring, and presenting Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required...Databricks3 days per week
- ...Candidates should have 12 or more years of experience in data engineering, platforms, or analytics, including at least five years... ...in modern cloud data platforms and tools such as Snowflake or Databricks, dbt, Spark, SQL, orchestration, and streaming, as well as experience...Databricks
- ...this role, candidates in other locations will be considered.At Databricks, our mission is to simplify and democratize data and AI so... ...will collaborate with internal stakeholders including product, engineering, sales, and finance to develop and optimize strategic...DatabricksWorldwide
- ...Senior AWS Data Engineer | Onsite, Washington DC Area | TS/SCI Required About the Role Our client, a federal services contractor... ...Airflow/MWAA or Step Functions orchestration Exposure to Databricks, Snowflake, or Informatica Streaming experience with Kafka...DatabricksFull timeFor contractors
- ...DriveDeveloping and maintaining technical solutions that adhere to engineering principles while meeting business requirements. Performing... .... Building and deploying base infrastructure components (e.g., Azure capabilities including Virtual Machines, ASE, AKS, Blob storage...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Databricks Engineer. Be the first to apply!
Related searches







