Databricks Data Engineer

Talascend is currently seeking a Databricks Data Engineer for a contract opportunity with our client in Washington, District of Columbia . Overview We are looking for a Databricks Data Engineer to develop and support data pipelines and analytics environments in a cloud-based data lake, primarily focused on Azure. The role involves translating business requirements into scalable data engineering solutions and ensuring data quality and management across enterprise-scale platforms. Responsibilities Design, build, and optimize scalable data solutions using Databricks and Medallion Architecture Manage ingestion routines for processing large datasets efficiently across multiple projects Integrate data from structured and unstructured sources to enable business insights Proficiency in data analysis techniques for deriving insights from large data sets Implement data management strategies to maintain data integrity, availability, and security Identify opportunities for cost optimization in storage, processing, and analytics operations Monitor platform performance, address user requests, and support cluster stability and Spark optimization Collaborate with cross-functional teams to enable AI-driven analytics and workflows Integrate with Azure services such as Azure Functions, Storage, Data Factory, and Log Analytics Provision and manage infrastructure utilizing Infrastructure-as-Code (IaC) Ensure compliance with data security, governance, and federal regulation standards Gather requirements and translate business needs into technical data solutions Qualifications Bachelor’s degree in Computer Science or related field with 3+ years of experience, or Master’s degree with 2+ years of experience 3+ years of experience designing and developing data ingestion flows using cloud platform services with a focus on data quality Databricks Data Engineer certification 2+ years of experience maintaining Databricks platform and developing in Spark Proficiency in Python, Spark, and R; .NET experience is a plus Knowledge of data governance, metadata management, enterprise data catalog, and data security Experience with Agile methodology, CI/CD automation, and cloud-based development in Azure or AWS U.S. citizen required Preferred Qualifications Azure cloud certifications Knowledge of FinOps principles and cost management Experience working with federal regulatory standards and public trust environments We thank all applicants for their interest. However, only those qualified individuals who closely meet thequalifications of the position will be contacted. The details of the position are only a summary, otherduties may be assigned as necessary. Background Check and Drug Screen may be required. Talascend is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race,religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, orveteran status. #J-18808-Ljbffr