Data Engineer

Data Engineer Washington DC (Day1 onsite)Key Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache SparkImplement complex data transformations using Spark SQL and Python (mandatory)Build and manage analytics models using DBT Core / DBT Cloud, following analytics engineering best practicesDevelop and orchestrate data ingestion and transformation workflows using Azure Data FactoryEnsure data quality, reliability, and performance across batch and near real time pipelinesIntegrate Databricks workloads with downstream reporting, analytics, and AI/ML use casesCollaborate with cross functional teams to understand business requirements and translate them into technical solutionsImplement CI/CD pipelines and source control using Azure DevOpsApply secure data engineering practices aligned with WBG data governance and compliance standardsLeverage AI assisted tools to improve developer productivity, code quality, and operational efficiencyParticipate in design reviews, code reviews, and knowledge sharing sessionsMandatory Skills Qualifications:Strong expertise in Spark SQL and Python programming (Mandatory)Azure Databricks Data Engineer with at least one real time project implementationHands on experience with DBT Core and/or DBT CloudExperience building and managing pipelines using Azure Data FactoryProficiency with Azure DevOps (Repos, Pipelines, CI/CD)Experience using AI tools (e.g., AI assisted development, data analysis, or automation tools)Solid understanding of data warehousing concepts, ETL/ELT patterns, and distributed data processingAbility to work in agile delivery models and collaborate with global teamsPrimarily looking At:Azure Data Factory (ADF)DbtDatabricksPythonGoogle VertexPreferred / Good to Have Skills:Databricks Certification - Associate or Professional (strongly preferred)Experience with Azure data ecosystem (ADLS Gen2, Azure SQL, Synapse †as applicable)Exposure to data governance, metadata management, and security frameworksFamiliarity with performance tuning and cost optimization on DatabricksExperience supporting analytics or AI/ML workloads on cloud platformsEqual Employment Opportunity:We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities. Candidates can request a reasonable accommodation by contacting the company ADA Coordinator.