Databricks Architect-III

Databricks Architect-III
Washington, DC
Need Visa Independent Consultant

1. BACKGROUND
The Trust Funds and Co-financing program supports the Bank's management, monitoring, and reporting of Trust Fund and co-financing data. As part of ongoing efforts to strengthen and standard reports capabilities, the team is enhancing the underlying data architecture and data products used to support standard operational and management reports.
The engagement requires a senior Databricks Architect to provide technical architecture, data engineering design, and implementation support for the development and optimization of Databricks-based data solutions supporting Trust Funds and Co-financing reporting.
2. SCOPE OF WORK
The Architect will work with the Trust Funds and Co-financing product, reporting, data, and technical teams to design and support scalable Databricks-based data solutions for standard reports and cofinancing reporting portal.
Key responsibilities will include:




Assess existing data sources, data flows, transformation logic, and reporting requirements supporting Trust Funds and Co-financing.




Define and refine the Databricks architecture required to support standard reporting and analytical use cases.




Design scalable data models and curated reporting datasets for Trust Funds and Co-financing information.




Define source-to-target mappings and transformation rules for required reporting data.




Provide technical guidance for Databricks notebooks, workflows, pipelines, Delta tables, and related data-processing components.




Support development and optimization of data ingestion, transformation, and orchestration processes.




Ensure appropriate data quality, reconciliation, lineage, security, and access-control considerations are incorporated into the solution.
Official Use Only




Optimize Databricks workloads and queries for performance, maintainability, and efficient resource utilization.




Support integration of Databricks data products with downstream reporting and analytics solutions.




Troubleshoot data and technical issues identified during development, testing, and report validation.




Support system integration testing, user acceptance testing, and production-readiness activities.




Develop technical documentation and provide knowledge transfer to Bank technical teams.
3. SKILLS / EXPERIENCE REQUIRED
The resource should meet the requirements for Architect Standard III, including a minimum of 8+ years of relevant professional experience, with strong experience in enterprise data architecture and modern cloud data platforms.
Preferred qualifications include:




8+ years of experience in data architecture, data engineering, analytics platforms, or related disciplines.




Strong hands-on experience with Databricks and lakehouse architectures.




Strong experience designing scalable enterprise data solutions and analytical/reporting data models.




Experience with Databricks notebooks, jobs/workflows, Delta Lake, SQL, and data transformation frameworks.




Strong SQL skills and experience with large-scale data processing.




Experience designing data ingestion and transformation pipelines from multiple enterprise data sources.




Experience with data quality, reconciliation, metadata, lineage, and governance practices.




Experience implementing role-based access, data security, and appropriate controls for enterprise data platforms.




Experience optimizing Databricks workloads, queries, pipelines, and storage structures.




Experience developing curated datasets or semantic/reporting layers for enterprise reporting.




Experience working with reporting and visualization platforms such as Power BI or equivalent tools is desirable.




Ability to translate business and reporting requirements into technical architecture and implementation designs.




Strong technical documentation, communication, and stakeholder-management skills.




Experience working within Agile delivery teams and collaborating with product owners, business analysts, data engineers, and reporting teams.
Official Use Only
4. ROLES
The table below lists the role(s) required for this engagement:
Role Quantity Location
Architect Standard III Databricks Architect
1
HQ Washington, DC, USA
Desired period of performance: August 31, 2026 through October 31, 2026
Desired country and location for work to be performed: HQ Washington, DC, USA
5.
TIMESHEETS AND PAYMENT
All time worked must be recorded in the Bank's ITVMS system on a weekly basis for approval by the Bank PM. Subsequent Invoices will be auto-generated for payment based on approved time.
6. DELIVERABLES AND ACCEPTANCE CRITERIA
The resource will be engaged for the following deliverables: # Activity Deliverables Acceptance Criteria
1
Databricks Architecture & Data Design
Databricks solution architecture, data flows, source-to-target mappings, and curated data model supporting Trust Funds standard reports and Co-financing reporting
Signed off by Technical Lead
2
Data Pipeline & Reporting Enablement
Databricks pipelines, transformations, notebooks/workflows, and curated datasets/views required to support standard Trust Funds and Co-financing reports
Signed off by Technical Lead
3
Testing, Optimization & Documentation
Data quality validation, performance optimization, technical issue resolution, architecture/data documentation, and knowledge transfer
Signed off by Business Lead