Senior Data Engineer

Overview Navy Federal Credit Union currently does not provide sponsorship for this role. Applicants must be authorized to work in the United States without the need for current or future sponsorship. The Senior Data Engineer is an experienced technical lead responsible for accelerating NFCU’s transition to AI-enabled data engineering by applying modern AI engineering, data engineering, and intelligent automation practices across the enterprise delivery lifecycle. This role will design and implement scalable data engineering patterns, reusable automation frameworks, and autonomous or human-guided AI agents that reduce manual effort, improve engineering productivity, strengthen delivery quality, and advance an AI-enabled data engineering SDLC across planning, architecture, design, development, testing, deployment, monitoring, and production support. The Senior Data Engineer will lead the practical adoption of Generative AI, Agentic AI, Retrieval-Augmented Generation, Lakehouse and Medallion architectural patterns. The role will automate repeatable engineering activities and establish secure, governed, and reusable AI-first engineering standards. It requires hands‑on expertise with Microsoft Foundry, Azure AI services, Databricks Mosaic AI, LangChain, LangGraph, vector search technologies, agent orchestration frameworks, Apache Spark, Python, SQL, Databricks, and Microsoft Fabric to deliver reliable, observable, and production‑ready data engineering and AI automation solutions. Responsibilities Lead the design, development, and deployment of AI-enabled data engineering accelerators, reusable frameworks, and intelligent agent-based solutions that automate and optimize activities across the data engineering lifecycle. Apply Generative AI, Agentic AI, Retrieval-Augmented Generation (RAG), vector search technologies, and agent orchestration frameworks to automate data ingestion, transformation, validation, testing, metadata generation, lineage documentation, reconciliation, monitoring, and production support processes. Design and implement scalable Lakehouse and Medallion architecture patterns using Databricks, Microsoft Fabric, Apache Spark, Python, SQL, and modern cloud-based data integration and analytics technologies. Establish AI-first engineering standards, design patterns, reusable prompts, agent frameworks, and governance practices that enable secure, responsible, and scalable adoption of AI across enterprise data engineering teams. Develop and optimize production-ready data pipelines and automation capabilities with a strong focus on reliability, observability, data quality, reconciliation, resiliency, monitoring, alerting, and service-level objective adherence. Collaborate with data architects, platform engineering teams, DevSecOps, product owners, governance teams, and business stakeholders to translate strategic business needs and technical requirements into scalable, maintainable, and secure solutions. Evaluate emerging AI and data engineering technologies, identify high‑value enterprise use cases, and recommend adoption strategies aligned with NFCU architecture, information security, governance, risk management, and operational standards. Lead the implementation of Agile delivery practices, CI/CD automation, test engineering, deployment strategies, operational readiness, production support, and continuous improvement for AI-enabled data engineering solutions. Mentor engineers, guide implementation decisions, promote engineering excellence, and drive consistent adoption of secure, governed, and measurable AI-enabled delivery improvements. Ensure the security, integrity, traceability, and compliance of data systems and automation solutions in alignment with Navy Federal, industry engineering, information security, data governance, and regulatory expectations. Qualifications Bachelor’s degree in Information Systems, Computer Science, Engineering, Data Engineering, or a related field, or the equivalent combination of education, training, and experience. Advanced hands‑on experience in data engineering using Apache Spark, Python, SQL, Databricks, Microsoft Fabric, and modern cloud-native data and analytics technologies. Experience designing and implementing scalable batch, near real‑time, and real‑time data pipelines within Lakehouse and Medallion architecture environments. Experience developing AI-enabled data engineering accelerators, developer productivity tools, intelligent assistants, reusable frameworks, and automation capabilities that improve software delivery and operational efficiency. Hands‑on experience applying Generative AI, Agentic AI, Retrieval-Augmented Generation (RAG), vector search technologies, agent orchestration frameworks, and related AI engineering capabilities. Experience with Microsoft Foundry, Azure AI Services, Databricks Mosaic AI, or comparable AI development platforms for building secure, scalable, and production‑ready AI-enabled solutions. Strong understanding of data quality, testing, validation, reconciliation, metadata management, data governance, lineage, observability, monitoring, alerting, and production support practices. Working knowledge of DevSecOps, Azure DevOps, CI/CD automation, Agile delivery methodologies, test engineering, deployment practices, operational readiness, and site‑reliability principles. Ability to design secure, scalable, reusable, and governed engineering patterns that support enterprise data platforms and analytics modernization. Excellent analytical, problem‑solving, communication, and leadership skills, with the ability to explain complex technical concepts to engineering teams, business stakeholders, and technology leaders. Desired Qualifications Master’s degree in computer science, Information Technology, Engineering, Data Engineering, Analytics, or a related discipline. 7 to 10 years of experience delivering advanced data engineering capabilities across cloud platforms, big data ecosystems, Lakehouse architecture, and governed enterprise data platforms. Experience modernizing legacy data engineering processes into cloud-native, AI-ready, automated, and governed delivery models. Knowledge of financial services data governance, regulatory traceability, audit readiness, data privacy, information security, and operational risk management expectations. Demonstrated ability to mentor engineering teams, influence technical standards, drive adoption of emerging technologies, and deliver measurable productivity and operational improvements. Knowledge of Navy Federal Credit Union instructions, standards, and procedures. Additional Information Monday - Friday, 8:00AM - 4:30PM Location 820 Follin Lane, Vienna, VA 22180 About Us Navy Federal provides much more than a job. We provide a meaningful career experience, including a culture that is energized, engaged and committed; and fierce appreciation for our teams, who are rewarded with highly competitive pay and generous benefits and perks. Our approach to careers is simple yet powerful: Make our mission your passion. FORTUNE 100 Best Companies to Work For® 2026 Yello and WayUp Top 100 Internship Programs 2025 Computerworld® Best Places to Work in IT 2026 Most Loved Workplace – America’s Top Most Loved Workplaces® 2025 2025 PEOPLE® Companies That Care Newsweek Most Trustworthy Companies in America 2026 Military Times 2025 Best for Vets Employers Forbes® 2026 America's Best Large Employers Forbes® 2025 America's Best Employers for New Grads Forbes® 2025 America's Best Employers for Tech Workers 2025 RippleMatch Campus Forward Award Winner for Overall Excellence Military.com Top Military Spouse Employers 2025 2026 Handshake Early Talent Award Newsweek America’s Greatest Workplaces for Culture, Belonging and Community 2026 Equal Employment Opportunity: All qualified applicants will receive consideration for employment without regard to age, race, sex, color, religion, national origin, disability, veteran status, pregnancy, sexual orientation, genetic information, gender identity or any other basis protected by applicable law. Accommodations: If you need accommodation or assistance for a qualifying condition to complete the online application (or during any stage of the hiring process), you can contact Navy Federal's Medical Accommodations team at View email address on click.appcast.io or by calling View phone number on click.appcast.io. This team cannot provide any information on job postings or application status. Disclaimers: Navy Federal reserves the right to fill this role at a higher/lower grade level based on business need. An assessment may be required to compete for this position. Job postings are subject to close early or extend out longer than the anticipated closing date at the hiring team’s discretion based on qualified applicant volume. Navy Federal Credit Union assesses market data to establish salary ranges that enable us to remain competitive. You are paid within the salary range, based on your experience, location and market position. For additional details regarding compensation and benefits, review the Benefits page of the Navy Federal Career Site. Bank Secrecy Act: Remains cognizant of and adheres to Navy Federal policies and procedures, and regulations pertaining to the Bank Secrecy Act. #J-18808-Ljbffr