Senior Data Engineer

At Imagine Believe Realize, LLC (IBR) we are driven by innovation, transformation and a relentless pursuit of excellence. As an industry leader delivering impactful results, we thrive on solving complex technical challenges and developing cutting-edge solutions that empower our customers and advance critical missions. IBR is a fast-growing company fueled by passion, curiosity, and innovative thinking – where every team member has the opportunity to continuously learn, unlock their full potential, and redefine what is possible in engineering and technology. If you are inspired by innovation, eager to make a difference, and ready to bring your creativity and expertise to a mission-focused team, we invite you to join us and together, we will shape the future. Let’s Make It Real! The Senior Data Engineer must be able to meet the key criteria below: Location: 100% remote. This is a United States based position, and candidates must reside in the continental United States to be eligible for employment. Years’ Experience: 5+ years professional data engineering related experience Education: Bachelor’s degree in Computer Science, Mathematics, Statistics or IT related field Security Clearance: IBR is a federal contractor. Applicants must be able to obtain and maintain a Secret security clearance issued by the Department of Defense (DoD). This agency handles and adjudicates the security clearance process. NOTE: United States Citizenship is required as part of the eligibility criteria to be able to obtain this type of security clearance. Employment Type: Full Time Work Schedules: IBR promotes work-life balance by offering flexible scheduling options. Standard business hours are aligned to the Eastern Time Zone. Key Skills: Professional experience in data architecture, data engineering, data hub, data lake, and/or data warehouse development. Experience with Databricks and/or Palantir Foundry required Active CompTIA Security+ or CompTIA Network+ certification preferred. If selected, the candidate must be able to obtain a CompTIA Security+ certification prior to being eligible to begin supporting the program. Position Overview As a Senior Data Engineer at IBR, you will play a key role in designing and implementing secure, next-generation solutions that support critical missions. As a member of our program supporting our U.S. Navy customer, you will collaborate with technical leaders, business stakeholders, and a multi-disciplinary team to ensure solutions are scalable, secure and forward-thinking, while remaining aligned with organizational and program goals. This position offers the opportunity to contribute to technical strategy within a dynamic, mission-driven, and customer focused environment. As a data engineer, you will support the Data Architecture team in implementing and executing the Department of the Navy (DON), Manpower, Analytics and Human Resources Systems (MAHRS) program Data Strategy, and High-Level Total Force Data Hub implementation plan. Responsibilities Provide data engineering expertise in the development, implementation, integration, and sustainment of data architectures, data hubs, data lakes, and data warehouse solutions. Support the design and development of data models, data structures, and data acquisition processes that enable data-driven decision making across the HC/HR Data Domain. Develop engineering and implementation plans for data hubs, data acquisition, data modeling, data integration and related data engineering activities. Research and evaluate existing data sources within the data lake and enterprise data environment to identify authoritative, reliable, and appropriate sources for data hub development. Plan, create, and maintain data architectures, ensuring alignment with business requirements. Design, develop, maintain, and optimize ETL/ELT data pipelines and data transformation processes supporting enterprise data integration and data hub activities. Develop and maintain batch and streaming data pipelines using technologies such as Spark, Python, Databricks, Palantir Foundry, Kafka, and related data engineering tools. Develop and maintain data acquisition processes to ingest, transform, validate, and integrate data from diverse enterprise sources. Implement incremental data loading strategies to optimize data processing and data freshness. Define and implement approaches for handling late-arriving data, processing windows, data freshness, and other data lifecycle considerations. Identify opportunities to automate manual data processes and improve the efficiency, reliability, and scalability of data engineering workflows. Develop, maintain, and optimize data engineering solutions within Databricks and enterprise data lake environments. Configure, monitor, and manage Databricks clusters in accordance with DON policies, standards, security requirements, and technical guidelines. Document Databricks cluster configurations, parameters, and operational standards for internal and external stakeholders. Develop and maintain Spark-based data processing solutions using PySpark, Spark SQL, Spark Data Frame, Data Sets, and related technologies. Implement and maintain Delta Lake solutions, including Delta Live Tables where applicable, to support scalable and reliable data processing. Optimize data processing, storage, and query performance within data lake environments. Support data engineering and application development activities within Palantir Foundry, including development and maintenance of ontologies, ETL/ELT pipelines, applications, and data-driven user interfaces. Support the integration of Palantir Foundry capabilities with enterprise data engineering and analytics environments. Develop and maintain streaming data solutions using Kafka, Kafka Streams, ksqlDB, and related technologies. Configure and manage Kafka topics and associated components, including Schema Registry, to support reliable and scalable data processing. Develop and maintain Python-based data processing applications and AWS Lambda functions. Support data integration and processing using AWS services such as S3, Kinesis, Lambda, and DynamoDB. Monitor, troubleshoot, and optimize cloud-based data processing solutions for performance and scalability. Develop and maintain data quality controls, validation processes, and data quality gates to ensure data accuracy, completeness, consistency, and reliability. Develop and execute data-driven testing and unit testing for Spark, Python, and other data processing solutions. Establish and maintain data lifecycle policies and processes, including retention, backup, recovery, and data management requirements. Monitor and troubleshoot data pipelines and processing jobs to identify and resolve data quality, performance, and integration issues. Identify opportunities to improve data processing performance, reliability, scalability, and maintainability. Qualifications 5+ years of IT experience focusing on enterprise data engineering to include data modeling, data quality, data mapping tools, and other technical documentation Must be eligible to obtain and maintain a Secret security clearance Bachelor degree in Computer Science, Engineering, Mathematics, Statistics, or IT related field required Active CompTIA Security+ or CompTIA Network+ certification preferred. If selected, the candidate must be able to obtain a CompTIA Security+ certification prior to being eligible to begin supporting the program. Professional experience in data architecture, data engineering, data hub, data lake, and/or data warehouse development. Experience designing, developing, implementing, and supporting enterprise-scale data engineering solutions. Experience with data modeling, data mapping, data quality, data integration, and data management. Experience supporting large-scale, high-performance enterprise data applications. Experience developing and supporting ETL/ELT data pipelines and data transformation processes. This includes data integration tools such as SSIS, Pentaho, AWS Data Migration Service, etc. Hands on experience with Databricks required Experience with Python and SQL for data engineering and data processing. Experience with Apache Spark and/or PySpark, include Spark SQL, DataFrames, and/or Data Sets preferred. Experience supporting data integration, migration, transformation, data warehouse, data hub, and/or data lake/delta lake implementations. Experience with batch and streaming data processing architectures. Experience with Kafka and/or other distributed steaming technologies. Experience developing and supporting Kafka Streams Experience working in AWS cloud environment with familiarity in AWS services such as S3, Lambda, Kinesis, and/or DynamoDB. Experience with Git based version control, including branching, merging, pull requests, and repository management. Experience supporting CI/CD pipelines and cloud monitoring with tools such as Jenkins, Docker, and/or CloudWatch preferred Experience with Palantir Foundry, including building and maintain ontologies, ETL/ELT pipelines, applications, and data-driven user interfaces preferred Experience with the Jupiter data and analytics environment, particularly in support of the HC/HR Data Domain preferred but not required Debug, troubleshoot, design and implement solutions to complex technical issues Ability to thrive in a team-based environment Experience briefing the benefits and constraints of technology solutions to technology partners, stakeholders, team members, and senior level of management Must have strong written and verbal communication Application Deadline: Applications will be reviewed as received and accepted on a continuous basis until the position is filled. Early application is strongly encouraged. Physical Demands and Work Environment This role primarily involves sedentary work, in a workplace and/or home office environment. There are some physical demands associated with the role, including: Extended periods of sitting and working at a computer workstation. Occasional lifting and carrying of equipment or materials weighing up to 20 pounds. Occasional travel to client sites or meetings may be required. Work may need to be performed in a fast-paced environment requiring quick decision making. Flexible work arrangements may be available based on business needs. Will be exposed to a wide variety of clients in differing functions, personalities, and abilities. Benefits and Compensation Information At Imagine Believe Realize, LLC (IBR), we recognize that our employees are our greatest asset. We are committed to attracting and retaining exceptional talent by offering competitive compensation, comprehensive benefits, and programs that support employees' health, financial well-being, professional growth, and work-life balance. Eligible employees enjoy a robust total rewards package that includes: Nationwide medical, dental, and vision insurance 3 weeks of Paid Time Off and 11 Paid Federal Holidays 401k matching Life Insurance, Short-Term Disability, and Long-Term Disability at no cost to our employees Supplemental insurance options Flexible spending accounts and Dependent Care spending accounts Wellness incentives Reimbursement for professional development and certifications Access to training assistance opportunities to support career growth and progression Hybrid and Remote work opportunities to support work-life balance Salary Range: $115,000.00 - $165,000.00 USD annually. This salary range represents the anticipated range for this position at the time of posting. Actual compensation may vary based on qualifications, experience, work location, internal equity, and business needs. Apply Today If you are ready to grow your career and make an impact, then we encourage you to apply today by submitting an application. We welcome you to explore additional job opportunities listed on our careers page Applicants who require alternative assistance with the application or interview process may request reasonable accommodations by contacting us using the contact information provided below: View email address on click.appcast.io View phone number on click.appcast.io Compliance and Regulatory Statements Equal Employment Opportunity (EEO) Statement Imagine Believe Realize, LLC (IBR) is proud to be an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to legally protected characteristics such as race, ethnicity, color, religion, sex, sexual orientation, gender identity, gender expression, creed, age, national origin, disability (including pregnancy, childbirth, or related medical conditions), marital status, veteran status, or any other applicable legally protected class in accordance with federal, state, and local laws. Employment Eligibility Employment with IBR is contingent upon successful completion of all pre-employment requirements, including verification of identity and authorization to work in the United States. The Company participates in the federal E-Verify program and will verify the identity and employment eligibility of all newly hired employees in accordance with applicable federal law. Please Note: Certain positions may require U.S. citizenship, the ability to obtain and maintain a U.S. Government security clearance, or other government contract eligibility requirements. Such requirements will be identified in the individual job posting where applicable. Individuals with Disabilities Imagine Believe Realize, LLC (IBR) is committed to providing equal employment opportunities to qualified individuals with disabilities and to making reasonable accommodations to enable them to apply for positions and perform the essential functions of their jobs. If you require a reasonable accommodation during the application or interview process, please contact Human Resources at View email address on click.appcast.io. Veterans Imagine Believe Realize, LLC (IBR) is committed to providing equal employment opportunities to qualified protected veterans and to making reasonable accommodations to enable them to apply for positions and perform the essential functions of their jobs in accordance with the Vietnam Era Veterans' Readjustment Assistance Act (VEVRAA). If you require a reasonable accommodation during the application or interview process, please contact Human Resources at View email address on click.appcast.io Pay Transparency The anticipated compensation range for this position will be provided in accordance with applicable federal, state, and local pay transparency laws. Actual compensation offered will be determined based on factors such as the candidate's skills, qualifications, experience, education, geographic location, internal equity, and business needs. In addition to base pay, eligible employees may be offered a comprehensive benefits package, paid time off, retirement benefits, bonus opportunities, and other programs, where applicable. Eligibility for benefits and incentive programs is governed by the terms of the applicable plans and company policies. IBR (Imagine Believe Realize)