Lead Data Engineer - Databricks & Data Architecture
Rearc
As a Lead Data Engineer at Rearc, youll play a pivotal role in establishing and maintaining technical excellence within our data engineering team.
Your deep expertise in data architecture, ETL processes, and data modeling will be instrumental in optimizing data workflows for efficiency, scalability, and reliability. You’ll work closely with cross-functional teams to design and implement robust data solutions that align with business objectives and industry best practices. Building strong partnerships with technical teams and stakeholders will be essential as you drive data-driven initiatives and ensure their successful delivery.What You Bring 10+ years of experience in data engineering, data architecture, or related technical fields, with a proven ability to design, build, and optimize large-scale data ecosystems.
A strong track record of leading complex data engineering initiatives , architecting end-to-end data solutions that are scalable, reliable, and aligned with business strategy.
Deep hands-on expertise in ETL/ELT design, data warehousing, and data modeling, enabling the creation of efficient, high-quality data pipelines and analytical foundations.
Extensive experience with data integration frameworks and best practices , ensuring seamless, performant data movement across diverse systems and platforms.
Advanced knowledge of cloud-based data services and architectures , including platforms such as AWS Redshift, Azure Synapse Analytics, Google BigQuery, or equivalent technologies.
Strong strategic and analytical thinking , allowing you to tackle complex data challenges, drive architectural decisions, and influence long-term data strategy.
Proficiency with modern data engineering frameworks, including Databricks, Spark , and lakehouse technologies like Delta Lake for managing and processing large-scale datasets.
Exceptional communication and interpersonal skills , enabling effective collaboration with engineers, product teams, executives, and customers—while influencing technical direction and decision-making.
What You’ll Do As a Lead Data Engineer, you will help shape, deliver, and elevate Rearc’s data engineering practice. You’ll lead by example—combining strong technical execution with mentorship, strategic thinking, and a culture-first approach.
Engage deeply with stakeholders to understand data needs, business challenges, and technical constraints, translating them into scalable, high-quality data solutions.
Implement with a DataOps mindset , applying modern engineering practices and leveraging tools such as Apache Airflow, Databricks/Spark, Kafka, or similar technologies to build reliable, automated, and efficient data pipelines and architectures.
Lead and execute complex projects , providing technical direction, setting engineering standards, and ensuring alignment with customer goals and Rearc’s principles.
Mentor and develop data engineers , offering guidance, code reviews, and hands-on support to help them grow technically and professionally.
Promote knowledge sharing and thought leadership by contributing to internal and external content—writing technical blogs, sharing best practices, and fostering a culture of continuous learning and innovation.
Some More About Us
Founded in 2016, Rearc is built on the belief that great engineering happens when creativity is encouraged, bureaucracy is eliminated, and people are empowered to challenge the status quo. We’re not just a consultancy—we’re a community of problem-solvers who care deeply about improving the lives of fellow software engineers.
We’re committed to empowering engineers to build awesome products and experiences. Our success hinges on our people’s ability to think freely, speak up with alternative approaches, and push the boundaries of what’s possible. If youre the kind of engineer driven by curiosity, ownership, and the desire to make a real impact—you’ll feel right at home here.
Our approach is simple: give engineers the tools, autonomy, and support they need to create meaningful change —whether that’s for our clients, our team, or the industry at large.
We look for engineers who thrive on responsibility and freedom, who bring both technical excellence and strong leadership, and who are eager to get hands-on. Our ideal team members don’t just talk the talk—they walk the walk, designing and building solutions that raise the bar for cloud, data, and modern engineering.
Join us, and let’s build great things together.
Generous time away and flexible PTO
Maternity and paternity leave
Access to educational resources with reimbursement for continued learning #J-18808-Ljbffr
Vacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer - Databricks & Data Architecture in Richmond, VA vacancy
- ...As a Lead Data Engineer at Rearc, youll play a pivotal role in establishing and maintaining... ...engineering team. Your deep expertise in data architecture, ETL processes, and data modeling... ...engineering frameworks, including Databricks, Spark and lakehouse technologies...DatabricksFlexible hours
- ...A global cybersecurity leader is seeking a Lead Data Engineer to steer their data engineering efforts. This position involves designing... ...guiding junior engineers, and setting the vision for data architecture. The ideal candidate should have over 5 years of experience...Suggested
- ...Principal Data Engineer – Azure Databricks Seeking a highly skilled Principal Azure Data Engineer to lead the design, architecture, and delivery of enterprise-scale Data Lakehouse solutions on Azure Databricks. This is a senior-level role within the Analytics organization...Databricks
- ...Job: Lead Agentic Data Engineer Location : 1401 E Broad St Richmond, VA 23219 Duration... ...and Design and build the data architecture, including databases, data warehouses... ...Utilize Big data frameworks like Spark/Databricks Training LLMs with structed...Databricks
- ...Role: Lead Data Engineer Locations: Richmond - VA / McLean - VA/ Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE ( Preferred... ...pipelines using technologies such as AWS Glue, Spark, and Databricks. Optimize database performance and ensure data integrity...DatabricksLong term contractWork at office
- ...EPAM Systems, Inc. is seeking a Lead Data Software Engineer (Python+AWS) to drive the design and development of scalable data solutions. In this... ...proficiency in Python and SQL, and expertise in AWS and Databricks. You will work in a dynamic environment while...Databricks
$197.3k - $225.1k
Lead Data Engineer - Data Transformation (Modeling and Architecture) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One...Full timePart timeInternshipH1bLocal area- Capital One National Association in Richmond, VA is seeking a Lead Data Engineer to design and maintain data models and implement advanced data ecosystem solutions. This position demands at least 4 years of application development experience and proficiency in big data...
- ...Lead Machine Learning / Data Science Engineer CapTech is an award-winning consulting firm that collaborates... .../environments such as Snowflake, Databricks, Azure SQL, Amazon RDS ~ Comfort... ...engineering, MCP and RAG, and agentic AI architectures ~ Strong understanding of...DatabricksWork at officeRemote workVisa sponsorshipWork visaFlexible hours
$130k - $140k
...seeking a highly skilled and motivated Data Engineer to join the Finance Solutions team.... ...optimize scalable data pipelines and architectures that transform raw financial data into... ...over other platforms (e.g., Snowflake, Databricks, Microsoft, Teradata) ~ Proven experience...DatabricksWork at officeRemote workRelocation package- A global consulting firm is seeking a Data Engineering Manager to lead the design and implementation of scalable... ...should have strong expertise in data architecture and management skills, along with proven experience in Databricks. You will engage with clients, lead delivery...Databricks
$175.8k - $200.7k
...Headquarters: VirginiaLead Data Engineer – Capital One Software (Remote)Ever since our first... ...question the status quo. As a Capital One Lead Data Engineer, you'll have the opportunity... ..., Hadoop, Hive, EMR, Kafka, Spark, or Databricks)4+ year experience working on real-time...DatabricksInternshipH1bLocal areaRemote work- ...Rudder Analytics is seeking a professional to design and lead scalable data architectures and pipelines across cloud and hybrid setups. This role requires proficiency in Python, PySpark, SQL, and ETL tools like Airflow, as well as experience with cloud environments including...
- ...the country. Job Description CapTech Data Engineering consultants enable clients to build and... ...lake solutions like Snowflake, Redshift, Databricks 5+ years of experience with SQL or... ...recommendations utilizing traditional and modern architectural components based on business needs...DatabricksFull timeVisa sponsorshipWork visa
- ...Lead Data Architect This position supports Revolutional's federal... ...and drive enterprise data architecture strategy, governance, and implementation... ...application architects, engineers, data scientists, SMEs, and... ...technologies (Spark, Kafka, Databricks, Snowflake, Airflow) APIs...DatabricksFor contractors
$286.2k - $326.7k
Sr. Distinguished, Software Engineer - Enterprise Data Storage and Consumption Platforms - Remote... ...Our Distinguished Engineers are leading experts in their domains, helping... ...in AWS infrastructure ,Lakehouse architecture, Snowflake, Databricks platform and BI tools to mature...DatabricksFull timePart timeH1bLocal areaRemote work$125.5k - $230.2k
...better working world. AI & Data - Data Architecture – Manager – Power & Utilities... ...power systems / electrical engineering background and having... ...will have the opportunity to lead and develop your skill set... ...cloud data platforms like Databricks. Experience in leading and...DatabricksSummer holidayFlexible hours- ...Create conceptual data model to identify key business entities and visualize their... ...activities and ensure alignment to the defined architecture. Perform data profiling/analysis... ...various data technologies such as Azure Synapse or SQL Server, Snowflake, Databricks...Databricks
- ...part in something special!The Lead Data Architect provides strategic... ...role balances high-level architecture with practical execution, ensuring... ...teams (typically 4-5 engineers per team) across data initiatives... ...data architecture across a Databricks-first lakehouse in a broader...DatabricksFull timeLocal areaWork from home
$80k - $90k
...Join to apply for the Data Engineer (IC1) role at ClassLink Join to apply for the... ...Headquartered in Clifton, NJ, ClassLink is a leading education technology company serving... ...and maintaining the underlying architecture of ClassLink Analytics. As ClassLink grows...Full timeRemote work- ...A new consulting start-up is looking for a part-time Sr Data Engineering Consultant based in the United States. This role requires a minimum... ...enhancing data infrastructure and driving the adoption of DataBricks. Candidates should be entrepreneurial-minded and highly...DatabricksPart timeFlexible hours
$130k - $140k
McKesson’s Corporate in Richmond, VA seeks a skilled Data Engineer to join their Finance Solutions team. This role is critical for building scalable data architectures and analytics-ready datasets. Candidates should have over 4 years of experience in data engineering,...- ...Data Engineer (763232) Requirements: Strong Data engineering fundamentals. Utilize Big data frameworks like Spark/Databricks. Training LLMs with structed and unstructured data sets. Understanding of Graph DB. Experience with Azure Blob...Databricks
- ...Datavail Infotech is hiring a Databricks Data Engineer to collaborate with clients on designing and optimizing data solutions using Databricks. The ideal candidate will lead implementation projects, ensuring high-quality delivery and maintaining strong client relationships...Databricks
$120k
.... POSITION TITLE Sr Manager - Data Architecture This role is not eligible for employment... ...technologies and platforms (e.g., DataBricks, Spark, AWS, Azure). Expert level... ...the model. Collaborating with data engineers to create data pipelines to populate the...DatabricksWork at officeLocal areaRemote work$197.3k - $225.1k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...Full timePart timeInternshipH1bLocal area- ...We're looking for Data Engineers to help clean and reconcile critical insurance producer data across 70 operating units. In this role,... ...and implement ETL pipelines and reconciliation logic using Databricks , SQL , and Python , working within a cloud environment...DatabricksContract workRemote work
- ...Lead Data Management Consultant - Housing & Financial Services (Microsoft Ecosystem)... ...data strategy, governance frameworks, and architecture design • Drive delivery across discovery... ...of experience in data management, data engineering, or consulting • Proven experience...
- ...based Software Development firm seeking a Data & AI Engineer to join our growing remote team! In... ...that underpin every role, from architecture and design to coding and delivery. We... ...Data Lake architecture. This role will lead the development and deployment of scalable...Remote work
- ...Insight Global looking for a Senior Data Engineer to design, build, and optimize cloud data... ...Python, Azure Data Factory (ADF), and Databricks, enabling reliable, scalable movement... ...and help evolve modern cloud-based data architecture and workflows PR: 45-65/hr We...Databricks
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer - Databricks & Data Architecture. Be the first to apply!
Related searches
- director data engineering Richmond, VA
- junior big data engineer Richmond, VA
- senior data engineer Richmond, VA
- data platform engineer Richmond, VA
- sr information security engineer Richmond, VA
- senior data integration developer Richmond, VA
- data developer Richmond, VA
- data engineer Richmond, VA
- data infrastructure engineer Richmond, VA
- entry level big data engineer Richmond, VA


