Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer

Full-time

Conch Technologies Inc

Job Title: Lead Data Engineer

Location: Columbus, OH (On-site)
Duration: 6+Months


Job Description

We are seeking an experienced Lead Data Engineer to join our team and lead the design, development, and implementation of large-scale data engineering solutions. The ideal candidate will have strong hands-on experience with Python, PySpark, AWS data services, ETL pipelines, data lakes, and data warehouses.

The role involves building and optimizing data integration solutions, supporting marketing data initiatives, and bringing data from multiple internal and external sources into enterprise data platforms.

The candidate should have strong technical leadership skills, hands-on development experience, and the ability to drive engineering best practices across the team.

Key Responsibilities

  • Lead the design, development, and implementation of large-scale ETL/ELT data pipelines.
  • Build and maintain data ingestion, transformation, validation, and integration processes.
  • Develop and optimize distributed data processing solutions using Apache Spark and PySpark.
  • Design and implement data lake and data warehouse architectures.
  • Work with AWS data services, including AWS Glue and other related services.
  • Integrate data from external vendors and various internal systems.
  • Perform performance tuning and optimization of data pipelines and distributed workloads.
  • Implement data quality, governance, security, and monitoring practices.
  • Develop and maintain Java-based services and components supporting data workflows.
  • Build REST APIs and integration components for downstream data consumption.
  • Establish coding standards, automated testing, CI/CD, and operational best practices.
  • Provide technical leadership, mentor team members, and collaborate with cross-functional teams.
  • Leverage approved AI-assisted development tools to improve engineering productivity and code quality.

Required Skills & Qualifications

  • 10+ years of overall software engineering experience, with strong experience in Data Engineering.
  • Strong hands-on experience with Python and PySpark.
  • Extensive experience building and maintaining ETL/ELT pipelines.
  • Strong knowledge of Data Lakes and Data Warehouses.
  • Hands-on experience with AWS Glue and other AWS data services.
  • Strong experience with Apache Spark and distributed data processing.
  • Understanding of data storage formats such as Parquet and Avro.
  • Knowledge of data lakehouse concepts and Medallion architecture.
  • Basic to working knowledge of Java and Java-based application development.
  • Experience with data integration from multiple internal and external sources.
  • Strong problem-solving, communication, and technical leadership skills.

Preferred Qualifications

  • Experience with Snowflake or other cloud data warehouse platforms.
  • Knowledge of workflow orchestration tools such as Airflow, Dagster, or Control-M.
  • Exposure to Kafka, Spark Structured Streaming, and real-time data processing.
  • Experience with Delta Lake, Apache Iceberg, or Hudi.
  • Exposure to Generative AI, Agentic AI, and AI-assisted development tools.
  • Experience in enterprise or regulated environments.
  • Knowledge of CI/CD, monitoring, performance optimization, and production support.

Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Columbus, OH vacancy
  • $75 - $82 per hour

     ...Job Title: Lead Data Engineer - Advanced Location: Columbus, OH Duration: Contract to hire, 6+ months Pay Range: $75.00/hr - $82.00/hr (W2) About BCforward BCforward is a leading global IT consulting and workforce solutions firm providing services and... 
    Suggested
    Contract work

    BC Forward

    Columbus, OH
    2 hours ago
  •  ...the country.Job DescriptionCapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific...  ...and our clients.Specific responsibilities for the Lead Machine Learning Engineer position include:... 
    Suggested
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    CapTech

    Columbus, OH
    15 hours ago
  • $70k - $140k

    DescriptionThe Lead Test Data Management Engineer is responsible for translating Huntington's Test Data Management (TDM) strategy into operational capabilities. This role serves as the bridge between architecture, engineering, governance, and delivery teams, driving the... 
    Suggested
    Full time
    Work experience placement
    Work at office
    Remote work
    Work from home
    Flexible hours

    The Huntington National Bank

    Columbus, OH
    15 hours ago
  • $134.5k - $224.1k

    Position Summary Join our Deloitte AI & Engineering team to transform technology platforms, drive innovation, and help make a...  ...ventures, and fuel growth through innovation.Work you'll doAs a Lead AI and Data Science Engineer II on the AI & Data team, you will be... 
    Suggested
    Local area

    Deloitte

    Columbus, OH
    1 day ago
  • Lead Software Engineer - Data Engineering This is your chance to change the path of your career and work at one of the world's leading financial institutions. As a Lead Software Engineer - Data Engineering at JPMorgan Chase within the Consumer & Community Banking/Data Products... 
    Suggested

    Chase

    Columbus, OH
    3 days ago
  • $101.66k

     ...Amazon, our tech isn't just a tool, it's your playground. Our engineers work on scalable systems, cloud services, and customer-facing products...  ...-disciplinary staff to provide full life-cycle support to AWS Data Centers from design inception through site improvement and... 
    Full time
    Summer work
    Internship
    Relocation
    Monday to Friday

    Amazon

    Columbus, OH
    3 days ago
  •  ...Lead / Sr. Data Engineer All IT Solutions United States · Columbus, Ohio Workplace Type — On-site Employment Type — Contract We are currently seeking a qualified Lead / Sr. Data Engineer to support this engagement. Please review the complete requirements,... 
    Contract work
    Local area

    All IT Solutions

    Columbus, OH
    11 days ago
  • $159k - $254k

     ...About this role: Wells Fargo is seeking a Lead Specialty Software Engineer in our Core Banking Group as part of Consumer Technology. Learn more about...  ....com. This role includes hands-on development of Data Store pipelines using PySpark, implementation of complex business... 
    Full time
    Work experience placement
    Work at office

    Wells Fargo

    Columbus, OH
    12 hours ago
  • $26 per hour

     ...products tailored for the BMW, MINI and Rolls-Royce customer. Be a part of our exciting growth by expressing an interest in our IT Data & AI Science internship position located in Columbus, OH. This is a part-time internship position for our Fall Rotation, from September... 
    Hourly pay
    Part time
    Internship
    Local area

    BMW Group

    Columbus, OH
    3 days ago
  • $77k - $104k

     ...TechSite is growing, and we're looking for a Mechanical Commissioning Engineer II who enjoys hands-on technical work, troubleshooting complex...  ...ownership of commissioning activities in mission-critical data center environments. This is an opportunity for someone who... 
    Full time
    For contractors
    Work at office
    Flexible hours

    TechSite

    Columbus, OH
    13 days ago
  •  ...us be the best place you'll ever work.A Brief OverviewThe AVP, Data Engineering and AI Innovation will provide executive leadership across...  ...decommissioning of legacy data integrations and technologies.Lead the transition to new data assets and ways of working through... 
    Full time
    Local area

    Safelite AutoGlass

    Columbus, OH
    3 days ago
  •  ...office in Columbus, OH or our Easton office in Columbus, OH.Summary: The Huntington Home Lending Data Management Support team is seeking a highly motivated Data Engineer II to support reporting, analytics, operational, and regulatory data solutions across the Home Lending... 
    Full time
    Work experience placement
    H1b
    Work at office
    Remote work
    Work from home
    Flexible hours

    The Huntington National Bank

    Columbus, OH
    1 day ago
  • $99k - $225k

    Data Loss Prevenetion EngineerThe Opportunity:We are seeking a highly skilled and experienced Forcepoint Engineer SME to support the architecture, deployment, management, and optimization of Forcepoint cybersecurity technologies across our enterprise infrastructure. You... 
    Full time
    Contract work
    Part time
    Local area
    Remote work

    Booz Allen Hamilton

    Columbus, OH
    2 days ago
  • $91.1k - $179.5k

     ...Recruiting for this role ends on 10/30/2026. Work you'll do The Data Engineer Consultant will support data architecture and engineering...  ...strong data governance, lineage, quality controls, and monitoring. Lead the design, development, and delivery of analytics solutions... 
    Local area

    Deloitte

    Columbus, OH
    2 days ago
  • $10k

     ...build a fulfilling career and encourage you to have a life. Let us be the best place you'll ever work.A Brief OverviewThe Senior Data Engineer at Safelite is responsible for implementing and maintaining new data pipelines, focusing on data ingestion, replication, and... 
    Weekly pay
    Full time
    Work at office
    Local area
    Work from home
    Home office

    Safelite AutoGlass

    Columbus, OH
    1 day ago
  • Company DescriptionIDEALFORCE has a CONTRACT position available immediately for a Voice/Data Engineer 3/VDE3 to join our customer in Columbus, OH. This is an ONSITE position. Please find below additional details about this job. Only LOCAL CANDIDATES are considered for this... 
    Contract work
    Work at office
    Local area
    Immediate start
    Flexible hours

    idealforce

    Columbus, OH
    15 hours ago
  • We Are:The beginning of a new Data & AI decade that will reshape work and society has begun...  ..., and Power Ecosystem.You Are:As a Data Engineering, Management & Governance professional,...  ...solutions, Databricks or Snowflake.Ability to lead and effectively facilitate design... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Columbus, OH
    1 day ago
  •  ...together.You will play a mission-critical role in architecting our data platform, enabling our machine learning and robotics teams to...  ...and drive value across the business. Reporting to the Data Engineering Manager, you will collaborate with a talented team of data engineers... 

    Path Robotics

    Columbus, OH
    15 hours ago
  • $130k - $178k

    At Prologis, we don’t just lead the industry—we define it with a 1.3 billion square foot...  ...comes next.Job Title:Senior Semantic Data EngineerCompany:PrologisA day in the lifePrologis...  ...operations. As a Senior Semantic Data Engineer on the Data Solutions team, you will help... 
    Full time

    Prologis

    Columbus, OH
    3 days ago
  • $130k - $180k

     ...The Data Analytics Engineer is responsible for designing, developing, and supporting enterprise reporting and analytics solutions that enable data...  ...project documentation. May act as a mentor and/or team lead for junior staff. Minimum Qualifications ~ Bachelor's Degree... 
    Contract work
    Work at office

    ASM Research, An Accenture Federal Services Company

    Columbus, OH
    3 days ago
  • athenahealth is seeking a Data Center Engineer to join our Columbus, Ohio data center. This role covers 24x7 support, lifecycle management of servers, storage, and networking equipment, and close collaboration with operations and vendors to keep systems running optimally... 

    athenahealth, Inc.

    Columbus, OH
    15 hours ago
  • Description The USRM Data Office turns data into a competitive advantage. As a Principal Data Solutions Analyst, you’ll design and...  ...requirements, building prototypes, and partnering with data engineers to deliver scalable data products on Snowflake. You’ll use advanced... 
    Work experience placement
    Work at office
    Local area

    Liberty Mutual

    Columbus, OH
    3 days ago
  • Title: Database Engineer Location: Columbus, OH Type: Contract Mode of Interview: F2F at OH office Client: Virtusa/JPMC JD: Skill:...  ...into functional and efficient code Implement and manage company data management practices and polices At least 5 years of experience... 
    Contract work
    Work at office

    Trinity Technology Solutions

    Columbus, OH
    3 days ago
  • We are:The Advanced Technology Centers (ATCs) is the engine for reinvention in our clients’ transformation journey. Powered by more than...  ...client challenges.You are:A best in class, hands -on Snowflake Data & Analytics Engineer with deep expertise in building modern, cloud... 
    Work experience placement
    Live in
    Work at office
    Local area
    3 days per week

    Accenture

    Columbus, OH
    15 hours ago
  • $137.5k - $193.6k

     ...sales, and service. We are a team of strategists, data scientists, operators, creatives, designers, engineers, and architects. Our team balances business strategy...  ...build and sustain professional relationshipsAbility to lead projects or workstreamsAbility to manage and... 
    Local area

    Deloitte

    Columbus, OH
    1 day ago
  • $96k - $156k

     ...Experienced in Mechanical Commissioning? Ready to Lead a Team? TechSite is growing, and we'...  ...Senior Mechanical Commissioning Engineer who knows how to get complex mechanical...  ...leadership role supporting mission-critical data centers and other complex facilities. You... 
    Full time
    For contractors
    Flexible hours

    TechSite

    Columbus, OH
    13 days ago
  • $79.2k - $209.5k

    Job Description We are facing several engineering challenges in critical foundational virtual networking data-plane services that power the next gen OCI cloud. We need...  ...for all. Discover your potential at a company leading the way in AI and cloud solutions that impact... 
    Temporary work
    Work experience placement
    Flexible hours

    Oracle

    Columbus, OH
    5 hours ago
  •  ...become part of a global team of over 50,000 planners, designers, engineers, scientists, digital innovators, program and construction...  ...seeking to hire a highly skilled Senior Mechanical Engineer for the Data Center and Mission Critical team for our east region. The ideal... 
    Permanent employment
    Work at office
    Local area
    Remote work
    Worldwide
    Visa sponsorship
    Relocation package
    Flexible hours

    AECOM

    Columbus, OH
    15 hours ago
  •  ...part of a global team of over 50,000 planners, designers, engineers, scientists, digital innovators, program and...  ...Job DescriptionAECOM is seeking a Mechanical Engineering Lead with experience on Hyperscale Data Center projects to act as Data Center Mechanical Engineer... 
    Permanent employment
    Work at office
    Local area
    Remote work
    Worldwide
    Relocation
    Visa sponsorship
    Flexible hours

    AECOM

    Columbus, OH
    3 days ago
  • $84.3k - $173.3k

     ...ends on 12/7/2026. Work you’ll do US Cyber Data Protection team is responsible for...  ...professional with strong systems administration, engineering, IT technical support and/or cyber...  .... You will work closely with management, leads, peers, development teams, business analysts... 

    Deloitte

    Columbus, OH
    15 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!