Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Technology Lead | Big Data - Data Processing | Spark

Ipolarity LLC

Job title - Technology Lead

Work location Atlanta, GA-30313

Is it Hybrid, onsite or remote position Full Onsite

Please confirm if the candidate can work from any Infosys DC office Nope, Client Preferred location is Atlanta

Tentative Start date 19-Oct

Contract duration greater than 6 months

Vendor rate ####

Minimum years of experience needed in the required skills- 5-8 years of experience

Minimum over all work experience required - 8-10 years of experience

Domain - CPG

Any certification required Good to Have

Mandatory skills required - Pyspark, Spark, Azure Synapse, Scala. SQL

Complete job description Support and maintain scalable Azure data platforms built on ADLS, Azure Synapse, Spark, ADF, and Delta Lake. Monitor and troubleshoot batch and incremental data pipelines, resolve production issues, and optimize jobs to ensure performance, reliability, and data availability. Maintain data models across the Bronze, Silver, and Gold layers to support reporting and analytics. Enforce security, governance, and operational best practices while mentoring engineers, maintaining support documentation, and driving continuous service improvement.

Interview mode - In person/Virtual - Virtual

How many rounds of interview Two Rounds

Project Code: COKE DnA IQ Support

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Technology Lead | Big Data - Data Processing | Spark in Atlanta, GA vacancy
  • OverviewThe Infosys Data and Analytics (DNA)...  ...with cutting-edge technologies, collaborate with industry...  ...elicitation process by documenting assigned...  ...ExperiencePyspark, Spark, Scala, Azure...  ...Skill 1Technology|Big Data - Data Processing...  ...2Career RoleTechnology Lead - US: 153311BR
    Big data
    Full time
    Temporary work
    Relocation

    Infosys Technologies

    Atlanta, GA
    3 days ago
  •  ...candidatesEmployment Type - FTEJob Description:Data Analyst + KafkaWe are seeking a highly skilled Big Data Analyst to join our...  ...:- Collect, process, and analyze large volumes of...  ...Utilize big data tools and technologies such as Hadoop, Spark, Kafka, and NoSQL databases.... 
    Big data

    SRI Tech

    Atlanta, GA
    21 hours ago
  •  ...Software Consultancy and Information Technology Enabled Services.Job DescriptionJob...  ...Description: At least 5 years of working on data management domain with big data, Oracle, SQL or other database...  ...- Hadoop, MapReduce, Pig, Hive, Spark, Storm, Amazon Kinesis, AWS EMR, AWS... 
    Big data
    Permanent employment
    Full time
    H1b

    Sonsoft

    Atlanta, GA
    2 days ago
  •  ...We are seeking an experienced Technology Lead / Azure Data Engineer with strong hands-on expertise in Azure Synapse Analytics and...  ...candidate will have a deep understanding of Apache Spark, distributed data processing, Data Lake architecture, and modern data engineering... 
    Suggested
    Contract work

    2T Consulting

    Atlanta, GA
    a month ago
  •  ...Big Data EngineerCompetent Big Data/Databrick engineer, who is independent...  ...and building out the technologies to take it to production....  ...tools including PySpark/Scala Spark/Hive/Hadoop CLI/MapReduce/...  ...working on real time stream processing technologies like Spark structured... 
    Big data

    Yantran LLC

    Atlanta, GA
    1 day ago
  • $195.3k - $199.2k

     ...member of Periscope’s technology team with...  ...expertise remain on the leading edge of technology...  ...maintain scalable data pipelines and...  ...and optimize ETL processes with a focus on performance...  ...background in big data technologiesProficiency...  ...on Azure, Spark, Python, and Spark... 
    Big data
    Apprenticeship
    Easy work

    McKinsey & Company

    Atlanta, GA
    3 days ago
  •  ..., and acquirers trust our technology to safeguard more than one...  ...transactions each year.The Data Science Team within...  ...Research, etc.) to improve processes, best practices and tooling...  ...overfit, etc.);Knowledge of Big Data technologies such as Spark, Hadoop and related;Proficiency... 
    Big data
    Contract work
    Work at office
    Remote work

    Feedzai

    Atlanta, GA
    2 days ago
  •  ...are a digital product engineering company that is scaling in a big way! We build products, services, and experiences that inspire,...  ...noticeSummaryType: Full-timeFunction: Information TechnologyExperience level: Not ApplicableIndustry: Information Technology And Services
    Big data

    Nagarro

    Atlanta, GA
    21 hours ago
  •  ...Statistics, or equivalent professional experience Experience building data processing pipelines and large scale machine learning platforms with experience in big data technologies like Spark, SQL, Snowflake/Hadoop, etc Experience operationalizing distributed... 
    Big data
    Long term contract
    Contract work

    Openkyber

    Atlanta, GA
    1 day ago
  • $100k - $160k

     ...) has an exciting opportunity for Data Scientist / Senior Data Scientist...  ...statistical inference, stochastic processes, and Bayesian statistics.Technical...  ...and Docker is a plusExperience with big data and distributed computing (e.g., Spark, Databricks, AWS/GCP/Azure) is a... 
    Big data
    Temporary work
    Flexible hours

    Berkshire Hathaway Specialty Insurance

    Atlanta, GA
    4 days ago
  •  ...will help advance the  Data Management and Data Analytics...  ...applications. • Data Processing: Work with large...  ...explore new methodologies and technologies to enhance our solutions...  ...: • Experience with big data technologies such as Hadoop, Spark, or similar. • Knowledge... 
    Big data

    4P Consulting Inc.

    Atlanta, GA
    1 day ago
  • $157.1k - $212.6k

     ...customers leverage emerging technologies that directly impact their...  ...a managed petabyte-scale data warehouse for fast SQL...  ...data; Amazon EMR, a managed big data platform for Spark, Hive, and Presto workloads...  ...real-time data streaming and processing; and Amazon OpenSearch, a... 
    Big data
    Local area
    Flexible hours

    AmazonWebServices

    Atlanta, GA
    1 day ago
  • $100k - $115k

    Role: Data EngineerWho You’ll Work WithAt Slalom...  ...passionate about technology, compelled by its...  ...native platforms.* Big Data Platforms (Dataproc, Apache Spark)* GoogleBigQuery,...  ...consulting company that leads with outcomes to...  ...of the selection process. Please advise the... 
    Big data
    Temporary work
    Work at office
    Local area
    Flexible hours

    Slalom

    Atlanta, GA
    2 days ago
  •  ...Description Job Description Data Scientist (5–10 Years...  ...tests to assess the impact of process or product changes. 10. Data...  ...audiences. Familiarity with big data and distributed computing frameworks (e.g., Hadoop, Spark) is a plus. Awareness of data... 
    Big data

    4P Consulting Inc.

    Atlanta, GA
    18 days ago
  • $116.2k - $229.1k

     ...organizations transform enterprise technology platforms, modernize data environments, and...  ...efficiency, and process scalability. • Team and Technology Lead: Evaluate, pilot, and integrate new big data and analytics technologies...  ...architecture, Apache Spark, Delta Lake, cloud-... 
    Big data
    Local area
    Visa sponsorship

    Deloitte

    Atlanta, GA
    2 days ago
  •  ...Senior AWS Tech Lead Data Engineer Start ASAP (2-4 WEEKS...  ...'t need architects or Big Data engineers. We...  ...a strong focus on AWS technologies About the Role: We are...  ...scalable data pipelines and processing systems. The candidate...  ...such as Apache Spark, Hadoop, or Kafka. Experience... 
    Big data
    Full time
    Immediate start
    Remote work

    Openkyber

    Atlanta, GA
    2 hours ago
  • $84 per hour

     ...Job Title: Data Engineer Cloud Data & Cybersecurity Analytics...  ...maintain AWS Glue ETL pipelines to process, transform, and integrate...  ...solutions using Python, SQL, and Spark . Support data governance...  ...cloud-based data engineering and big data processing. ~ Strong... 
    Big data
    Contract work
    H1b
    Local area

    Openkyber

    Atlanta, GA
    1 day ago
  •  ...and programs methods, processes, and systems to consolidate...  ..., diverse “big data” sources to generate actionable...  ....WHAT YOU'LL DO* Lead the design, development...  ...and recommending new technologies and methodologies.* Contribute...  ...technologies (e.g., Spark, Hadoop) is highly... 
    Big data
    Full time
    Live out
    Local area
    Flexible hours

    Waystar

    Atlanta, GA
    1 day ago
  • $130.9k - $210k

     ...leader in payments technology, facilitating transactions...  ...Sr. Consultant leads the development of...  ...presentations, and data visualizations. The...  ...team practices, processes, templates, quality...  ...modern analytics and big data platforms such as Hadoop, Hive, Spark, Databricks, cloud-... 
    Big data
    Full time
    Work experience placement
    Work at office
    Local area

    Visa

    Atlanta, GA
    3 days ago
  • We Are:Accenture helps the world's leading enterprises reinvent by building their...  ...assets and platforms, deep process and industry expertise, and leading...  ...with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve approximately 9,000 clients... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Atlanta, GA
    1 day ago
  •  ...Role: Sr. Data Engineer (Customer Data Platform) Location...  ...to generate insights Lead development of large-scale data processing solutions using Databricks and Spark technologies Design and optimize...  ...processing, and highly scalable big-data data stores... 
    Big data

    Sumeru Solutions

    Atlanta, GA
    1 day ago
  • $196.5k - $294.75k

     ...responsible use of data and AI. We believe...  ...develop the first technology platform for responsible...  ...using our big-data and high-scale...  ...CloudOps, and Support.Lead deep-dive technical...  ...product, tooling, and processes that reduce recurrence...  ...frameworks (e.g., Spark, Flink, Kafka,... 
    Big data
    Work experience placement
    Work at office
    Local area
    Worldwide
    Flexible hours
    3 days per week
    1 day per week

    OneTrust

    Atlanta, GA
    1 day ago
  •  ...Job Description: Data Engineers own the architecture...  ...Unity Catalog, Apache Spark (Spark SQL / PySpark),...  ...proficiency with these technologies and the ability to...  ...architecture principles and help lead initiatives from...  ...manipulating, processing, and extracting value from... 
    Big data

    Akaasa Technologies

    Atlanta, GA
    1 day ago
  • We Are:Accenture helps the world's leading enterprises reinvent by building their...  ...assets and platforms, deep process and industry expertise, and leading...  ...with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve approximately 9,000 clients... 
    Full time
    Contract work
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Atlanta, GA
    3 days ago
  •  ...CTG is seeking to fill a Data Engineer - AI &...  ...batch and real-time data processing pipelines. Create...  ...with Databricks, Apache Spark, or similar cloud data...  ...Language Processing (NLP) technologies is a plus. Excellent...  ...cloud data platforms, or big data development.... 
    Big data
    Full time
    Remote work

    Openkyber

    Atlanta, GA
    2 hours ago
  •  ...Are:Accenture is a leading global professional...  ...than 120 countries. Technology is at the core of...  ...leadership in cloud, AI and data with unmatched...  ...and reinvent processes with AI to drive efficiency...  ...have knowledge of big data technologies (e.g., Hadoop, Spark).You have knowledge... 
    Big data
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Atlanta, GA
    21 hours ago
  • The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics. They will be responsible for conducting both recurring and ad hoc analysis for business users. Responsibilities Understand the day-to-day... 
    Big data

    ShrinQ Consulting Group Inc

    Atlanta, GA
    21 hours ago
  •  ...a skilled and motivated Data Engineer to join our growing technology team. The ideal candidate...  ...pipelines to collect, process, and integrate data from...  ...Cloudera, Hadoop, or related big data processing...  ...technologies such as Apache Spark, Databricks, Apache Hive,... 
    Big data
    Permanent employment

    Onsite It Advisors LLC

    Atlanta, GA
    1 day ago
  • $79.6k - $156.7k

    Databricks Data Engineer Position Description Are...  ...fascinated by information technology and its role in...  ...consumption. . Develop scalable processing solutions using PySpark, Python, Spark SQL, SQL, Delta Lake, and...  ..., ETL/Data Warehouse, or Big Data experience, including... 
    Big data
    Full time
    Work at office
    Local area
    Remote work

    None

    Atlanta, GA
    21 hours ago
  •  ...and limitations of AI, ML, and data engineeringParticipate in peer...  ..., including proven experience leading a team of MLE, DS, SDE, DevOps...  ...company to develop impactful big data solutionsCloud Computing...  ...development, data modeling, parallel processing and performance optimization.... 
    Big data
    Full time
    Work experience placement
    Immediate start

    Equifax

    Atlanta, GA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Technology Lead | Big Data - Data Processing | Spark. Be the first to apply!