Technology Lead | Big Data - Data Processing | Spark
Ipolarity LLC
Job title - Technology Lead
Work location Atlanta, GA-30313 Is it Hybrid, onsite or remote position Full Onsite Please confirm if the candidate can work from any Infosys DC office Nope, Client Preferred location is Atlanta Tentative Start date 19-Oct Contract duration greater than 6 months Vendor rate #### Minimum years of experience needed in the required skills- 5-8 years of experience Minimum over all work experience required - 8-10 years of experience Domain - CPG Any certification required Good to Have Mandatory skills required - Pyspark, Spark, Azure Synapse, Scala. SQL Complete job description Support and maintain scalable Azure data platforms built on ADLS, Azure Synapse, Spark, ADF, and Delta Lake. Monitor and troubleshoot batch and incremental data pipelines, resolve production issues, and optimize jobs to ensure performance, reliability, and data availability. Maintain data models across the Bronze, Silver, and Gold layers to support reporting and analytics. Enforce security, governance, and operational best practices while mentoring engineers, maintaining support documentation, and driving continuous service improvement. Interview mode - In person/Virtual - Virtual How many rounds of interview Two RoundsProject Code: COKE DnA IQ Support
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Technology Lead | Big Data - Data Processing | Spark in Atlanta, GA vacancy
- OverviewThe Infosys Data and Analytics (DNA)... ...with cutting-edge technologies, collaborate with industry... ...elicitation process by documenting assigned... ...ExperiencePyspark, Spark, Scala, Azure... ...Skill 1Technology|Big Data - Data Processing... ...2Career RoleTechnology Lead - US: 153311BRBig dataFull timeTemporary workRelocation
- ...candidatesEmployment Type - FTEJob Description:Data Analyst + KafkaWe are seeking a highly skilled Big Data Analyst to join our... ...:- Collect, process, and analyze large volumes of... ...Utilize big data tools and technologies such as Hadoop, Spark, Kafka, and NoSQL databases....Big data
- ...Software Consultancy and Information Technology Enabled Services.Job DescriptionJob... ...Description: At least 5 years of working on data management domain with big data, Oracle, SQL or other database... ...- Hadoop, MapReduce, Pig, Hive, Spark, Storm, Amazon Kinesis, AWS EMR, AWS...Big dataPermanent employmentFull timeH1b
- ...Job Description: Technology Lead Data Management (Talend & Snowflake) Job Title: Technology Lead... ...and real-time ETL/ELT integration processes using the Talend platform. Snowflake... ...using Talend Data Integration / Big Data platform for building enterprise ETL...Big dataContract work
- ...Experient, we provide experience, technology, and transformation... ...a Senior Snowflake Data Engineer to join our development... ...used by our client to process business critical order transaction... ...~ Knowledge of big data technologies (Hadoop, Spark, Kafka) and data visualization...Big data
- ...We are seeking an experienced Technology Lead / Azure Data Engineer with strong hands-on expertise in Azure Synapse Analytics and... ...candidate will have a deep understanding of Apache Spark, distributed data processing, Data Lake architecture, and modern data engineering...Contract work
$100k - $135k
...SQL and Apache SparkETL/Data Pipeline DevelopmentBig Data technologies: Hadoop, Spark, Kafka, Hive, HDFS,... ...warehouse and large-scale data processing experienceExperience... ...scalable solutions for Big Data processing and... ...into technical solutions.Lead and mentor junior data...Big data- ...Senior Data EngineerSkill - Last Used - Experience in Years/... ...to the fast-paced world of Big Data technology and has experience in building... ...transforming the way Client captures, processes, stores and visualizes data.... ...including Hadoop, Spark, and related frameworks.Programming...Big data
- Req ID:374073NTT DATA strives to hire exceptional... ...queries to reduce processing times and AWS... ...in Apache Spark or PySpark.Preferred... ...or AWS Certified Big Data Specialty.Experience... ...business and technology services leader, serving... ...of the world's leading AI and digital...Big dataContract workWork at officeRemote workFlexible hours
$195.3k - $199.2k
...member of Periscope’s technology team with... ...expertise remain on the leading edge of technology... ...maintain scalable data pipelines and... ...and optimize ETL processes with a focus on performance... ...background in big data technologiesProficiency... ...on Azure, Spark, Python, and Spark...Big dataApprenticeshipEasy work- ..., and acquirers trust our technology to safeguard more than one... ...transactions each year.The Data Science Team within... ...Research, etc.) to improve processes, best practices and tooling... ...overfit, etc.);Knowledge of Big Data technologies such as Spark, Hadoop and related;Proficiency...Big dataContract workWork at officeRemote work
- ...Job Title: Sr. Data Engineer Work Location: Newark, New Jersey 07068 Contract... ...CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step... ...of ETL/ELT, data modeling, and big data technologies. Familiarity with data warehousing...Big dataLong term contractContract work
- ...Azure Data EngineerSeeking an Azure Data... ...and customers, and leading the design and hands... ...private cloud technologies, our Data Engineer... ...perspective on storage, big data platform... ...data ingestion, data processing, and analytical... ..., SQL, ADLS/Blob, Spark/SparkSQL, Databricks...Big dataWork experience placement
- ...Description Job Description Data Scientist (5–10 Years... ...tests to assess the impact of process or product changes. 10. Data... ...audiences. Familiarity with big data and distributed computing frameworks (e.g., Hadoop, Spark) is a plus. Awareness of data...Big data
- ...are a digital product engineering company that is scaling in a big way! We build products, services, and experiences that inspire,... ...noticeSummaryType: Full-timeFunction: Information TechnologyExperience level: Not ApplicableIndustry: Information Technology And ServicesBig data
- ...Statistics, or equivalent professional experience Experience building data processing pipelines and large scale machine learning platforms with experience in big data technologies like Spark, SQL, Snowflake/Hadoop, etc Experience operationalizing distributed...Big dataLong term contractContract work
$150k - $170k
...be submitted Role: Senior Data Engineer Salary: $150,000-1... .... Data Engineering & Processing Develop ETL/ELT pipelines using... .... Optimize performance for Spark workloads and Redshift queries... ...Tableau, Quicksight, Looker, big data and Realtime BI experience...Big dataLocal areaRemote work$100k - $160k
...) has an exciting opportunity for Data Scientist / Senior Data Scientist... ...statistical inference, stochastic processes, and Bayesian statistics.Technical... ...and Docker is a plusExperience with big data and distributed computing (e.g., Spark, Databricks, AWS/GCP/Azure) is a...Big dataTemporary workFlexible hours$157.1k - $212.6k
...customers leverage emerging technologies that directly impact their... ...a managed petabyte-scale data warehouse for fast SQL... ...data; Amazon EMR, a managed big data platform for Spark, Hive, and Presto workloads... ...real-time data streaming and processing; and Amazon OpenSearch, a...Big dataLocal areaFlexible hours$100k - $115k
Role: Data EngineerWho You’ll Work WithAt Slalom... ...passionate about technology, compelled by its... ...native platforms.* Big Data Platforms (Dataproc, Apache Spark)* GoogleBigQuery,... ...consulting company that leads with outcomes to... ...of the selection process. Please advise the...Big dataTemporary workWork at officeLocal areaFlexible hours$116.2k - $229.1k
...organizations transform enterprise technology platforms, modernize data environments, and... ...efficiency, and process scalability. • Team and Technology Lead: Evaluate, pilot, and integrate new big data and analytics technologies... ...architecture, Apache Spark, Delta Lake, cloud-...Big dataLocal areaVisa sponsorship- ...product/business partners, data engineers, data... ...Augmentation & Services team. Lead the entire product... .... Knowledge of Big Data Technologies: Experience with big... ...technologies (e.g., Hadoop, Spark, Kafka) can help in... ...and optimizing data processing. User Experience (UX...Big data
- ...OpenKyber is hiring a Lead Snowflake Software Developer... ...experience with a strong focus on data engineering, analytics,... ...data modeling, ETL/ELT processes, database management, and... ...Strong experience with Apache Spark and Azure, with proficiency in big data processing, analytics...Big dataContract work
- ...Databricks Data EngineerAre you fascinated by information technology and its role in innovative business solutions... .... Develop scalable processing solutions using PySpark, Python, Spark SQL, SQL, Delta Lake, and... ...Engineering, ETL/Data Warehouse, or Big Data experience, including...Big dataWork at officeLocal areaRemote work
- ...Lead Software Engineer (Big Data, Spark, AWS, Full Stack) Location: Rockville, MD or Tysons Corner, VA Work... ...Hive, and Trino ~ Experience processing large-scale datasets (TB/PB scale)... ...Design Patterns ~ Data Storage Technologies (Relational & NoSQL) ~ Performance...Big data
- ...candidate will have a strong Data Engineering background with... ...extensive experience working with Big Data technologies . Day-to-Day... ...established development practices, processes, and reporting standards. The... ...technologies. Experience with Spark for large-scale batch processing...Big dataContract workWork at officeImmediate startRemote work3 days per week
$84 per hour
...Job Title: Data Engineer Cloud Data & Cybersecurity Analytics... ...maintain AWS Glue ETL pipelines to process, transform, and integrate... ...solutions using Python, SQL, and Spark . Support data governance... ...cloud-based data engineering and big data processing. ~ Strong...Big dataContract workH1bLocal area- ...Senior AWS Tech Lead Data Engineer Start ASAP (2-4 WEEKS... ...'t need architects or Big Data engineers. We... ...a strong focus on AWS technologies About the Role: We are... ...scalable data pipelines and processing systems. The candidate... ...such as Apache Spark, Hadoop, or Kafka. Experience...Big dataImmediate startRemote work
$130.9k - $210k
...leader in payments technology, facilitating transactions... ...Sr. Consultant leads the development of... ...presentations, and data visualizations. The... ...team practices, processes, templates, quality... ...modern analytics and big data platforms such as Hadoop, Hive, Spark, Databricks, cloud-...Big dataFull timeWork experience placementWork at officeLocal area- ...and programs methods, processes, and systems to consolidate... ..., diverse “big data” sources to generate actionable... ....WHAT YOU'LL DO* Lead the design, development... ...and recommending new technologies and methodologies.* Contribute... ...technologies (e.g., Spark, Hadoop) is highly...Big dataFull timeLive outLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Technology Lead | Big Data - Data Processing | Spark. Be the first to apply!
Related searches
- technology lead Atlanta, GA
- big data cloud engineer Atlanta, GA
- entry level big data engineer Atlanta, GA
- big data Atlanta, GA
- junior big data engineer Atlanta, GA
- big data engineer Atlanta, GA
- big data developer Atlanta, GA
- big data devops engineer Atlanta, GA
- distribution tech Atlanta, GA
- trauma tech Atlanta, GA




