Technology Lead | Big Data - Data Processing | Spark
Ipolarity LLC
POC: Sam Chavez
ATTENTION ALL SUPPLIERS!!! READ BEFORE SUBMITTING:UPDATED CONTACT NUMBER and EMAIL ID is a MANDATORY REQUEST from our client for all the submissions
We prioritize endorsing those with complete and accurate information
Avoid submitting duplicate profiles. We will Reject/Disqualify immediately.
Make sure that candidate's interview schedules are updated. Please inform the candidate to keep their lines open.
Please submit profiles within the max proposed rate.
Please make sure to TAG the profiles correctly if the candidate has WORKED FOR INFOSYS as a SUBCON or FTE. MANDATORY: Please include in the resume the candidate s complete & updated contact information (Phone number, Email address and Skype ID) as well as a set of 5 interview timeslots over a 72-hour period after submitting the profile when the hiring managers could potentially reach to them. PROFILES WITHOUT THE REQUIRED DETAILS and TIME SLOTS will be REJECTED. Job Title: Technology Lead | Big Data - Data Processing | Spark -- Spark-Scala Developer
Work Location & Reporting Address: Irving, TX 75039 (Onsite-Hybrid. Client to consider candidates willing to relocate)
Contract duration: 12
MAX VENDOR RATE: #### per hour max
Target Start Date: 25 Aug 2026
Does this position require Visa independent candidates only? Yes Must Have Skills:
Spark
Scala
Python
SQL Nice to Have Skills:
Spark Streaming
Hadoop
Hive
SQL
Sqoop
Impala Detailed Job Description:
At least 8+ years of experience and strong knowledge in Scala programming language.
Able to write clean, maintainable and efficient Scala code following best practices.
Good knowledge on the fundamental Data Structures and their usage
At least 8+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies.
Having expertise in Spark Core, Spark SQL and Spark Streaming.
Experience with Python, Hadoop, HDFS, Hive and other BigData technologies.
Familiarity with Data warehousing and ETL concepts and techniques
Having expertise in Database concepts and SQL/NoSQL operations.
UNIX shell scripting will be an added advantage in scheduling/running application jobs.
At least 8 years of experience in Project development life cycle activities and maintenance/support projects.
Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives.
Understand project requirements and translate them into technical solutions which meets the project quality standards
Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues.
Strong problem solving and Good Analytical skills.
Excellent verbal and written communication skills.
Experience and desire to work in a Global delivery environment.
Stay up to date with new technologies and industry trends in Development. Minimum Years of Experience:
8+ years Certifications Needed:
Karat assessment. Need to be cleared before onboarding Top 3 responsibilities you would expect the Subcon to shoulder and execute:
Coding
Requirement gathering
Team lead Interview Process (Is face to face required?)
Face-to-face Any additional information you would like to share about the project specs/nature of work:
Project Code: Infosys FP CAPACITY Anubhav Ram Gontla n
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Technology Lead | Big Data - Data Processing | Spark in Irving, TX vacancy
- ...SolutionsTitles: Java Spark Lead DeveloperDuration : Full... ...Developer to join our dynamic data engineering team. The... ...deployment of scalable big data applications and... ...in Spark-based data processing, Java backend development and big data technologies along with the ability...Big dataFull time
- OverviewThe Infosys Data and Analytics (DNA)... ...with cutting-edge technologies, collaborate with industry... ...elicitation process by documenting assigned... ...in Apache Spark, Spark SQL and Starburst... ...Skill 1Technology|Big Data - Data Processing... ...RoleTechnology Lead - USAuto req ID: 14...Big dataFull timeTemporary workRelocation
- EXL is seeking an experienced Data Engineering Lead to drive architecture decisions and mentor distributed teams. You will own end-to-end data pipelines, focusing on on-prem Hadoop ecosystems, Spark processing, and effective scheduling with CA7/Control-M. The role requires...Big data
- Job Title: Senior Specialist - Data EngineeringWork Location:Irving... ...experience in Python Scala and Spark SQL to design and optimize scalable big data processing solutions within the Databricks... ...Scala Python and related big data technologies to continuously improve...Big data
- Job Title: Sr. DATA Engineer Work LocationIrving TXJob Description:... ...experience in Python Scala and Spark SQL to design and optimize scalable big data processing solutions within the Databricks... ...Scala Python and related big data technologies to continuously improve...Big data
- • Analyze and understand data sources & APIs• Design and Develop methods to... ...Payments Required Technical Skills • Big Data-Hadoop, NoSQL, Hive, Apache Spark• Python • Java & REST• GIT and... ...engineering• Exposure to NLP and text processing• Experience with pipelines, job scheduling...Big data
- ...build and optimize scalable data solutions within the Amazon... ...will have strong expertise in big data processing using PySpark and a deep... ...resources and big data applications Spark Hive Iceberg for performance... ...managementOther Big Data Technologies Exposure to other big data...Big data
- ...MapReduce, HBase, Hive, Pig,Programming in Spark/StormProgramming in distributed messaging... ...of working knowledge in Kafka/Storm data pipelines6+ years of experience in working... ...documentation and API/Framework documentation/process build.* Bachelor’s degreeDesired Skills:•...Big data
- ...Big Data EngineerLocation: Irving, TX (Day 1 Onsite-Hybrid)HexawarePrimary Skills: Hadoop, Hive & Spark FrameworkResponsibilities:Experience with big data processing and distributed computing systems like Spark... ...Experience with big data technologies like Hadoop, Hive, and...Big data
- ...Data ScientistLocation: Irving/Dallas area, Basking NJ, Atlanta,... ...practitioner, who is familiar with AI technology and its business applications.... ...and handy at analyzing big data, preparing data for modeling... ...NLP.Experience with Hadoop, Spark, and RDBMS.Strong...Big dataWork experience placement
$55 - $60 per hour
...AI-Enabled Data Engineer (GCP)Duration: 12+ Months ContractLocation: Chandler, AZ | Charlotte... ..., and distribute data for a variety of big data appsLeverage AI/Agentic frameworks to... ...Cloud data solutions: creating/supporting Spark based ingestion and processing3 plus years...Big dataHourly pay- ...PySpark Lead DeveloperExperience: 8-10 YearsLocation: Irving, TX-... ...HybridRole Overview• Experience with big data processing and distributed computing systems like Spark.• Implement ETL pipelines and... ...SQL.• Experience with big data technologies like Hadoop, Hive, and Kafka.•...Big data
- ...standards for the team. Ensure process compliance in the assigned... ...9+ years of experience in Data Engineering and Data Analytics. Expert in Big Data Technologies including Spark, Kafka, Kudu, Impala, HBase,... ...Jenkins, Java, and Spring Boot. Lead experience is highly...Big dataFor contractors
$125k - $185k
...Apache Spark Developer – Remote Bright Vision Technologies is a technology consulting and software... ...company delivering cloud, AI, data, and enterprise... ...-scale distributed data processing applications supporting... ...optimization, and cloud-based big data ecosystems. Key...Big dataFull timeH1bLocal areaImmediate startRemote workVisa sponsorship- ...experienced Principal Data Engineer to join our team... ...enable efficient data processing, storage, and retrieval... ...scalability. Leverage big data technologies and frameworks (e.g., Hadoop, Spark, Hive) to process and analyze... .... Propose and lead continuous improvement...Big dataFull timeLocal area
- ...online.Job SummaryAs a Lead Data Engineer, you will be responsible... ...to ensure data is processed, stored, and analyzed... ...support.•Evaluate new data technologies and make recommendations... ...BI.•Experience with big data technologies such as Hadoop, Spark, or Kafka.•Experience gained...Big dataFull timeLocal area
$125k - $150k
...Senior Data Architect Location: Irving, TX... ...integration patterns. Lead modernization... ...Collaborate with business and technology teams to translate... ...time and batch data processing architectures.... ...Experience with Big Data & Data Processing: Spark, Hadoop, Kafka, Databricks...Big dataFull time- ...strategies for effective data analysis and... ...Key Requirements and Technology Experience: ~... ...of IT project using Big Data/Hadoop... ...Pig, Programming in Spark/Storm Programming in... ...Framework documentation/process build. Our client is a leading Telecom Industry and...Big dataContract workImmediate start
$125.76k - $188.64k
...$188,640.00Category: Technology, Applications Development... ...experienced Senior Data Engineer to join our... ...using PySpark, Spark SQL, and Delta Lake on... ...services for data storage, processing, and analytics.Big Data Technologies:... ...downstream applications.Lead the design and...Big dataFull time$125.76k - $188.64k
...$188,640.00Category: Technology, Data Analytics, ProfessionalCompany... ...for a Data Analytics Lead Engineer to design,... ...— working across big data platforms, data lakes... ...and parallel processing to improve pipeline efficiency... ...as Hadoop, Apache Spark, PySpark, Databricks,...Big dataFull timeWork at officeRemote work- Required Skills Data Science, Machine Learning, AI, Big Data/ Hadoop, Python, Cloud- AWS/GCP... ...a thought leader in AI Technology and business innovation.... ...relational database, Hadoop and Spark. Experience with Cloud... ..., etc. Experience in leading large scale data science...Big dataWork experience placement
- Why GMF Technology?Innovation isn’t just a talking point at... ...solutionSQL experience: querying data and sharing what... ...DevOps).Experience with processing large data sets using Hadoop, HDFS, Spark, Kafka, Flume or similar... ...skills.Understanding of big data platforms and...Big dataWork at officeFlexible hours2 days per week
- Lead Data Engineer Job DescriptionJob Overview:We are seeking a talented individual... ...scalable data pipelines and ETL processes.Work closely with data scientists and... ....Proficiency in SQL, Python, and big data technologies (Hadoop, Spark, etc.).Strong communication and problem...Big data
- ...Sr. Data Engineer - Assistant Vice PresidentWorking... ...with the Technology team. The overall objective... ...cutting-edge Big Data technologies,... ...technologies (e.g., Hadoop, Spark, Kafka, Hive,... ..., Avro) to ingest, process, and transform... ...a Data Engineering lead role with a strong...Big data
- ...skilled and motivated Data Engineer to play a... ...requires expertise in processing massive datasets using cutting-edge technologies like Apache Spark, PySpark, and Hive within... ...components on leading cloud platforms such... ...Qualifications: • Big Data Frameworks Expertise...Big data
$156.16k - $234.24k
...disciplinary areas. Leads and directs a team of... ...in enterprise data architecture and data... ...opportunities to leverage these technologies to address business... ...strategies, big data deployment plans... ...with distributed data processing technologies such as Spark, Presto/Trino, and...Big dataTemporary work- ...candidatesEmployment Type - FTEJob Description:Data Analyst + KafkaWe are seeking a highly skilled Big Data Analyst to join our... ...:- Collect, process, and analyze large volumes of... ...Utilize big data tools and technologies such as Hadoop, Spark, Kafka, and NoSQL databases....Big data
- ...our efforts into complementary data technologies for decision support in areas of ingesting and processing large data sets including data... ...data sets using Hadoop, HDFS, Spark, Kafka, Flume or similar... ...Analytics solutions Understanding of big data platforms and...Big dataWork experience placement
- ...Data ScientistRequired Skills & Experience: 4-7 years of experience in Data Science, Analytics, or a related field. Advanced... ...development. Exposure to Teradata, PySpark, Scala, or similar big data technologies. Telecommunications industry experience.Job Description: As...Big data
$125.76k - $188.64k
...Citi is looking for a Data Analytics Lead Engineer to design, build... ...systems — working across big data platforms, data lakes... ...and parallel processing to improve pipeline efficiency... ...data lake solutions using technologies such as Hadoop, Apache Spark, PySpark, Databricks, Delta...Big dataFull timeWork at officeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Technology Lead | Big Data - Data Processing | Spark. Be the first to apply!
Related searches
- technology lead Irving, TX
- big data devops engineer Irving, TX
- big data Irving, TX
- big data developer Irving, TX
- big data cloud engineer Irving, TX
- junior big data engineer Irving, TX
- big data engineer Irving, TX
- hadoop big data developer Irving, TX
- entry level big data engineer Irving, TX
- milestone technologies Irving, TX


