Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Technology Lead | Big Data - Data Processing | Spark

Ipolarity LLC

POC: Sam Chavez

ATTENTION ALL SUPPLIERS!!!

READ BEFORE SUBMITTING:
UPDATED CONTACT NUMBER and EMAIL ID is a MANDATORY REQUEST from our client for all the submissions
We prioritize endorsing those with complete and accurate information
Avoid submitting duplicate profiles. We will Reject/Disqualify immediately.
Make sure that candidate's interview schedules are updated. Please inform the candidate to keep their lines open.
Please submit profiles within the max proposed rate.
Please make sure to TAG the profiles correctly if the candidate has WORKED FOR INFOSYS as a SUBCON or FTE.

MANDATORY: Please include in the resume the candidate s complete & updated contact information (Phone number, Email address and Skype ID) as well as a set of 5 interview timeslots over a 72-hour period after submitting the profile when the hiring managers could potentially reach to them. PROFILES WITHOUT THE REQUIRED DETAILS and TIME SLOTS will be REJECTED.

Job Title: Technology Lead | Big Data - Data Processing | Spark -- Spark-Scala Developer
Work Location & Reporting Address: Irving, TX 75039 (Onsite-Hybrid. Client to consider candidates willing to relocate)
Contract duration: 12
MAX VENDOR RATE: #### per hour max
Target Start Date: 25 Aug 2026
Does this position require Visa independent candidates only? Yes

Must Have Skills:
Spark
Scala
Python
SQL

Nice to Have Skills:
Spark Streaming
Hadoop
Hive
SQL
Sqoop
Impala

Detailed Job Description:
At least 8+ years of experience and strong knowledge in Scala programming language.
Able to write clean, maintainable and efficient Scala code following best practices.
Good knowledge on the fundamental Data Structures and their usage
At least 8+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies.
Having expertise in Spark Core, Spark SQL and Spark Streaming.
Experience with Python, Hadoop, HDFS, Hive and other BigData technologies.
Familiarity with Data warehousing and ETL concepts and techniques
Having expertise in Database concepts and SQL/NoSQL operations.
UNIX shell scripting will be an added advantage in scheduling/running application jobs.
At least 8 years of experience in Project development life cycle activities and maintenance/support projects.
Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives.
Understand project requirements and translate them into technical solutions which meets the project quality standards
Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues.
Strong problem solving and Good Analytical skills.
Excellent verbal and written communication skills.
Experience and desire to work in a Global delivery environment.
Stay up to date with new technologies and industry trends in Development.

Minimum Years of Experience:
8+ years

Certifications Needed:
Karat assessment. Need to be cleared before onboarding

Top 3 responsibilities you would expect the Subcon to shoulder and execute:
Coding
Requirement gathering
Team lead

Interview Process (Is face to face required?)
Face-to-face

Any additional information you would like to share about the project specs/nature of work:

Project Code: Infosys FP CAPACITY Anubhav Ram Gontla n

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Technology Lead | Big Data - Data Processing | Spark in Irving, TX vacancy
  •  ...SolutionsTitles: Java Spark Lead DeveloperDuration : Full...  ...Developer to join our dynamic data engineering team. The...  ...deployment of scalable big data applications and...  ...in Spark-based data processing, Java backend development and big data technologies along with the ability... 
    Big data
    Full time

    SRI Tech

    Irving, TX
    3 days ago
  • OverviewThe Infosys Data and Analytics (DNA)...  ...with cutting-edge technologies, collaborate with industry...  ...elicitation process by documenting assigned...  ...in Apache Spark, Spark SQL and Starburst...  ...Skill 1Technology|Big Data - Data Processing...  ...RoleTechnology Lead - USAuto req ID: 14... 
    Big data
    Full time
    Temporary work
    Relocation

    Infosys Technologies

    Irving, TX
    1 day ago
  • EXL is seeking an experienced Data Engineering Lead to drive architecture decisions and mentor distributed teams. You will own end-to-end data pipelines, focusing on on-prem Hadoop ecosystems, Spark processing, and effective scheduling with CA7/Control-M. The role requires... 
    Big data

    EXL

    Dallas, TX
    5 days ago
  • Job Title: Senior Specialist - Data EngineeringWork Location:Irving...  ...experience in Python Scala and Spark SQL to design and optimize scalable big data processing solutions within the Databricks...  ...Scala Python and related big data technologies to continuously improve... 
    Big data

    LTM

    Irving, TX
    2 days ago
  • Job Title: Sr. DATA Engineer Work LocationIrving TXJob Description:...  ...experience in Python Scala and Spark SQL to design and optimize scalable big data processing solutions within the Databricks...  ...Scala Python and related big data technologies to continuously improve... 
    Big data

    LTM

    Irving, TX
    3 days ago
  • • Analyze and understand data sources & APIs• Design and Develop methods to...  ...Payments Required Technical Skills • Big Data-Hadoop, NoSQL, Hive, Apache Spark• Python • Java & REST• GIT and...  ...engineering• Exposure to NLP and text processing• Experience with pipelines, job scheduling... 
    Big data

    NTT DATA

    Irving, TX
    1 day ago
  •  ...build and optimize scalable data solutions within the Amazon...  ...will have strong expertise in big data processing using PySpark and a deep...  ...resources and big data applications Spark Hive Iceberg for performance...  ...managementOther Big Data Technologies Exposure to other big data... 
    Big data

    LTM

    Irving, TX
    3 days ago
  •  ...MapReduce, HBase, Hive, Pig,Programming in Spark/StormProgramming in distributed messaging...  ...of working knowledge in Kafka/Storm data pipelines6+ years of experience in working...  ...documentation and API/Framework documentation/process build.* Bachelor’s degreeDesired Skills:•... 
    Big data

    LanceSoft

    Irving, TX
    5 days ago
  •  ...Big Data EngineerLocation: Irving, TX (Day 1 Onsite-Hybrid)HexawarePrimary Skills: Hadoop, Hive & Spark FrameworkResponsibilities:Experience with big data processing and distributed computing systems like Spark...  ...Experience with big data technologies like Hadoop, Hive, and... 
    Big data

    InterSources

    Irving, TX
    1 day ago
  •  ...Data ScientistLocation: Irving/Dallas area, Basking NJ, Atlanta,...  ...practitioner, who is familiar with AI technology and its business applications....  ...and handy at analyzing big data, preparing data for modeling...  ...NLP.Experience with Hadoop, Spark, and RDBMS.Strong... 
    Big data
    Work experience placement

    Samprasoft

    Irving, TX
    2 days ago
  • $55 - $60 per hour

     ...AI-Enabled Data Engineer (GCP)Duration: 12+ Months ContractLocation: Chandler, AZ | Charlotte...  ..., and distribute data for a variety of big data appsLeverage AI/Agentic frameworks to...  ...Cloud data solutions: creating/supporting Spark based ingestion and processing3 plus years... 
    Big data
    Hourly pay

    Saxon Global

    Irving, TX
    1 day ago
  •  ...PySpark Lead DeveloperExperience: 8-10 YearsLocation: Irving, TX-...  ...HybridRole Overview• Experience with big data processing and distributed computing systems like Spark.• Implement ETL pipelines and...  ...SQL.• Experience with big data technologies like Hadoop, Hive, and Kafka.•... 
    Big data

    E-Solutions

    Irving, TX
    1 day ago
  •  ...standards for the team. Ensure process compliance in the assigned...  ...9+ years of experience in Data Engineering and Data Analytics. Expert in Big Data Technologies including Spark, Kafka, Kudu, Impala, HBase,...  ...Jenkins, Java, and Spring Boot. Lead experience is highly... 
    Big data
    For contractors

    TechDigital Group

    Irving, TX
    2 days ago
  • $125k - $185k

     ...Apache Spark Developer – Remote Bright Vision Technologies is a technology consulting and software...  ...company delivering cloud, AI, data, and enterprise...  ...-scale distributed data processing applications supporting...  ...optimization, and cloud-based big data ecosystems. Key... 
    Big data
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Bedford, TX
    a month ago
  •  ...experienced Principal Data Engineer to join our team...  ...enable efficient data processing, storage, and retrieval...  ...scalability. Leverage big data technologies and frameworks (e.g., Hadoop, Spark, Hive) to process and analyze...  .... Propose and lead continuous improvement... 
    Big data
    Full time
    Local area

    TXU Energy

    Irving, TX
    5 days ago
  •  ...online.Job SummaryAs a Lead Data Engineer, you will be responsible...  ...to ensure data is processed, stored, and analyzed...  ...support.•Evaluate new data technologies and make recommendations...  ...BI.•Experience with big data technologies such as Hadoop, Spark, or Kafka.•Experience gained... 
    Big data
    Full time
    Local area

    TXU Energy

    Irving, TX
    2 days ago
  • $125k - $150k

     ...Senior Data Architect Location: Irving, TX...  ...integration patterns. Lead modernization...  ...Collaborate with business and technology teams to translate...  ...time and batch data processing architectures....  ...Experience with Big Data & Data Processing: Spark, Hadoop, Kafka, Databricks... 
    Big data
    Full time

    Diverse Lynx

    Irving, TX
    2 days ago
  •  ...strategies for effective data analysis and...  ...Key Requirements and Technology Experience: ~...  ...of IT project using Big Data/Hadoop...  ...Pig, Programming in Spark/Storm Programming in...  ...Framework documentation/process build. Our client is a leading Telecom Industry and... 
    Big data
    Contract work
    Immediate start

    Pyramid Corporation

    Irving, TX
    5 days ago
  • $125.76k - $188.64k

     ...$188,640.00Category: Technology, Applications Development...  ...experienced Senior Data Engineer to join our...  ...using PySpark, Spark SQL, and Delta Lake on...  ...services for data storage, processing, and analytics.Big Data Technologies:...  ...downstream applications.Lead the design and... 
    Big data
    Full time

    Citigroup

    Irving, TX
    4 days ago
  • $125.76k - $188.64k

     ...$188,640.00Category: Technology, Data Analytics, ProfessionalCompany...  ...for a Data Analytics Lead Engineer to design,...  ...— working across big data platforms, data lakes...  ...and parallel processing to improve pipeline efficiency...  ...as Hadoop, Apache Spark, PySpark, Databricks,... 
    Big data
    Full time
    Work at office
    Remote work

    Citigroup

    Irving, TX
    2 days ago
  • Required Skills Data Science, Machine Learning, AI, Big Data/ Hadoop, Python, Cloud- AWS/GCP...  ...a thought leader in AI Technology and business innovation....  ...relational database, Hadoop and Spark. Experience with Cloud...  ..., etc. Experience in leading large scale data science... 
    Big data
    Work experience placement

    Rapinno Tech

    Irving, TX
    5 days ago
  • Why GMF Technology?Innovation isn’t just a talking point at...  ...solutionSQL experience: querying data and sharing what...  ...DevOps).Experience with processing large data sets using Hadoop, HDFS, Spark, Kafka, Flume or similar...  ...skills.Understanding of big data platforms and... 
    Big data
    Work at office
    Flexible hours
    2 days per week

    GM Financial

    Irving, TX
    5 days ago
  • Lead Data Engineer Job DescriptionJob Overview:We are seeking a talented individual...  ...scalable data pipelines and ETL processes.Work closely with data scientists and...  ....Proficiency in SQL, Python, and big data technologies (Hadoop, Spark, etc.).Strong communication and problem... 
    Big data

    Gables Search Group

    Dallas, TX
    3 days ago
  •  ...Sr. Data Engineer - Assistant Vice PresidentWorking...  ...with the Technology team. The overall objective...  ...cutting-edge Big Data technologies,...  ...technologies (e.g., Hadoop, Spark, Kafka, Hive,...  ..., Avro) to ingest, process, and transform...  ...a Data Engineering lead role with a strong... 
    Big data

    Citigroup Inc

    Irving, TX
    1 day ago
  •  ...skilled and motivated Data Engineer to play a...  ...requires expertise in processing massive datasets using cutting-edge technologies like Apache Spark, PySpark, and Hive within...  ...components on leading cloud platforms such...  ...Qualifications: • Big Data Frameworks Expertise... 
    Big data

    Tata Consultancy Services

    Irving, TX
    3 days ago
  • $156.16k - $234.24k

     ...disciplinary areas. Leads and directs a team of...  ...in enterprise data architecture and data...  ...opportunities to leverage these technologies to address business...  ...strategies, big data deployment plans...  ...with distributed data processing technologies such as Spark, Presto/Trino, and... 
    Big data
    Temporary work

    Jobleads-US

    Irving, TX
    1 day ago
  •  ...candidatesEmployment Type - FTEJob Description:Data Analyst + KafkaWe are seeking a highly skilled Big Data Analyst to join our...  ...:- Collect, process, and analyze large volumes of...  ...Utilize big data tools and technologies such as Hadoop, Spark, Kafka, and NoSQL databases.... 
    Big data

    SRI Tech

    Dallas, TX
    5 days ago
  •  ...our efforts into complementary data technologies for decision support in areas of ingesting and processing large data sets including data...  ...data sets using Hadoop, HDFS, Spark, Kafka, Flume or similar...  ...Analytics solutions Understanding of big data platforms and... 
    Big data
    Work experience placement

    GM Financial

    Irving, TX
    1 day ago
  •  ...Data ScientistRequired Skills & Experience: 4-7 years of experience in Data Science, Analytics, or a related field. Advanced...  ...development. Exposure to Teradata, PySpark, Scala, or similar big data technologies. Telecommunications industry experience.Job Description: As... 
    Big data

    Insight Global

    Irving, TX
    4 days ago
  • $125.76k - $188.64k

     ...Citi is looking for a Data Analytics Lead Engineer to design, build...  ...systems — working across big data platforms, data lakes...  ...and parallel processing to improve pipeline efficiency...  ...data lake solutions using technologies such as Hadoop, Apache Spark, PySpark, Databricks, Delta... 
    Big data
    Full time
    Work at office
    Remote work

    Citi

    Irving, TX
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Technology Lead | Big Data - Data Processing | Spark. Be the first to apply!