Senior Big Data Engineer: PySpark, Kafka & Hive Lakehouse
$110k - $125kTata Consultancy Services
Tata Consultancy Services is hiring a Senior Big Data Engineer in Charlotte, North Carolina. The ideal candidate will have 10-13 years of experience specializing in Hadoop, PySpark, and Kafka. You will design and optimize ETL pipelines and manage Hadoop components to support financial systems. Key responsibilities include building ingestion frameworks and developing data solutions for regulatory reporting. Comprehensive employee benefits, including medical coverage and a salary range of $110,000–125,000 annually, are offered. #J-18808-Ljbffr Tata Consultancy Services
Vacancy posted 16 hours ago
Similar jobs that could be interesting for youBased on the Senior Big Data Engineer: PySpark, Kafka & Hive Lakehouse in Charlotte, NC vacancy
$110k - $125k
Job Description Seeking a Senior Big Data Engineer with 10-13 years of experience specializing in Hadoop, PySpark, Kafka, Hive, and strong experience designing data solutions for... ...and market risk processing. Databricks Lakehouse & Delta Framework Architect and implement...SeniorBig data- Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte,... ...have experience with Hadoop ecosystem and Big Data technologies: Spark, AWS, Kafka, Hive,...Big dataFull timeLocal areaImmediate startRemote work
$105.4k - $124k
...and implemented scalable data lake solutions using... ...Optimization Tune Hadoop, Hive, and Spark jobs and... ...degree in Computer Science, Engineering, or related field.... ...Spark, and migration of Big Data into Azure cloud services... ...C++, Java, and Python, Pyspark for automating...SeniorBig dataTemporary work- ...skilled IT developer with significant experience in Hadoop and big-data applications based in Charlotte, North Carolina. The ideal candidate... ...development, along with hands-on expertise in tools such as HIVE and Apache Spark. The role entails optimizing application performance...SeniorBig data
- IRC299438 - Senior Data Engineer - PySpark & Python (Client:) Location: Charlotte, NC Need Senior profiles with at least 12 years of experience. Key... ...cloud ecosystem (S3, Glue, EMR, Redshift, Lambda, etc.). Kafka Strong hands‑on experience with PySpark and Python, especially...Senior
$128.57k
...Description At Regions, the Data Engineer focuses on the... ...storage in Regions’ big data environment... ...experience in Python/PySpark, Scala, SQL Five (5... ...Technology in Hadoop, Hive, Impala, Spark, or Kafka Preferences... ...experience working with senior executives in the use...SeniorBig dataFull timeWork experience placementWork at officeRelocationVisa sponsorshipWork visaRelocation packageFlexible hours3 days per week- To Apply for this Job Click Here Senior Data Engineer | Onsite | Charlotte, NC | H1B Sponsorship Available... ...as Code: Terraform Nice to have: PySpark, Spark, SQL, Hadoop, CI/CD pipelines,... ...products Experience migrating on‑premise big data platforms to AWS Strong...SeniorBig dataContract workH1bVisa sponsorship
$106.9k - $176.5k
...Data Architecture & Engineering - Senior - Financial Services - Consulting - NYC Location: New York Other locations... ..., storage, mining/warehousing, big data analytics, and visualization. Understanding... ...and Applications (Spark streaming, Kafka, Storm, etc.) Experience with data...SeniorBig dataWork experience placementSummer holidayFlexible hoursEY
Charlotte, NC1 day ago- Comcentric Consulting is looking for a Data Engineer in Charlotte, NC, to work on a hybrid schedule (2 days/week). This position is expected... ...will have significant experience in Data Engineering, particularly with PySpark and Scala. #J-18808-Ljbffr Comcentric ConsultingSeniorContract workLocal area2 days per week
- Akaasa Technologies is seeking a Data Developer in Charlotte, NC with 5+ years of experience to design, build, and operate lakehouse architectures using Microsoft Fabric. The role develops end-to-end data pipelines, Spark jobs, and notebooks to transform data for analytics...Senior
- ...candidate will leverage their 7+ years of experience to optimize data pipelines and collaborate with global teams. Successful candidates... ...possess extensive knowledge in Teradata SQL, Unix/Linux, and Big Data technologies. The role offers a dynamic work environment with...SeniorBig data
- Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Software Engineer in Charlotte, NC (Onsite). Work with the brightest minds at one of the largest financial institutions in the world. This is a long-term contract opportunity...SeniorBig dataLong term contractContract work
- A top technology consulting firm in Charlotte, North Carolina, is seeking a skilled developer with expertise in JAVA/J2EE Development, Spring framework, and strong SQL knowledge. The ideal candidate will have experience in Agile methodologies and a solid understanding of...SeniorBig data
- Affirm is looking for an experienced data engineer to lead the architecture of its lakehouse analytics platform in Charlotte, North Carolina. This role requires over 10 years of experience in software/data engineering, with significant expertise in Snowflake, and proficiency...SeniorRemote jobFlexible hours
- ...Description We are currently seeking a talented and motivated Senior Data Engineer to join our Cloud data solutions team. This role will be... ...Enable streaming data use-cases and standard design patterns in a big data environment. Review and provide feedback on core code...SeniorBig dataWork at officeLocal areaWork from home
- ...The Senior Data Engineer will design, develop, and optimize scalable cloud-based data platforms that... .... Experience with Apache Spark or PySpark for distributed data processing. Experience... ...orchestration platforms. Experience with Kafka or other streaming technologies....Senior
Compunnel
Charlotte, NC1 day ago - ...2 only. Brooksource is searching for a Senior Data Engineer to join our Fortune 500 Energy & Utilities... ...data processing jobs using AWS Glue, PySpark, Python, and Java Develop and maintain... ...data ingestion solutions using AWS DMS, Kafka, and AWS Lambda Design and manage data...SeniorFull timeContract workLocal areaRemote workVisa sponsorship3 days per week
Brooksource
Charlotte, NC1 day ago $100k - $110k
...Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of... ...looking for an experienced Big Data Engineer with strong... ...as Apache Hadoop, Spark, and Hive. Implement data processing and transformation using Pyspark, Python, and Scala to support...Big dataTemporary workFlexible hours- Senior Data Quality Assurance Engineer (Informatica, Tableau, QlikView, Quality Center, Data Strategies, Data Delivery... ..., Agile Central (Rally), Scoop, Hive, Pig, NoSQL DESCRIPTION: For our prestigious... ...or a high level understanding of Big Data technologies on a Hadoop...SeniorBig dataPermanent employmentFull timeWork experience placementRemote work
- ...Consultancy Services Limited is seeking an experienced data engineering professional in Charlotte, NC, to migrate near... ...event-driven architectures using EventBridge, Kafka, and Kinesis, and build scalable pipelines with Glue, PySpark, and Python. You will also configure Glue...Senior
- ...We are seeking a Technical Specialist, Data Engineering to join a strategic in‑house data platform... ..., Debezium, Apache Flink, Apache Kafka, and AWS. Collaborate closely with internal... ...industry background. Python or PySpark familiarity; conceptual understanding is...SeniorFull timeShift work
$105k - $115k
...seeking an experienced Lead Data Engineer to design, develop, and optimize... ..., data warehousing, and big data ecosystems, along with proven... ...Apache Spark, Databricks, Kafka, and Airflow. Strong experience... .... Knowledge of Data Lake, Lakehouse, and modern data architecture...Big dataTemporary workFlexible hours- ...list that spans across the country. Job Description CapTech Data Engineering consultants enable clients to build and maintain advanced data... ...tools (git, Jenkins, CI/CD, Jira). Fundamental understanding of big data, open source, and data streaming concepts. Abilityto...SeniorBig dataWork at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...services company to hire a Data Engineering Associate Manager. **Please... ...strategic direction set by senior management and implement senior... ...of streaming data utilizing PySpark, Go, Kubeflow, Kafka Streams, Airflow and Dockers; Utilizing big data and data management platforms...Big data
- A global consulting firm is seeking a Big Data Engineer to design, develop, and optimize large-scale data processing systems. The ideal candidate... ...in big data technologies such as Apache Hadoop, Spark, and Hive. Responsibilities include maintaining ETL pipelines,...Big data
- Job Title: Hadoop / HPE MapR Engineer (Data Platform) We are seeking a highly... ...Hadoop clusters. This is a senior‑level role requiring... ...Qualifications 7+ years of experience in Big Data / Data Platform... ...Exposure to streaming technologies (Kafka or MapR Streams)....Big data
- Job Title: Data Engineer Location: Charlotte NC 28203 Schedule: Hybrid (3 days on-site and 2 days remote) Position: Contract Duration: 8... ...structured programming, SQL, and scripting 5+ years of experience with big data technologies 3+ years of experience with cloud-based big...SeniorBig dataContract workWork experience placementRemote workFlexible hours
- BCforward is looking for a Senior Java Full Stack Developer in Charlotte, North Carolina, for a 12-month contract. The role requires... ...possess over 7 years of experience with Java, database design, and big data tools. The position offers competitive compensation, growth...SeniorBig dataContract work
- ...Ab Initio Developer with expertise in Python and PySpark. The role involves designing, developing, and maintaining data integration solutions while collaborating with... ...proficiency in data modeling and experience with big data technologies such as Hadoop and Spark. The...Big dataContract work
- Position Data Engineer (Scala) Senior Location Charlotte, NC Employment Type Cliff W2 Duration Long-Term... ...Mandatory) Apache Spark using Scala (Not PySpark) Strong SQL skills ETL/Data Pipeline development Hadoop ecosystem (Hive/HDFS) is a plus Experience with Git...SeniorLong term contract
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Big Data Engineer: PySpark, Kafka & Hive Lakehouse. Be the first to apply!
Related searches
- data engineer analytics Charlotte, NC
- data engineer manager Charlotte, NC
- remote data engineer Charlotte, NC
- junior data engineer remote Charlotte, NC
- senior cloud data engineer Charlotte, NC
- data platform engineer Charlotte, NC
- data infrastructure engineer Charlotte, NC
- aws data engineer Charlotte, NC
- director data engineering Charlotte, NC
- big data developer Charlotte, NC