Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data /Hadoop/Kafka - Platform Administrator

My3Tech Inc

Big Data /Hadoop/Kafka - Platform Administrator Austin, TX (Hybrid) 12 Months Contract Person will be responsible to perform Big Data Platform Administration and Engineering activities on multiple Hadoop, Kafka, Hbase and Spark clusters Work on Performance Tuning and Increase Operational efficiency on a continuous basis Monitor health of the platforms and generate performance reports and monitor and provide continuous improvements Working closely with development, engineering, and operation teams, jointly work on key deliverables ensuring production scalability and stability Develop and enhance platform best practices Ensure the Hadoop platform can effectively meet performance & SLA requirements Responsible for Big Data Production environment which includes Hadoop (HDFS and YARN), Hive, Spark, Livy, SOLR, Oozie, Kafka, Airflow, Nifi, Hbase etc. Perform optimization, debugging and capacity planning of a Big Data cluster Perform security remediation, automation and selfheal as per the requirement Hands on experience in Hadoop Admin, Hive, Spark, Kafka, experience in maintaining, optimization, issue resolution of Big Data large scale clusters, supporting Business users and Batch process Hands-on experience No SQL Databases HBASE is plus Prior experience in Linux / Unix OS Services, Administration, Shell, awk scripting is a plus Excellent oral and written communication, analytical and problem-solving skills Self-driven, ability to work independently and as part of a team with proven track record My3Tech Inc

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Big Data /Hadoop/Kafka - Platform Administrator in Austin, TX vacancy
  •  ...Full time role)Location - Austin - Texas (on-site work from customer location)JD Experience with managing and optimizing Hadoop, Big Data and Kafka clusters in production environmentDemonstrated experience with AWS EMR , MSK and GCP Hadoop and Kafka on-prem & cloud platformsProficient... 
    Big data
    Full time

    SRI Tech

    Austin, TX
    3 days ago
  •  ...Middleware organization is seeking a Senior Kafka Platform Engineer with experience to lead the...  ...ideal candidate combines deep Kafka administration expertise with a strong Java development...  ...clusters, replication, disaster recovery, and data pipelines Hands-on experience with... 
    Suggested
    Full time
    Work at office

    The Charles Schwab Corporation

    Austin, TX
    3 days ago
  • $145k - $165k

     ...company delivering cloud, AI, data, and enterprise solutions...  ...: Senior Data Engineer - Hadoop Location: 100% Remote (U.S....  ...processing pipelines and analytics platforms on Hadoop and related big-data ecosystems. In this...  ...data platforms such as Kafka, Spark Streaming, or Flink.... 
    Big data
    Full time
    H1b
    Local area
    Remote work
    Visa sponsorship

    JobCubby

    Round Rock, TX
    1 day ago
  •  ...skills Past experience and exposure to ETL and data warehouse projectsExperience with Spark,...  ....At least 3 years of experience in Big Data space.Complex High Volume High Velocity...  ...projects end to end delivery experienceStrong Hadoop - Hive/PIG/MAP REDUCE/SQOOP/OOZIECandidate... 
    Big data

    Sonsoft

    Austin, TX
    4 days ago
  •  ...- Austin, TX (Day 1 Onsite)Employment Type - FTEJob Description:Experience with Python and Java.Experience with Big Data technologies such as Hadoop, Kafka, and Spark.Experience with Generative AI or Generative AI tools is preferred.Technology Expertise6+ months of experience... 
    Big data
    Full time

    SRI Tech

    Austin, TX
    4 days ago
  • $110.7k - $171.8k

     ...DescriptionWe are seeking a highly motivated Hadoop Engineer with strong development skills and hands-on experience in Big Data platforms. The ideal candidate will be responsible...  ...solutions.Perform engineering and administration duties for Big Data platforms built on open... 
    Big data
    Full time
    Work experience placement
    Work at office
    Local area

    Visa

    Austin, TX
    5 days ago
  • $143.5k - $212.85k

     ...completion of payments on our platform on behalf of our customers.We...  ...Design, implement and operate data infrastructure’s initiatives to...  ...applications with AWS SQS, Apache Kafka etc- Demonstrable ability to...  ...Bash)Hands-on experience with big data operations including, but... 
    Big data
    Full time
    Work at office
    Local area
    Immediate start
    Flexible hours

    PayPal

    Austin, TX
    3 days ago
  •  ...applications with advanced shell scripting, and knowledge in data analysis within databases. Additionally, the candidate should have experience building high-performance Big Data and streaming solutions using Kafka and Hadoop. Must have strong experience working in production... 
    Big data
    Full time

    SRI Tech

    Austin, TX
    4 days ago
  •  ...engineering with strong skills in parallel data processing, data flows, REST APIs...  .../Scala.Strong understanding of Hadoop fundamentals.Must have experience working on Big Data Processing Frameworks and...  ...Spark Streaming, Spark SQL, and Kafka is a plus.Experience to Financial... 
    Big data
    Work experience placement

    Sonsoft

    Austin, TX
    1 day ago
  •  ...Create and optimize SQL queries and ensure efficient data retrieval for large datasets. Strong SQL and experience...  ...as well as in a team. ~ Familiarity with other big data technologies (e.g., Hadoop, Spark, Kafka) is a plus. Highly beneficial: Experience... 
    Big data
    Remote work

    AITA Consulting Services, Inc.

    Austin, TX
    2 days ago
  •  ...astounding quality and administrations through industry best practices...  ...Business Intelligence, Data Management, SOA, BPM,...  ...in working on big data systems and technologies...  ...experience in the Hadoop platform· Hands on experience with Spark, Kafka, Cassandra and HBase preferred... 
    Big data
    Worldwide

    USM Systems

    Austin, TX
    4 days ago
  • Big Data Technical Lead Location: Austin, Texas Position: Fulltime Work...  ...stack Big Data project on HDP platform. Hands-on experience in Spark, Python, Hive and Kafka. Agile with good knowledge of relational...  ...experience in at least one Hadoop distributor like Hortonworks... 
    Big data
    Full time
    Work experience placement

    ClifyX

    Austin, TX
    2 days ago
  • Job DescriptionDUTIES: Communicate and maintain Master Data, Metadata, Data Management Repositories, Logical Data...  ..., C++, and Scala. Two (2) years of experience with: Big Data Tools including Hadoop, Spark, and Kafka; Advanced SQL and NoSQL databases, including Postgres... 
    Big data
    Full time
    Work at office
    Local area
    Remote work
    Work from home

    General Motors

    Austin, TX
    1 day ago
  •  ...Spark, and the Cloudera Hadoop Ecosystem to design and develop large-scale data processing applications....  ...optimization for handling big data workloads. Key...  ...HDFS, Hive, Impala, HBase, Kafka, and Sqoop . Design and...  ...bottlenecks in Spark and Cloudera platforms. Collaboration & Data... 
    Big data
    Contract work

    Equiliem

    Austin, TX
    2 days ago
  • A Big Data Engineer develops and manages large-scale data processing systems that enable...  ...analytics initiatives. Skills Required Hadoop Kafka SQL Python Java Scala Data Warehousing...  ...design and maintain high-performance data platforms capable of processing structured and... 
    Big data

    myBridge Corporation

    Austin, TX
    4 days ago
  •  ...Java, Apache Spark, and the Cloudera Hadoop Ecosystem to design and develop large-scale data processing applications. The ideal...  ...optimization for handling big data workloads. Required Skills &...  ...such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop. Experience building and... 
    Big data
    Fixed term contract
    Local area

    E-Solutions

    Austin, TX
    2 days ago
  •  ...build our advertising platform. The Apple Ads engineering...  ...operates large-scale data systems that process and...  ...such as Apache Spark, Kafka, Java/Scala, cloud storage...  ...software around big-data processing frameworks...  ...technologies such as Kafka, Hadoop, S3/object storage, or... 
    Big data
    Contract work

    Socket.dev

    Austin, TX
    3 days ago
  • $70 - $75 per hour

     ...exclusive features. Job Details Position: Data Engineer III Location: Austin, Texas Duration...  ...as Python, Java, or Scala. Experience with big data technologies like Hadoop, Spark, or Kafka. Familiarity with cloud platforms such as AWS, Azure, or Google Cloud. Excellent... 
    Big data
    Hourly pay
    Full time
    Contract work

    PTR Global

    Austin, TX
    4 days ago
  • $195k - $290k

     ...advanced AI-native platform. We work on large scale...  ....About the Role:Our Data Platform group at...  ...technology in the Apache Hadoop ecosystem: Spark, Kafka, Hive/Iceberg/Delta...  ...with multiple big data frameworks in general...  ...with Linux administration tools.Proven experience... 
    Big data
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    CrowdStrike

    Austin, TX
    5 days ago
  •  ...Talend, Best Practices and TroubleshootingWorking knowledge of Talend Data Integration tool.Exposure to Other Talend Product Suites.Experience with Core Java development is a plusExperience with Hadoop and big data technology is a plusExperience with design and... 
    Big data

    Sonsoft

    Austin, TX
    4 days ago
  •  ...objectives. Collaborate with cross-functional teams including data science, software engineering, and product management to...  ...architecture, and data pipeline design. Experience with big data platforms such as Hadoop, Spark, and Hive. Experience in cloud platforms like AWS/... 
    Big data

    Omega Solutions Inc

    Austin, TX
    4 days ago
  • Texas Attorney General seeks a senior Relativity administrator to lead the Relativity One tenant, spanning workspace design, template management...  .... The role blends business analysis with hands-on platform configuration and troubleshooting to support litigation workflows... 

    Texas Attorney General

    Austin, TX
    3 days ago
  •  ...PowerShell (advanced), Google Apps Script (advanced), Email Security Platforms (advanced) Contract Type W2 Only Duration 6+ Months Location...  ...their secure integration into workflows. Automate routine administrative tasks using scripting and APIs. Must-Have Skills Proven... 
    Contract work

    Akraya, Inc.

    Austin, TX
    2 days ago
  • The role of a ServiceNow Platform Administrator involves managing and maintaining the ServiceNow platform to ensure its optimal performance and...  ...platform usage, license allocations, and performance. Support data driven decision making . Minimum Qualifications Bachelor's... 
    Contract work
    Work at office

    ASM Research, An Accenture Federal Services Company

    Austin, TX
    2 days ago
  •  ...Pioneering massively parallel data-intensive analytic processing,...  ...insights from the biggest of big data.Join us to do the best work...  ...engineering, product, and platform teams to enable AI at scale.scale...  ...Expert-level command over PySpark, Kafka, data lakehouses (Apache... 
    Big data

    Dell Technologies

    Round Rock, TX
    18 hours ago
  • BDE Platform Engineering & Support Location: Austin, TX - 100% Onsite...  ...complex issues with MapR/Hadoop ecosystems such as Hive/...  ...Platform: HPE/MapR Hadoop (Big Data), Programming: Python, UNIX...  ...experience in Big Data platform administration / management. Good knowledge... 
    Big data
    Full time
    Shift work

    Zortech Solutions

    Austin, TX
    2 days ago
  •  ...architectures. You'll work closely with data engineers, architects, and DevOps...  ...and Python.Build and enhance data platform components to support data ingestion...  ....Familiarity with data platforms or big data technologies (e.g., Kafka, Spark, Flink, Airflow, or similar)... 
    Big data

    SRI Tech

    Austin, TX
    4 days ago
  •  ...PalankiCompany: SRI Tech SolutionsJob Title: Data Engineer (Snowflake & Python)-...  ....Familiarity with cloud platforms (AWS, Azure, or GCP) and data...  ...Airflow or Prefect.Knowledge of other big data technologies such as Databricks, Spark, or Kafka.Familiarity with REST APIs and... 
    Big data
    Full time

    SRI Tech

    Austin, TX
    3 days ago
  •  ...the first end-to-end private AI platform. Enterprises and Governments use webAI to bring AI to their data, powering specialized...  ...the underlying assumption that big data is the key to unlocking the...  ...Knowledge of Big Data technologies (Hadoop, Spark).Familiarity with... 
    Big data
    Live out
    Work at office
    Local area
    Remote work

    webAI

    Austin, TX
    3 days ago
  • Data Scientist - AV Metrics & Evaluation Analytics Austin, Texas About the team Our team is dedicated to advancing the future...  ...model evaluation, feature engineering). Familiarity with big data tools (Spark, Hadoop, MapReduce). Knowledge of traffic regulations or... 
    Big data
    Remote work
    Relocation

    Avride

    Austin, TX
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data /Hadoop/Kafka - Platform Administrator. Be the first to apply!