Big Data /Hadoop/Kafka - Platform Administrator
My3Tech Inc
Big Data /Hadoop/Kafka - Platform Administrator Austin, TX (Hybrid) 12 Months Contract Person will be responsible to perform Big Data Platform Administration and Engineering activities on multiple Hadoop, Kafka, Hbase and Spark clusters Work on Performance Tuning and Increase Operational efficiency on a continuous basis Monitor health of the platforms and generate performance reports and monitor and provide continuous improvements Working closely with development, engineering, and operation teams, jointly work on key deliverables ensuring production scalability and stability Develop and enhance platform best practices Ensure the Hadoop platform can effectively meet performance & SLA requirements Responsible for Big Data Production environment which includes Hadoop (HDFS and YARN), Hive, Spark, Livy, SOLR, Oozie, Kafka, Airflow, Nifi, Hbase etc. Perform optimization, debugging and capacity planning of a Big Data cluster Perform security remediation, automation and selfheal as per the requirement Hands on experience in Hadoop Admin, Hive, Spark, Kafka, experience in maintaining, optimization, issue resolution of Big Data large scale clusters, supporting Business users and Batch process Hands-on experience No SQL Databases HBASE is plus Prior experience in Linux / Unix OS Services, Administration, Shell, awk scripting is a plus Excellent oral and written communication, analytical and problem-solving skills Self-driven, ability to work independently and as part of a team with proven track record My3Tech Inc
- ...Full time role)Location - Austin - Texas (on-site work from customer location)JD Experience with managing and optimizing Hadoop, Big Data and Kafka clusters in production environmentDemonstrated experience with AWS EMR , MSK and GCP Hadoop and Kafka on-prem & cloud platformsProficient...Big dataFull time
- ...Middleware organization is seeking a Senior Kafka Platform Engineer with experience to lead the... ...ideal candidate combines deep Kafka administration expertise with a strong Java development... ...clusters, replication, disaster recovery, and data pipelines Hands-on experience with...SuggestedFull timeWork at office
$145k - $165k
...company delivering cloud, AI, data, and enterprise solutions... ...: Senior Data Engineer - Hadoop Location: 100% Remote (U.S.... ...processing pipelines and analytics platforms on Hadoop and related big-data ecosystems. In this... ...data platforms such as Kafka, Spark Streaming, or Flink....Big dataFull timeH1bLocal areaRemote workVisa sponsorship- ...skills Past experience and exposure to ETL and data warehouse projectsExperience with Spark,... ....At least 3 years of experience in Big Data space.Complex High Volume High Velocity... ...projects end to end delivery experienceStrong Hadoop - Hive/PIG/MAP REDUCE/SQOOP/OOZIECandidate...Big data
- ...- Austin, TX (Day 1 Onsite)Employment Type - FTEJob Description:Experience with Python and Java.Experience with Big Data technologies such as Hadoop, Kafka, and Spark.Experience with Generative AI or Generative AI tools is preferred.Technology Expertise6+ months of experience...Big dataFull time
$110.7k - $171.8k
...DescriptionWe are seeking a highly motivated Hadoop Engineer with strong development skills and hands-on experience in Big Data platforms. The ideal candidate will be responsible... ...solutions.Perform engineering and administration duties for Big Data platforms built on open...Big dataFull timeWork experience placementWork at officeLocal area$143.5k - $212.85k
...completion of payments on our platform on behalf of our customers.We... ...Design, implement and operate data infrastructure’s initiatives to... ...applications with AWS SQS, Apache Kafka etc- Demonstrable ability to... ...Bash)Hands-on experience with big data operations including, but...Big dataFull timeWork at officeLocal areaImmediate startFlexible hours- ...applications with advanced shell scripting, and knowledge in data analysis within databases. Additionally, the candidate should have experience building high-performance Big Data and streaming solutions using Kafka and Hadoop. Must have strong experience working in production...Big dataFull time
- ...engineering with strong skills in parallel data processing, data flows, REST APIs... .../Scala.Strong understanding of Hadoop fundamentals.Must have experience working on Big Data Processing Frameworks and... ...Spark Streaming, Spark SQL, and Kafka is a plus.Experience to Financial...Big dataWork experience placement
- ...Create and optimize SQL queries and ensure efficient data retrieval for large datasets. Strong SQL and experience... ...as well as in a team. ~ Familiarity with other big data technologies (e.g., Hadoop, Spark, Kafka) is a plus. Highly beneficial: Experience...Big dataRemote work
- ...astounding quality and administrations through industry best practices... ...Business Intelligence, Data Management, SOA, BPM,... ...in working on big data systems and technologies... ...experience in the Hadoop platform· Hands on experience with Spark, Kafka, Cassandra and HBase preferred...Big dataWorldwide
- Big Data Technical Lead Location: Austin, Texas Position: Fulltime Work... ...stack Big Data project on HDP platform. Hands-on experience in Spark, Python, Hive and Kafka. Agile with good knowledge of relational... ...experience in at least one Hadoop distributor like Hortonworks...Big dataFull timeWork experience placement
- Job DescriptionDUTIES: Communicate and maintain Master Data, Metadata, Data Management Repositories, Logical Data... ..., C++, and Scala. Two (2) years of experience with: Big Data Tools including Hadoop, Spark, and Kafka; Advanced SQL and NoSQL databases, including Postgres...Big dataFull timeWork at officeLocal areaRemote workWork from home
- ...Spark, and the Cloudera Hadoop Ecosystem to design and develop large-scale data processing applications.... ...optimization for handling big data workloads. Key... ...HDFS, Hive, Impala, HBase, Kafka, and Sqoop . Design and... ...bottlenecks in Spark and Cloudera platforms. Collaboration & Data...Big dataContract work
- A Big Data Engineer develops and manages large-scale data processing systems that enable... ...analytics initiatives. Skills Required Hadoop Kafka SQL Python Java Scala Data Warehousing... ...design and maintain high-performance data platforms capable of processing structured and...Big data
- ...Java, Apache Spark, and the Cloudera Hadoop Ecosystem to design and develop large-scale data processing applications. The ideal... ...optimization for handling big data workloads. Required Skills &... ...such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop. Experience building and...Big dataFixed term contractLocal area
- ...build our advertising platform. The Apple Ads engineering... ...operates large-scale data systems that process and... ...such as Apache Spark, Kafka, Java/Scala, cloud storage... ...software around big-data processing frameworks... ...technologies such as Kafka, Hadoop, S3/object storage, or...Big dataContract work
$70 - $75 per hour
...exclusive features. Job Details Position: Data Engineer III Location: Austin, Texas Duration... ...as Python, Java, or Scala. Experience with big data technologies like Hadoop, Spark, or Kafka. Familiarity with cloud platforms such as AWS, Azure, or Google Cloud. Excellent...Big dataHourly payFull timeContract work$195k - $290k
...advanced AI-native platform. We work on large scale... ....About the Role:Our Data Platform group at... ...technology in the Apache Hadoop ecosystem: Spark, Kafka, Hive/Iceberg/Delta... ...with multiple big data frameworks in general... ...with Linux administration tools.Proven experience...Big dataFull timeWork experience placementWork at officeLocal areaRemote work- ...Talend, Best Practices and TroubleshootingWorking knowledge of Talend Data Integration tool.Exposure to Other Talend Product Suites.Experience with Core Java development is a plusExperience with Hadoop and big data technology is a plusExperience with design and...Big data
- ...objectives. Collaborate with cross-functional teams including data science, software engineering, and product management to... ...architecture, and data pipeline design. Experience with big data platforms such as Hadoop, Spark, and Hive. Experience in cloud platforms like AWS/...Big data
- Texas Attorney General seeks a senior Relativity administrator to lead the Relativity One tenant, spanning workspace design, template management... .... The role blends business analysis with hands-on platform configuration and troubleshooting to support litigation workflows...
- ...PowerShell (advanced), Google Apps Script (advanced), Email Security Platforms (advanced) Contract Type W2 Only Duration 6+ Months Location... ...their secure integration into workflows. Automate routine administrative tasks using scripting and APIs. Must-Have Skills Proven...Contract work
- The role of a ServiceNow Platform Administrator involves managing and maintaining the ServiceNow platform to ensure its optimal performance and... ...platform usage, license allocations, and performance. Support data driven decision making . Minimum Qualifications Bachelor's...Contract workWork at office
- ...Pioneering massively parallel data-intensive analytic processing,... ...insights from the biggest of big data.Join us to do the best work... ...engineering, product, and platform teams to enable AI at scale.scale... ...Expert-level command over PySpark, Kafka, data lakehouses (Apache...Big data
- BDE Platform Engineering & Support Location: Austin, TX - 100% Onsite... ...complex issues with MapR/Hadoop ecosystems such as Hive/... ...Platform: HPE/MapR Hadoop (Big Data), Programming: Python, UNIX... ...experience in Big Data platform administration / management. Good knowledge...Big dataFull timeShift work
- ...architectures. You'll work closely with data engineers, architects, and DevOps... ...and Python.Build and enhance data platform components to support data ingestion... ....Familiarity with data platforms or big data technologies (e.g., Kafka, Spark, Flink, Airflow, or similar)...Big data
- ...PalankiCompany: SRI Tech SolutionsJob Title: Data Engineer (Snowflake & Python)-... ....Familiarity with cloud platforms (AWS, Azure, or GCP) and data... ...Airflow or Prefect.Knowledge of other big data technologies such as Databricks, Spark, or Kafka.Familiarity with REST APIs and...Big dataFull time
- ...the first end-to-end private AI platform. Enterprises and Governments use webAI to bring AI to their data, powering specialized... ...the underlying assumption that big data is the key to unlocking the... ...Knowledge of Big Data technologies (Hadoop, Spark).Familiarity with...Big dataLive outWork at officeLocal areaRemote work
- Data Scientist - AV Metrics & Evaluation Analytics Austin, Texas About the team Our team is dedicated to advancing the future... ...model evaluation, feature engineering). Familiarity with big data tools (Spark, Hadoop, MapReduce). Knowledge of traffic regulations or...Big dataRemote workRelocation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data /Hadoop/Kafka - Platform Administrator. Be the first to apply!

