Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

Keylent Inc

Big Data EngineerVisa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp or 3rd Parties: Yes SO#000452348623 Austin, TXSkill Description - Hadoop, Kafka, Hbase, Spark, big data adminEssential Functions:Perform Big Data Platform Administration and Engineering activities on multiple Hadoop, Kafka, Hbase, and Spark clustersWork on Performance Tuning and Increase Operational efficiency on a continuous basisMonitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvementsWorking closely with development, engineering, and operation teams jointly work on key deliverables ensuring production scalability and stabilityDevelop and enhance platform best practicesEnsure the Hadoop platform can effectively meet performance & SLA requirementsResponsible for Big Data Production environment which includes Hadoop (HDFS and YARN), Hive, Spark, Livy, SOLR, Oozie, Kafka, Airflow, Nifi, Hbase etcPerform optimization, debugging, and capacity planning of a Big Data clusterPerform security remediation, automation, and self heal as per the requirementQualifications:Basic Qualifications:2 years of work experience with a Bachelor's Degree or an Advanced DegreeHands on Experience in Hadoop Admin, Hive, Spark, Kafka is mustPreferred Qualifications:Minimum 3 years of work experience in maintaining, optimization, issue resolution of Big Data large scale clusters supporting Business users and Batch processHands-on Experience No SQL Databases HBASE is plusPrior Experience in Linux / Unix OS Services Administration Shell awk scripting is a plusExcellent oral and written communication and presentation skillsAnalytical and problem solving skillsSelf-driven Ability to work independently and as part of a team with proven track recordExperience on Hortonworks distribution or Open Source preferredWork Hours: Incumbent must make themselves available during core business hours. Occasional weekend and evening hours needed on a rotational basis for operational support.Travel Requirements: This position requires the incumbent to travel for work 5% of the time.Physical Requirements: This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone frequently, operate standard office equipment such as telephones and computers, and reach with hands and arms.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Austin, TX vacancy
  •  ...GorusuCompany: SRI Tech SolutionsRole: Applied Data Scientist/ Data Science EngineerLocation:...  ...productsCollaborate with software engineers, business stakeholders and product owners...  ...data scientists is a plusExperience with Big Data technologies and/or software development... 
    Big data
    Full time
    Local area
    Relocation
    3 days per week

    SRI Tech

    Austin, TX
    3 days ago
  • $100k - $115k

    Role: Data EngineerWho You’ll Work WithAt Slalom we co-create custom software, data, AI...  ...on injecting intelligence into products, engineering systems that support learning and insight...  ...scalable, secure, cloud-native platforms.* Big Data Platforms (Dataproc, Apache Spark)*... 
    Big data
    Temporary work
    Work at office
    Local area
    Flexible hours

    Slalom

    Austin, TX
    10 hours ago
  • $116.2k - $229.1k

    Position Summary Join Deloitte’s AI & Engineering practice and help organizations transform...  ...technology platforms, modernize data environments, and unlock value through innovation...  ...Lead: Evaluate, pilot, and integrate new big data and analytics technologies, ensuring... 
    Big data
    Local area
    Visa sponsorship

    Deloitte

    Austin, TX
    3 hours ago
  •  ...Contract Based Data EngineerRole: Data EngineerLocation: Denver CO or Austin TX (Onsite)Hire Type: ContractClient: Wester UnionShould...  ...multiple priorities in a fast-paced environmentYou will work with big data sets to build forecasts, attribution models, content and engagement... 
    Big data
    Contract work

    Argyle Infotech

    Austin, TX
    4 days ago
  •  ...WiproContact: Surendra PenumalaCompany: SRI Tech SolutionsJob Title: Data Engineer (Snowflake & Python)- DBTLocation: Day 1 Sunnyvale, CA or...  ...orchestration tools like Airflow or Prefect.Knowledge of other big data technologies such as Databricks, Spark, or Kafka.Familiarity... 
    Big data
    Full time

    SRI Tech

    Austin, TX
    3 days ago
  •  ...on-site, dedicated Candidate, with skills and expertise as described in below requirement. Responsibilities: As a Senior Data Engineer, you will help design, enhance and build solutions dealing with real-time data in a fast-paced environment working with/on... 
    Big data
    Full time
    Work experience placement

    PEOPLECORP AMERICA INC

    Austin, TX
    1 day ago
  •  ...Data EngineerWe are looking for passionate data engineers to join our growing Data and Analytics team. Join this exciting journey in modernizing our Advisor solutions...  ...Services, as well as PowerBI.Experience with other Big Data tools such as Spark, Snowflake, and... 
    Big data
    Work at office

    Software Technology Inc

    Austin, TX
    4 days ago
  • $154.6k - $209.1k

     ...Security Experiences (ASE) organization is the data intelligence backbone of Amazon Security....  ...infrastructure management scripts. Our engineers work directly with source systems across...  ...qualification - Experience with big data technologies such as: Hadoop, Hive,... 
    Big data
    Temporary work
    Flexible hours

    Amazon

    Austin, TX
    3 days ago
  •  ...Principal Data EngineerLocation: Fort Mill or Austin (Hybrid)We are looking for a skilled Data Engineer to join our team and help build robust, scalable, and efficient data pipelines...  ..., Docker, or Kubernetes.Knowledge of big data tools such as Apache Kafka or Airflow.... 
    Big data

    United IT

    Austin, TX
    4 days ago
  •  ...Senior Data Engineer With Databricks Remote, Anywhere in the Continental US Due to the nature of the role, this position requires U.S...  ...technology that brings together the very best consultants from the big data, machine learning, and software modernization space.... 
    Big data
    Full time
    Immediate start
    Remote work

    Data Surge

    Austin, TX
    17 hours ago
  •  ...Location: Remote We are seeking an experienced Data Engineer to support challenging data engineering, data management, and analytics...  ...since we started in 2006! We specialize in everything data from big data to data science, data engineering, software engineering,... 
    Big data
    Temporary work
    Local area
    Remote work

    Illumination Works

    Austin, TX
    17 hours ago
  • $89.95k

     ...Data Engineer IIDell Medical SchoolAll Applicants40Exempt from FLSAImmediatelyExpected to ContinueAUSTIN, TXGeneral NotesData Engineer II is...  ...Engineer II to troubleshoot and optimize across the technology stack.Big Data Processing: Proficiency with big data frameworks such as... 
    Big data
    Work at office
    Remote work

    UT Medicine

    Austin, TX
    3 days ago
  •  ...streamers around the world while gaining meaningful experience across a variety of disciplines.About the teamRoku's Data Engineering team develops a world-class big data platform so internal and external customers can leverage data to grow their businesses. Data Engineering... 
    Big data
    Work at office
    Local area
    Remote work
    Worldwide
    Monday to Thursday
    Flexible hours

    Roku

    Austin, TX
    5 days ago
  • Cloudera Data Engineer (Data Migration & BI Modernization)Location: Remote, EST hoursEmployment Type: Project-based contractStart Date: October...  ...with Cloudera, Hadoop ecosystem technologies, or similar big data platforms.* Experience migrating data from legacy/on-premises... 
    Big data
    Local area
    Remote work
    Flexible hours

    Slalom

    Austin, TX
    2 days ago
  • $65 - $69.72 per hour

     ...Job Description Job Description Data Science Engineer Job Details Data Science Engineer (Contract) Location: Austin TX, 78758 (Hybrid...  ...Demonstrate expertise in ML techniques, SQL, Python/R, and big data frameworks. ~ Hands-on experience with AI agents and... 
    Big data
    Hourly pay
    Contract work

    Cypress HCM

    Austin, TX
    a month ago
  •  ...environmental efforts. Join Apple, and help us lead the future generation of innovation. Description Join our Infrastructure Systems Engineering team within the Fleet Operations Engineering organization, where we design, build, and operate the large-scale Linux systems that... 
    Big data

    Apple

    Austin, TX
    5 days ago
  • $117.8k - $168.3k

     ...Technologies is seeking a highly skilled AI Engineer to design, develop, and deploy advanced AI...  ..., scalability, and real-world impact. Data Engineering & Processing - Work with large...  ...deployments. Proficiency in working with big data technologies (Spark, Hadoop, SQL, NoSQL... 
    Big data
    Full time
    Remote work
    Flexible hours

    Gainwell

    Austin, TX
    2 days ago
  • $132.1k - $178.8k

    Join the OTS Data ANCHOR team to build strategic data infrastructure powering Amazon's Operations...  ..., Pantry, and Amazon Campus.As a Data Engineer, you will build and maintain scalable data...  ...production-grade ETL/ELT pipelines and big data infrastructure supporting OTS... 
    Big data
    Full time
    Temporary work
    Seasonal work
    Worldwide
    Flexible hours

    Amazon

    Austin, TX
    3 days ago
  •  ...architecture, design, and development of enterprise data quality, discovery, and governance...  ...in AWS/GCP cloud environments using big data technologies, ensuring operational stability...  ...leadership by mentoring and directing engineers and consultants, driving roadmap and... 
    Big data
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours
    1 day per week

    Roku

    Austin, TX
    1 day ago
  • $132.1k - $178.8k

     ...scalable solutions to flow huge amounts of data from production systems into the Redshift...  .../ data lake infrastructure using AWS big data stack, Python, Redshift, QuickSight,...  ...problems. Work with Product Managers, Engineering, BI Teams on day-to-day basis to support... 
    Big data
    Flexible hours

    Jobleads-US

    Austin, TX
    3 days ago
  • $132.1k - $178.8k

     ...with a centralized team of 40+ technical specialists spanning data engineering, business intelligence, data science, and product development,...  ...technologies such as AWS Redshift, S3, Hadoop, etc. ~ Experience with big data technologies such as: Hadoop, Hive, Spark, EMR ~6+... 
    Big data
    Local area
    Flexible hours

    Jobleads-US

    Austin, TX
    1 day ago
  • $170k - $230k

     ...Stores Technology (WWGST) organization is seeking an experienced Data Engineering Manager to lead the Data Platform Management (DPM) team within...  ...(such as Redshift, Teradata, Netezza, Spark or Hadoop based big data solution) experience- 5+ years of relational database... 
    Big data
    Worldwide
    Flexible hours

    Amazon

    Austin, TX
    2 days ago
  •  ...searching for a Senior Director, Enterprise Integrations and Data Engineering to oversee YETI’s Data Warehouse, Analytics Platforms, MDM, and...  ...developing and maintaining large analytical data warehouses (BI/Big data) and a leader in technical problem solving and data... 
    Big data
    Full time
    Contract work
    Local area
    Flexible hours

    YETI COOLERS

    Austin, TX
    4 days ago
  • $153.5k - $245.9k

     ...starts with you. Job Description As a Senior Consultant Data Engineer , you'll join our Value Added Services – Digital Marketing &...  ...-scale, enterprise-class applications. • Solid experience in big data engineering, with working knowledge of Hadoop, Apache Spark... 
    Big data
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start

    VISA

    Austin, TX
    23 days ago
  • $143.5k - $212.85k

     ...and our communities.Job Summary:The Venmo Data Infrastructure team supports Venmo's...  ...stakeholders including the Executive, Product, Engineering and Analytics teams to assist with data-...  ...Lambda)Hands-on experience with related big data infrastructure — AWS S3, AWS DMS, AWS... 
    Big data
    Full time
    Work at office
    Local area
    Immediate start
    Flexible hours

    PayPal

    Austin, TX
    1 day ago
  •  ...Job Description Job Description Data Engineer  Employment Type: Full-Time, Mid-level Department: Business Intelligence   CGS is...  ...manipulate data (Python, R, SQL, SAS). -Strong knowledge of big data analysis and storage tools and technologies. -Strong understanding... 
    Big data
    Full time
    Flexible hours

    Contact Government Services, LLC

    Austin, TX
    3 days ago
  •  ...Sr. Software Engineer (Data Solutions), IS&T Ai & Data Platforms Austin, Texas, United States Software and Services Do you want to help...  ...experience on Cloud with databases like SnowFlake, Big Query or Cloudera ~ Programming experience with Python, Scala... 
    Big data
    Work experience placement

    Jobleads-US

    Austin, TX
    1 day ago
  •  ...Responsibilities Build tools and features for data processing, insights portals, data observability, data lineage, model hubs, and...  ...applications or products is preferred. Working experience with big data technologies, data platforms, and distributed computing technologies... 
    Big data
    Full time
    Work experience placement

    Apple

    Austin, TX
    8 days ago
  •  ...and systems to consolidate and analyze unstructured, diverse big data sources, producing actionable insights and solutions for client...  ...Education Employer will accept a Master’s degree in Computer Science, Engineering, or a related technical field. #J-18808-Ljbffr
    Big data
    Remote work

    DataJobs.com

    Austin, TX
    16 hours ago
  •  ...generation computing experiences—from AI and data centers, to PCs, gaming and embedded...  ...Pipeline & Infrastructure:Collaborate with data engineering teams to design and maintain scalable...  ..., or custom shell scripting.Leverage big data frameworks (e.g., Snowflake, Hadoop,... 
    Big data

    AMD

    Austin, TX
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!