Big Data Engineer
Keylent Inc
Big Data EngineerVisa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp or 3rd Parties: Yes SO#000452348623 Austin, TXSkill Description - Hadoop, Kafka, Hbase, Spark, big data adminEssential Functions:Perform Big Data Platform Administration and Engineering activities on multiple Hadoop, Kafka, Hbase, and Spark clustersWork on Performance Tuning and Increase Operational efficiency on a continuous basisMonitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvementsWorking closely with development, engineering, and operation teams jointly work on key deliverables ensuring production scalability and stabilityDevelop and enhance platform best practicesEnsure the Hadoop platform can effectively meet performance & SLA requirementsResponsible for Big Data Production environment which includes Hadoop (HDFS and YARN), Hive, Spark, Livy, SOLR, Oozie, Kafka, Airflow, Nifi, Hbase etcPerform optimization, debugging, and capacity planning of a Big Data clusterPerform security remediation, automation, and self heal as per the requirementQualifications:Basic Qualifications:2 years of work experience with a Bachelor's Degree or an Advanced DegreeHands on Experience in Hadoop Admin, Hive, Spark, Kafka is mustPreferred Qualifications:Minimum 3 years of work experience in maintaining, optimization, issue resolution of Big Data large scale clusters supporting Business users and Batch processHands-on Experience No SQL Databases HBASE is plusPrior Experience in Linux / Unix OS Services Administration Shell awk scripting is a plusExcellent oral and written communication and presentation skillsAnalytical and problem solving skillsSelf-driven Ability to work independently and as part of a team with proven track recordExperience on Hortonworks distribution or Open Source preferredWork Hours: Incumbent must make themselves available during core business hours. Occasional weekend and evening hours needed on a rotational basis for operational support.Travel Requirements: This position requires the incumbent to travel for work 5% of the time.Physical Requirements: This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone frequently, operate standard office equipment such as telephones and computers, and reach with hands and arms.
- ...GorusuCompany: SRI Tech SolutionsRole: Applied Data Scientist/ Data Science EngineerLocation:... ...productsCollaborate with software engineers, business stakeholders and product owners... ...data scientists is a plusExperience with Big Data technologies and/or software development...Big dataFull timeLocal areaRelocation3 days per week
$100k - $115k
Role: Data EngineerWho You’ll Work WithAt Slalom we co-create custom software, data, AI... ...on injecting intelligence into products, engineering systems that support learning and insight... ...scalable, secure, cloud-native platforms.* Big Data Platforms (Dataproc, Apache Spark)*...Big dataTemporary workWork at officeLocal areaFlexible hours$116.2k - $229.1k
Position Summary Join Deloitte’s AI & Engineering practice and help organizations transform... ...technology platforms, modernize data environments, and unlock value through innovation... ...Lead: Evaluate, pilot, and integrate new big data and analytics technologies, ensuring...Big dataLocal areaVisa sponsorship- ...Contract Based Data EngineerRole: Data EngineerLocation: Denver CO or Austin TX (Onsite)Hire Type: ContractClient: Wester UnionShould... ...multiple priorities in a fast-paced environmentYou will work with big data sets to build forecasts, attribution models, content and engagement...Big dataContract work
- ...WiproContact: Surendra PenumalaCompany: SRI Tech SolutionsJob Title: Data Engineer (Snowflake & Python)- DBTLocation: Day 1 Sunnyvale, CA or... ...orchestration tools like Airflow or Prefect.Knowledge of other big data technologies such as Databricks, Spark, or Kafka.Familiarity...Big dataFull time
- ...on-site, dedicated Candidate, with skills and expertise as described in below requirement. Responsibilities: As a Senior Data Engineer, you will help design, enhance and build solutions dealing with real-time data in a fast-paced environment working with/on...Big dataFull timeWork experience placement
- ...Data EngineerWe are looking for passionate data engineers to join our growing Data and Analytics team. Join this exciting journey in modernizing our Advisor solutions... ...Services, as well as PowerBI.Experience with other Big Data tools such as Spark, Snowflake, and...Big dataWork at office
$154.6k - $209.1k
...Security Experiences (ASE) organization is the data intelligence backbone of Amazon Security.... ...infrastructure management scripts. Our engineers work directly with source systems across... ...qualification - Experience with big data technologies such as: Hadoop, Hive,...Big dataTemporary workFlexible hours- ...Principal Data EngineerLocation: Fort Mill or Austin (Hybrid)We are looking for a skilled Data Engineer to join our team and help build robust, scalable, and efficient data pipelines... ..., Docker, or Kubernetes.Knowledge of big data tools such as Apache Kafka or Airflow....Big data
- ...Senior Data Engineer With Databricks Remote, Anywhere in the Continental US Due to the nature of the role, this position requires U.S... ...technology that brings together the very best consultants from the big data, machine learning, and software modernization space....Big dataFull timeImmediate startRemote work
- ...Location: Remote We are seeking an experienced Data Engineer to support challenging data engineering, data management, and analytics... ...since we started in 2006! We specialize in everything data from big data to data science, data engineering, software engineering,...Big dataTemporary workLocal areaRemote work
$89.95k
...Data Engineer IIDell Medical SchoolAll Applicants40Exempt from FLSAImmediatelyExpected to ContinueAUSTIN, TXGeneral NotesData Engineer II is... ...Engineer II to troubleshoot and optimize across the technology stack.Big Data Processing: Proficiency with big data frameworks such as...Big dataWork at officeRemote work- ...streamers around the world while gaining meaningful experience across a variety of disciplines.About the teamRoku's Data Engineering team develops a world-class big data platform so internal and external customers can leverage data to grow their businesses. Data Engineering...Big dataWork at officeLocal areaRemote workWorldwideMonday to ThursdayFlexible hours
- Cloudera Data Engineer (Data Migration & BI Modernization)Location: Remote, EST hoursEmployment Type: Project-based contractStart Date: October... ...with Cloudera, Hadoop ecosystem technologies, or similar big data platforms.* Experience migrating data from legacy/on-premises...Big dataLocal areaRemote workFlexible hours
$65 - $69.72 per hour
...Job Description Job Description Data Science Engineer Job Details Data Science Engineer (Contract) Location: Austin TX, 78758 (Hybrid... ...Demonstrate expertise in ML techniques, SQL, Python/R, and big data frameworks. ~ Hands-on experience with AI agents and...Big dataHourly payContract work- ...environmental efforts. Join Apple, and help us lead the future generation of innovation. Description Join our Infrastructure Systems Engineering team within the Fleet Operations Engineering organization, where we design, build, and operate the large-scale Linux systems that...Big data
$117.8k - $168.3k
...Technologies is seeking a highly skilled AI Engineer to design, develop, and deploy advanced AI... ..., scalability, and real-world impact. Data Engineering & Processing - Work with large... ...deployments. Proficiency in working with big data technologies (Spark, Hadoop, SQL, NoSQL...Big dataFull timeRemote workFlexible hours$132.1k - $178.8k
Join the OTS Data ANCHOR team to build strategic data infrastructure powering Amazon's Operations... ..., Pantry, and Amazon Campus.As a Data Engineer, you will build and maintain scalable data... ...production-grade ETL/ELT pipelines and big data infrastructure supporting OTS...Big dataFull timeTemporary workSeasonal workWorldwideFlexible hours- ...architecture, design, and development of enterprise data quality, discovery, and governance... ...in AWS/GCP cloud environments using big data technologies, ensuring operational stability... ...leadership by mentoring and directing engineers and consultants, driving roadmap and...Big dataWork experience placementWork at officeLocal areaRemote workMonday to ThursdayFlexible hours1 day per week
$132.1k - $178.8k
...scalable solutions to flow huge amounts of data from production systems into the Redshift... .../ data lake infrastructure using AWS big data stack, Python, Redshift, QuickSight,... ...problems. Work with Product Managers, Engineering, BI Teams on day-to-day basis to support...Big dataFlexible hours$132.1k - $178.8k
...with a centralized team of 40+ technical specialists spanning data engineering, business intelligence, data science, and product development,... ...technologies such as AWS Redshift, S3, Hadoop, etc. ~ Experience with big data technologies such as: Hadoop, Hive, Spark, EMR ~6+...Big dataLocal areaFlexible hours$170k - $230k
...Stores Technology (WWGST) organization is seeking an experienced Data Engineering Manager to lead the Data Platform Management (DPM) team within... ...(such as Redshift, Teradata, Netezza, Spark or Hadoop based big data solution) experience- 5+ years of relational database...Big dataWorldwideFlexible hours- ...searching for a Senior Director, Enterprise Integrations and Data Engineering to oversee YETI’s Data Warehouse, Analytics Platforms, MDM, and... ...developing and maintaining large analytical data warehouses (BI/Big data) and a leader in technical problem solving and data...Big dataFull timeContract workLocal areaFlexible hours
$153.5k - $245.9k
...starts with you. Job Description As a Senior Consultant Data Engineer , you'll join our Value Added Services – Digital Marketing &... ...-scale, enterprise-class applications. • Solid experience in big data engineering, with working knowledge of Hadoop, Apache Spark...Big dataFull timeWork experience placementWork at officeLocal areaImmediate start$143.5k - $212.85k
...and our communities.Job Summary:The Venmo Data Infrastructure team supports Venmo's... ...stakeholders including the Executive, Product, Engineering and Analytics teams to assist with data-... ...Lambda)Hands-on experience with related big data infrastructure — AWS S3, AWS DMS, AWS...Big dataFull timeWork at officeLocal areaImmediate startFlexible hours- ...Job Description Job Description Data Engineer Employment Type: Full-Time, Mid-level Department: Business Intelligence CGS is... ...manipulate data (Python, R, SQL, SAS). -Strong knowledge of big data analysis and storage tools and technologies. -Strong understanding...Big dataFull timeFlexible hours
- ...Sr. Software Engineer (Data Solutions), IS&T Ai & Data Platforms Austin, Texas, United States Software and Services Do you want to help... ...experience on Cloud with databases like SnowFlake, Big Query or Cloudera ~ Programming experience with Python, Scala...Big dataWork experience placement
- ...Responsibilities Build tools and features for data processing, insights portals, data observability, data lineage, model hubs, and... ...applications or products is preferred. Working experience with big data technologies, data platforms, and distributed computing technologies...Big dataFull timeWork experience placement
- ...and systems to consolidate and analyze unstructured, diverse big data sources, producing actionable insights and solutions for client... ...Education Employer will accept a Master’s degree in Computer Science, Engineering, or a related technical field. #J-18808-LjbffrBig dataRemote work
- ...generation computing experiences—from AI and data centers, to PCs, gaming and embedded... ...Pipeline & Infrastructure:Collaborate with data engineering teams to design and maintain scalable... ..., or custom shell scripting.Leverage big data frameworks (e.g., Snowflake, Hadoop,...Big data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
- data engineer machine learning Austin, TX
- aws data engineer Austin, TX
- data systems engineer Austin, TX
- big data developer Austin, TX
- sr data engineer Austin, TX
- big data cloud engineer Austin, TX
- finance data engineer Austin, TX
- junior big data engineer Austin, TX
- entry level data engineer Austin, TX
- sr information security engineer Austin, TX



