Big Data Developer
eNcloud Services LLC
Big Data Developer
eNcloud Services LLC, a Katy, TX based IT solutions firm. Multiple openings for Big Data Developer.
Job Duties and Responsibilities:
- Build processes that support data transformation, data structures, metadata, dependency and workload management
- Build and implement data ingestion and curation process developed using Big data tools such as Spark (Scala/python), Hive, Spark, HDFS, Sqoop, Hbase, Kerberos, Sentry and Impala etc.
- Handle ingestion of huge volumes data from various platforms for Analytics needs and writing high-performance, reliable and maintainable ETL code
- Strong SQL knowledge and data analysis skills for data anomaly detection and data quality assurance.
- Write shell scripts. Complex SQL queries, Hadoop commands and Git.
- Create Database, Schemas, Hive tables (External and Managed) with various file formats (Orc, Parquet, Avro and Text etc.)
- Monitor performance of production jobs and advising any necessary infrastructure changes.
- Work on Code version using Bitbucket and CI/CD pipeline.
Requirements:
- Bachelor's degree in Computer Science, IT, Engg or related with at least 60 months of experience.
- Travel and relocation to various unanticipated client locations throughout the United States may be required.
Equal Opportunity Employer.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Big Data Developer in Katy, TX vacancy
- ...where fun can’t lose! What You Will Work OnIn this role, you shape data science solutions that support enterprise real estate decisions... ...problems, prepare and integrate diverse enterprise data, develop and validate models, and support deployment, monitoring, and adoption...SuggestedFull timeWork at office
Academy Sports + Outdoors
Katy, TX1 day ago - Job Title: Data Analytics/CJA Consultant Location: Katy, TX - 4 days a week onsite... ...within the Adobe Experience Platform (AEP). Develop comprehensive measurement strategies to ensure... .../ Power BI) • Experience with Google Big Query and creating data ingestion pipelines...Big dataWork experience placement
Scadea
Katy, TX7 days ago - ...We have a Sr. Manager, Data Analytics Implementation position. Expected Start Date:... ...within the Adobe Experience Platform (AEP). Develop comprehensive measurement strategies to... ...Looker / Power BI) Experience with Google Big Query and creating data ingestion...Big dataWork experience placementWork at office
Comtello
Katy, TX3 days ago - ...! What You Will Work On In this role, you shape the enterprise data platform that teams rely on for secure, scalable, and dependable... ...platforms, including Google Cloud Platform (GCP) Experience developing and supporting data orchestration, streaming technologies, CI/CD...SuggestedFull timeWork at officeFlexible hours
Academy Sports + Outdoors
Katy, TX2 days ago - INVISTA is seeking an Operations System Engineer to enhance operational excellence by building data pipelines and supporting industrial analytics across its global manufacturing network. You will leverage AVEVA PI, Seeq, Snowflake and related technologies to convert raw...SuggestedFlexible hours
- Academy Sports + Outdoors is looking for an AI Specialist to develop AI agents and assistants using Microsoft Copilot Studio and related tools. This role requires a Bachelor's degree in Computer Science and at least 4 years of experience in AI solution development. The...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Developer. Be the first to apply!
