Big Data Engineer
RIT Solutions, Inc.
Job Description
Candidate will be responsible for designing and developing complex requirements to accomplish business outcomes. The selected candidate should have hands-on Hadoop experience and an excitement for solving complex problems. This developer will be part of a collaborative team and will provide direction to team members. Experience in an Agile based programming environment is a plus Position Summary
• Key responsibilities of the role include ensuring that software is developed to meet functional, non-functional, and compliance requirements. This role ensures solutions are well designed with maintainability/ease of integration and testing built-in from the outset. They possess strong proficiency in development and testing practices common to the industry, and have extensive experience of using design and architectural patterns. A Software Engineer is an individual contributor to a team.
• Contributes to story refinement/defining requirements.
• Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle.
• Performs spike/proof of concept as necessary to mitigate risk or implement new ideas.
• Codes solutions and unit tests to deliver a requirement/story per the defined acceptance criteria and compliance requirements.
• Designs/develops/maintains automated test suites (integration, regression, performance). Required Qualifications
• Strong database and SQL skills
• Good understanding on Hadoop Big Data Eco system
• Experience writing Shell scripts in LINUX or Unix
• Experience with Autosys
• Hadoop/Spark - Running Pig and Hive Queries, analyzing data with Hive, Hands on experience with Oozie, Importing and exporting the data using Sqoop from HDFS to Relational Database, Developing MapReduce Program to format the data
• Good communication skills
• Familiarity with CI/CD tools such as Ansible, Jenkins, and Artifactory
Candidate will be responsible for designing and developing complex requirements to accomplish business outcomes. The selected candidate should have hands-on Hadoop experience and an excitement for solving complex problems. This developer will be part of a collaborative team and will provide direction to team members. Experience in an Agile based programming environment is a plus Position Summary
• Key responsibilities of the role include ensuring that software is developed to meet functional, non-functional, and compliance requirements. This role ensures solutions are well designed with maintainability/ease of integration and testing built-in from the outset. They possess strong proficiency in development and testing practices common to the industry, and have extensive experience of using design and architectural patterns. A Software Engineer is an individual contributor to a team.
• Contributes to story refinement/defining requirements.
• Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle.
• Performs spike/proof of concept as necessary to mitigate risk or implement new ideas.
• Codes solutions and unit tests to deliver a requirement/story per the defined acceptance criteria and compliance requirements.
• Designs/develops/maintains automated test suites (integration, regression, performance). Required Qualifications
• Strong database and SQL skills
• Good understanding on Hadoop Big Data Eco system
• Experience writing Shell scripts in LINUX or Unix
• Experience with Autosys
• Hadoop/Spark - Running Pig and Hive Queries, analyzing data with Hive, Hands on experience with Oozie, Importing and exporting the data using Sqoop from HDFS to Relational Database, Developing MapReduce Program to format the data
• Good communication skills
• Familiarity with CI/CD tools such as Ansible, Jenkins, and Artifactory
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Plano, TX vacancy
- ...Big Data Engineer Location: Costa Mesa, CA or Allen, TX Duration: Fulltime Job Description: Big Data Engineer Must Have Technical/Functional Skills: Big Data, PySpark, AWS (EMR, SageMaker, DunamoDB) Roles & Responsibilities: Strong hands-on experience...Big dataFull timeImmediate startRelocation
JConnect Infotech
Parker, TX18 hours ago - ...Job Title: Data Engineer Location: TechM US Texas Plano Years of Experience: 7 10 Years Job Summary: We are seeking a highly skilled Data Engineer with a strong background in GCP Data Testing to join our team as a contractor. The ideal candidate will have 7...Big dataFor contractors
Yantran LLC
Plano, TX4 days ago - ...Role: Big Data Engineer Location: Plano, TX (Onsite) Client: Artech / JPMorgan Chase Mode: W2 Contract / Full Time Opening Job Description: Job Family Description: Expert in in AWS and Client Azure technology and design techniques as...Big dataFull timeContract workWork experience placement
Exaways Corporation
Plano, TX1 day ago - ...Sr. Big Data Engineer Roles We are looking for Sr. Big Data Engineer roles with the required skills are: 1. Big Data Engineer 2. Comfortable with Data Warehousing & Data Lake architecture 3. Spark | Strong Python 4. Strong Snowflake 5. Hadoop experience desired...Big data
STIAOS Technologies
Plano, TX3 days ago - ...Job TitleRequired Skills:Strong in SQL and Python, 8+ years' experience.Experience with big data frameworks (i.e. Hadoop and Spark), 5+ years' experience.Experience building automated data pipelines, 5+ years of experience.Experience performing data analysis and data...Big data
Syntricate Technologies
Richardson, TX3 days ago - ...store and utilize structured and unstructured data from internal and external sources.... ...artificial intelligence, machine learning and big-data techniques to cleanse, organize and... ...storage to accommodate ongoing needs.Why TI?Engineer your future. We empower our employees to...Big dataInternshipLocal area
$82.42k - $126.6k
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...with Hadoop ecosystem (Cloudera). Experience in working with a Big Data implementation in production environment. Experience with...Big dataFull timeTemporary workRelocation- Texas Instruments is seeking a recent graduate for its TMG Development program in Richardson, TX. You will design, build and oversee data architecture, data pipelines, and systems to capture, store and transform data from multiple sources. The role emphasizes AI/ML...Big data
- ...Our client is currently seeking a Data Engineer with strong experience in data modeling, data warehousing, and cloud-based data platforms.... ...experience with AWS services and a strong foundation in SQL and big data technologies. You will play a key role in building and optimizing...Big data
The Judge Group
Plano, TX1 day ago - ...experiences. Role Summary: We are seeking a highly skilled Senior Data Engineer to design, build, and optimize enterprise-scale data platforms.... ...and PySpark Experience with distributed data processing and big data platforms Strong analytical mindset focused on building...Big dataHourly payDaily paidFull timeContract work
Cinemark
Plano, TX2 days ago $86.8k - $165.2k
...YOU will do:Design, build, and maintain data pipelines that ingest, transform, and deliver... ..., images, documents, logs, and engineering artifacts.Engineer data solutions that can... ...software platforms such as Internet of Things, big data, artificial intelligence, and blockchain...Big dataContract workTemporary workWork experience placementWork at officeRemote workFlexible hours$120k - $225k
...experience insurance.Our Global Cybersecurity Data and Analytics team is tasked with... ...innovative, collaborative Principal Data Engineer to help build and grow our Data and Analytics... ...Collects, cleans, and transforms traditional and big data to ensure data accuracy and...Big dataTemporary workLocal areaFlexible hoursShift work- ...Data Engineering LeadLead end-to-end delivery of large-scale data engineering initiatives, ensuring high-quality and timely outcomes. Architect... ...experience with at least 5+ years of hands-on experience in Big Data and Data Engineering. Strong expertise in Apache Spark and...Big data
ConnectedX Inc
Plano, TX3 days ago - ...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...|data science|PYTHON Technical/Domain Skill 3Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 4Technology...Big dataFull timeTemporary workRelocation
- Design, develop, and maintain scalable data pipelines using Snowflake and cloud platforms Build and optimize data models, data warehouses... ...) Familiarity with data lakes, data warehousing concepts, and big data technologies #J-18808-Ljbffr GBIT (Global Bridge InfoTech Inc...Big data
- ...85998 The ideal candidate will have a strong background in data engineering and software development, with hands-on experience building scalable... ...data engineering team focused on customer data management and big data solutions that power marketing analytics, personalization...Big data
PROLIM Corporation
Murphy, TX2 days ago $86.8k - $165.2k
...will do: Design, build, and maintain data pipelines that ingest, transform, and deliver... ..., images, documents, logs, and engineering artifacts. Engineer data solutions that... ...software platforms such as Internet of Things, big data, artificial intelligence, and blockchain...Big dataContract workTemporary workWork experience placementWork at officeRemote workFlexible hoursRTX
Richardson, TX2 days ago- ...GorusuCompany: SRI Tech SolutionsRole:GCP data EngineerLocation: Santa Clara, CA and Plano... ...for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will... ...analyticsBig Data & Streaming: Implement and support Big Data solutions for both batch (scheduled)...Big dataFull time
- ...focused on Digital Transformation and Product Engineering Services, enabling clients achieve their... ...) experience plus working exposure with data and analytics platforms. We are are Data... ..., Data Modeling, SQL, NoSQL Big Data Technologies: Hadoop, Spark, Athena,...Big data
ConnectedX Inc
Plano, TX5 days ago $179.4k - $204.7k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast... ...iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real...Big dataFull timePart timeInternshipH1bLocal areaCapital One Financial Corp
Plano, TX1 day ago- ...Python Data Engineer (Palantir) Our client, a multinational telecommunications technology company, is looking for a Data Engineer to join... .... - Understanding data warehousing concepts - Cloud & Big Data - Experience with cloud platforms (AWS, Azure, GCP) and...Big dataTemporary work
Elite Technical
Plano, TX9 days ago - ...This is Aditya from Jconnect INC Job Title: Cloud Data Engineer Location: Seattle, WA / Dallas, TX Type: Full-Time... ...ingestion ~ Knowledge of data lakes, data warehouses, and big data architectures ~ Experience with multi-cloud environments...Big dataFull timeImmediate startRelocation
3B Staffing LLC
Murphy, TX5 days ago - Compunnel, Inc. in Plano, TX seeks a Lead Data Engineer to design and implement scalable data platforms across the enterprise. You will build data pipelines, data models, and governance practices while delivering measurable improvements to developer productivity and data...Big data
- The Lead Data Engineer will be responsible for designing, developing, testing, implementing, and supporting scalable data engineering solutions. The role will focus on building data pipelines, data movement solutions, data modeling, data quality, governance, and developer...Big data
$158.6k - $181k
...iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies....Big dataFull timePart timeInternshipH1bLocal area$209k - $238.5k
...platforms and reliable analytics pipelines. This onsite Senior Lead Data Engineering position in Plano, TX pairs hands-on platform work with team... ...data pipelines on medium to large scale datasets using big data technologies such as Spark , Flink , Kafka , Snowflake ,...Big dataInternship$179.4k - $204.7k
Lead Data Engineer (Java, Python, AWS) - Do you love building and pioneering in the technology space? Do you enjoy solving complex business... ...iterative delivery environment? At Capital One, you’ll be part of a big group of makers, breakers, doers, and disruptors who solve real...Big dataInternshipLocal area$179.4k - $204.7k
...Overview Lead Data Engineer (Java, Python, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex... ...delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real...Big dataFull timePart timeInternshipH1bLocal areaCapital One
Plano, TX22 days ago- Sr. Manager - Data & AI Support Engineering P-1388 As a Sr. Manager of the Data & AI Support Engineering team, you will lead and manage a team of... ...systems. Experience leading production‑scale workloads across Big Data, Hadoop, AI/ML, Kafka, Streaming, Data Science, or...Big dataWork experience placementWorldwide
- ...help Make Tomorrow Better.Role Overview:Could you be our next Data & AI Engineer III? Globe Life is looking for a Data & AI Engineer III to... ...expertise in AWS services, advanced SQL, Python, Informatica, and Big Data technologies such as Hadoop and Spark, this role also...Big dataFull timePart timeWork experience placementWork at officeWork from homeMonday to FridayShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- data engineer contract Plano, TX
- big data cloud engineer Plano, TX
- big data developer Plano, TX
- finance data engineer Plano, TX
- software data engineer Plano, TX
- hadoop big data developer Plano, TX
- data engineer machine learning Plano, TX
- senior data quality engineer Plano, TX
- data visualization developer Plano, TX
- aws data engineer Plano, TX