Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

Expert In Recruitment Solutions

Job Description

Job Description

Job Description
Candidate will be responsible for designing and developing complex requirements to accomplish business outcomes. The selected candidate should have hands-on Hadoop experience and an excitement for solving complex problems. This developer will be part of a collaborative team and will provide direction to team members. Experience in an Agile based programming environment is a plus

Position Summary
• Key responsibilities of the role include ensuring that software is developed to meet functional, non-functional, and compliance requirements. This role ensures solutions are well designed with maintainability/ease of integration and testing built-in from the outset. They possess strong proficiency in development and testing practices common to the industry, and have extensive experience of using design and architectural patterns. A Software Engineer is an individual contributor to a team.
• Contributes to story refinement/defining requirements.
• Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle.
• Performs spike/proof of concept as necessary to mitigate risk or implement new ideas.
• Codes solutions and unit tests to deliver a requirement/story per the defined acceptance criteria and compliance requirements.
• Designs/develops/maintains automated test suites (integration, regression, performance).

Required Qualifications
• Strong database and SQL skills
• Good understanding on Hadoop Big Data Eco system
• Experience writing Shell scripts in LINUX or Unix
• Experience with Autosys
• Hadoop/Spark - Running Pig and Hive Queries, analyzing data with Hive, Hands on experience with Oozie, Importing and exporting the data using Sqoop from HDFS to Relational Database, Developing MapReduce Program to format the data
• Good communication skills
• Familiarity with CI/CD tools such as Ansible, Jenkins, and Artifactory
Vacancy posted 26 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Plano, TX vacancy
  • Big Data Engineer Location: Costa Mesa, CA or Allen, TX Duration: Fulltime Job Description: Big Data Engineer Must Have Technical/Functional Skills: Big Data, PySpark, AWS (EMR, SageMaker, DunamoDB) Roles & Responsibilities: Strong hands-on experience with AWS Cloud Services... 
    Big data
    Full time
    Immediate start
    Relocation

    JConnect Infotech

    Parker, TX
    3 days ago
  • Role: Big Data Engineer Location: Plano, TX (Onsite) Client: Artech / JPMorgan Chase Mode: W2 Contract / Full Time Opening Job Description: Job Family Description: Expert in in AWS and Client Azure technology and design techniques as well as experience working across... 
    Big data
    Full time
    Contract work
    Work experience placement

    Exaways Corporation

    Plano, TX
    3 days ago
  •  ...Snowflake, ETL/ELT development, AWS and Azure cloud platforms, big data technologies (Spark, Hadoop, PySpark), data warehousing and databases...  ...skills: Industry Insurance Background A Data Engineer specializes in designing, developing, and integrating data... 
    Big data

    eCom Solutions Inc

    Plano, TX
    5 days ago
  • Job Title: Sr Big Data Engineer Job Location: Plano, Texas Job Type: Contract Job Description:- Must-Have Skills: Python PySpark Spark AWS ETL Docker Good to Have Skills: Lead Experience Data Modeling CI/CD - Jenkins R Airflow Kubernetes TriOptus LLC
    Big data
    Contract work

    TriOptus LLC

    Plano, TX
    3 days ago
  • Senior ML Data Engineer Feature Engineering ETL Qualifications 7 years in data engineering and at least 4 years focusing on ML feature engineering...  ...a strong plus and advanced skills in Apache Spark PySpark for big data processing and analytics Proficient in Python for data... 
    Big data
    Remote job

    Samprasoft

    Plano, TX
    3 days ago
  •  ...forward. What you'll do You'll design and build large-scale big data solutions on Google Cloud, with Spark on Dataproc at the...  ...degree in a technical field such as computer science, computer engineering, or a related field ~5–7 years of experience designing and implementing... 
    Big data
    Contract work
    Temporary work

    Judit Inc

    Plano, TX
    9 days ago
  • $95 per hour

    Senior Software Engineer - Java Possible 3 Month CTH | No Fees | Do Not Re-Post | Confidential Role: Senior SW Engineer - Java Work location...  ...on experience with Java Experience in distributed systems and big data technologies (Hadoop, Hive, Spark, etc.) Strong debugging... 
    Big data
    Relocation

    Redolent

    Richardson, TX
    3 days ago
  • Big Data/ Machine Learning Engineer Plano, TX 2 Months No C2C, any visa is okay. Basic Qualifications Bachelor's Degree At least 8 years of software development experience At least 5 years of experience managing software development projects through complete release... 
    Big data

    3B Staffing LLC

    Plano, TX
    3 days ago
  •  ...store and utilize structured and unstructured data from internal and external sources....  ...artificial intelligence, machine learning and big-data techniques to cleanse, organize and...  ...storage to accommodate ongoing needs.Why TI?Engineer your future. We empower our employees to... 
    Big data
    Internship
    Local area

    Texas Instruments

    Richardson, TX
    2 days ago
  • $95 per hour

    Senior SW Engineer - BigData+Java Possible 3 Month CTH | No Fees | Do Not Re-Post | Confidential...  ...which deals with few petabytes of data coming to the system daily. You will contribute...  ...internally Strong experience in distributed Big Data processing (batch/offline, Terabytes... 
    Big data
    For contractors
    Relocation

    Redolent

    Richardson, TX
    3 days ago
  • REQUIREMENT Job Description: Data Engineer Location: Plano,TX Duration: 6 month Job ID: 96989-1 Prior Client : Capital One experience is...  ...experience in application development At least 2 years of experience in big data technologies At least 1 year experience with cloud... 
    Big data
    Long term contract

    Maintec Technologies

    Murphy, TX
    3 days ago
  • $82.42k - $126.6k

     ...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock...  ...with Hadoop ecosystem (Cloudera). • Experience in working with a Big Data implementation in production environment. • Experience with... 
    Big data
    Full time
    Temporary work
    Relocation

    Infosys Technologies

    Plano, TX
    3 days ago
  • $76 per hour

    Job Description Senior Big Data & Data Architecture Engineer Location: Plano, TX (Fully Onsite) Duration: 12+ Month Contract-to-Hire (with multi-extension capabilities) Compensation: $76.00 / hour (W2) Schedule: Fully Onsite Position Overview We are seeking a seasoned... 
    Big data
    Contract work
    Temporary work

    ektello

    Plano, TX
    18 hours ago
  • Data Engineer Highly experienced Data Engineer with expertise in cloud engineering, data engineering, and data warehousing, particularly within...  ...Engineering: ETL, Data Warehousing, Data Modeling, SQL, NoSQL Big Data Technologies: Hadoop, Spark, Athena, materialized views... 
    Big data

    ConnectedX Inc

    Plano, TX
    3 days ago
  • Job Description Senior Data Engineer - Python, PySpark & AWS Location: Plano, TX Relocation : Open Open for W2 only- No c2c/1099 or third...  .../ELT data pipelines using Python andPySpark. Build and support big-data processing solutions on AWS using S3,EMR, and Lambda. Implement... 
    Big data
    Relocation

    SCI Solutions Global LLC

    Plano, TX
    3 days ago
  • $10,000 per month

     ...Job Profile Summary The Data Engineer Principal plays a pivotal role within Dataworks and provides dynamic leadership at the enterprise level...  ...the design, build, test and maintenance of data pipelines at big data scale. Leads batch processing of collected data to ensure... 
    Big data
    Full time
    Work experience placement

    FedEx Dataworks

    Plano, TX
    10 days ago
  • Our client is currently seeking a Data Engineer with strong experience in data modeling, data warehousing, and cloud-based data platforms. The...  ...with AWS services and a strong foundation in SQL and big data technologies. You will play a key role in building and optimizing... 
    Big data

    The Judge Group

    Plano, TX
    3 days ago
  •  ...Design and develop scalable code based custom ETL pipelines using big data technologies on Cloud platform. Design and develop code to...  ...Bigquery. Code and query Optimization. Follow and contribute to engineering best practices for source control using Github, release... 
    Big data

    Samsung Electronics Co., Ltd.

    Plano, TX
    3 days ago
  •  ...had Interview Scheduled but candidate backed out at last moment DATA ENGINEER Location: Plano, TX | Hybrid Option Duration: 6+ Month...  ...Description: Work with a team of data and software engineers to deliver big data streaming platform and data management capabilities.... 
    Big data
    Permanent employment
    Contract work
    Immediate start
    Remote work

    3B Staffing LLC

    Murphy, TX
    3 days ago
  •  ...for an experienced Software Developers and Engineers who has a passion for building software...  ...IT experience 3+ years of experience as a Data Engineer, having built large and complex...  ..., etc. Experience implementing streaming big-data pipelines as well as batch job flows... 
    Big data
    Full time
    Work at office
    Local area
    Immediate start

    r2 Technologies, Inc.

    Plano, TX
    3 days ago
  • Data Engineering Lead Lead end-to-end delivery of large-scale data engineering initiatives, ensuring high-quality and timely outcomes. Architect...  ...experience with at least 5+ years of hands-on experience in Big Data and Data Engineering. Strong expertise in Apache Spark... 
    Big data

    ConnectedX Inc

    Plano, TX
    3 days ago
  • $52.73 - $80 per hour

    Title: Senior Data Engineer Location: McLean, VA; NYC; Wilmington; Boston; Plano; Chicago; or RichmondWork Arrangement: Hybrid - 3 days/week onsite Contract: 6+ month We are seeking a Senior Big Data/Machine Learning Engineer to support the design, development, and implementation... 
    Big data
    Contract work
    3 days per week

    Yoh

    Plano, TX
    4 days ago
  •  ...0585998 The ideal candidate will have a strong background in data engineering and software development, with hands-on experience building scalable...  ...data engineering team focused on customer data management and big data solutions that power marketing analytics, personalization... 
    Big data

    PROLIM Corporation

    Murphy, TX
    3 days ago
  • Senior Data Engineer / Full Stack Engineer Location: Remote (EST preferred) | Duration: 12 months (potential for full-time conversion) | Plano...  ...-scale data solutions, leveraging cutting-edge AWS and big data technologies. This contract offers a path to full-time employment... 
    Big data
    Full time
    Contract work
    Remote work

    Indotronix International Corporation

    Plano, TX
    3 days ago
  • We need: Three Senior (10+ years) Data Engineers with extensive experience working with SQL/NoSQL, Big Data/Spark as well as Java or Python. CANDIDATES MUST HAVE RECENT EXPERIENCE IN BANKING OR FINANCIAL SERVICES/CAPITAL MARKETS . CANDIDATES MUST BE WITHIN A ONE HOUR COMMUTE... 
    Big data
    Work at office
    Local area
    Relocation

    3B Staffing LLC

    Murphy, TX
    3 days ago
  •  ...Full TimeCompany: SRI Tech SolutionsRole:GCP data EngineerLocation: Santa Clara, CA and...  ...looking for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will...  ...Data & Streaming: Implement and support Big Data solutions for both batch (scheduled)... 
    Big data
    Full time

    SRI Tech

    Plano, TX
    5 days ago
  • Lead Software Engineer We have an opportunity to impact your career and provide an adventure...  ...architecture and hands-on delivery of large-scale data pipelines (ETL/ELT) covering ingestion,...  ..., with strong depth in data engineering/big data platforms Strong hands-on development... 
    Big data

    Chase

    Plano, TX
    3 days ago
  •  ...Sr. Manager of the Data & AI Support Engineering Team As a Sr. Manager of the Data & AI Support Engineering team, you will lead and manage a team...  .... ~ Experience leading production-scale workloads across Big Data, Hadoop, AI/ML, Kafka, Streaming, Data Science, or Analytics... 
    Big data
    Work experience placement
    Worldwide

    Databricks

    Plano, TX
    1 day ago
  • $55 per hour

     ...Job Description Job Description Job Title: Big Data Engineer Healthcare AI & GenAI Work Location: RichardsonTX75082 Vendor Rate: $55/hr Contract duration: 12 Months Interview Process (Is face to face required?): No Must Have Skills Databricks, pypark... 
    Big data
    Contract work

    Diverse Lynx

    Richardson, TX
    26 days ago
  •  ...Job Description Job Description Job Title: Senior Data Engineer Work Location: Richardson TX 75082 **hybrid work set-up** Contract...  ...responsibilities you would expect the Subcon to shoulder and execute Big Data Spark Data Processing Must Have Skills... 
    Big data
    Contract work

    eTeam Inc.

    Richardson, TX
    26 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!