Big Data Engineer
Expert In Recruitment Solutions
Job Description
Job Description
Job Description
Candidate will be responsible for designing and developing complex requirements to accomplish business outcomes. The selected candidate should have hands-on Hadoop experience and an excitement for solving complex problems. This developer will be part of a collaborative team and will provide direction to team members. Experience in an Agile based programming environment is a plus
• Key responsibilities of the role include ensuring that software is developed to meet functional, non-functional, and compliance requirements. This role ensures solutions are well designed with maintainability/ease of integration and testing built-in from the outset. They possess strong proficiency in development and testing practices common to the industry, and have extensive experience of using design and architectural patterns. A Software Engineer is an individual contributor to a team.
• Contributes to story refinement/defining requirements.
• Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle.
• Performs spike/proof of concept as necessary to mitigate risk or implement new ideas.
• Codes solutions and unit tests to deliver a requirement/story per the defined acceptance criteria and compliance requirements.
• Designs/develops/maintains automated test suites (integration, regression, performance). Required Qualifications
• Strong database and SQL skills
• Good understanding on Hadoop Big Data Eco system
• Experience writing Shell scripts in LINUX or Unix
• Experience with Autosys
• Hadoop/Spark - Running Pig and Hive Queries, analyzing data with Hive, Hands on experience with Oozie, Importing and exporting the data using Sqoop from HDFS to Relational Database, Developing MapReduce Program to format the data
• Good communication skills
• Familiarity with CI/CD tools such as Ansible, Jenkins, and Artifactory
Vacancy posted 26 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Plano, TX vacancy
- Big Data Engineer Location: Costa Mesa, CA or Allen, TX Duration: Fulltime Job Description: Big Data Engineer Must Have Technical/Functional Skills: Big Data, PySpark, AWS (EMR, SageMaker, DunamoDB) Roles & Responsibilities: Strong hands-on experience with AWS Cloud Services...Big dataFull timeImmediate startRelocation
- Role: Big Data Engineer Location: Plano, TX (Onsite) Client: Artech / JPMorgan Chase Mode: W2 Contract / Full Time Opening Job Description: Job Family Description: Expert in in AWS and Client Azure technology and design techniques as well as experience working across...Big dataFull timeContract workWork experience placement
- ...Snowflake, ETL/ELT development, AWS and Azure cloud platforms, big data technologies (Spark, Hadoop, PySpark), data warehousing and databases... ...skills: Industry Insurance Background A Data Engineer specializes in designing, developing, and integrating data...Big data
- Job Title: Sr Big Data Engineer Job Location: Plano, Texas Job Type: Contract Job Description:- Must-Have Skills: Python PySpark Spark AWS ETL Docker Good to Have Skills: Lead Experience Data Modeling CI/CD - Jenkins R Airflow Kubernetes TriOptus LLCBig dataContract work
- Senior ML Data Engineer Feature Engineering ETL Qualifications 7 years in data engineering and at least 4 years focusing on ML feature engineering... ...a strong plus and advanced skills in Apache Spark PySpark for big data processing and analytics Proficient in Python for data...Big dataRemote job
- ...forward. What you'll do You'll design and build large-scale big data solutions on Google Cloud, with Spark on Dataproc at the... ...degree in a technical field such as computer science, computer engineering, or a related field ~5–7 years of experience designing and implementing...Big dataContract workTemporary work
$95 per hour
Senior Software Engineer - Java Possible 3 Month CTH | No Fees | Do Not Re-Post | Confidential Role: Senior SW Engineer - Java Work location... ...on experience with Java Experience in distributed systems and big data technologies (Hadoop, Hive, Spark, etc.) Strong debugging...Big dataRelocation- Big Data/ Machine Learning Engineer Plano, TX 2 Months No C2C, any visa is okay. Basic Qualifications Bachelor's Degree At least 8 years of software development experience At least 5 years of experience managing software development projects through complete release...Big data
- ...store and utilize structured and unstructured data from internal and external sources.... ...artificial intelligence, machine learning and big-data techniques to cleanse, organize and... ...storage to accommodate ongoing needs.Why TI?Engineer your future. We empower our employees to...Big dataInternshipLocal area
$95 per hour
Senior SW Engineer - BigData+Java Possible 3 Month CTH | No Fees | Do Not Re-Post | Confidential... ...which deals with few petabytes of data coming to the system daily. You will contribute... ...internally Strong experience in distributed Big Data processing (batch/offline, Terabytes...Big dataFor contractorsRelocation- REQUIREMENT Job Description: Data Engineer Location: Plano,TX Duration: 6 month Job ID: 96989-1 Prior Client : Capital One experience is... ...experience in application development At least 2 years of experience in big data technologies At least 1 year experience with cloud...Big dataLong term contract
$82.42k - $126.6k
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...with Hadoop ecosystem (Cloudera). • Experience in working with a Big Data implementation in production environment. • Experience with...Big dataFull timeTemporary workRelocation$76 per hour
Job Description Senior Big Data & Data Architecture Engineer Location: Plano, TX (Fully Onsite) Duration: 12+ Month Contract-to-Hire (with multi-extension capabilities) Compensation: $76.00 / hour (W2) Schedule: Fully Onsite Position Overview We are seeking a seasoned...Big dataContract workTemporary work- Data Engineer Highly experienced Data Engineer with expertise in cloud engineering, data engineering, and data warehousing, particularly within... ...Engineering: ETL, Data Warehousing, Data Modeling, SQL, NoSQL Big Data Technologies: Hadoop, Spark, Athena, materialized views...Big data
- Job Description Senior Data Engineer - Python, PySpark & AWS Location: Plano, TX Relocation : Open Open for W2 only- No c2c/1099 or third... .../ELT data pipelines using Python andPySpark. Build and support big-data processing solutions on AWS using S3,EMR, and Lambda. Implement...Big dataRelocation
$10,000 per month
...Job Profile Summary The Data Engineer Principal plays a pivotal role within Dataworks and provides dynamic leadership at the enterprise level... ...the design, build, test and maintenance of data pipelines at big data scale. Leads batch processing of collected data to ensure...Big dataFull timeWork experience placement- Our client is currently seeking a Data Engineer with strong experience in data modeling, data warehousing, and cloud-based data platforms. The... ...with AWS services and a strong foundation in SQL and big data technologies. You will play a key role in building and optimizing...Big data
- ...Design and develop scalable code based custom ETL pipelines using big data technologies on Cloud platform. Design and develop code to... ...Bigquery. Code and query Optimization. Follow and contribute to engineering best practices for source control using Github, release...Big data
- ...had Interview Scheduled but candidate backed out at last moment DATA ENGINEER Location: Plano, TX | Hybrid Option Duration: 6+ Month... ...Description: Work with a team of data and software engineers to deliver big data streaming platform and data management capabilities....Big dataPermanent employmentContract workImmediate startRemote work
- ...for an experienced Software Developers and Engineers who has a passion for building software... ...IT experience 3+ years of experience as a Data Engineer, having built large and complex... ..., etc. Experience implementing streaming big-data pipelines as well as batch job flows...Big dataFull timeWork at officeLocal areaImmediate start
- Data Engineering Lead Lead end-to-end delivery of large-scale data engineering initiatives, ensuring high-quality and timely outcomes. Architect... ...experience with at least 5+ years of hands-on experience in Big Data and Data Engineering. Strong expertise in Apache Spark...Big data
$52.73 - $80 per hour
Title: Senior Data Engineer Location: McLean, VA; NYC; Wilmington; Boston; Plano; Chicago; or RichmondWork Arrangement: Hybrid - 3 days/week onsite Contract: 6+ month We are seeking a Senior Big Data/Machine Learning Engineer to support the design, development, and implementation...Big dataContract work3 days per week- ...0585998 The ideal candidate will have a strong background in data engineering and software development, with hands-on experience building scalable... ...data engineering team focused on customer data management and big data solutions that power marketing analytics, personalization...Big data
- Senior Data Engineer / Full Stack Engineer Location: Remote (EST preferred) | Duration: 12 months (potential for full-time conversion) | Plano... ...-scale data solutions, leveraging cutting-edge AWS and big data technologies. This contract offers a path to full-time employment...Big dataFull timeContract workRemote work
- We need: Three Senior (10+ years) Data Engineers with extensive experience working with SQL/NoSQL, Big Data/Spark as well as Java or Python. CANDIDATES MUST HAVE RECENT EXPERIENCE IN BANKING OR FINANCIAL SERVICES/CAPITAL MARKETS . CANDIDATES MUST BE WITHIN A ONE HOUR COMMUTE...Big dataWork at officeLocal areaRelocation
- ...Full TimeCompany: SRI Tech SolutionsRole:GCP data EngineerLocation: Santa Clara, CA and... ...looking for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will... ...Data & Streaming: Implement and support Big Data solutions for both batch (scheduled)...Big dataFull time
- Lead Software Engineer We have an opportunity to impact your career and provide an adventure... ...architecture and hands-on delivery of large-scale data pipelines (ETL/ELT) covering ingestion,... ..., with strong depth in data engineering/big data platforms Strong hands-on development...Big data
- ...Sr. Manager of the Data & AI Support Engineering Team As a Sr. Manager of the Data & AI Support Engineering team, you will lead and manage a team... .... ~ Experience leading production-scale workloads across Big Data, Hadoop, AI/ML, Kafka, Streaming, Data Science, or Analytics...Big dataWork experience placementWorldwide
$55 per hour
...Job Description Job Description Job Title: Big Data Engineer Healthcare AI & GenAI Work Location: RichardsonTX75082 Vendor Rate: $55/hr Contract duration: 12 Months Interview Process (Is face to face required?): No Must Have Skills Databricks, pypark...Big dataContract work- ...Job Description Job Description Job Title: Senior Data Engineer Work Location: Richardson TX 75082 **hybrid work set-up** Contract... ...responsibilities you would expect the Subcon to shoulder and execute Big Data Spark Data Processing Must Have Skills...Big dataContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- junior data engineer remote Plano, TX
- data engineer analytics Plano, TX
- data science developer Plano, TX
- data engineer manager Plano, TX
- big data developer Plano, TX
- big data devops engineer Plano, TX
- data center engineer Plano, TX
- big data cloud engineer Plano, TX
- big data engineer Plano, TX
- junior big data engineer Plano, TX


