Big Data Engineer

Exaways Corporation

Plano, TX

Role: Big Data Engineer

Location: Plano, TX (Onsite)

Client: Artech / JPMorgan Chase

Mode: W2 Contract / Full Time Opening

Job Description:

Job Family Description: Expert in in AWS and Client Azure technology and design techniques as well as experience working across large environments with multiple operating systems/infrastructure for large-scale programs (e.g., Expert Engineers) starting to be firm-wide resources working on projects across Client
Is multi-skilled with expertise across the software development lifecycle and toolset
May be recognized as a leader in Agile and cultivating teams working in Agile frameworks
Sought out as coach for at least one technical skill
Strong understanding of techniques such as Continuous Integration, Continuous Delivery, Test Driven Development, Cloud Development, resiliency, security
Stays abreast of cutting-edge technologies/trends and uses experience to influence the application of those technologies/trends to support the business; may give speeches outside the firm, writes articles

Technologies:

Data Bricks
Apache Spark
Python(and/or Scala)
AWS
SQL
Java
CI/CD Pipeline tools

Description:

Minimum Industry experience: 10 years
Bachelor's degree or equivalent work experience
Must have experience implementing atleast 2 end to end projects with Databricks which includes components like.
Delta lake.
Unity Catalog.
Databricks Connect.
DataBricks API.
Databricks workflow Orchestration.
Must be well-versed with Databricks Lakehouse concepts and its implementation in large-scale enterprise environments.
Must have a good understanding of creating complex data pipelines and use of data ingestion tools like nifi.
Must be well versed in using Apache Spark framework and strong in SQL and spark-sql
Must have excellent coding skills in Python(and/or Scala), preferably Python.
Must have strong performance optimization skills to improve efficiency and reduce cost using techniques like parallel processing.
Must have worked on AWS and should have working experience with AWS services like S3, Lambda, DynamoDB, SQS, and CloudWatch.
Must be able to work with architects and lead engineers to design solutions to meet functional and non-functional requirements.
Must have strong written and verbal communication skills.
Must have experience in an Agile environment.
Data engineering background is a plus.

Apply

Vacancy posted 20 hours ago

Similar jobs that could be interesting for youBased on the Big Data Engineer in Plano, TX vacancy

Big Data Engineer
$60 - $70 per hour
...Akkodis is seeking a Big Data Engineer for a Contract job with a client in Plano, TX(Hybrid) . Responsibilities include developing processes to interact with HDFS and Oracle, creating workflows using Autosys, and ensuring ML/AI models are production-ready while working...
Big data
Hourly pay
Contract work
Temporary work
Local area
Akkodis
Plano, TX
4 days ago
Senior Data Engineer
$75 per hour
...Senior Data Engineer MAX BILL RATE: $75 Top 2 Must Haves: Graph DB hands on experience AWS services Job Summary: - Analyzing... ...Certification - 15+ years of hands-on experience in big data tools, infrastructure and related tech Roles & Responsibilities...
Big data
Keylent Inc
Plano, TX
20 hours ago
Data Engineer | AI & Big Data, CAP Path to Impact
Texas Instruments is seeking a recent graduate for its TMG Development program in Richardson, TX. You will design, build and oversee data architecture, data pipelines, and systems to capture, store and transform data from multiple sources. The role emphasizes AI/ML...
Big data
Texas Instruments
Richardson, TX
2 days ago
Lead Data Engineer
...Lead Data Engineer Role Cognizant is looking for a Lead Data Engineer role. The position involves understanding business requirements and... ...: 7 to 10 years. Required skills include AWS Machine Learning, Big Data, and Apache Spark. Roles and responsibilities include designing...
Big data
Keylent Inc
Plano, TX
4 days ago
Data Engineer
...What we are looking for Highly experienced Data Engineer with expertise in cloud engineering, data engineering, and data warehousing... ...: ETL, Data Warehousing, Data Modeling, SQL, NoSQL Big Data Technologies: Hadoop, Spark, Athena, materialized views...
Big data
ConnectedX Inc
Plano, TX
11 hours ago
Data engineer
...Senior Data Engineer / Sr. Strategy Analyst-CX Location: Texas Plano Years of Experience: 10 - 15 Years Job Summary We are seeking... ...databases (e.g., PostgreSQL, MySQL). • Familiarity with big data technologies such as Hadoop, Spark, or similar frameworks....
Big data
Echo IT Solutions
Plano, TX
3 days ago
Data Engineer
$70 - $75 per hour
...00 USD Hourly Description: Our client is currently seeking a Data Engineer with strong experience in data modeling, data warehousing, and... ...experience with AWS services and a strong foundation in SQL and big data technologies. You will play a key role in building and optimizing...
Big data
Hourly pay
Judge Group, Inc.
Plano, TX
3 days ago
Senior Big Data & ML Engineer - Remote/Plano
A technology firm in Plano, TX is looking for a Senior Big Data/Machine Learning Engineer with a minimum of 8 years of experience. The position requires proficiency in data engineering, Python, SQL, pyspark, and AWS. The role entails developing data models and implementing...
Big data
Remote job
Contract work
Work visa
Rapinno Tech
Plano, TX
1 day ago
Big Data/Machine Learning Engineer - Sr
About the job Big Data/Machine Learning Engineer - Sr Note: Need Only US Citizen, Green Card, EAD-GC, J2 EAD, H4 EAD, L2 EAD, and TN Visa. Job Title: Big Data/Machine Learning Engineer - Sr Location: Plano, TX (Remote Until Covid) Duration: 06+ Months Contract Job...
Big data
Contract work
Remote work
Rapinno Tech
Plano, TX
1 day ago
Data Engineer
...Data Engineering Team Member PepsiCo operates in an environment undergoing immense and rapid change. Big-data and digital technologies are driving business transformation that is unlocking new capabilities and business innovations in areas like eCommerce, mobile experiences...
Big data
Remote work
Flexible hours
Phenom People
Plano, TX
20 hours ago
Career Accelerator Program - Data Engineer
...and utilize structured and unstructured data from internal and external sources. Establishes... ...intelligence, machine learning and big-data techniques to cleanse, organize and... ...Requirements: Bachelor's degree in Electrical Engineering, Computer Engineering or related field of...
Big data
Internship
Local area
Texas Instruments Incorporated
Richardson, TX
3 days ago
Lead Data Engineer
...Data Engineering Lead Lead end-to-end delivery of large-scale data engineering initiatives, ensuring high-quality and timely outcomes. Architect... ...experience with at least 5+ years of hands-on experience in Big Data and Data Engineering. Strong expertise in Apache Spark...
Big data
ConnectedX Inc
Plano, TX
11 hours ago
Data Engineer
...for an experienced Software Developers and Engineers who has a passion for building software... ...experience ~3+ years of experience as a Data Engineer, having built large and complex... ...Experience implementing streaming big-data pipelines as well as batch job flows...
Big data
Full time
Work at office
Local area
Immediate start
r2 Technologies, Inc.
Plano, TX
11 hours ago
Sr. Data Engineer
$90k - $100k
Elevate is hiring a contract Sr. Data Engineer for an on-site role in Plano, TX, supporting enterprise data systems and large-scale architecture... ...practices, and Jira Preferred Qualifications Experience with big data tools such as Spark and Hadoop Familiarity with APIs and...
Big data
Contract work
Elevate Services
Plano, TX
2 days ago
Cloud Data Engineer
...Cloud Data Engineer We are looking for a skilled Cloud Data Engineer to design and build scalable data platforms and pipelines, primarily... ...data ingestion ~ Knowledge of data lakes, data warehouses, and big data architectures ~ Experience with multi-cloud environments...
Big data
Immediate start
Relocation
JConnect Infotech
Plano, TX
1 day ago
2027 Summer Intern: Technology Data & Analytics, Data Engineer & Data Science
$21.09 - $44.4 per hour
...ecosystem of people, processes, systems, and data to engage seamlessly with consumers,... ...Transformationteams. The Data & Analytics, Data Engineer & Data Science role profile consists of -... ...Skills Artificial neural networks Azure Big Data Chatbots Data architectures Hadoop MATLAB...
Big data
Hourly pay
Full time
Work experience placement
Internship
Summer internship
PepsiCo Inc.
Plano, TX
4 days ago
Data Engineering Feature Lead - Technology
...competencies. Position Summary: The Claims Data Emerging Technology team is in search of a talented Feature Lead to guide a data engineering team that consists of software/quality... ...Qualifications: 10+ years of experience in Big Data (Hadoop Echo system, Python) Solid experience...
Big data
Work at office
Flexible hours
Shift work
Day shift
Bank of America
Plano, TX
11 hours ago
Big Data Engineer
...experience of using design and architectural patterns. A Software Engineer is an individual contributor to a team. • Contributes to... ...Strong database and SQL skills • Good understanding on Hadoop Big Data Eco system • Experience writing Shell scripts in LINUX or...
Big data
Expert In Recruitment Solutions
Plano, TX
3 days ago
Senior Hadoop & Big Data Developer - Production Support
$60 - $65 per hour
A technology staffing firm is seeking a Sr. Hadoop / Big Data Developer with a focus on production support. The ideal candidate will have strong experience in the Hadoop ecosystem and SQL query writing, particularly within the financial services industry. This role, based...
Big data
Hourly pay
Akkodis
Plano, TX
1 day ago
Hadoop / Big Data Developer (with Production Support focus)
$60 - $65 per hour
Akkodis is seeking a Sr. Hadoop / Big Data Developer (with Production Support focus) for a Contract job with a client in Plano, TX/Charlotte, NC/Kennesaw, GA(Hybrid) . Ideally looking for applicants with a solid background in the financial services industry. Rate Range...
Big data
Hourly pay
Contract work
Akkodis
Plano, TX
1 day ago
Lead data engineer
...the areas, This role is a 6 month Plus role The Lead Data Engineer will report to the Marketing Technology (MarTech) team and will... .... Implement data ingestion and processing with the help of Big Data technologies • Data processing/transformation using various...
Big data
Remote work
Flexible hours
3B Staffing LLC
Addison, TX
4 days ago
Senior Data Engineer
...Job Description Job Description Job Title: Senior Data Engineer Work Location: Richardson TX 75082 **hybrid work set-up** Contract... ...responsibilities you would expect the Subcon to shoulder and execute Big Data Spark Data Processing Must Have Skills...
Big data
Contract work
eTeam Inc.
Richardson, TX
3 days ago
Big Data Engineer - Healthcare AI & GenAI
$55 per hour
...Job Title: Big Data Engineer Healthcare AI & GenAI Work Location: RichardsonTX75082 Vendor Rate: $55/hr Contract duration: 12 Months Interview Process (Is face to face required): No Must Have Skills Databricks pypark SparkScala Aws HiveEligible to workP...
Big data
Full time
Contract work
Diverse Lynx LLC
Richardson, TX
12 days ago
Data Engineer II
$66 - $68 per hour
...Responsibilities: Develop various facets of data capture, data processing, storage and... ...stories Experience with AWS ecosystem or other big data technologies such as EC2, S3,... ...by 2x Sign in to set job alerts for “Data Engineer” roles. Irving, TX $80,000.00 - $100,000.0...
Big data
Full time
Contract work
Remote work
Aditi Consulting
Frisco, TX
1 day ago
Senior Data Engineer
...Role Summary: We are seeking a highly skilled Senior Data Engineer to design, build, and optimize enterprise-scale data platforms.... ...and PySpark Experience with distributed data processing and big data platforms Strong analytical mindset focused on building...
Big data
Hourly pay
Daily paid
Full time
Contract work
Cinemark USA, Inc
Plano, TX
more than 2 months ago
Director, Data Engineering & Development
...company culture, and achieving unparalleled success. The Director, Data Engineering & Development will partner with Senior Business and Digital... ...functions to drive the creation, endorsement, and delivery of big data platforms, data integrations and data products. The...
Big data
Full time
Temporary work
Part time
For contractors
Work experience placement
Local area
Flexible hours
Shift work
T-Mobile
Frisco, TX
5 days ago
Data Engineer 4, Real-time Data Platform
$179.4k - $204.7k
...Overview Data Engineer 4, Real-time Data Platform Do you love building and pioneering in the technology space? Do you enjoy solving... ...iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real...
Big data
Full time
Part time
Internship
H1b
Local area
Capital One
Plano, TX
14 days ago
Software Engineer III- Data Engineer(Python, Databricks and AWS)
...Job Description Job Description: As a Data Engineer III at JPMorganChase within the Corporate Sector you serve as a seasoned member... ...Knowledge of data governance and compliance standards. Exposure to big data tools and frameworks. Ability to work in a fast-paced,...
Big data
JPMorgan Chase & Co.
Plano, TX
7 days ago
Staff Engineer, AdTech Data & Attribution Platforms
$200k - $230k
...highly skilled and experienced front-end staff engineer to join our dynamic team and help shape... ...on user conversion. Collaborate with data scientists, product managers, and other engineers... ...Apache Ignite) Proficient in working with big data technologies and databases (e.g.,...
Big data
Samsung
Plano, TX
1 day ago
Data Scientist
...Who we're looking for: Role: Data Scientist Location: Plano, TX (Hybrid... ...predictive analysis. • Exp leveraging big data and search technologies (e.g., Spark... ...capabilities, and work closely with the engineering team in the development of data products....
Big data
Contract work
ConnectedX Inc
Plano, TX
11 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!