Big Data Engineer

Exaways Corporation

Plano, TX

Role: Big Data Engineer

Location: Plano, TX (Onsite)

Client: Artech / JPMorgan Chase

Mode: W2 Contract / Full Time Opening

Job Description:

Job Family Description: Expert in in AWS and Client Azure technology and design techniques as well as experience working across large environments with multiple operating systems/infrastructure for large-scale programs (e.g., Expert Engineers) starting to be firm-wide resources working on projects across Client
Is multi-skilled with expertise across the software development lifecycle and toolset
May be recognized as a leader in Agile and cultivating teams working in Agile frameworks
Sought out as coach for at least one technical skill
Strong understanding of techniques such as Continuous Integration, Continuous Delivery, Test Driven Development, Cloud Development, resiliency, security
Stays abreast of cutting-edge technologies/trends and uses experience to influence the application of those technologies/trends to support the business; may give speeches outside the firm, writes articles

Technologies:

Data Bricks
Apache Spark
Python(and/or Scala)
AWS
SQL
Java
CI/CD Pipeline tools

Description:

Minimum Industry experience: 10 years
Bachelor's degree or equivalent work experience
Must have experience implementing atleast 2 end to end projects with Databricks which includes components like.
Delta lake.
Unity Catalog.
Databricks Connect.
DataBricks API.
Databricks workflow Orchestration.
Must be well-versed with Databricks Lakehouse concepts and its implementation in large-scale enterprise environments.
Must have a good understanding of creating complex data pipelines and use of data ingestion tools like nifi.
Must be well versed in using Apache Spark framework and strong in SQL and spark-sql
Must have excellent coding skills in Python(and/or Scala), preferably Python.
Must have strong performance optimization skills to improve efficiency and reduce cost using techniques like parallel processing.
Must have worked on AWS and should have working experience with AWS services like S3, Lambda, DynamoDB, SQS, and CloudWatch.
Must be able to work with architects and lead engineers to design solutions to meet functional and non-functional requirements.
Must have strong written and verbal communication skills.
Must have experience in an Agile environment.
Data engineering background is a plus.

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Big Data Engineer in Plano, TX vacancy

Big Data Engineer
...experience of using design and architectural patterns. A Software Engineer is an individual contributor to a team. • Contributes to... ...Strong database and SQL skills • Good understanding on Hadoop Big Data Eco system • Experience writing Shell scripts in LINUX or Unix...
Big data
RIT Solutions, Inc.
Plano, TX
5 days ago
Big Data Engineer
...Big Data Engineer Location: Costa Mesa, CA or Allen, TX Duration: Fulltime Job Description: Big Data Engineer Must Have Technical/Functional Skills: Big Data, PySpark, AWS (EMR, SageMaker, DunamoDB) Roles & Responsibilities: Strong hands-on experience...
Big data
Full time
Immediate start
Relocation
JConnect Infotech
Parker, TX
18 hours ago
Big Data Engineer
...Job Title: Data Engineer Location: TechM US Texas Plano Years of Experience: 7 10 Years Job Summary: We are seeking a highly skilled Data Engineer with a strong background in GCP Data Testing to join our team as a contractor. The ideal candidate will have 7...
Big data
For contractors
Yantran LLC
Plano, TX
4 days ago
Sr. Big Data Engineer
...Sr. Big Data Engineer Roles We are looking for Sr. Big Data Engineer roles with the required skills are: 1. Big Data Engineer 2. Comfortable with Data Warehousing & Data Lake architecture 3. Spark | Strong Python 4. Strong Snowflake 5. Hadoop experience desired...
Big data
STIAOS Technologies
Plano, TX
3 days ago
Snowflake Data Engineer
...Job TitleRequired Skills:Strong in SQL and Python, 8+ years' experience.Experience with big data frameworks (i.e. Hadoop and Spark), 5+ years' experience.Experience building automated data pipelines, 5+ years of experience.Experience performing data analysis and data...
Big data
Syntricate Technologies
Richardson, TX
3 days ago
Career Accelerator Program - Data Engineer
...store and utilize structured and unstructured data from internal and external sources.... ...artificial intelligence, machine learning and big-data techniques to cleanse, organize and... ...storage to accommodate ongoing needs.Why TI?Engineer your future. We empower our employees to...
Big data
Internship
Local area
Texas Instruments
Richardson, TX
3 days ago
Hadoop and PySpark Data Engineer
$82.42k - $126.6k
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...with Hadoop ecosystem (Cloudera). Experience in working with a Big Data implementation in production environment. Experience with...
Big data
Full time
Temporary work
Relocation
Infosys Technologies
Plano, TX
8 hours ago
Data Engineer | AI & Big Data, CAP Path to Impact
Texas Instruments is seeking a recent graduate for its TMG Development program in Richardson, TX. You will design, build and oversee data architecture, data pipelines, and systems to capture, store and transform data from multiple sources. The role emphasizes AI/ML...
Big data
Texas Instruments
Richardson, TX
5 days ago
Data Engineer
...Our client is currently seeking a Data Engineer with strong experience in data modeling, data warehousing, and cloud-based data platforms.... ...experience with AWS services and a strong foundation in SQL and big data technologies. You will play a key role in building and optimizing...
Big data
The Judge Group
Plano, TX
1 day ago
Senior Data Engineer
...experiences. Role Summary: We are seeking a highly skilled Senior Data Engineer to design, build, and optimize enterprise-scale data platforms.... ...and PySpark Experience with distributed data processing and big data platforms Strong analytical mindset focused on building...
Big data
Hourly pay
Daily paid
Full time
Contract work
Cinemark
Plano, TX
2 days ago
Data Engineer (Hybrid)
$86.8k - $165.2k
...YOU will do:Design, build, and maintain data pipelines that ingest, transform, and deliver... ..., images, documents, logs, and engineering artifacts.Engineer data solutions that can... ...software platforms such as Internet of Things, big data, artificial intelligence, and blockchain...
Big data
Contract work
Temporary work
Work experience placement
Work at office
Remote work
Flexible hours
Raytheon
Richardson, TX
2 days ago
Principal Data Engineer - Global Cybersecurity Data & Analytics
$120k - $225k
...experience insurance.Our Global Cybersecurity Data and Analytics team is tasked with... ...innovative, collaborative Principal Data Engineer to help build and grow our Data and Analytics... ...Collects, cleans, and transforms traditional and big data to ensure data accuracy and...
Big data
Temporary work
Local area
Flexible hours
Shift work
Liberty Mutual
Plano, TX
2 days ago
Lead Data Engineer
...Data Engineering LeadLead end-to-end delivery of large-scale data engineering initiatives, ensuring high-quality and timely outcomes. Architect... ...experience with at least 5+ years of hands-on experience in Big Data and Data Engineering. Strong expertise in Apache Spark and...
Big data
ConnectedX Inc
Plano, TX
3 days ago
AWS Python Data Engineer
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...|data science|PYTHON Technical/Domain Skill 3Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 4Technology...
Big data
Full time
Temporary work
Relocation
Infosys Technologies
Richardson, TX
8 hours ago
Data Engineer
Design, develop, and maintain scalable data pipelines using Snowflake and cloud platforms Build and optimize data models, data warehouses... ...) Familiarity with data lakes, data warehousing concepts, and big data technologies #J-18808-Ljbffr GBIT (Global Bridge InfoTech Inc...
Big data
GBIT (Global Bridge InfoTech Inc)
Richardson, TX
2 days ago
Lead Data Engineer
...85998 The ideal candidate will have a strong background in data engineering and software development, with hands-on experience building scalable... ...data engineering team focused on customer data management and big data solutions that power marketing analytics, personalization...
Big data
PROLIM Corporation
Murphy, TX
2 days ago
Data Engineer (Hybrid)
$86.8k - $165.2k
...will do: Design, build, and maintain data pipelines that ingest, transform, and deliver... ..., images, documents, logs, and engineering artifacts. Engineer data solutions that... ...software platforms such as Internet of Things, big data, artificial intelligence, and blockchain...
Big data
Contract work
Temporary work
Work experience placement
Work at office
Remote work
Flexible hours
RTX
Richardson, TX
2 days ago
GCP data Engineer
...GorusuCompany: SRI Tech SolutionsRole:GCP data EngineerLocation: Santa Clara, CA and Plano... ...for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will... ...analyticsBig Data & Streaming: Implement and support Big Data solutions for both batch (scheduled)...
Big data
Full time
SRI Tech
Plano, TX
2 days ago
Full Stack Data engineer
...focused on Digital Transformation and Product Engineering Services, enabling clients achieve their... ...) experience plus working exposure with data and analytics platforms. We are are Data... ..., Data Modeling, SQL, NoSQL Big Data Technologies: Hadoop, Spark, Athena,...
Big data
ConnectedX Inc
Plano, TX
5 days ago
Lead Data Engineer
$179.4k - $204.7k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast... ...iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real...
Big data
Full time
Part time
Internship
H1b
Local area
Capital One Financial Corp
Plano, TX
1 day ago
Python Data Engineer (Palantir)
...Python Data Engineer (Palantir) Our client, a multinational telecommunications technology company, is looking for a Data Engineer to join... .... - Understanding data warehousing concepts - Cloud & Big Data - Experience with cloud platforms (AWS, Azure, GCP) and...
Big data
Temporary work
Elite Technical
Plano, TX
9 days ago
Cloud Data Engineer
...This is Aditya from Jconnect INC Job Title: Cloud Data Engineer Location: Seattle, WA / Dallas, TX Type: Full-Time... ...ingestion ~ Knowledge of data lakes, data warehouses, and big data architectures ~ Experience with multi-cloud environments...
Big data
Full time
Immediate start
Relocation
3B Staffing LLC
Murphy, TX
5 days ago
Lead Big Data Engineer: Real-Time Pipelines & Cloud
Compunnel, Inc. in Plano, TX seeks a Lead Data Engineer to design and implement scalable data platforms across the enterprise. You will build data pipelines, data models, and governance practices while delivering measurable improvements to developer productivity and data...
Big data
Compunnel, Inc.
Plano, TX
2 days ago
Senior / Lead Big Data Engineer
The Lead Data Engineer will be responsible for designing, developing, testing, implementing, and supporting scalable data engineering solutions. The role will focus on building data pipelines, data movement solutions, data modeling, data quality, governance, and developer...
Big data
Compunnel, Inc.
Plano, TX
2 days ago
Senior Data Engineer
$158.6k - $181k
...iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies....
Big data
Full time
Part time
Internship
H1b
Local area
iHire
Plano, TX
2 days ago
Senior Lead Data Engineer
$209k - $238.5k
...platforms and reliable analytics pipelines. This onsite Senior Lead Data Engineering position in Plano, TX pairs hands-on platform work with team... ...data pipelines on medium to large scale datasets using big data technologies such as Spark , Flink , Kafka , Snowflake ,...
Big data
Internship
Information Technology Senior Management Forum
Plano, TX
2 days ago
Lead Data Engineer (Java, Python, AWS)
$179.4k - $204.7k
Lead Data Engineer (Java, Python, AWS) - Do you love building and pioneering in the technology space? Do you enjoy solving complex business... ...iterative delivery environment? At Capital One, you’ll be part of a big group of makers, breakers, doers, and disruptors who solve real...
Big data
Internship
Local area
Capital One
Plano, TX
2 days ago
Lead Data Engineer (Java, Python, AWS)
$179.4k - $204.7k
...Overview Lead Data Engineer (Java, Python, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex... ...delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real...
Big data
Full time
Part time
Internship
H1b
Local area
Capital One
Plano, TX
22 days ago
Sr. Manager - Data & AI Support Engineering Plano, Texas
Sr. Manager - Data & AI Support Engineering P-1388 As a Sr. Manager of the Data & AI Support Engineering team, you will lead and manage a team of... ...systems. Experience leading production‑scale workloads across Big Data, Hadoop, AI/ML, Kafka, Streaming, Data Science, or...
Big data
Work experience placement
Worldwide
Databricks
Plano, TX
6 days ago
Data & AI Engineer III (Hybrid)
...help Make Tomorrow Better.Role Overview:Could you be our next Data & AI Engineer III? Globe Life is looking for a Data & AI Engineer III to... ...expertise in AWS services, advanced SQL, Python, Informatica, and Big Data technologies such as Hadoop and Spark, this role also...
Big data
Full time
Part time
Work experience placement
Work at office
Work from home
Monday to Friday
Shift work
Globe Life
Mckinney, TX
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!