Data Engineer
Artech Information Systems LLC
Job Title: Data Engineer
Duration: 10 months
Location: Plano , TX (Hybrid)
Interview: Coding exercise at the time of interview Overview: We are seeking a skilled professional with over 5 years of experience in AWS, Python, Scala, Spark, and SQL. The ideal candidate will have a strong understanding of data processing, API development, and data pipeline construction. Key Responsibilities:
For immediate consideration please click APPLY.
Duration: 10 months
Location: Plano , TX (Hybrid)
Interview: Coding exercise at the time of interview Overview: We are seeking a skilled professional with over 5 years of experience in AWS, Python, Scala, Spark, and SQL. The ideal candidate will have a strong understanding of data processing, API development, and data pipeline construction. Key Responsibilities:
- Build and maintain APIs to support enterprise-wide data needs.
- Analyze large volumes of data and write efficient SQL queries.
- Develop and manage billing data pipelines.
- Design and implement ETL pipelines for processing large-scale data.
- Collaborate with the compliance team as part of the centralized data management team.
- Ensure compliance with regulatory and ethical standards through effective data management.
- Handle high-volume data processing and optimize performance.
- Work closely with stakeholders to gather requirements and provide data-driven solutions.
- Experience working with financial institutions is preferred.
- We support all compliance-related activities by serving as a centralized data management team. Our primary responsibility is to manage customer data, ensuring accuracy and security.
- This project is an ongoing initiative with no immediate end, involving multiple processes tailored to various teams. Our current focus is on expanding our capabilities by developing new data products to support additional teams and use cases.
- We are expanding rapidly, enabling us to grow our team and enhance our scope across the product.
- Currently, our focus is primarily on customer data, but we are transitioning to include customer transactions.
- This expansion is expected to evolve into a multi-year project, although commitments beyond the current year are uncertain due to external factors.
- We manage approximately 40 million records daily, with potential increases beyond this figure.
- Our infrastructure includes 16 to 20 data pipelines, ingesting customer data from various sources.
- These pipelines process data volumes ranging from 150 million to 25 million records, with delta processing to optimize storage and performance.
- On average, we handle 60 to 70 million records within our data pipelines.
- AWS: 20%
- Python: 20%
- Scala: 20%
- Spark: 20%
- SQL: 20%
For immediate consideration please click APPLY.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer in Plano, TX vacancy
- ...capture, manage, store and utilize structured and unstructured data from internal and external sources. Establishes and builds processes... ...to systems and storage to accommodate ongoing needs.Why TI?Engineer your future. We empower our employees to truly own their career...SuggestedInternshipLocal area
Texas Instruments
Richardson, TX1 day ago $82.42k - $126.6k
...driving digital transformation for financial institutions. We specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock business value. Our AI-driven solutions empower financial institutions...SuggestedFull timeTemporary workRelocationInfosys Technologies
Plano, TX2 days ago- We are looking for a Data Engineer to join a Financial Services team in Plano, Texas on a contract basis with the potential for a permanent role. This role is focused on designing and delivering reliable data pipelines in a cloud-first environment, with Snowflake serving...SuggestedPermanent employmentContract work
Robert Half
Plano, TX3 days ago - ...Lead Data Engineer Role Cognizant is looking for a Lead Data Engineer role. The position involves understanding business requirements and providing impact analysis during changes and production events. The candidate should have strong skills in Azure, Airflow, CICD,...Suggested
Keylent Inc
Plano, TX1 day ago - ...Lead Data Engineer We are seeking a highly experienced Lead Data Engineer to drive the modernization and transformation of enterprise data platforms. The Lead Data Engineer will be responsible for managing and optimizing data movement between external partners and...Suggested
Saxon Global
Plano, TX3 days ago - ...Location: Plano, TX Duration: 6 months GBaMS ReqID: 10585998 The ideal candidate will have a strong background in data engineering and software development, with hands-on experience building scalable systems that collect, process, and activate customer data....
PROLIM Corporation
Murphy, TX5 days ago - ...Lead Data Engineer Locations: Richmond - VA / McLean - VA/ Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design, development...Long term contractWork at office
InterSources
Plano, TX3 days ago - ...Data Engineering Lead Lead end-to-end delivery of large-scale data engineering initiatives, ensuring high-quality and timely outcomes. Architect, design, and implement scalable, cloud-native data platforms using Databricks, Apache Spark (Scala), and AWS services. Develop...
ConnectedX Inc
Plano, TX2 days ago $102.68k - $171.13k
Job ID: 384793Company: NTT DATA Americas, Inc.Location: Plano, US-TX, United StatesEmployment type: full timeCategory: OtherPosted: 2... ..., apply now. We are currently seeking a Senior Oracle Data Engineer - Onsite to join our team in Plano, Texas (US-TX), United States...Temporary workWork at officeRemote workFlexible hoursNTT DATA
Plano, TX3 days ago- ...PROLIM Global Corporation is hiring a Data Engineer for one of our top clients. Location: Plano, TX - Onsite Duration: 6 Months Job Type: Contract Experience Required: 8-10 Years Job Summary We are seeking an experienced...Contract work
PROLIM Corporation
Plano, TX3 days ago - ...Job Title Technical hands on skill and minimum 10+ years of on job experience on below tech stack: Data factory Azure Pyspark Azure Databricks Delta lake Python Synpase Good to have: Ability to analyze and understand data, data flows,...
The Dignify Solutions, LLC
Plano, TX2 days ago - ...We had Interview Scheduled but candidate backed out at last moment DATA ENGINEER Location: Plano, TX | Hybrid Option Duration: 6+ Month Contract Hybrid/Remote Requirement: Hybrid Initial Term of Engagement: ASAP Interview Process...Permanent employmentContract workImmediate startRemote work
3B Staffing LLC
Murphy, TX2 days ago - ...Purple Drive Data Engineer • Design, build, and monitor ETL/ELT pipelines for scalable data processing. • Automate data ingestion using APIs and scripting tools. • Implement automated health checks and pipeline monitoring systems. • Work with technologies including...
Purple Drive
Plano, TX4 days ago - ...Title : Lead Data Platform Engineer Location: PLANO, TX- 75024 Duration: 0-4+ months Shift: M-F 8am-4pm Hybrid Pay Rate: $51.09-$72.99/HR on w2 Job Description: Primary Responsibilities: Design, implement, and manage cloud infrastructure and...Shift work
LanceSoft
Plano, TX4 days ago - ...Data Engineer Client is seeking a data engineer for the Data & Analytics engineering team, driving innovation in scalable, personalized financial advice through data infrastructure, machine learning, and engineering excellence. The role involves collaborating with a...
RIT Solutions
Plano, TX2 days ago - ...Data Engineer The Company does not provide visa sponsorship for this position. Applicants must be currently authorized to work in the U.S. About Sally Beauty Holdings, Inc. At SBH, our purpose is to inspire a more colorful, confident, and welcoming world. We are...Work at office
Sally Beauty
Plano, TX4 days ago - ...Role:- Data Engineer Location:- Plano, TX Job Summary: We seek a skilled Data Engineer proficient in Java and Python to design, develop, and optimize data pipelines and systems. The ideal candidate will have experience with big data technologies, cloud...
InterSources
Plano, TX5 days ago - ...customers. We are looking for an experienced Software Developers and Engineers who has a passion for building software solutions, asking... ...years of total IT experience ~3+ years of experience as a Data Engineer, having built large and complex data pipelines ~ Experience...Full timeWork at officeLocal areaImmediate start
r2 Technologies, Inc.
Plano, TX2 days ago $50 per hour
...Data Engineer Work Location: Plano, TX or Atlanta, GA Maximum Pay Rate: $50/hr (to me) Client: BOFA Candidate’s Experience: 5 Years of Experience Candidates will also need to go through a tech screening. We are looking for candidates with the following primary...Argyle Infotech
Plano, TX3 days ago$120k - $130k
...Job Title: Sr. Snowflake Data Engineer Location: PLANO, TX ( Day 1 Onsite) Salary Range: $120-130K Job Summary: We are seeking a skilled Data Engineer with a strong background in Snowflake to join our dynamic team. The ideal candidate will have 7 to 1...Diverse Lynx
Plano, TX3 days ago- ...Engineer II The Engineer II role plans, designs, develops and tests high-quality, high-performance, innovative, and fully functioning products and live services related to Toyota vehicle data. The scope of the projects includes ingestion of data from multiple types...
Software Technology Inc
Plano, TX3 days ago - ...Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data...
Samprasoft
Plano, TX4 days ago - ...Our client is currently seeking a Data Engineer with strong experience in data modeling, data warehousing, and cloud-based data platforms. The ideal candidate will have hands-on experience with AWS services and a strong foundation in SQL and big data technologies. You...
The Judge Group
Plano, TX3 days ago - ...Data Engineer Opportunity A rapidly expanding consumer financial services organization in Plano, TX is seeking an analytics-driven professional to join their Reporting and Analytics team. This pivotal role offers the opportunity to make an impact through data storytelling...Visa sponsorship
New Day Executive Search
Plano, TX4 days ago - ...Data Engineer Opportunity At Ascentt Ascentt is transforming the future of manufacturing through advanced Data Analytics, AI/ML, and Generative AI solutions. We partner with global manufacturing enterprises to convert complex industrial data into actionable, real-time...
Ascentt
Plano, TX3 days ago - ...Job Title:Data Engineer Location: ONSITE- Plano,TX Duration: 6 month Experience Required: 6-8 Description: Data Engineer Lead responsible for building and optimizing scalable data pipelines using DBT, Snowflake, and IBM DataStage, combining modern ELT and...
I-Flow
Murphy, TX4 days ago - ...Data Engineer Job Location: Plano, TX Job Type: Contract Client: Virtusa Rate: Depend on Experience Job Authorization: US Citizen/ GC /EAD (H4/L2/TN) preferred C2c are open only for own corp, not accepted from any employers Responsibilities: ~4-8...Contract work
Georgia IT Inc
Plano, TX3 days ago $100k
...Cloud World/Oracle Java One (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023 ll Positions are open for... ...developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions with clients. Who Should Apply...Full timeH1bSynergisticIT
Plano, TX5 days ago- ...driving digital transformation for financial institutions. We specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock business value. Our AI-driven solutions empower financial institutions...Full timeTemporary workRelocation
Infosys Technologies
Richardson, TX2 days ago - ...loving what you do and where you do it.Job CategoryData Analytics, Data Science, TechnologyCompensation OverviewThe annual base salary... ...0,200.00Target Openings1What Is the Opportunity?Travelers Data Engineering team constructs pipelines that contextualize and provide easy...Full timeWork experience placementH1bLocal areaImmediate start
The Travelers Indemnity Company
Richardson, TX2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- finance data engineer Plano, TX
- data engineer contract Plano, TX
- big data devops engineer Plano, TX
- sr data engineer Plano, TX
- senior data engineer Plano, TX
- entry level big data engineer Plano, TX
- etl data engineer Plano, TX
- director data engineering Plano, TX
- data engineer machine learning Plano, TX
- data infrastructure engineer Plano, TX