Data Engineer

Artech Information Systems LLC

Job Title: Data Engineer
Duration: 10 months
Location: Plano , TX (Hybrid)
Interview: Coding exercise at the time of interview

Overview:

We are seeking a skilled professional with over 5 years of experience in AWS, Python, Scala, Spark, and SQL. The ideal candidate will have a strong understanding of data processing, API development, and data pipeline construction.

Key Responsibilities:

Build and maintain APIs to support enterprise-wide data needs.
Analyze large volumes of data and write efficient SQL queries.
Develop and manage billing data pipelines.
Design and implement ETL pipelines for processing large-scale data.
Collaborate with the compliance team as part of the centralized data management team.
Ensure compliance with regulatory and ethical standards through effective data management.
Handle high-volume data processing and optimize performance.
Work closely with stakeholders to gather requirements and provide data-driven solutions.
Experience working with financial institutions is preferred.

About the Team:

We support all compliance-related activities by serving as a centralized data management team. Our primary responsibility is to manage customer data, ensuring accuracy and security.
This project is an ongoing initiative with no immediate end, involving multiple processes tailored to various teams. Our current focus is on expanding our capabilities by developing new data products to support additional teams and use cases.
We are expanding rapidly, enabling us to grow our team and enhance our scope across the product.
Currently, our focus is primarily on customer data, but we are transitioning to include customer transactions.
This expansion is expected to evolve into a multi-year project, although commitments beyond the current year are uncertain due to external factors.

Data Volume and Infrastructure:

We manage approximately 40 million records daily, with potential increases beyond this figure.
Our infrastructure includes 16 to 20 data pipelines, ingesting customer data from various sources.
These pipelines process data volumes ranging from 150 million to 25 million records, with delta processing to optimize storage and performance.
On average, we handle 60 to 70 million records within our data pipelines.

Skills:

AWS: 20%
Python: 20%
Scala: 20%
Spark: 20%
SQL: 20%

For immediate consideration please click APPLY.

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Data Engineer in Plano, TX vacancy

Lead Data Engineer
$193.4k - $220.7k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...
Suggested
Full time
Part time
Internship
H1b
Local area
Capital One
Plano, TX
4 days ago
Lead Data Engineer
...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design...
Suggested
Long term contract
Work at office
InterSources
Plano, TX
5 days ago
Lead Data Engineer
...Lead Data Engineer Role Cognizant is looking for a lead data engineer role. The job summary includes understanding business requirements, providing impact analysis during changes and production events, and being strong in Azure, Airflow, CICD, Kubernetes, Spark Scala...
Suggested
Keylent Inc
Plano, TX
3 days ago
Data Engineer 1
...Overview What Is the Opportunity? Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key role in growing and transforming our analytics landscape. In addition...
Suggested
Immediate start
The Travelers Companies, Inc.
Richardson, TX
3 days ago
Data Engineer
$70 - $75 per hour
...Location: Plano, TX Salary: $70.00 USD Hourly - $75.00 USD Hourly Description: Our client is currently seeking a Data Engineer with strong experience in data modeling, data warehousing, and cloud-based data platforms. The ideal candidate will have hands-on experience with...
Suggested
Hourly pay
The Judge Group
Plano, TX
3 days ago
Data Engineer
$157.41k
...of health around every individual - shaping a more connected, convenient and compassionate health experience. Position Summary Data Engineer – Richardson, TX. Develop, build and manage large-scale data structures, pipelines and efficient ETL workflows to address complex...
Temporary work
Local area
Hispanic Alliance for Career Enhancement
Richardson, TX
3 days ago
Data Engineer
...Job Description Insight Global is looking for a Lead Data Engineer to come join their team. This candidate will be helping design and deliver modern data solutions using cloud-based platforms and AI-driven innovations. You will partner with business, technology, and governance...
Insight Global
Plano, TX
4 days ago
Data Engineer
...We are seeking a skilled Data Engineer to build and maintain ETL/ELT pipelines that support the creation of a centralized data platform in Snowflake. The ideal candidate will have extensive experience with Snowflake and data engineering best practices, ensuring data quality...
Compunnel
Plano, TX
3 days ago
Data Engineer
...Ascentt is transforming the future of manufacturing through advanced Data Analytics, AI/ML, and Generative AI solutions. We partner with... ...business insights. Our teams work on scalable, high-impact engineering challenges across cloud, data, and intelligent automation...
Ascentt
Plano, TX
2 days ago
Data Engineer
...We have partnered with our client in their search for a Data Engineer in Plano, TX. Responsibilities Design, build, and maintain scalable data pipelines to support real-time, batch, and streaming data processing using tools such as Python, Java, Spark, and Kafka. Develop...
Work experience placement
Ports North
Plano, TX
2 days ago
Data Engineer
...Job Type Full-time Position Purpose and Objectives At Texans Credit Union, great data powers exceptional member experiences. We're looking for a Data Engineer to build and optimize scalable data pipelines, ensure data quality, and enable reliable, data-driven decision-...
Full time
Texans Credit Union
Richardson, TX
2 days ago
Data Engineer
$116k - $135k
...Summary/Objective Reporting to the IT Manager, Data & Analytics, the Data Engineer is responsible for designing, building, and maintaining scalable data pipelines, data platforms, and data warehouse/data lakehouse architectures that support enterprise analytics, reporting...
Full time
Temporary work
Work experience placement
Work at office
Immediate start
Monday to Friday
Cain-Watters-
Frisco, TX
3 days ago
Data Engineer
...Design, develop, and maintain scalable data pipelines using Snowflake and cloud platforms Build and optimize data models, data warehouses, and data marts Implement ETL/ELT workflows for structured and semi-structured data Work with large datasets to ensure data quality...
GBIT (Global Bridge InfoTech Inc)
Richardson, TX
3 days ago
Data Engineer
$110k - $140k
...Megazone Cloud is looking for a Data Engineer to be a backbone of our data‑driven culture. You are a "builder" with a true thirst for knowledge and a startup mentality. You're not afraid to be a "jack of all trades" and you thrive in an environment where you can think...
Internship
Immediate start
Flexible hours
MegazoneCloud US
Frisco, TX
4 days ago
Lead Data Engineer (Java, Python, AWS)
$179.4k - $204.7k
...Lead Data Engineer (Java, Python, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big...
Full time
Part time
Internship
H1b
Local area
Capital One Financial Corp
Plano, TX
11 days ago
Data Engineer / Analyst (Coupa DataGuru Databricks): INTL
...Job Description A fortune 100 client is seeking to increase their team in India by 2. They are seeking hands-on data engineer to support the refactoring and migration of existing data transformations built in the Coupa Data Guru tool into Databricks. This role will...
Insight Global
Plano, TX
2 days ago
Data Engineer
...Role: Data Engineer Location: Plano, TX (Onsite) looking for an experienced Data Engineer to build and maintain scalable data pipelines and analytics solutions leveraging AWS services such as Athena, Lambda, Glue, and S3. The candidate will support reporting...
Lorven Technologies
Plano, TX
1 day ago
Data Engineer
$100k - $140k
...day one ~401(k), tuition reimbursement & longevity bonuses Responsibilities We are hiring a hands-on senior level Data Engineer to build trustworthy, well governed data products and turn them into insights that drive underwriting, claims, product, distribution...
Work at office
Remote work
Weekend work
3 days per week
Berkshire Hathaway GUARD Insurance Companies
Plano, TX
4 days ago
Data Engineer
...Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data...
Samprasoft
Plano, TX
1 day ago
Data Engineer
...Description Data Governance Platform Engineer Description At Liberty Mutual, technology isn't just a part of our business, it's what drives us forward. We deliver our customers peace of mind every day by helping them protect what they value most. Our passion...
Work at office
Local area
Visa sponsorship
Work visa
Shift work
Liberty Information Technology Limited
Plano, TX
2 days ago
Snowflake Data Engineer
...Job Title Required Skills: Strong in SQL and Python, 8+ years' experience. Experience with big data frameworks (i.e. Hadoop and Spark), 5+ years' experience. Experience building automated data pipelines, 5+ years of experience. Experience performing...
Syntricate Technologies
Richardson, TX
4 days ago
Data Engineer
...Data Engineering Manager Design, develop, and maintain scalable, production-grade ELT pipelines using Snowflake and dbt (Core or Cloud). Lead technical design discussions and provide architectural guidance for data engineering solutions. Implement dimensional...
Cynet Systems
Plano, TX
5 days ago
DATA ENGINEER
...Overview: Data Engineer • Design, build, and monitor ETL/ELT pipelines for scalable data processing. • Automate data ingestion using APIs and scripting tools. • Implement automated health checks and pipeline monitoring systems. • Work with technologies including...
Purple Drive
Plano, TX
1 day ago
Data Engineer
...We had Interview Scheduled but candidate backed out at last moment DATA ENGINEER Location: Plano, TX | Hybrid Option Duration: 6+ Month Contract Hybrid/Remote Requirement: Hybrid Initial Term of Engagement: ASAP Interview Process...
Permanent employment
Contract work
Immediate start
Remote work
3B Staffing LLC
Murphy, TX
4 days ago
Data Engineer
...customers. We are looking for an experienced Software Developers and Engineers who has a passion for building software solutions, asking... ...years of total IT experience ~3+ years of experience as a Data Engineer, having built large and complex data pipelines ~ Experience...
Full time
Work at office
Local area
Immediate start
r2 Technologies, Inc.
Plano, TX
4 days ago
Data Engineer
$50 per hour
...Data Engineer Work Location: Plano, TX or Atlanta, GA Maximum Pay Rate: $50/hr (to me) Client: BOFA Candidate’s Experience: 5 Years of Experience Candidates will also need to go through a tech screening. We are looking for candidates with the following primary...
Argyle Infotech
Plano, TX
5 days ago
Data Engineer
...Role:- Data Engineer Location:- Plano, TX Job Summary: We seek a skilled Data Engineer proficient in Java and Python to design, develop, and optimize data pipelines and systems. The ideal candidate will have experience with big data technologies, cloud...
InterSources
Plano, TX
2 days ago
Data Engineer
$63 per hour
...Request-ID: 33412-1 BFS -Domain preferred ***Max rate $63 ***Hybrid in Plano TX Data Engineer Job summary Experience : 5to7Yrs Required Skills : Unix,Java,Spring Boot,Spark,SQL,AWS As a Data Engineer within our multinational corporation, you will...
Keylent Inc
Plano, TX
3 days ago
Data Engineer
...Data Engineer Job Location: Plano, TX Job Type: Contract Client: Virtusa Rate: Depend on Experience Job Authorization: US Citizen/ GC /EAD (H4/L2/TN) preferred C2c are open only for own corp, not accepted from any employers Responsibilities: ~4-8...
Contract work
Staffing the Universe
Plano, TX
13 hours ago
Data Engineer
$104.24k - $156.36k
...Data Engineer NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our...
Temporary work
Work experience placement
Relocation
Flexible hours
NTT DATA
Plano, TX
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!