Data Engineer
Artech Information Systems LLC
Job Title: Data Engineer
Duration: 10 months
Location: Plano , TX (Hybrid)
Interview: Coding exercise at the time of interview Overview: We are seeking a skilled professional with over 5 years of experience in AWS, Python, Scala, Spark, and SQL. The ideal candidate will have a strong understanding of data processing, API development, and data pipeline construction. Key Responsibilities:
For immediate consideration please click APPLY.
Duration: 10 months
Location: Plano , TX (Hybrid)
Interview: Coding exercise at the time of interview Overview: We are seeking a skilled professional with over 5 years of experience in AWS, Python, Scala, Spark, and SQL. The ideal candidate will have a strong understanding of data processing, API development, and data pipeline construction. Key Responsibilities:
- Build and maintain APIs to support enterprise-wide data needs.
- Analyze large volumes of data and write efficient SQL queries.
- Develop and manage billing data pipelines.
- Design and implement ETL pipelines for processing large-scale data.
- Collaborate with the compliance team as part of the centralized data management team.
- Ensure compliance with regulatory and ethical standards through effective data management.
- Handle high-volume data processing and optimize performance.
- Work closely with stakeholders to gather requirements and provide data-driven solutions.
- Experience working with financial institutions is preferred.
- We support all compliance-related activities by serving as a centralized data management team. Our primary responsibility is to manage customer data, ensuring accuracy and security.
- This project is an ongoing initiative with no immediate end, involving multiple processes tailored to various teams. Our current focus is on expanding our capabilities by developing new data products to support additional teams and use cases.
- We are expanding rapidly, enabling us to grow our team and enhance our scope across the product.
- Currently, our focus is primarily on customer data, but we are transitioning to include customer transactions.
- This expansion is expected to evolve into a multi-year project, although commitments beyond the current year are uncertain due to external factors.
- We manage approximately 40 million records daily, with potential increases beyond this figure.
- Our infrastructure includes 16 to 20 data pipelines, ingesting customer data from various sources.
- These pipelines process data volumes ranging from 150 million to 25 million records, with delta processing to optimize storage and performance.
- On average, we handle 60 to 70 million records within our data pipelines.
- AWS: 20%
- Python: 20%
- Scala: 20%
- Spark: 20%
- SQL: 20%
For immediate consideration please click APPLY.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Plano, TX vacancy
- ...Job Description: ~ Job Description: Data Engineer Lead Snowflake, DataStage / Informatica "1 Analyze and build ETL data assets using IBM DataStage / Informatica and On-Prem Databases such as Netezza. Propose design and implement solutions to migrate...Suggested
Mando Technologies
Frisco, TX3 days ago - ...requirements and translate them into technical solutions. 4. Develop and maintain database systems using snowflake and sql. 5. Implement data transformation and modeling using dbt (data build tool). 6. Write and optimize python code for data extraction, transformation,...Suggested
Omni Inclusive
Frisco, TX1 day ago $179.4k - $204.7k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and...SuggestedFull timePart timeInternshipH1bLocal areaCapital One
Plano, TX3 days ago- ...Lead Data Engineer Role Cognizant is looking for a lead data engineer role. The job summary includes understanding business requirements, providing impact analysis during changes and production events, and being strong in Azure, Airflow, CICD, Kubernetes, Spark Scala...SuggestedDay shift
Keylent Inc
Plano, TX3 days ago - ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design...SuggestedLong term contractWork at office
InterSources
Plano, TX15 days ago - ...Job Description A fortune 100 client is seeking to increase their team in India by 2. They are seeking hands-on data engineer to support the refactoring and migration of existing data transformations built in the Coupa Data Guru tool into Databricks. This role will...
Insight Global
Plano, TX7 days ago $104k - $130k
...Job Description Job Description What we’re looking for: As a member of the Data Platform Engineering team, the Real-Time Data Engineer II will work collaboratively to develop an infrastructure that ingests data from disparate sources, processes them real-time...Hourly payFull timeImmediate startAppFolio
Richardson, TX2 hours ago- ...Job Description Job Description We are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions. Data analyst responsibilities include conducting full...Work experience placement
forhyre.com
Plano, TX4 days ago - ...ConnectedX is focused on Digital Transformation and Product Engineering Services, enabling clients to achieve their business, operating... ...We are looking for a passionate and highly motivated Lead Data Engineer for a Fortune 100 client. This is a long term role in...
ConnectedX Inc
Plano, TX4 days ago - ...Required Skills: Proficiency in snowflake for database development and management. Experience with dbt for data transformation and modeling. Strong sql skills for querying and managing databases. Advanced knowledge of python for data manipulation and...
Syntricate Technologies
Frisco, TX4 days ago - ...Overview: Data Engineer • Design, build, and monitor ETL/ELT pipelines for scalable data processing. • Automate data ingestion using APIs and scripting tools. • Implement automated health checks and pipeline monitoring systems. • Work with technologies including...
Purple Drive
Plano, TX1 day ago - ...Title: Data Engineer Locations: India - Remote Duration: 15 weeks Job Description: We're in search of a candidate who knows about and loves working with modern data integration frameworks, big data and cloud technologies. Candidates must also be proficient...Local areaRemote work
My3Tech Inc
Plano, TX4 days ago - ...o Design and implement scalable data pipelines using Databricks or AWS services such as Glue, Redshift, S3, Lambda, EMR, Athena Develop... ...resolution. o Stay updated with the latest developments in AWS Data engineering technologies and best practices. Job Requirements
Seven Seven Software
Plano, TX3 days ago - ...What we are looking for Highly experienced Data Engineer with expertise in cloud engineering, data engineering, and data warehousing, particularly within the AWS and google cloud ecosystem. Success in designing and implementing scalable cloud solutions, data pipelines...
ConnectedX Inc
Plano, TX4 days ago - ...Data Engineering Manager Design, develop, and maintain scalable, production-grade ELT pipelines using Snowflake and dbt (Core or Cloud). Lead technical design discussions and provide architectural guidance for data engineering solutions. Implement dimensional...
Cynet Systems
Plano, TX18 hours ago - ...Description Data Governance Platform Engineer Description At Liberty Mutual, technology isn't just a part of our business, it's what drives us forward. We deliver our customers peace of mind every day by helping them protect what they value most. Our passion...Work at officeLocal areaVisa sponsorshipWork visaShift work
Liberty Information Technology Limited
Plano, TX2 days ago - ...valued, your efforts have a visible impact, and your dedication is recognized, take the next step in your career with us. As a Data Engineer III, you’ll play a senior technical role designing, building, and optimizing scalable data pipelines and platforms that power...Temporary workH1bImmediate start
GAINSCO
Richardson, TX1 day ago - ...Data Bricks Data Engineer Location: Seattle, WA / Bellevue, WA / Everett, WA / Renton, WA / Richardson, TX / Plano, TX / Dallas, TX / St. Louis, MO / Charleston, SC / Arlington, VA Duration: Fulltime Job Description: Skills Desired: • Strong programming skills...Full time
JConnect Infotech
Plano, TX18 hours ago - ...We had Interview Scheduled but candidate backed out at last moment DATA ENGINEER Location: Plano, TX | Hybrid Option Duration: 6+ Month Contract Hybrid/Remote Requirement: Hybrid Initial Term of Engagement: ASAP Interview Process...Permanent employmentContract workImmediate startRemote work
3B Staffing LLC
Murphy, TX4 days ago - ...Ascentt is transforming the future of manufacturing through advanced Data Analytics, AI/ML, and Generative AI solutions. We partner with... ...business insights. Our teams work on scalable, high-impact engineering challenges across cloud, data, and intelligent automation...
Ascentt
Plano, TX18 hours ago - ...Data Engineer Visa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax terms: W2, 1099 Corp-Corp or 3rd Parties. Roles: Data Engineer. Location: Plano, TX. Experience: 8 years in IT. Skills: Spark, Scala, Java, EMR, AWS, Streaming...
Keylent Inc
Plano, TX18 hours ago - ...customers. We are looking for an experienced Software Developers and Engineers who has a passion for building software solutions, asking... ...years of total IT experience ~3+ years of experience as a Data Engineer, having built large and complex data pipelines ~ Experience...Full timeWork at officeLocal areaImmediate start
r2 Technologies, Inc.
Plano, TX4 days ago $63 per hour
...Request-ID: 33412-1 BFS -Domain preferred ***Max rate $63 ***Hybrid in Plano TX Data Engineer Job summary Experience : 5to7Yrs Required Skills : Unix,Java,Spring Boot,Spark,SQL,AWS As a Data Engineer within our multinational corporation, you will...Keylent Inc
Plano, TX3 days ago- ...The Enterprise Data Management Services team is looking for a strong, self-motivated Technology Developer to become an integral part... ...release processes Identifies, defines, and documents data engineering requirements, communicating required information for deployment...
Texas State Library and Archives Commision
Murphy, TX3 days ago - ...Responsibilities : ~5+ years of data engineering experience. ~ Design, develop, and maintain efficient data pipelines for the extraction, transformation, and loading (ETL) of data from various sources (databases, APIs, flat files, etc.) ~ Solid experience...For contractorsLocal area
My3Tech Inc
Plano, TX3 days ago - ...Role:- Data Engineer Location:- Plano, TX Job Summary: We seek a skilled Data Engineer proficient in Java and Python to design, develop, and optimize data pipelines and systems. The ideal candidate will have experience with big data technologies, cloud...
InterSources
Plano, TX2 days ago $80k - $120k
...Role - Data Engineer Experience Required - 8+ Years Must Have Technical/Functional Skills Snowflake, dbt, Datastage / Informatica, python (basics), git, control-m, vs code copilot Roles & Responsibilities 1. Analyze and build ETL data assets in cloud...Tata Consultancy Services
Plano, TX2 days ago- ...Data Engineer (ETL/ELT) Work Location (City, State) San Antonio/Plano (TX), Phoenix (AZ) Open for Remote (Yes/No) No Client Interview (Yes/No) Yes No. of Positions 2 Experience level (Years) 10+ Must have skills Dbt /snowflake Preferred skills Informatica...Remote work
E-Solutions
Plano, TX1 day ago - ...Position- Data Engineer Location- Plano TX Duration- Contract Job Description: Required Skills: Unix,Python,PySpark,SQL,AWS Roles & Responsibilities : Analyze business processes to identify areas for improvement and optimization. Develop and...Contract work
Georgia IT Inc
Plano, TX1 day ago - ...time Description Position Purpose and Objectives At Texans Credit Union, great data powers exceptional member experiences. We're looking for a Data Engineer to build and optimize scalable data pipelines, ensure data quality, and enable reliable, data-...Full time
Texans Credit Union
Richardson, TX18 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- director data engineering Plano, TX
- junior big data engineer Plano, TX
- senior data engineer Plano, TX
- data platform engineer Plano, TX
- sr information security engineer Plano, TX
- senior data integration developer Plano, TX
- data developer Plano, TX
- data engineer Plano, TX
- data infrastructure engineer Plano, TX
- entry level big data engineer Plano, TX