Data Engineer
Artech Information Systems LLC
Job Title: Data Engineer
Duration: 10 months
Location: Plano , TX (Hybrid)
Interview: Coding exercise at the time of interview Overview: We are seeking a skilled professional with over 5 years of experience in AWS, Python, Scala, Spark, and SQL. The ideal candidate will have a strong understanding of data processing, API development, and data pipeline construction. Key Responsibilities:
For immediate consideration please click APPLY.
Duration: 10 months
Location: Plano , TX (Hybrid)
Interview: Coding exercise at the time of interview Overview: We are seeking a skilled professional with over 5 years of experience in AWS, Python, Scala, Spark, and SQL. The ideal candidate will have a strong understanding of data processing, API development, and data pipeline construction. Key Responsibilities:
- Build and maintain APIs to support enterprise-wide data needs.
- Analyze large volumes of data and write efficient SQL queries.
- Develop and manage billing data pipelines.
- Design and implement ETL pipelines for processing large-scale data.
- Collaborate with the compliance team as part of the centralized data management team.
- Ensure compliance with regulatory and ethical standards through effective data management.
- Handle high-volume data processing and optimize performance.
- Work closely with stakeholders to gather requirements and provide data-driven solutions.
- Experience working with financial institutions is preferred.
- We support all compliance-related activities by serving as a centralized data management team. Our primary responsibility is to manage customer data, ensuring accuracy and security.
- This project is an ongoing initiative with no immediate end, involving multiple processes tailored to various teams. Our current focus is on expanding our capabilities by developing new data products to support additional teams and use cases.
- We are expanding rapidly, enabling us to grow our team and enhance our scope across the product.
- Currently, our focus is primarily on customer data, but we are transitioning to include customer transactions.
- This expansion is expected to evolve into a multi-year project, although commitments beyond the current year are uncertain due to external factors.
- We manage approximately 40 million records daily, with potential increases beyond this figure.
- Our infrastructure includes 16 to 20 data pipelines, ingesting customer data from various sources.
- These pipelines process data volumes ranging from 150 million to 25 million records, with delta processing to optimize storage and performance.
- On average, we handle 60 to 70 million records within our data pipelines.
- AWS: 20%
- Python: 20%
- Scala: 20%
- Spark: 20%
- SQL: 20%
For immediate consideration please click APPLY.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Plano, TX vacancy
- ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design...SuggestedLong term contractWork at office
InterSources
Plano, TX14 days ago - ...Job Description: ~ Job Description: Data Engineer Lead Snowflake, DataStage / Informatica "1 Analyze and build ETL data assets using IBM DataStage / Informatica and On-Prem Databases such as Netezza. Propose design and implement solutions to migrate...Suggested
Mando Technologies
Frisco, TX2 days ago - ...requirements and translate them into technical solutions. 4. Develop and maintain database systems using snowflake and sql. 5. Implement data transformation and modeling using dbt (data build tool). 6. Write and optimize python code for data extraction, transformation,...Suggested
Omni Inclusive
Frisco, TX21 hours ago $179.4k - $204.7k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and...SuggestedFull timePart timeInternshipH1bLocal areaCapital One
Plano, TX2 days ago- ...Lead Data Engineer Role Cognizant is looking for a lead data engineer role. The job summary includes understanding business requirements, providing impact analysis during changes and production events, and being strong in Azure, Airflow, CICD, Kubernetes, Spark Scala...SuggestedDay shift
Keylent Inc
Plano, TX2 days ago - ...Job Description A fortune 100 client is seeking to increase their team in India by 2. They are seeking hands-on data engineer to support the refactoring and migration of existing data transformations built in the Coupa Data Guru tool into Databricks. This role will...
Insight Global
Plano, TX6 days ago - ...ConnectedX is focused on Digital Transformation and Product Engineering Services, enabling clients to achieve their business, operating... ...We are looking for a passionate and highly motivated Lead Data Engineer for a Fortune 100 client. This is a long term role in...
ConnectedX Inc
Plano, TX3 days ago - ...Job Summary We are seeking a highly skilled Data Engineer / Data Analyst to support large-scale data initiatives by designing robust data pipelines, performing advanced data analysis, and delivering measurable business impact. This role requires strong hands-on...
Prophecy Technologies
Plano, TX4 days ago - ...Design, develop, and maintain scalable ETL/ELT pipelines to support data processing and analytics. Automate data ingestion and... ...technologies such as Python, SQL, Snowflake SQL, and Databricks for data engineering and analysis. Develop and maintain comprehensive...
Purple Drive
Plano, TX4 days ago - ...Job Title Required Skills: Strong in SQL and Python, 8+ years' experience. Experience with big data frameworks (i.e. Hadoop and Spark), 5+ years' experience. Experience building automated data pipelines, 5+ years of experience. Experience performing...
Syntricate Technologies
Richardson, TX3 days ago - ...Client: CBRE Job: Data Engineer (Snowflake/SQL/R, DBT) Number of openings: 2 Location: Hybrid 2-3 times per week in Richardson TX (MUST be local) Term: 4+ months Visa : GC EAD, OPT EAD, H4 EAD and L2 EAD only are egligible ***Please DO NOT send me any information...Local area
ShiftCode Analytics
Richardson, TX2 days ago $130k - $155k
...Insight Global is seeking a Data Engineer to sit hybrid in Frisco, Texas at a cybersecurity client. You will be responsible for designing, building, and overseeing the deployment and operation of technology architecture, solutions, and software that unlock the full potential...Insight Global
Frisco, TX21 hours ago- Job Title Python or Java SQL must – 2 years AWS must Required Skills Basic Qualification Additional Skills Background Check: Yes Candidate must be your W2 Employee: No Interview Process Additional Keywords Degree Requirements Certification...
Samprasoft
Plano, TX21 hours ago - ...Required Skills: Proficiency in snowflake for database development and management. Experience with dbt for data transformation and modeling. Strong sql skills for querying and managing databases. Advanced knowledge of python for data manipulation and...
Syntricate Technologies
Frisco, TX3 days ago - ...Data Engineers (10 Positions) Visa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2. Long term data engineers with strong Scala, Python and Spark. Any experience with Java or big data such as Hadoop is a huge plus...
Keylent Inc
Plano, TX4 days ago - ...Data Engineer (Migrations) Location: Frisco, TX, 75034 (Hybrid) Project Duration: 12+ Months Engineers in this role accomplish business objectives by monitoring system functions from all points of system processing, identifying, and assisting in solving processing...Work at office
Kasmo Global
Frisco, TX4 days ago - ...Data Engineer TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions to clients worldwide. Our client provider of digital technology and transformation, information technology and services....Temporary workWorldwide
Merican
Frisco, TX4 days ago - ...Data Engineer We have the below Data Engineer opening with Toyota Connected. We can work C2C. Contract: 12 months +. This is a new team to us so we don’t have any example resumes yet. No submittals just started working it. Role - Level - Team - Remote Data Engineer...Contract workRemote work
My3Tech Inc
Plano, TX3 days ago - ...We have partnered with our client in their search for a Data Engineer in Plano, TX. Responsibilities Design, build, and maintain scalable data pipelines to support real-time, batch, and streaming data processing using tools such as Python, Java, Spark...Work experience placement
Korn Ferry
Plano, TX2 days ago $55.06 - $63.06 per hour
...Data Engineer Genesis10 is currently seeking a Data Engineer for a hybrid position (3 days per week onsite) with a Global Financial Institution located in Charlotte, NC, Plano, TX and Pennington, NJ. This is a 12+ month contract opportunity. This role is responsible...Hourly payContract work3 days per weekGenesis10
Plano, TX2 days ago$120k - $150k
...Data Bricks Data Engineer Location: Seattle, WA / Bellevue, WA / Everett, WA / Renton, WA / Richardson, TX / Plano, TX / Dallas, TX / St. Louis, MO / Charleston, SC / Arlington, VA Fulltime Salary Range: $120,000-$150,000/Year Must Have Technical/Functional Skills...Full timeRemote workDiverse Lynx
Plano, TX2 days ago- ...Role: Data Engineer Location: Plano, TX (Onsite) looking for an experienced Data Engineer to build and maintain scalable data pipelines and analytics solutions leveraging AWS services such as Athena, Lambda, Glue, and S3. The candidate will support reporting...
Lorven Technologies
Plano, TX21 hours ago - ...thinking skills; Strong documentation skills Coding: Proficiency in Python or Java Cluster Computing frameworks: Proficiency in Spark AWS Data Services: Proficiency in Lake formation, Glue ETL (or) EMR, S3, Glue Catalog, Athena, Kinesis (or) MSK, Airflow (or) Lambda + Step...
Virtusa
Plano, TX21 hours ago - • Strong knowledge on SQL, including writing complex queries, stored procedures and triggers. • Proficiency in Azure Data Factory for orchestrating data workflows and pipelines. Experience with Data Bricks on Azure. • Familiarity with data modelling and schema...
Futran Tech Solutions Pvt. Ltd.
Plano, TX4 days ago $50 per hour
...Data Engineer Work Location: Plano, TX or Atlanta, GA Maximum Pay Rate: $50/hr (to me) Client: BOFA Candidate’s Experience: 5 Years of Experience Candidates will also need to go through a tech screening. We are looking for candidates with the following primary...Argyle Infotech
Plano, TX4 days ago- ...The Enterprise Data Management Services team is looking for a strong, self-motivated Technology Developer to become an integral part... ...release processes Identifies, defines, and documents data engineering requirements, communicating required information for deployment...
Texas State Library and Archives Commision
Murphy, TX2 days ago - ...Responsibilities : ~5+ years of data engineering experience. ~ Design, develop, and maintain efficient data pipelines for the extraction, transformation, and loading (ETL) of data from various sources (databases, APIs, flat files, etc.) ~ Solid experience...For contractorsLocal area
My3Tech Inc
Plano, TX2 days ago $10k
...Data Engineer – Data It's an exciting time to be a member of the Fisher Investments Technology Department. We're investing in the future of our firm's technology and are building our team to achieve global growth. We are looking for a Data Engineer to support our Enterprise...Work at officeWork from homeFisher Investments
Plano, TX4 days ago- ...Data Engineer (ETL/ELT) Work Location (City, State) San Antonio/Plano (TX), Phoenix (AZ) Open for Remote (Yes/No) No Client Interview (Yes/No) Yes No. of Positions 2 Experience level (Years) 10+ Must have skills Dbt /snowflake Preferred skills Informatica...Remote work
E-Solutions
Plano, TX21 hours ago - ...time Description Position Purpose and Objectives At Texans Credit Union, great data powers exceptional member experiences. We're looking for a Data Engineer to build and optimize scalable data pipelines, ensure data quality, and enable reliable, data-...Full time
Texans Credit Union
Richardson, TX4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- director data engineering Plano, TX
- junior big data engineer Plano, TX
- senior data engineer Plano, TX
- data platform engineer Plano, TX
- sr information security engineer Plano, TX
- senior data integration developer Plano, TX
- data developer Plano, TX
- data engineer Plano, TX
- data infrastructure engineer Plano, TX
- entry level big data engineer Plano, TX