Data Engineer
Artech Information Systems LLC
Job Title: Data Engineer
Duration: 10 months
Location: Plano , TX (Hybrid)
Interview: Coding exercise at the time of interview Overview: We are seeking a skilled professional with over 5 years of experience in AWS, Python, Scala, Spark, and SQL. The ideal candidate will have a strong understanding of data processing, API development, and data pipeline construction. Key Responsibilities:
For immediate consideration please click APPLY.
Duration: 10 months
Location: Plano , TX (Hybrid)
Interview: Coding exercise at the time of interview Overview: We are seeking a skilled professional with over 5 years of experience in AWS, Python, Scala, Spark, and SQL. The ideal candidate will have a strong understanding of data processing, API development, and data pipeline construction. Key Responsibilities:
- Build and maintain APIs to support enterprise-wide data needs.
- Analyze large volumes of data and write efficient SQL queries.
- Develop and manage billing data pipelines.
- Design and implement ETL pipelines for processing large-scale data.
- Collaborate with the compliance team as part of the centralized data management team.
- Ensure compliance with regulatory and ethical standards through effective data management.
- Handle high-volume data processing and optimize performance.
- Work closely with stakeholders to gather requirements and provide data-driven solutions.
- Experience working with financial institutions is preferred.
- We support all compliance-related activities by serving as a centralized data management team. Our primary responsibility is to manage customer data, ensuring accuracy and security.
- This project is an ongoing initiative with no immediate end, involving multiple processes tailored to various teams. Our current focus is on expanding our capabilities by developing new data products to support additional teams and use cases.
- We are expanding rapidly, enabling us to grow our team and enhance our scope across the product.
- Currently, our focus is primarily on customer data, but we are transitioning to include customer transactions.
- This expansion is expected to evolve into a multi-year project, although commitments beyond the current year are uncertain due to external factors.
- We manage approximately 40 million records daily, with potential increases beyond this figure.
- Our infrastructure includes 16 to 20 data pipelines, ingesting customer data from various sources.
- These pipelines process data volumes ranging from 150 million to 25 million records, with delta processing to optimize storage and performance.
- On average, we handle 60 to 70 million records within our data pipelines.
- AWS: 20%
- Python: 20%
- Scala: 20%
- Spark: 20%
- SQL: 20%
For immediate consideration please click APPLY.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Plano, TX vacancy
- ...requirements and translate them into technical solutions. 4. Develop and maintain database systems using snowflake and sql. 5. Implement data transformation and modeling using dbt (data build tool). 6. Write and optimize python code for data extraction, transformation,...Suggested
Omni Inclusive
Frisco, TX2 days ago $179.4k - $204.7k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and...SuggestedFull timePart timeInternshipH1bLocal areaCapital One
Plano, TX4 days ago- ...Job Description: ~ Job Description: Data Engineer Lead Snowflake, DataStage / Informatica "1 Analyze and build ETL data assets using IBM DataStage / Informatica and On-Prem Databases such as Netezza. Propose design and implement solutions to migrate...Suggested
Mando Technologies
Frisco, TX4 days ago - ...Lead Data Engineer Role Cognizant is looking for a lead data engineer role. The job summary includes understanding business requirements, providing impact analysis during changes and production events, and being strong in Azure, Airflow, CICD, Kubernetes, Spark Scala...SuggestedDay shift
Keylent Inc
Plano, TX4 days ago - ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design...SuggestedLong term contractWork at office
InterSources
Plano, TX6 days ago - ...Job Description A fortune 100 client is seeking to increase their team in India by 2. They are seeking hands-on data engineer to support the refactoring and migration of existing data transformations built in the Coupa Data Guru tool into Databricks. This role will...
Insight Global
Plano, TX13 days ago - ...We're Hiring: Lead Data Engineer – SQL (StreamSets) Location: Berkeley Heights, NJ OR Frisco, TX Work Mode: On-site Employment Type: Full-Time Preferred ⏳ Experience: 8+ Years Join Apexon, a digital-first technology services company helping enterprises accelerate...Full time
Apexon
Frisco, TX2 days ago - ...ConnectedX is focused on Digital Transformation and Product Engineering Services, enabling clients to achieve their business, operating... ...We are looking for a passionate and highly motivated Lead Data Engineer for a Fortune 100 client. This is a long term role in...
ConnectedX Inc
Plano, TX11 hours ago $121.2k - $225.2k
...development. Job Summary This position is responsible for the engineering work necessary for successful creation, deployment, and... ...capabilities of the Intelligent Delivery Platform. This includes ensuring data quality, creation of new data pipelines, optimization and...Work experience placementRelocationHealth Care Service Corporation
Richardson, TX3 days ago- ...Required Skills: Proficiency in snowflake for database development and management. Experience with dbt for data transformation and modeling. Strong sql skills for querying and managing databases. Advanced knowledge of python for data manipulation and...
Syntricate Technologies
Frisco, TX5 days ago - ...Description Data Governance Platform Engineer Description At Liberty Mutual, technology isn't just a part of our business, it's what drives us forward. We deliver our customers peace of mind every day by helping them protect what they value most. Our passion...Work at officeLocal areaVisa sponsorshipWork visaShift work
Liberty Information Technology Limited
Plano, TX3 days ago $10k
...We're investing in the future of our firm's technology and are building our team to achieve global growth. We are looking for a Data Engineer to support our Enterprise Data Management team. If you are looking for an opportunity to make a difference as we develop scalable...Work at officeWork from homeFisher Investments Careers
Plano, TX1 day ago- ...Data Engineer Visa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax terms: W2, 1099 Corp-Corp or 3rd Parties. Roles: Data Engineer. Location: Plano, TX. Experience: 8 years in IT. Skills: Spark, Scala, Java, EMR, AWS, Streaming...
Keylent Inc
Plano, TX1 day ago - ...valued, your efforts have a visible impact, and your dedication is recognized, take the next step in your career with us. As a Data Engineer III, you’ll play a senior technical role designing, building, and optimizing scalable data pipelines and platforms that power...Temporary workH1bImmediate start
GAINSCO
Richardson, TX2 days ago - ...We had Interview Scheduled but candidate backed out at last moment DATA ENGINEER Location: Plano, TX | Hybrid Option Duration: 6+ Month Contract Hybrid/Remote Requirement: Hybrid Initial Term of Engagement: ASAP Interview Process...Permanent employmentContract workImmediate startRemote work
3B Staffing LLC
Murphy, TX5 days ago - ...Ascentt is transforming the future of manufacturing through advanced Data Analytics, AI/ML, and Generative AI solutions. We partner with... ...business insights. Our teams work on scalable, high-impact engineering challenges across cloud, data, and intelligent automation...
Ascentt
Plano, TX1 day ago - ...Data Bricks Data Engineer Location: Seattle, WA / Bellevue, WA / Everett, WA / Renton, WA / Richardson, TX / Plano, TX / Dallas, TX / St. Louis, MO / Charleston, SC / Arlington, VA Duration: Fulltime Job Description: • Awareness of IBM Data Stage ETL/ELT data...Full timeImmediate startRemote workRelocation
JConnect Infotech
Richardson, TX1 day ago - ...Job Title Required Skills: Strong in SQL and Python, 8+ years' experience. Experience with big data frameworks (i.e. Hadoop and Spark), 5+ years' experience. Experience building automated data pipelines, 5+ years of experience. Experience performing...
Syntricate Technologies
Richardson, TX5 days ago $130k - $155k
...Insight Global is seeking a Data Engineer to sit hybrid in Frisco, Texas at a cybersecurity client. You will be responsible for designing, building, and overseeing the deployment and operation of technology architecture, solutions, and software that unlock the full potential...Insight Global
Frisco, TX2 days ago- ...o Design and implement scalable data pipelines using Databricks or AWS services such as Glue, Redshift, S3, Lambda, EMR, Athena Develop... ...resolution. o Stay updated with the latest developments in AWS Data engineering technologies and best practices. Job Requirements
Seven Seven Software
Plano, TX4 days ago - ...Data Engineering Manager Design, develop, and maintain scalable, production-grade ELT pipelines using Snowflake and dbt (Core or Cloud). Lead technical design discussions and provide architectural guidance for data engineering solutions. Implement dimensional...
Cynet Systems
Plano, TX1 day ago - ...Overview: Data Engineer • Design, build, and monitor ETL/ELT pipelines for scalable data processing. • Automate data ingestion using APIs and scripting tools. • Implement automated health checks and pipeline monitoring systems. • Work with technologies including...
Purple Drive
Plano, TX2 days ago - ...Role: Data Engineer Location: Plano, TX (Onsite) looking for an experienced Data Engineer to build and maintain scalable data pipelines and analytics solutions leveraging AWS services such as Athena, Lambda, Glue, and S3. The candidate will support reporting...
Lorven Technologies
Plano, TX2 days ago - ...Data Engineer Irvine, CA | 8 - 10 years of experience Hire Type: Full Time Job Description Data Engineer We are seeking project based Platform Engineering delivery support with strong, hands on technical depth in the following areas: • Databricks...Full time
ClifyX
Plano, TX2 days ago - ...Data Engineer Job Location: Plano, TX Job Type: Contract Client: Virtusa Rate: Depend on Experience Job Authorization: US Citizen/GC/EAD (H4/L2/TN) preferred C2c are open only for own corp, not accepted from any employers Responsibilities: ~4-8 Years...Contract work
Georgia IT Inc
Plano, TX16 days ago - ...Job Title: Data Engineer Location: Plano, TX (Onsite from Day 1) Employment Type: W2 Only Job Description: We are seeking a highly skilled Data Engineer with advanced SnowPro certifications to join our team in Dallas, TX. The ideal candidate...Work at officeLocal area
Fisec Global
Plano, TX4 days ago - ...Insight Global is looking for a Lead Data Engineer to come join their team. This candidate will be helping design and deliver modern data solutions using cloud-based platforms and AI-driven innovations. You will partner with business, technology, and governance teams to...
Insight Global
Plano, TX5 days ago $95 per hour
...11134024, 11134025, 11134026, 11134027 Role Senior Software Engineer - Python Work location Dallas, TX Rates as follows: $ 95 hr... ...largest social media platform which deals with few petabytes of data coming to the system daily. You will contribute as part of R&D self...For contractorsRelocationRedolent
Richardson, TX2 days ago$95 per hour
...R2D2 11147686, 11147687, 11147688, 111476899 Role Senior SW Engineer - Java Work location Dallas, Tx Rates as follows: $ 95 hr/... ...experience with Java • Experience in distributed systems and big data technologies (Hadoop, Hive, Spark, etc.) • Strong debugging...For contractorsRelocationRedolent
Richardson, TX2 days ago- ...Data Engineer Location: Plano TX Duration: Contract Job Description: Required Skills: Unix, Python, PySpark, SQL, AWS Roles & Responsibilities: Analyze business processes to identify areas for improvement and optimization. Develop and maintain data...Contract work
Staffing the Universe
Plano, TX1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data visualization developer Plano, TX
- data science developer Plano, TX
- senior data center engineer Plano, TX
- sr information security engineer Plano, TX
- junior big data engineer Plano, TX
- entry level big data engineer Plano, TX
- data engineer contract Plano, TX
- aws data engineer Plano, TX
- senior data engineer Plano, TX
- director data engineering Plano, TX