Data Engineer

LanceSoft Inc

Position Details: Job Title Data Engineer Location Charlotte, NC Contract/Full-time +12 Months contract with possible extension.
Job Description: The primary role of the Data Engineer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with the company's objectives. They are responsible for the design and development of data/batch processing, data manipulation, data mining, and data extraction/transformation/loading into large data domains using Python/Pyspark and AWS tools.

Responsibilities:

Provide scoping, estimating, planning, design, development, and support services to a project.
Identify and develop the technical detail design document.
Work with developers and business areas to design, configure, deploy, and maintain custom ETL Infrastructure to support project initiatives.
Design and develop data/batch processing, data manipulation, data mining, and data extraction/transformation/loading (ETL Pipelines) into large data domains.
Document and present solution alternatives to clients, which support business processes and business objectives.
Work with business analysts to understand and prioritize user requirements.
Design, development, test, and implement application code.
Follow proper software development lifecycle processes and standards.
Quality Analysis of the products, responsible for the Defect tracking and Classification.
Track progress and intervene as needed to eliminate barriers and ensure delivery.
Resolve or escalate problems and manage risk for both development and production support.
Coordinate vendors and contractors for specific projects or systems.
Maintain deep knowledge and awareness of technical & industry best practices and trends, especially in technology & methodologies.

Skills and Knowledge:

Developer experience specifically focusing on Data Engineering.
Hands-on experience in Development using Python and Pyspark as an ETL tool.
Experience in AWS services like Glue, Lambda, MSK (Kafka), S3, Step functions, RDS, EKS etc.
Experience in Databases like Postgres, SQL Server, Oracle, Sybase etc.
Experience with SQL database programming, SQL performance tuning, relational model analysis, queries, stored procedures, views, functions, and triggers.
Strong technical experience in Design (Mapping specifications, HLD, LLD), Development (Coding, Unit testing).
Knowledge in developing UNIX scripts, Oracle SQL/PL-SQL.
Experience with data models, data mining, data analysis and data profiling.
Experience in working with REST API's.
Experience in workload automation tools like Control-M, Autosys etc.
Good knowledge in CI/CD DevOps process and tools like GitHub, Jenkins.
Strong experience with Agile/SCRUM methodology.
Experience with other ETL tools (DataStage, Informatica, Pentaho, etc.).
Knowledge in MDM, Data warehouse and Data Analytics.

Apply

Vacancy posted 7 days ago

Similar jobs that could be interesting for youBased on the Data Engineer in Charlotte, NC vacancy

Lead Data Engineer (Hybrid)
$130k - $176k
...assume the sponsorship of an employment visa at this time". Selective Insurance is seeking an energetic and collaborative Data Engineer Team lead to work on data and analytics projects supporting the Claims team within the Information Management group. This group...
Suggested
Work experience placement
Selective Insurance
Charlotte, NC
1 day ago
Lead Data Engineer
...In need of a Lead Data Engineer (MongoDB), please find the details below and send me who you have- thank you! There is no one in play right now and we need candidates ASAP. Exclusive to Apex, it is my backfill! 6+ months - likely to extend Hybrid Schedule...
Suggested
Contract work
Immediate start
Remote work
Saxon Global
Charlotte, NC
2 days ago
Lead Data Engineer
...Lead Data Engineer - Big Data/Cloud Will be functioning as a lead of the initiative and key components of the project, no direct reports Candidates must have experience moving data from MS SQL server platform to Hadoop/Hive platform ~5+ years...
Suggested
3B Staffing LLC
Charlotte, NC
1 day ago
Lead Data Engineer
$60 - $65.06 per hour
...Lead Data Engineer Location: Charlotte, North Carolina (Hybrid) Employment Type: Contract Contract Duration: 12 Months Role Overview We are seeking a Lead Data Engineer for a hands-on role focused on the design and development of ETL solutions within...
Suggested
Hourly pay
Contract work
3 days per week
Apex Systems
Charlotte, NC
1 day ago
Lead Data Engineer
...Job Type Full-time Description Job Summary: The Lead Data Engineer is a hands-on Data Engineer that will own the design, development, and governance of our data platforms. Leveraging Azure, with primary focus on Microsoft SQL Server, Power BI reporting...
Suggested
Full time
Casual work
Work at office
Remote work
Monday to Friday
E4E Relief
Charlotte, NC
5 days ago
Lead Data Engineer
$111.6k - $212k
...Impact The main purpose of this role is to deliver end-to-end data solutions for complex business problems. This role includes... ...tandem with the respective product manager, and advises other engineers; executes with limited guidance. Evaluates and facilitates decisions...
Local area
Flexible hours
Lowe's
Charlotte, NC
3 days ago
Lead Data Engineer with PySpark
...Lead Data Engineer With PySpark Mount Laurel Township, NJ, United States Lead Data Engineer With PySpark Requisition Title: Lead Data Engineer With PySpark (1 Day Onsite) Locations: Mt Laurel, NJ & Charlotte, NC Visa Status: GC/USC/H4 EAD Client: TD Bank...
Full time
Infinity Outsourcing
Charlotte, NC
1 day ago
Lead Graph Data Engineer
$119k - $224k
...About this role: Wells Fargo is seeking a Lead Graph Data Engineer within the Fraud and Claims Technology organization. This role is central to building and expanding our enterprise graph database platform, which is used to uncover complex relationships that strengthen...
Work experience placement
Wells Fargo
Charlotte, NC
6 days ago
Lead Data Engineer
$119k - $224k
...About this role: Within COO Technology, Wells Fargo is seeking a Lead Data Engineer to help shape and scale our cloud‑native data ecosystem. In this role, you will focus on Google Cloud Platform (GCP) services and frameworks, leading the design, build, and operation...
Work experience placement
Work at office
Remote work
Flexible hours
Wells Fargo
Charlotte, NC
1 day ago
Data Engineer/ Data Analyst
...Sr. Data Analyst/ Data Engineer Requirement: Make recommendations based on the data and information sourced Ability to navigate through data discrepancies Understands next steps in the data process, data reconciliation, is the data in a good state, etc....
Samprasoft
Charlotte, NC
2 days ago
Data Engineer
...Role : Data Engineer Location : Charlotte, NC (Onsite) Contract End Client - Banking Experience - 8+ Required Skills & Experience Programming: Python/PySpark, Scala is a plus Big Data: Hadoop (HDFS, YARN), Hive, Spark (optimization, tuning) Orchestration...
Contract work
Rivago Infotech Inc
Charlotte, NC
1 day ago
Timon Global Resourcing Inc - Data Engineer
$105.75k
...Global Resourcing Inc.seeks applicants for the following full-time position at its Charlotte, NC worksite for $105,747/year: Data Engineer: Design and maintain scalable data pipelines and ETL/ELT workflows using Apache Airflow, AWS Glue, or custom Python/SQL scripts...
Full time
Timon Global Resourcing Inc.
Charlotte, NC
5 days ago
Data Replication Engineer
$110k - $125k
...IBM Infosphere Data Replication Specialist Must Have Technical/Functional Skills Primary skills/ Tools: IIDR / CDC / Q... ...with onshore and offshore teams, architects, DBAs, and platform engineers. • Drive the technical roadmap for data replication, modernization...
Tata Consultancy Services
Charlotte, NC
2 days ago
Data Engineer - Onsite Position
$59.53 - $67.53 per hour
...Data Engineer Genesis10 is currently seeking a Data Engineer for an onsite position located in Irving, TX or Charlotte, NC. This is a 24+ month contract opportunity. Responsibilities: Support a new data platform modernization project to modernize cloud data...
Hourly pay
Contract work
Genesis10
Charlotte, NC
4 days ago
Data Engineer
...Overview: Job Description: Data Engineer Responsibilities Data Pipelines: Design, build, and maintain scalable pipelines using Databricks and Spark for ETL (extraction, transformation, loading). Data Modeling: Develop and optimize databases and large...
Purple Drive
Charlotte, NC
2 days ago
Data Engineer
$135k - $150k
...that advisors use in helping clients achieve wealth, independence, and purpose. The Job/What You'll Do: The Data Engineer ( Analytics Engineering ) will be a key technical leader responsible for the architecture, development, and optimization of mission...
Work at office
Flexible hours
AssetMark
Charlotte, NC
1 day ago
Spark Data Engineer- Charlotte NC
...Position- Spark Data Engineer Location- Charlotte NC Duration- Contract Contract- DOE Must have at least 5 years of experience Must have experience in Helm and Kubernetes Must have a Bachelors degree Must have good communication...
Contract work
Georgia IT Inc
Charlotte, NC
2 days ago
Snowflake Data Engineer
...Snowflake Data Engineer This is a 6-month contract and needs to meet client full-time conversion policies. MUST BE HYBRID IN Hartford, CT; Charlotte, NC; Chicago, IL; Frisco, TX; Columbus, OH, Danbury, CT, or Alpharetta, GA MUST BE W2 Job Type: Contract Expected...
Full time
Contract work
Work at office
Remote work
3 days per week
RIT Solutions
Charlotte, NC
1 day ago
Data Engineer
...Data Engineer SMBC Group is a top-tier global financial group. Headquartered in Tokyo and with a 400-year history, SMBC Group offers a diverse range of financial services, including banking, leasing, securities, credit cards, and consumer finance. The Group has more...
Work at office
Local area
Work from home
Worldwide
Smbc Global Foundation Inc
Charlotte, NC
2 days ago
Data Engineer (Onsite Hybrid)
...Data Engineer (Onsite Hybrid) NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer...
Work experience placement
NTT DATA
Charlotte, NC
4 days ago
Data Engineer
...Data Engineer The Data Engineer will design, build, and maintain batch ETL pipelines on a modern Databricks Lakehouse platform, delivering high-quality data solutions that support critical banking functions. You will take ownership of pipelines end-to-end, from ingestion...
Work experience placement
Towne Family of Companies
Charlotte, NC
1 day ago
Data Engineer USA
...Data Engineer Role: Data Engineer Required legal status: Green Card, Green Card-EAD, US Citizen Location: Charlotte, NC (Hybrid work model) Job involves: Extract, Transform, Load (ETL) operations Using Scala programming language Working with Spark...
Zortech Solutions
Charlotte, NC
1 day ago
Data Engineer
$69 - $74 per hour
...Client: Financial Services Team: TBA Job Title: Data Engineer Location: Zone 2 Contract Length: 18months Pay Rate: $69 - $74 Top Requirements: ~5+ years of Software Engineering experience (or equivalent through work, consulting, military, training...
Contract work
Apex Systems
Charlotte, NC
4 days ago
Data Engineer
...Data Engineer We are in the process of leading a Digital Transformation across our Americas Division as we continue to modernize our technology, focus on our data-driven approach, grow, and plan for the future. As a result of this expansion, we are seeking experienced...
eTeam
Charlotte, NC
1 day ago
Data Engineer
...Job Title: Data Engineer Contract: Ongoing contract (up to 24 months) Location: Charlotte NC Onsite / Hybrid / Remote: Hybrid- 3 days onsite Interview Process: 2 rounds (virtual)- 1st is 30 minute technical with his lead, 2nd is cultural with HM....
Ongoing contract
Contract work
Remote work
Apex Informatics
Charlotte, NC
5 days ago
Data Engineer
...Data Engineer Employment Type: Full-Time, Mid-level Department: Business Intelligence CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform focused on providing solutions that empower...
Full time
Flexible hours
Contact Government Services LLC
Charlotte, NC
5 days ago
Data Engineer
$90k - $96k
...Data Engineer Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine...
Permanent employment
Full time
Contract work
Local area
Capgemini
Charlotte, NC
4 days ago
Data Engineer III
$75 - $80 per hour
...Data Engineer Location: Newport Beach, CA, Omaha, NE, or Charlotte, NC Onsite: 4 days per week Rate: $75-80/hour Apex is not able to consider candidates for this role who require visa sponsorship now or in the future. Qualified candidates will have the following...
Visa sponsorship
Apex Systems
Charlotte, NC
4 days ago
Data Engineer
...Data Engineer (Python,FAST API, Apache) Charlotte, NC Contract We are seeking a Python-based platform engineer to design and build a containerized API layer that abstracts and governs interactions with engines such as Apache Spark through a well-defined API contract...
Contract work
Lorven Technologies
Charlotte, NC
4 days ago
Data Engineer - GCP
...Key Responsibilities Design and build scalable ETL/data pipelines using Spark and Python Develop data workflows to ingest... ...large-scale data processing Proficiency in Python for data engineering (ETL pipelines) Experience designing and developing data pipelines...
Euclid Innovations
Charlotte, NC
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!