Big Data Engineer
Q1 Technologies
Job Description
Must Have Technical/Functional Skills
Secondary: UI - Angular.
Experience: Minimum 9 years Roles & Responsibilities Architectural Leadership:
• Define end-to-end architecture for data platforms, streaming systems, and web applications.
• Ensure alignment with enterprise standards, security, and compliance requirements.
• Evaluate emerging technologies and recommend adoption strategies. Data Engineering :
• Design and implement data ingestion, transformation, and processing pipelines using Hadoop, PySpark, and related tools.
• Optimize ETL workflows for large-scale datasets and real-time streaming.
• Integrate Apache Kafka for event-driven architectures and messaging. Application Development :
• Build and maintain backend services using Python and microservices architecture.
• Develop responsive, dynamic front-end applications using Angular.
• Implement RESTful APIs and ensure seamless integration between components.
Collaboration & Leadership:
• Work closely with product owners, business analysts, and DevOps teams.
• Mentor junior developers and data engineers.
• Participate in agile ceremonies, code reviews, and design discussions.
Required Skills & Qualifications:
Technical Expertise:
• Strong experience with Hadoop ecosystem (HDFS, Hive, Spark).
• Proficiency in PySpark for distributed data processing.
• Advanced programming skills in Python.
• Hands-on experience with Apache Kafka for real-time streaming.
• Frontend development using Angular (TypeScript, HTML, CSS).
Architectural Skills:
• Expertise in designing scalable, secure, and high-performance systems.
• Familiarity with microservices, API design, and cloud-native architectures.
Additional Skills:
• Knowledge of CI/CD pipelines, containerization (Docker/Kubernetes).
• Exposure to cloud platforms (AWS, Azure, GCP).
Education:
• Bachelor's or Master's degree in Computer Science, Engineering, or related field.
Experience:
• 9+ years in software development, with at least 4 + years in architecture and Big Data technologies.
Preferred Qualifications:
• BFSI domain experience or large-scale enterprise systems.
• Understanding of data governance, security, and compliance standards.
Soft Skills:
• Strong analytical and problem-solving abilities.
• Excellent communication and leadership skills.
• Ability to thrive in a fast-paced, agile environment.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Charlotte, NC vacancy
- ...Job Title Required Skills: Applicant should be familiar with the following technologies/skillsets: Big Data knowhow is mandatory Big Data pipelines Optimization of big data Scalability of big data across different data stores (Aurora, RedShift, S3)...Big data
Syntricate Technologies
Charlotte, NC5 days ago - ...Big Data EngineerThe applicant will be responsible for managing, enhancing and updating big data pipelines where appropriate including but not limited to:Upgrades to infrastructureEnhancements to infrastructureProduction supportCreating curated versions of data as requested...Big data
Samprasoft
Charlotte, NC6 hours ago - ...Job Title: Hadoop / HPE MapR Engineer (Data Platform) We are seeking a highly skilled Hadoop / HPE MapR Engineer to design, build, operate... ...improvements. Required Qualifications 7+ years of experience in Big Data / Data Platform Engineering. Strong hands‑on experience...Big data
Innoventrics
Charlotte, NC5 hours ago - ...Big Data Engineer Location: Charlotte, NC (Hybrid) Client: Synechron / Wells Fargo EXP: 9+ Years Rate: $55/hr. on C2C Job Summary We are seeking an experienced Big Data Engineer to join a high-performing team supporting enterprise-scale data initiatives for Wells...Big data
Conflux Systems
Charlotte, NC20 hours ago - ...Data EngineerRole: Data EngineerRequired legal status: Green Card, Green Card-EAD, US CitizenLocation: Charlotte, NC (Hybrid work model... ...operationsUsing Scala programming languageWorking with Spark and PySpark for big data processingUtilizing Hadoop for data storage and...Big data
Zortech Solutions
Charlotte, NC4 hours ago - ...Lead Data Engineer - Big Data/Cloud Will be functioning as a lead of the initiative and key components of the project, no direct reports Candidates must have experience moving data from MS SQL server platform to Hadoop/Hive platform ~5+ years...Big data
3B Staffing LLC
Charlotte, NC3 days ago - ...Job title: AWS Data Engineer Work Location with Zip code: Charlotte, NC 28202 Duration of the project: 6 months but can be extended... ...Lambda, IAM, Redshift. Developing and optimizing with proven big data experience. Best practices in data analysis and modeling...Big dataWork experience placement
eTeam
Charlotte, NC2 days ago $125k - $145k
...What we're buildingOur team runs a range of data and AI projects across the GPS business.A... ...forThis is a hybrid role that spans data engineering, AI product enablement, and platform... ...tuning and engineering across RDBMS and Big Data platforms such as Oracle Exadata, SQL...Big dataFull timeWork at officeFlexible hoursDay shift- OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business growth... ...|data science|PYTHON Technical/Domain Skill 2Technology|Big Data - Data Processing|Spark Work LocationCharlotte, NC CountryUSAState...Big dataFull timeTemporary workRelocation
- ...WithAt Slalom, we co-create custom software, data, and cloud products with clients who are... ...true change.Our Data Architecture & Engineering team sees data as the foundation for decision... ...solutions that inspire people to dream big and move faster.What You’ll DoAs a Data Engineer...Big dataTemporary workLocal area
$116.2k - $229.1k
Position Summary Join Deloitte’s AI & Engineering practice and help organizations transform... ...technology platforms, modernize data environments, and unlock value through innovation... ...Lead: Evaluate, pilot, and integrate new big data and analytics technologies, ensuring...Big dataLocal areaVisa sponsorship$106.84k - $160.25k
Req ID:386062NTT DATA strives to hire exceptional, innovative and passionate individuals... ...apply now.We are currently seeking a Data Engineer - Cybersecurity Analytics - Onsite to join... ...experience in cloud-based Data Engineering and Big Data processing environments.3+ years of...Big dataFull timeTemporary workWork at officeRemote workFlexible hours$100k - $115k
Role: Data EngineerWho You’ll Work WithAt Slalom we co-create custom software, data, AI... ...on injecting intelligence into products, engineering systems that support learning and insight... ...scalable, secure, cloud-native platforms.* Big Data Platforms (Dataproc, Apache Spark)*...Big dataTemporary workWork at officeLocal areaFlexible hours$82.42k - $126.6k
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...with Hadoop ecosystem (Cloudera). Experience in working with a Big Data implementation in production environment. Experience with...Big dataFull timeTemporary workRelocation- ...AWS Data Engineer - Create and maintain optimal data pipeline using Python Spark - Build the infrastructure required for optimal extraction... ...Hours : 8:00am to 5:00pm Education : Additional Job Details : Must Have Skills AWS Big Data AWS Glue ETL Credit Risk-RegulationsBig data
3B Staffing LLC
Charlotte, NC2 days ago - ...Data EngineerWe are seeking a Data Engineer to provide data-driven solutions that help improve processes and overall business performance. This role focuses... ...languages such as Java and Python.Experience with big data technologies like Hadoop or Spark.Proficiency in SQL...Big data
Apex Systems
Charlotte, NC4 hours ago - ...Position- AWS Data Engineer Duration-Contract Location- Charlotte, NC /Hybrid JD Must Have: Strong experience with AWS services on big data platforms. Strong Python experience in building Dash application in AWS Spark Shell...Big dataContract workImmediate start
Syntricate Technologies
Charlotte, NC4 days ago $100k - $110k
...Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and... ...key global markets. We are looking for an experienced Big Data Engineer with strong Software Engineering skills to design...Big dataTemporary workFlexible hours$53.24 - $61.24 per hour
...Data Engineer IIGenesis10 is currently seeking a Data Engineer II for a contract position with a Global Financial Institution located in Charlotte... ...and documentation skillsDesired Skills:Experience working on Big Data Technologies like HadoopCloudera Admin / Dev...Big dataContract workGenesis10
Charlotte, NC2 days ago- ...Data Engineer Hybrid 3 days onsite Charlotte (locals only) 10+ months Responsibilities: Build large-scale batch and real-time data... ...and problem-solving skills particularly those that apply to a big data environment. Strong expertise in applying narrow and wide...Big dataWork experience placementLocal area
RIT Solutions
Charlotte, NC3 days ago - ...Data Engineer IIWe are seeking a Data Engineer II to help design, build, and maintain a centralized performance and analytics repository. This... ...CI/CD practices.Preferred QualificationsExperience working on Big Data Technologies.Cloudera Admin / Dev Certification....Big data
Apex Systems
Charlotte, NC4 days ago - ...Job Title: Sr. Data Engineer Duration: 12+ Months Location: Charlotte, NC - Hybrid Role (3 days onsite in a week) Manager Notes... ...team for entire platform and help with migration to cloud. • Big Data Hub, the tools are used purely for ETL functions, moving...Big data3 days per week
Veracity
Charlotte, NC5 days ago - ...driven solutions through our 5 core specialist Practices; Software Engineering, Data & Analytics, IT Operations, Change & Transformation, and Risk,... ...data warehouses, legacy Informatica ETL workflows, and Hadoop/Big Data systems into cloud-native environments. Pipeline...Big dataWork at officeRelocationVisa sponsorship3 days per week
FDM Group
Charlotte, NC5 days ago - ...Data EngineerEmployment Type: Full-Time, Mid-levelDepartment: Business IntelligenceCGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence... ..., SQL, SAS).Strong knowledge of big data analysis and storage tools...Big dataFull time
Contact Government Services LLC
Charlotte, NC19 hours ago - ...Description We are currently seeking a talented and motivated Senior Data Engineer to join our Cloud data solutions team. This role will be... ...Enable streaming data use-cases and standard design patterns in a big data environment. Review and provide feedback on core code...Big dataWork at officeLocal areaWork from home
SMBC Group
Charlotte, NC5 hours ago $125.1k - $152.9k
...policyholders count on us to be there when it matters most. It’s a big ask, but it’s one that we have the power to deliver when we... ...including your own. Pacific Life is actively seeking a Senior Data Engineer to join our Customer Data team onsite in Charlotte, North Carolina...Big dataRelha LLC
Charlotte, NC1 day ago- ...Data Engineer Location: Charlotte, North Carolina (Onsite) Role Overview We are seeking a Data Engineer to provide data-driven solutions... ...languages such as Java and Python. Experience with big data technologies like Hadoop or Spark. Proficiency in SQL and...Big data
Apex Systems
Charlotte, NC1 day ago $50.02k - $131.04k
...and operations of technology, digital, and data capabilities, platforms, and services... ...responsible for the company’s technology engineering, architecture, and infrastructure, providing... ..., data pipelines, database systems, big data patterns, cloud-native data tooling,...Big dataInternshipSummer internshipWork at officeLocal areaFlexible hours- ...Data Engineer II Location: Charlotte, North Carolina (Hybrid) Duration: 12 months Role Overview We are seeking a Data Engineer... ...practices. Preferred Qualifications Experience working on Big Data Technologies. Cloudera Admin / Dev Certification. Certification...Big data
Apex Systems
Charlotte, NC5 days ago - Data Engineer Charlotte, NC Fulltime - Need only independent VISA Holders Job Description 8 - 15 years of experience Must Have Technical/Functional... ...of cloud-native data lakes and warehouses. Optimize big data processing jobs for speed and cost. Mentor junior data engineers...Big dataFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- data engineer analytics Charlotte, NC
- principal data engineer Charlotte, NC
- senior cloud data engineer Charlotte, NC
- data center engineer Charlotte, NC
- director data engineering Charlotte, NC
- data engineer graduate Charlotte, NC
- big data devops engineer Charlotte, NC
- azure data engineer Charlotte, NC
- data engineer manager Charlotte, NC
- sr data engineer Charlotte, NC