Data Engineer III

Description: Senior Data Engineer – Data Platforms Role Overview We are seeking a Senior Data Engineer to design, build, and maintain scalable data engineering solutions that power analytics, reporting, and data products across the organization. This role works closely with product managers, data analysts, BI developers, and other engineers to deliver reliable, high quality data pipelines across both batch and real time streaming architectures. The ideal candidate has deep experience building cloud native data solutions on AWS, strong fundamentals in distributed systems, and hands on experience with stream processing frameworks such as Apache Flink, using Python and Java. ________________________________________ Key Responsibilities Data Engineering & Platform DevelopmentDesign, develop, and maintain scalable data pipelines supporting batch and real time streaming workloadsBuild and optimize data processing jobs using AWS Glue, PySpark, Python, and JavaDevelop and maintain stream processing applications using Apache FlinkImplement reliable data ingestion solutions using AWS DMS, Kafka, and AWS LambdaDesign and manage data persistence layers using Amazon Aurora (PostgreSQL) and related AWS services Streaming & Batch ProcessingDesign and support real time and near real time streaming pipelines using Kafka and Apache FlinkBuild and maintain stateful stream processing jobs, including windowing, aggregation, and event time processingDevelop efficient batch processing workflows for large scale data transformation and enrichmentEnsure data consistency, latency, fault tolerance, and reliability across streaming and batch systems Data Quality, Reliability & PerformanceImplement monitoring, logging, and alerting for batch and streaming data pipelinesDiagnose and resolve data quality, performance, and scalability issuesApply best practices for schema evolution, checkpointing, fault tolerance, and back pressure handlingOptimize pipelines for performance and cost efficiency Analytics & ConsumptionEnable downstream analytics and reporting through well modeled, well documented datasetsPartner with analytics and BI teams supporting tools such as QlikSupport data consumers by improving data discoverability, usability, and trust Collaboration & Engineering ExcellenceCollaborate with product, analytics, and platform teams to translate requirements into technical solutionsParticipate in architecture discussions, design reviews, and code reviewsContribute to data engineering standards, reusable frameworks, and documentationMentor junior engineers and promote best practices across the team ________________________________________ Core Technologies This role will work extensively with the following technologies:AWS GluePySparkPythonJavaApache Flink (Stream Processing)KafkaAWS DMSAWS LambdaAmazon Aurora (PostgreSQL)Streaming and Batch Data ProcessingQlik (analytics / BI consumption) ________________________________________ Preferred / Nice to Have ExperienceAmazon RedshiftData warehousing concepts (dimensional modeling, star/snowflake schemas)Experience building or supporting enterprise data warehouses or data lakesFamiliarity with event driven architectures and real time analytics use casesExperience with data governance, metadata management, or lineage tools ________________________________________ Required Qualifications5+ years of experience in data engineering or backend engineeringStrong hands on experience with Python and Java in distributed systemsExperience building streaming data applications using Apache Flink and KafkaSolid experience with AWS data servicesStrong SQL skills and understanding of relational data modelingExperience working with large scale, distributed data systems ________________________________________ What Success Looks LikeStreaming and batch pipelines are reliable, scalable, and observableReal time data is processed with low latency and high correctnessData is trusted and easily consumable by analytics and downstream systemsSystems are designed with fault tolerance, performance, and maintainability in mindEngineering best practices are consistently applied and sharedDexian stands at the forefront of Talent + Technology solutions with a presence spanning more than 70 locations worldwide and a team exceeding 10,000 professionals. As one of the largest technology and professional staffing companies and one of the largest minority-owned staffing companies in the United States, Dexian combines over 30 years of industry expertise with cutting-edge technologies to deliver comprehensive global services and support.   Dexian connects the right talent and the right technology with the right organizations to deliver trajectory-changing results that help everyone achieve their ambitions and goals. To learn more, please visit .Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.