Data Engineer
Epsilon Solutions Ltd
Cloud Data Engineer
This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise in understanding Banking and Capital markets, especially in investment banking would be a big plus. Strong Database fundamentals is a must along with PySpark Coding expertise.
Must Have:
- Snowflake
- Databricks
- SQL
- Python
- ADF
- PySpark
- Data Warehouse Concepts
Major Responsibilities:
- Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
- Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
- Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
- Proficient in developing programs in Python and SQL
- Experience with Data warehouse Dimensional data modeling.
- Working with event based/streaming technologies to ingest and process data.
- Working with structured, semi structured and unstructured data.
- Optimize Databricks jobs for performance and scalability to handle big data workloads.
- Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
- Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
- Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
- Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills:
- 5+ years Python coding experience.
- 5+ years - SQL Server based development of large datasets
- 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
- Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
- Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
- Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
- Experience with Cloud based data architectures, messaging, and analytics.
- Cloud certification(s).
- Strong experience in Code Optimizations and Performance tuning
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in United States vacancy
- ...MANTECH seeks a motivated, career and customer-oriented Data Engineer to join our team in Herndon VA. The Data Engineer will leverage their expertise with Python to support the customer’s data pipelines and related applications, from collection to ingestion, and ensure...Suggested
MANTECH
Herndon, VA14 hours ago - ...MANTECH seeks a motivated, career and customer-oriented Data Engineer to join our team in Chantilly, VA. The Data Engineer will leverage their development skills and experience to support the successful designing, ingesting, cleansing, transformation, loading...SuggestedWork at office
MANTECH
Chantilly, Loudoun County, VA14 hours ago $121k - $155k
...Description and Requirements The Team You Will JoinAt MetLife, data isn’t just a tool - it is a catalyst for growth. As part of our... ...building the future of data - one that’s governed responsibly, engineered for scalability, and designed for growth. When you join us, you...SuggestedFull timeTemporary workWork at officeLocal areaRelocation package3 days per week- Job-ID28042347Reference24-19051TypeContractRemote30% RemoteJob Description: The Data Science Engineering Analyst will play a pivotal role in analysing complex datasets, designing and implementing predictive models, and deriving actionable insights to drive business decisions...Suggested
- ...be recognized for your ideas. Join our team and increase your opportunities for success.We are currently seeking an experienced Data Engineer to join the Big Dat and Advanced Analytics department. The Data Engineer will work closely with business domain experts to create...Suggested
$132.5k - $172.5k
...,000 colleagues worldwide, all of whom are equity owners of the firm.Position SummaryBrown Advisory is seeking a Senior Addepar Data Engineer / Analyst to help advance the firm’s Wealth and Asset Management data capabilities. This role is responsible for supporting and...Full timeTemporary workH1bWork at officeWorldwide3 days per week- ...place for you. About the Role:At PitchBook, we believe that the Data Operations team plays a vital role in setting us apart from our... ...overhead Act as a technical mentor and coach a team of data engineers with diverse experience levels Uplevel the team’s capabilities...Work at officeRemote workVisa sponsorship
$170.9k - $185k
Exceptional Hospitality Starts with YouJob title: Lead Data EngineerLocation: McLean, VA (position allows 100% full remote work anywhere... ...with minimal oversight. Apply industry-standard software engineering principles throughout the lifecycle, including requirements gathering...Remote workWorldwide- Honeywell is accelerating its transformation from industrial automation to full autonomy and the data that powers that future starts here. As a Lead Data Engineer on our Industrial AI & Data Platforms team, you will architect and own the data foundations that enable physical...Permanent employmentTemporary workRelocation packageFlexible hours
$120.9k - $187k
...careers by learning from the world and each other.POSITION TITLELead Data EngineerPOSITION LOCATIONThis position is available to Virginia... ...end-to-end‑to‑end data architecture, data governance, and data engineering from source systems to data consumers—is seeking a Lead Data...Full timeWork at officeLocal areaRemote workWork visa- ...we invest in our employees and our community. Join us in using data, bold thinking, and a commitment to innovation to help clear the... ...accounting, investor reporting, and collections. As a Lead Data Engineer, you'll lead the Financial Data Operations team, owning the pipelines...Full timeWork at officeLocal areaRemote workRelocationFlexible hours
$195k - $215k
New York, NYTechnology - Software Engineering /Full Time /HybridAbout TodayTix Group:TodayTix Group (TTG) is the global e-commerce leader... ...customers with the best in live entertainment.Powered by vast data and insights, TTG helps theatres, producers, and cultural institutions...Full timeContract workWork at officeFlexible hoursShift work2 days per week- Req ID:373986NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be... ...thinking organization, apply now.We are currently seeking a Lead Data Engineer to join our team in Pla, Texas (US-TX), United States (US)....Work at officeRemote workFlexible hours
$165k - $180k
Data Engineering ManagerLocation: Remote (NY/NJ residents only) Direct Hire OverviewSeeking a hands-on engineering leader to guide a small data engineering team while driving modernization of a cloud-based data platform. ResponsibilitiesLead, mentor, and perform code reviews...Work at officeLocal areaRemote work$110k - $204.2k
Lead Data EngineerWe are seeking a highly skilled and strategic Lead Data Engineer to join our team. In this advanced individual contributor role, you will spearhead the development of sophisticated, insightful, and visually compelling reporting solutions using tools such...Full timeWork at officeLocal areaFlexible hours- ...to explore the world.The Royal Caribbean Group’s Analytics Team has an exciting career opportunity for a full-time Sr. Lead, Data Engineering reporting to the Director, Data Solutions EngineeringThe position is onsite and based in Miramar, Florida.Position Summary: The...Full time
- LEAD, DATA ENGINEER - NIKE[Beaverton, OR - USA]WHO YOU'LL WORK WITHConsumer Product and Innovation (CP&I) Data and Analytics Engineering sits at the intersection of product innovation and enterprise data strategy at Nike. Reporting to the Engineering Director, this team...Full time
$120k - $180k
...Value Proposition:The position sits within the newly consolidated Data and Analytics (D&A) organization supporting the U.S. Business... ...data science, from data infrastructure, data governance, data engineering, data modeling, data analysis to business intelligence, data science...Full timeTemporary workWork at officeLocal areaRelocation package3 days per week$152.9k - $221.1k
By joining Chubb as Lead Data Engineer for our North America Finance & Actuarial data platform, you'll set the engineering direction for a portfolio of strategic applications — Atlas, BAR, CDW, Posting, and Regulatory Reporting — that directly underpin financial, actuarial...Permanent employmentWork experience placementWork at officeLocal area$65 - $70 per hour
...Employment Type: C2C, Full TimeIndustry: Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole: Lead Data Engineer (Priority 1)Location: San Diego( Onsite only )Opening -1Lead Data Engineer JD:Role SummaryWe are seeking a highly skilled Lead...Hourly payFull time$121.7k - $162.2k
...? At MGM Resorts, we seek individuals like YOU to create unique and show-stopping experiences for our guests.THE JOB:The Senior Data Engineer provides technical leadership in the architecture, development, and operational management of enterprise data platforms and integration...Full timeHome office- ...customers and colleagues. Those stories are part of what makes this such a special place to work.Job Overview The Lead Enterprise Data Engineer designs and maintains scalable data architecture to support Macy’s analytics initiatives. This role ensures high-quality, secure...
$160.06k - $183.33k
...USAJob Family GroupEngineering / Product DevelopmentJob ProfileLead Data EngineerManagement LevelManager - Non People LeaderFlexible Work... ...Services, LLCLead Data EngineerJob Description: Lead Data Engineer positions offered by Cox Automotive Corporate Services, LLC (Atlanta...Full timeWork at officeRemote workFlexible hours- ...this sounds like the choice you want to make, then choose MITRE - and make a difference with us.Department Summary:MITRE’s Data Science and Engineering department is looking for qualified applicants to bring their advanced data engineering skills to bear on solving...InternshipLocal area
- We are seeking a hands-on Lead Data Engineer to join the Data & AI Supply Chain organization and drive the design, development, and delivery of enterprise-scale data products on Google Cloud Platform (GCP). This role will support Supply Chain initiatives across Sourcing...Hourly payFreelance
- Be part of a dynamic team where your distinctive skills will contribute to a winning culture and team.As a Lead Data Engineering at JPMorgan Chase within the Consumer and Community Banking team, you design, develop, and maintain robust data pipelines and architectures....
- OverviewLutron is seeking a Lead Data Engineer in Coopersburg, PA or Philadelphia, PA to help build and scale a modern, cloud-native data and AI platform powering analytics, real-time intelligence, and next-generation products. In this role, you will shape the architecture...Worldwide
- Job ID: 25729598Reference Number: 25-00664Title: Lead Data EngineerLocation: NYC, NYPosted Date: 2025-06-17Contact: Mahi MahiContact... ...-8019Company: HAN Staffing Required Skills:Proficiency in data engineering programming languages (preferably Python, alternatively Scala...
$75.9k - $141.9k
Application Deadline:08/20/2026Address:4100 Gordon Baker RoadJob Family Group:Data Analytics & ReportingWe are seeking a Lead Data Engineer with strong ETL and Application expertise to lead the enhancement of existing ETL applications and design modern ETL/ELT pipelines...Full timeContract workPart time- ...the next level? Fiberutilities Group (FG) is excited to welcome a new member to their dynamic team! FG is actively hiring a Lead Data Engineer to join its team in a hybrid position. As the Lead Data Engineer, you will be responsible for owning the design, implementation,...Temporary workLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data platform engineer United States
- aws data engineer United States
- azure data engineer United States
- data engineer freelance United States
- data engineer graduate United States
- big data devops engineer United States
- data pipeline engineer United States
- big data developer United States
- software data engineer United States
- data center engineer United States