Sr. Data Engineer
Concord IT Systems
Role: Sr. Data Engineer
Client: Airbnb
Location : Remote Key skills - Skill Sets - Python, SQL (expert level), Spark and Scala (intermediate).
Expertise:
A Typical Day:
Client: Airbnb
Location : Remote Key skills - Skill Sets - Python, SQL (expert level), Spark and Scala (intermediate).
Expertise:
- 8+ years of relevant industry experience with a BS/Masters
- Experience with distributed processing technologies and frameworks, such as Hadoop, Spark, Kafka, and distributed storage systems (e.g., HDFS, S3)
- Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
- Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks
- Solid understanding of data warehousing concepts and hands-on experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.g., Redshift, BigQuery, HBase, ClickHouse)
- Excellent written and verbal communication skills
A Typical Day:
- Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources, including user interactions, financial details, and external data feeds.
- Develop data models that enable the efficient analysis and manipulation of data for merchandising optimization. Ensure data quality, consistency, and accuracy.
- Build scalable data pipelines (SparkSQL & Scala) leveraging Airflow scheduler/executor framework
- Collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to define data requirements, and deliver data solutions that drive merchandising and sales improvements.
- Contribute to the broader Data Engineering community at Airbnb to influence tooling and standards to improve culture and productivity
- Improve code and data quality by leveraging and contributing to internal tools to automatically detect and mitigate issues.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Sr. Data Engineer in United States vacancy
- ...Job Summary We're looking for an exceptionally skilled and experienced Sr. Principal Data Scientist / Machine Learning Engineer to lead and deliver high-impact AI/ML projects across Automotive domain. The ideal candidate will have a deep understanding of data science...SeniorFull time
Ascentt
Plano, TX20 hours ago $175k - $190k
...the health of others, join us and make it happen! About Pelago Data: Our Data team sits at the center of how Pelago makes decisions... ...to-day decision-making across the company. The Senior Analytics Engineer is a key force multiplier on that mission. Overview of the Role...SeniorFull time- ...Job Title: Sr. Data Engineer Location: Jersey City, NJ Hybrid (3-4 days) Pay rate: As per industry standards. Visa reqt: USC and GC Mandatory Skills Python, scripting, web services, API design, etc. Kubernetes CI/CD (preferably GitLab) Job Orchestration (preferably Airflow...Senior
Highbrow
Jersey City, NJ4 days ago - ...Mandatory Skills Azure Data Bricks Azure Data Lake Python Pyspark Desired Skill: Bloomberg data acquisition and transformation Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure Data Lake. Integrate data from various sources into the...Senior
TechDigital Group
New York, NY20 hours ago - Job Title As an Engineer on the full stack team, you will be dedicated to help design, implement, and maintain a modern, robust, and scalable platform which will enable the Operational Risk team to meet the increasing demands from the various trading desks.Senior
Samprasoft
Charlotte, NC3 days ago - ***This position is only for Local Nearby Contractor***** We are seeking a Senior Databricks Engineer with deep hands-on experience designing and implementing large-scale data solutions on Azure Databricks . The ideal candidate has real-world experience building and troubleshooting...SeniorFor contractorsLocal area
Golden Technology
Cincinnati, OH4 days ago - ...Job Description Sr. Data engineer (1) Snowflake/dbt/GCP/Python skillset 6 months Location: Atlanta, GA (Onsite, no remote work allowed) Required skills: Snowflake/dbt/GCP/Python skillset Design, develop, and implement data integration solutions to move data between disparate...SeniorRemote work
6AM City
New York, NY2 days ago - ...Senior Data Engineer Python experience must 100% remote As a senior data engineer in the engineering enablement organization, you will develop and oversee the best practices around data enablement with highly efficient and scalable code. The engineer will oversee...SeniorRemote work
Samprasoft
United States3 days ago - ...Cloud Engineer Remote till Sep(Durham, NC)(Hybrid Mode) 12 Months Job Description Develop Oracle SQL and PLSQL stored procedures Develop ETL code using Informatica PowerCenter Work in an agile manner within your squad and across other teams to deliver...SeniorRemote work
Samprasoft
Durham, NC3 days ago - ..., Azure Services, Power BI Proven experience with Symphony Engine development (architect-level skills in development and design).... ...Experience in Power BI for creating reports, dashboards, and data visualizations to aid in decision-making. Strong understanding...Senior
Syntricate Technologies
Redmond, WA2 days ago - Position Summary - Hybrid Schedule (Fort Worth, TX) The Senior Data Engineer designs, builds, and maintains the scalable cloud-based infrastructure required to collect, process, and store large volumes of data used for analytics and decision‑making. They develop and manage...Senior
Range Resources
Fort Worth, TX4 days ago - ...Big Data Engineer Experience Required - 6+ Years Must Have Technical/Functional Skills Strong hands-on experience in Big Data technologies and distributed data processing frameworks. Proficiency in Python for data engineering, scripting, and performance optimization...Senior
ClifyX
Phoenix, AZ1 day ago - ...We are seeking experienced Data Engineers to support a high-impact data modernization initiative. The ideal candidate will be responsible for building and maintaining scalable data pipelines and foundational components of Datawarehouse. This role requires strong technical...Senior
Inizio Partners Corp
New York, NY1 day ago - ...system requirements and design responsive algorithms and solutions Use big data and cloud technologies to produce production quality code Engage in performance tuning and scalability engineering Work with team, peers and management to identify objectives and set priorities...Senior
Compugain
Rockville, MD20 hours ago $125k - $145k
...Senior Data Engineer Location: Chicago, IL (Hybrid) Pay: $125K - $145k base + bonus Overview A rapidly growing financial services organisation is seeking a Senior Data Engineer to join a lean, highly collaborative data team. The company focuses on delivering transparent...SeniorHarnham
Chicago, IL2 days ago$130k
Are you the data professional who enjoys turning complex information into insights that help organizations make smarter decisions, not... ...to expand its data capabilities with a talented BI and Data Engineer. This role offers the opportunity to solve meaningful data challenges...SeniorLocal areaITAC Solutions
Birmingham, AL9 hours ago- ...job. Deep knowledge and hands-on experience working with cloud data platform technologies in Azure, and scripting language Python.... ...experience in developing and deploying data architecture strategies or engineering practices. Five plus years' experience with complex SQL queries...SeniorRemote work
The Dignify Solutions, LLC
United States1 day ago $145k - $165k
Megazone Cloud is looking for a Senior Data Engineer to help lead and define our data-driven culture. You are a "builder" at heart, a seasoned expert who thrives on solving complex problems. You have a startup mentality, a thirst for knowledge, and the ability to lead projects...SeniorImmediate startFlexible hoursMegazoneCloud US
Rochester, NY3 days ago- ...Data Engineer Client: JnJ Role: Data Engineer Location: Remote (ET) Duration: 6 Months+ Data Engineer onshore with the following skills: Total experience in analytics (ETL, big data, reporting and analytics, multidimensional modelling): 8+ years Tech...SeniorRemote work
Staffing the Universe
United States2 days ago - ...IDR is seeking a Sr Data Engineer to join one of our top clients in Charlotte, NC as a long term opportunity. If you are looking for an opportunity to join an organization who has invested in bleeding edge technology - Apply today! At this time, we are only able to consider...Senior
IDR, Inc.
Charlotte, NC4 days ago - ...About Neon Redwood Neon Redwood is a data services consulting company, working on cutting-edge AI and data-driven solutions. We are a team of passionate engineers and data experts, and we are currently looking for a Senior Data Engineer to join our team and help us develop...SeniorFull timeWork experience placement
Neon Redwood
San Francisco, CA2 days ago - Company : BeyondTrust Corporation Location : Johns Creek, GA Position Title : Senior Data Engineer (Req # 3389121) Job Description Data Engineers at BeyondTrust are the backbone of the company’s core data infrastructure that powers all analytics products running...SeniorWork at officeRemote workHome office
BeyondTrust
Johns Creek, GA20 hours ago - ...The Data Engineer will work iteratively on the cloud platform to design, develop and implement scalable, high performance solutions that offer measurable business value to customers. Responsibilities Data Solutions: Design and implementation of data pipelines using GCP...Senior
TechDigital Group
Saint Louis, MO4 days ago $60 - $70 per hour
...Long term opportunity | $60-$70 per hour. Job Title: Data Engineer. Must be located in Atlanta, GA. Primary Responsibilities & Essential Functions Design, implement, and maintain the data pipeline architecture for our business Assemble large, complex data sets that meet...SeniorHourly paySciata
New York, NY20 hours ago- ...Overview A seasoned Data Analytics and BI professional with 6–8 years of experience, specializing in Tableau and Power BI for enterprise... ...Python for Analytics – IBM Education Bachelor’s of Engineering in Electronics and Telecomm or related fields. #J-18808-Ljbffr...Senior
Fixity Technologies
Sacramento, CA3 days ago - Job Description Insight Global is seeking a Sr. Data Engineer to partner with our client's Lead Data Architect in designing, scaling, and managing a modern enterprise analytical data warehouse. This role is ideal for a hands‑on professional who can bridge business requirements...Senior
Insight Global
Dallas, TX4 days ago - Job Description Insight Global is looking for a Sr. Data Engineer to come join their team. This candidate will be helping design and deliver modern data solutions using cloud-based platforms and AI-driven innovations. You will partner with business, technology, and governance...Senior
Insight Global
Plano, TX4 days ago - ...Overview The ideal candidate has hands-on experience building modern data pipelines and platforms using Python, SQL, and AWS services... ...a scientific or quantitative discipline, such as Mathematics, Engineering, Computer Science, Economics, or Physical Sciences 5+ years of...SeniorFull time
TechTriad Inc
New York, NY20 hours ago - ...Sr. Data Engineer CarMax is disrupting the industry by empowering customers to buy a car on their own terms, providing an iconic customer experience. The CarMax Master Data Management (MDM) team is looking for a Sr. Data Engineer to provide hands on data integration...SeniorRemote work
Damco
United States3 days ago $102.7k - $128.4k
...wins and show up ready to build something better every day. This is your chance to be part of what’s next. About the Role: The Sr Data Engineer is a senior-level, hands‑on technical leader responsible for designing, building, and evolving Subway’s enterprise data...SeniorSubway
Shelton, CT3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Data Engineer. Be the first to apply!
Related searches
- big data cloud engineer United States
- big data engineer United States
- big data developer United States
- remote data engineer United States
- bi data engineer United States
- big data devops engineer United States
- finance data engineer United States
- sr information security engineer United States
- junior big data engineer United States
- entry level big data engineer United States