Sr. Data Engineer
Concord IT Systems
Role: Sr. Data Engineer
Client: Airbnb
Location : Remote Key skills - Skill Sets - Python, SQL (expert level), Spark and Scala (intermediate).
Expertise:
A Typical Day:
Client: Airbnb
Location : Remote Key skills - Skill Sets - Python, SQL (expert level), Spark and Scala (intermediate).
Expertise:
- 8+ years of relevant industry experience with a BS/Masters
- Experience with distributed processing technologies and frameworks, such as Hadoop, Spark, Kafka, and distributed storage systems (e.g., HDFS, S3)
- Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
- Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks
- Solid understanding of data warehousing concepts and hands-on experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.g., Redshift, BigQuery, HBase, ClickHouse)
- Excellent written and verbal communication skills
A Typical Day:
- Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources, including user interactions, financial details, and external data feeds.
- Develop data models that enable the efficient analysis and manipulation of data for merchandising optimization. Ensure data quality, consistency, and accuracy.
- Build scalable data pipelines (SparkSQL & Scala) leveraging Airflow scheduler/executor framework
- Collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to define data requirements, and deliver data solutions that drive merchandising and sales improvements.
- Contribute to the broader Data Engineering community at Airbnb to influence tooling and standards to improve culture and productivity
- Improve code and data quality by leveraging and contributing to internal tools to automatically detect and mitigate issues.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Sr. Data Engineer in United States vacancy
- ...and skilled reporting expert with mandatory proficiency in Power BI and advanced SQL, plus experience with other BI tools and Azure Data Factory as a strong advantage. This US-based role will focus on building and delivering impactful data insights to customers...Senior
3B Staffing LLC
Minneapolis, MN1 day ago - ...All visa except H1b Hybrid: Des, Moines (local or nearby) Top 3 skills: Need 10+ years' experience # Python-based Data Engineering (ETL/ELT) - Building and maintaining backend data pipelines and curated data products. # AWS Data Platform Experience - Working...SeniorTemporary workFor contractorsH1bLocal areaShift work3 days per week
ShiftCode Analytics
Des Moines, IA10 hours ago - ...Ascentt is building cutting-edge data analytics & AI/ML solutions for global automotive... ...learning and GenAI. Our team solves hard engineering problems at scale, with real-world industry... ...an exceptionally skilled and experienced Sr. Principal Data Scientist / Machine...Senior
Ascentt
Plano, TX1 day ago - ...Job Title: Sr. Data Engineer Skills: Azure Data Factory, Databricks, Snowflake, Azure Devops Experience: 10+ years Location: Raleigh, NC (Hybrid) Duration: Fulltime We at Coforge are hiring a Sr. Data Engineer with following skillset : Solid 10+...SeniorFull time
Coforge
Raleigh, NC3 days ago - ...Sr Data Engineer Key Responsibilities: ~5 - 8 yrs experience in Azure (Databricks, PySpark) ~ Good to have knowledge in Azure Data factory ~ Good communication skills ~ Experience in leading a team and handling project deliverables Mandatory skills...SeniorRemote work
ClifyX
United States4 days ago - Sr. Data Engineer Location: Charlotte, NC/Marlborough, MA (Initial Remote) Duration: 12+ Months Contract TJMAXx Job Description: Minimum years of experience: 7-10+ Hands on experience in Databricks Hands on experience in SnowflakeSeniorContract workRemote work
ClifyX
United States1 day ago - ...Technology Sr. Data Engineer sought by Evolus, Inc. in Newport Beach, CA to collaborate with team members to collect business requirements, define successful analytics outcomes, & design data models. Req:BS or foreign equiv.+6yr. $158,808-165k/YR. *WFH ALLOWED* recblid...SeniorWork from home
Confidential
Costa Mesa, CA18 hours ago - ...Spark SQL, Python, Familiarity with AWS Services, Writing complex SQL, Write DQ rules, Experience understanding framework and creating data framework. AWS ecosystems (AWS Glue Jobs, S3, Iceberg) or equivalent tools stack Experience level: 7-12 years experience; 100%...SeniorRemote work
Diverse Lynx
United States4 days ago - ...Data Engineer Contract length: 6+ month contract to hire - conversion contingent on performance Location: 100% remote - will require travel to Charlotte, NC 1-2 times a quarter Top Requirements: 5+ years experience ~ Hadoop Ecosystem – Spark/PySpark – queries...SeniorContract workRemote work
Software Technology Inc
United States14 hours ago - ...time to discuss and also you can reach me @ (***) ***-**** (or) through email at ****@*****.*** Title : Senior Big Data Engineers. Location : Iselin, NJ office (hybrid) Must Have: ~7+ years of exp. ~ Python programming ~...SeniorWork at office
My3Tech Inc
Iselin, NJ4 days ago - ...Sr. Data Engineer San Francisco, CA We are seeking a Senior Data Engineer to support data analytics and platform initiatives. This role is ideal for a hands-on consultant who can build scalable data pipelines and enable analytics platforms across the organization. You...SeniorRemote work
Phizenix
United States16 hours ago - ...Senior Data Engineer Python experience must 100% remote As a senior data engineer in the engineering enablement organization, you will develop and oversee the best practices around data enablement with highly efficient and scalable code. The engineer will oversee...SeniorRemote work
Samprasoft
United States2 days ago - ...Data Lake Developer Role will be 60% development, 40% technical design supporting a data lake build out for analytics initiative and will also be accountable for developing processes to load target data to the lake. Familiar with AWS and data lakes, SQL and NoSQL...SeniorRemote work
Software Technology Inc
United States15 hours ago - ...Sr. Data Engineer The Howard Hughes name is synonymous with entrepreneurial vision, tenacity and a pioneering spirit-values still embodied by The Howard Hughes Corporation today. While Hughes' passion for aviation and the silver screen are legendary, it was his investment...Senior
Howard Hughes Corporation
Shenandoah, TX2 days ago - ...Senior Data Engineer The senior data engineer will play a role accomplishing the following team goals: Data Centralization, Data Governance, and Data Integrity. They will lead component design and development, work with data science, development and business analytics...Senior
Randstad
Chicago, IL3 days ago - ...Job Title: Sr. Data Engineer Location: Remote (MST) Type: Contract Rate: $Best Possible /hr. Requirements Minimum Qualifications: ~ Bachelor’s degree in Computer Science, Computer Information Systems, Engineering, Statistics or closely related field (willing...SeniorContract workRemote work
TWO95 International
United States3 days ago - ...Enterprise Data Engineer What You Can Expect In This Role Enterprise data engineers will be responsible for designing and implementing scalable data and integration solutions. This role requires strong technical skills in Snowflake, SQL and DBT, with a focus on enabling...Senior
Randstad
West Des Moines, IA2 days ago - ...Sr. Data Engineer 100% Remote Position type: Contract Rate: DOE US citizens and those authorized to work in the U.S are encouraged to apply. We are unable to sponsor at this time. Responsibilities: Participate in design and development of Hadoop and cloud-...SeniorContract workRemote work
Georgia IT Inc
United States17 hours ago - ...Sr. Data Engineer Role Spyglass Partners LLC has over 20 years of experience as a nationwide staffing firm and is your ideal source for all your project-based temporary and direct-hire staffing needs. Spyglass Partners excels in placing contract and direct-hire resources...SeniorContract workTemporary work
Spyglass Partners LLC
Greenwald, MN4 days ago - ...Data Engineer We are seeking a motivated Data Engineer to join our team and support the modernization of our data estate. This role focuses on assisting with data pipeline development, migration of legacy systems, and maintaining scalable, secure, and efficient data...Senior
Conflux Systems
Atlanta, GA4 days ago - Sr Data Engineer Location: Chicago / Remote Duration: Long Term Relevant Experience: 10+ years of experience Skills: Min 5 years of Airflow experience, 5+ years of Python experience. Good understanding of Cloud (Azure).SeniorRemote work
My3Tech Inc
United States1 day ago - ...Los Angeles or Orange County, CA ~ MUST HAVE Healthcare background, at least 3-4+ years ~ Extensive SQL Server and SQL Programming ~ SSIS ETL Development ~ Data Engineering, Data Warehousing, Data Pipelining Background ~8+ YEARS of experience...SeniorLocal area
3B Staffing LLC
Los Angeles, CA1 day ago - ...Data Modeler Must have experience of playing a lead role in at least 2 to 3 mid-large sized projects. Leads a team of data modelers in large projects for creation of logical and physical data models using best practices. Optimizes and updates logical and physical data...Senior
Samprasoft
Plano, TX2 days ago - ...Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning...Senior
ClifyX
Conshohocken, PA1 day ago - ...Sr Data Engineer / Arch with Databricks & Python / PySpark experience Requirements: Hands on experience in analyzing complex requirements, designing, and developing data engineering solution on Databricks. Excellent analytical skills Python/PySpark are...Senior
Cardinal Integrated
Monmouth Junction, NJ1 day ago - ...Sr .Data Engineer /Architect at North Quincy ,Massachusetts Required Skills : • Should have minimum of 12 years of IT experience in implementing data warehousing and migration projects • Should have minimum of 3 years of experience as a cloud consultant...Senior
Futran Tech Solutions Pvt. Ltd.
Quincy, IL2 days ago - ...Job Title Required Skills: 8+ Year experience Azure Data Factory and Data bricks Good understanding on Data modeling... ...Data Factory. Azure Databricks and SQL. Experienced data engineer with expertise in SQl/NoSQL processing using Azure technology stack...Senior
Syntricate Technologies
Montvale, NJ5 days ago - ...About the job Sr.Data Engineer with Redshift ED's Glue Job Description Data Transformation and ETL - Experience of Qlik Compose, AWS Glue ideal Development experience in the Amazon Cloud Environment AWS (S3, AWS Glue, Amazon Redshift, Data Lake)...Senior
RxCloud
Alameda, CA3 days ago - ...Senior Data Information Engineer Our client, a major transportation organization based in Washington, DC, is seeking a Senior Data Information Engineer to lead the design and implementation of data architecture across its Transportation Operations ecosystem. This highly...Senior
Software Technology Inc
Washington DC11 days ago - ...Sr. Data Engineer Our leading Fortune 100 Financial Services client is looking to bring on a Sr, Data Engineer to assist with several business critical pushes. In this role you will be contributing a specific line of business of our clients and developing new best practices...SeniorHourly payRemote work
Software Technology Inc
United States15 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Data Engineer. Be the first to apply!
Related searches
- junior data developer United States
- director data engineering United States
- junior big data engineer United States
- data engineer graduate United States
- senior data engineer United States
- data platform engineer United States
- sr information security engineer United States
- senior data integration developer United States
- data developer United States
- data engineer United States