Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer

xScion Solutions

As an employee, you Turn Change Into Value® - for our clients, for our company, for your professional growth, for the consumers. We hire the best and brightest, who are driven to create lasting value. At xScion, you aren't just another team member, you're impactful. You're empowered. You're driven. You're an xScioneer.

Location: Los Angeles, San Francisco, Salt Lake City, Portland, Seattle

As a Senior Data Engineer, You Will:
  • Design, develop, and operationalize large-scale enterprise data solutions using AWS services such as S3, Glue, Athena, Lambda, RedShift, EMR, Spark, and DynamoDB
  • Analyze, redesign, and re-platform on-premise data solutions from Cloudera Hadoop platforms to AWS native data stack
  • Design, develop, and deploy data pipelines from ingestion to consumption within a big data architecture using Java, Python, or Scala
  • Participate in discussions related to architecture, design, and product development to understand business requirements and translate them into technical solutions
  • Take responsibility for complete user stories through analysis, design, development, and testing as per project timelines
  • Develop and maintain scripts to automate batch jobs
  • Support and maintain existing applications, troubleshooting and resolving technical issues
  • Follow appropriate technical best practices and internal processes while complying with various information security controls
  • Maintain existing data solutions running on Hadoop stack using HDFS, Oozie, Impala, and Hive, handling some enhancements until the cloud migration.
To Be Successful, You Need:
  • Bachelor's Degree in Computer Science, Information Technology, or other relevant fields
  • Must be a US Citizen or a Green Card holder for over 3 years with the intent to become a US Citizen.
  • 7+ years of software development experience related to data engineering
  • Hands-on experience in Java, Python, or Scala with the ability to understand/write complex SQL queries
  • Proficient in AWS services such as S3, Glue, Athena, Lambda, RedShift, EC2, EMR, Spark, and DynamoDB using Java, Python, Scala, or PySpark
  • Experience deploying software solutions to the cloud platform through CI/CD in a DevOps model
  • General understanding of application and data security concepts with exposure to AWS IAM, CloudTrail, CloudWatch, AWS Config, Secrets Manager, and KMS
  • Hands-on experience with Hadoop technologies such as HDFS, Oozie, Impala, and Hive
  • Experience with Ansible, Terraform, or Cloud Formation scripts to develop or support Infrastructure as Code
  • Experience working with Hadoop-based Big Data architecture and solutions.
  • Experience working in an Agile development environment using Agile tools like Jira or Rally.
  • Proficiency with UNIX commands and shell scripts.
  • Ability to effectively communicate, collaborate, and work in a team environment to deliver high-quality work independently.
  • Nice to have experience with RDBMS and data warehouses
  • Nice to have experience with Machine Learning technologies and data visualization tools
Why xScion?
  • We have an amazing culture- We were named a Best Places to Work in Virginia 8 times, including 2025.
  • We are poised for rapid growth- We are on the cutting edge of digital transformation in Financial Services, Healthcare, Nonprofit and Public Sector and continuously welcome new clients to the xScion family.
  • We believe in your continuous development- We invest in our teams' development, including our Communities of Practice, technology partnerships, sandbox and paying for certifications and trainings to improve their skills because we are committed to collectively being the best at what we do.
  • We want you to make an impact in whatever you do- Our people are given the opportunity to provide impactful change to our clients and team.
  • We believe in equality - As a woman-owned organization, we believe in an inclusive and diverse culture where everyone's uniqueness makes us stronger.
  • Great Benefits: Medical, dental, 401(k) match, flexible spending and more, but we also have unique perks such as up to 27 days off a year (including your birthday!), remote work opportunities, parental leave, wellness benefits and many other things that inspire balance and flexibility.

We're Transforming RegTech Organizations:

At xScion, we Turn Change Into Value. We help clients in highly regulated industries start or accelerate their digital transformation initiatives by shifting their mindset and goals into smaller, actionable steps that create lasting value. With more than 20 years of experience supporting Regulatory Technology (RegTech), xScion provides both domain experts and tailored solutions to help organizations navigate complex compliance and technology requirements. We specialize in Business Agility, Cloud Transformation and Organizational Change Management solutions for clients in Financial Services, Public Sector, Nonprofits and Healthcare. Our experts help prepare and create change to clients' processes, technology and culture in order to improve operational efficiencies and the customer experience. As a certified Woman-Owned Small Business, we are proud to be the most trusted solutions partner that business and technology leaders count on to deliver lasting, impactful value.

All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or protected veteran status. xScion takes affirmative action in support of its policy to employ and advance in employment individuals who are minorities, women, protected veterans and individuals with disabilities.

You will be added to our talent community when you apply to this job. You may opt out at any time.

Want to Learn More about xScion?


Check us out on or socially at LinkedIn, Twitter and Glassdoor.
Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in San Francisco, CA vacancy
  •  ...Insight Global is seeking a Senior Data Engineer to support their Data Strategy & Operations function. This fully remote role focuses on building and managing data integration patterns into Data 360, ensuring reliable data ingestion, and collaborating with cross-functional... 
    Senior
    Remote work

    Insight Global

    San Francisco, CA
    1 day ago
  •  ...A fintech company is seeking a Senior Data Engineer to lead the design and implementation of scalable data pipelines using Python in a cloud environment. This fully remote role requires experience with Databricks, AWS, and Delta Lake. The ideal candidate will have a Bachelor... 
    Senior
    Remote work

    Plum Inc

    San Francisco, CA
    1 day ago
  •  ...Title: Senior Snowflake Data Engineer Location: Santa Clara, CA -95054 (5 days onsite) Duration: Longterm Contract Note: Need only local resource as in person interview required. Senior Snowflake Data Engineer - Key Requirements: • Strong hands... 
    Senior
    Contract work
    Local area

    E-Solutions

    San Francisco, CA
    2 days ago
  •  ...Job Description Description: We're seeking a Senior Data Engineer to build and own our data platform and infrastructure. You will design systems that power transaction processing, analytics, reporting, and real-time insights across our global financial product... 
    Senior
    Flexible hours

    Serene Healthcare Staffing

    San Francisco, CA
    2 days ago
  •  ...Francisco, CA, with a global presence across the United States, EMEA, and APAC. Role Overview RZR Global is seeking a talented Data Engineer to join our growing engineering team. This role is ideal for an engineer with a strong background in building and operating... 
    Senior

    RZR Global Inc.

    San Francisco, CA
    3 days ago
  •  ...Senior Data Engineer SAN FRANCISCO, CA / ENGINEERING / FULL-TIME What Will You Be Doing? Building fast, reliable, scalable data pipelines that process over billions of historical data points collected from tens of thousands of retail stores across the US which... 
    Senior
    Full time
    Work experience placement

    1872 Consulting

    San Francisco, CA
    8 days ago
  •  ...We are seeking a skilled and experienced Senior Data Engineer to join our innovative team. The ideal candidate will bring deep expertise in modern data engineering technologies, strong collaboration skills, and a solid understanding of the financial services sector. Beyond... 
    Senior
    Contract work

    GrabJobs

    San Francisco, CA
    1 day ago
  • $226k - $254k

     ...and work relationships. Yes, you can build an exciting business AND have real-life real-customer impact. We are looking for a Data Engineer or Analytics Engineer to join our Data team. You will collaborate with the data scientist and engineers to design, build, and... 
    Senior
    Work experience placement
    Local area

    Kikoff

    San Francisco, CA
    1 day ago
  •  ...Sr. Data Engineer (SCM) Location: Bay area, CA (Hybrid/Remote) Duration: Long term contract Description: Design, build and launch efficient & reliable data pipelines to move and transform data (both large and small amounts) Apply proven expertise and build... 
    Senior
    Long term contract
    Remote work

    InterSources

    San Francisco, CA
    3 days ago
  •  ...Data Engineering Role at Triumph Triumph is a skill-based real-money gaming platform in a period of rapid growth. Real money flows through every game, every matchmaking decision, and every payout, which means the data infrastructure powering those systems has to be... 
    Senior

    Triumph

    San Francisco, CA
    3 days ago
  • $25 per hour

     ...Data Engineer Point is building a modern and aspirational banking experience by bringing rewards and benefits to the everyday debit card. We are looking for a data engineer to pioneer the data team at Point and be responsible for building out the data pipelines and... 
    Senior
    Work experience placement
    Work at office
    Work from home
    Flexible hours

    Point Defunct

    San Francisco, CA
    3 days ago
  •  ...About the job Senior Data Engineer Role: Senior Data Engineer We are seeking a Sr Data Engineer for our Data feeds team to provide batch data processing, real-time streaming, and pipeline orchestration capabilities. You'll be part of the Data Technology... 
    Senior
    Work experience placement

    Inizio Partners

    San Francisco, CA
    3 days ago
  • $180k - $195k

     ...company is backed by climate-tech and Silicon Valley investors. For more information, please visit Role Description As a Senior Data Engineer at Gridware, you'll design and scale the data infrastructure that powers our real-time grid monitoring platform. You'll... 
    Senior

    Gridware

    San Francisco, CA
    3 days ago
  • $160k - $240k

     ...Senior Data Engineer San Francisco About the Role Together AI is looking for a Senior Data Engineer to help define, build, and operate the data infrastructure that handles millions of events every day to power Together's mission-critical systems. As a Senior... 
    Senior
    Full time

    Together AI

    San Francisco, CA
    2 days ago
  • $130k - $200k

     ...real growth. How we work at Aircall: We're customer-obsessed, data-driven, and focused on delivering meaningful outcomes. We value...  ..., you'll feel at home here. About the role The Data Engineering team at Aircall works on providing high-quality, reliable, and... 
    Senior
    Worldwide

    Aircall

    San Francisco, CA
    2 days ago
  •  ..., General Catalyst, GV, and Accel and enjoy a multi-year runway. About The Role: We're looking for an entrepreneurial Data Engineer with interest in agentic AI and at least 5 years of general engineering experience who wants to make an impact as one of the founding... 
    Senior
    Temporary work
    Work at office
    Flexible hours

    Sprinter Health

    San Francisco, CA
    2 days ago
  • $147.4k - $272.1k

     ...Senior Data Engineer Work Locations (3) Submit Resume Imagine what you could do here. At Apple, new ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what... 
    Senior
    Relocation

    Apple

    San Francisco, CA
    3 days ago
  •  ...Title: Senior Data Engineer Location: San Francisco, California Work Type: Hybrid Job Type: Contract Key Responsibilities: Design, develop, optimize, and maintain enterprise data pipelines and data warehouse solutions. Build and support ETL/ELT processes... 
    Senior
    Contract work
    Work at office

    Cogent Data Solutions

    San Francisco, CA
    1 day ago
  •  ...Title: Senior Data Engineer - Platform Engineering Location: San Francisco, Los Angeles, or Dallas - Hybrid (Requires three days/week in our San Francisco, Los Angeles or Dallas office) Type: Full-time Reports to : Director of Data Engineering... 
    Senior
    Full time
    Work at office
    Flexible hours
    3 days per week

    Kaav Inc.

    San Francisco, CA
    2 days ago
  • $204.5k - $267k

     ...Senior Data Engineer Formation Bio is a tech and AI driven pharma company differentiated by radically more efficient drug development. Advancements in AI and drug discovery are creating more candidate drugs than the industry can progress because of the high cost and... 
    Senior
    Work at office
    Local area
    Relocation
    3 days per week

    Formation Bio (Formerly TrailSpark)

    San Francisco, CA
    3 days ago
  • $150k - $220k

     ...center of this effort, collaborating across engineering, design, research, and education to...  ...Content & AI Systems team is building the data layer that powers the next generation of...  ...geographic location, prior experience, seniority, and demonstrated role related ability during... 
    Senior
    Permanent employment
    Full time
    Local area
    Flexible hours

    Kiddom

    San Francisco, CA
    1 day ago
  • $180k - $220k

     ...truth for operational metrics, customer-facing reports, billing, actionable insights, and a host of business-critical KPIs. As a Data Engineer in the Data Engineering team, you will own the tooling, frameworks, data pipelines, integrations, databases, schemas and the... 
    Senior
    Flexible hours

    Finix

    San Francisco, CA
    3 days ago
  • $185k - $221.4k

     ...ll Do Build and own production data infrastructure. Design, implement, and operate...  ...shape at the right time. Uphold high engineering standards and collaborate broadly. Lead...  ...innovation. Autonomy. Small, senior teams give you room to architect and own... 
    Senior
    Remote work
    Flexible hours

    Foresite Labs

    San Francisco, CA
    1 day ago
  • $165k - $175k

     ...headquartered in New York City with offices around the world. To learn more, go to The Role We're looking for a Senior Data Engineer to design, build, and operate the data pipelines and aggregates that power Zeta's AdTech platform. This is a hands-on... 
    Senior

    Zeta Global

    San Francisco, CA
    9 hours ago
  • $240k - $300k

     ...Senior Data Engineer At EliseAI, we're improving the industries that matter most: housing and healthcare. Everyone needs a place to live and access to quality healthcare, yet both are often harder to secure than they should be. By integrating AI agents deeply into... 
    Senior
    Work at office
    Local area
    Relocation

    EliseAI

    San Francisco, CA
    3 days ago
  •  ...Job Description Senior Data Engineer Principal, Lead on site Client is building a global consumer neobank, merging banking, payments, and crypto into a single product. Our initial focus is emerging markets, where traditional banking and local currencies fail... 
    Senior
    Local area
    Flexible hours

    Simple Solutions

    San Francisco, CA
    3 days ago
  • $15 per hour

     ...200,000+ volunteer contributors. The Wikimedia Foundation’s Data Platform team enables this global knowledge ecosystem through...  ...access to data for research, feature development, and . As a Senior Data Engineer for our Data Platform, you will shape the future of how... 
    Senior
    For contractors
    Local area
    Remote work

    CloudDevs

    San Francisco, CA
    1 day ago
  • $196k - $220.5k

     ...people to talk and hang out before, during, and after playing games. Discord is looking for an experienced and passionate Senior Data Engineer, Analytics to join our data team! You will be owning the transformation and semantic layer that turns data into clean, tested... 
    Senior
    Full time

    Discord

    San Francisco, CA
    3 days ago
  • $180k - $260k

     ...Engineer data systems that change how people live and work. As a senior data engineer at Gallup, you'll play a key role in designing, developing and optimizing the data systems that underpin our flagship platform, Gallup Access. You'll use your enterprise-level data... 
    Senior
    Work at office
    3 days per week

    Gallup

    San Francisco, CA
    2 days ago
  •  ...meaningful impact—both together and individually. Job Summary We are seeking a candidate with experience as, or applicable to, a Senior Data Engineer role with significant demonstrated experience using Python in a cloud environment to lead the design and implementation of... 
    Senior
    Work experience placement
    Remote work

    Plum Inc

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!