Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer

xScion Solutions

As an employee, you Turn Change Into Value® - for our clients, for our company, for your professional growth, for the consumers. We hire the best and brightest, who are driven to create lasting value. At xScion, you aren't just another team member, you're impactful. You're empowered. You're driven. You're an xScioneer.

Location: Los Angeles, San Francisco, Salt Lake City, Portland, Seattle

As a Senior Data Engineer, You Will:
  • Design, develop, and operationalize large-scale enterprise data solutions using AWS services such as S3, Glue, Athena, Lambda, RedShift, EMR, Spark, and DynamoDB
  • Analyze, redesign, and re-platform on-premise data solutions from Cloudera Hadoop platforms to AWS native data stack
  • Design, develop, and deploy data pipelines from ingestion to consumption within a big data architecture using Java, Python, or Scala
  • Participate in discussions related to architecture, design, and product development to understand business requirements and translate them into technical solutions
  • Take responsibility for complete user stories through analysis, design, development, and testing as per project timelines
  • Develop and maintain scripts to automate batch jobs
  • Support and maintain existing applications, troubleshooting and resolving technical issues
  • Follow appropriate technical best practices and internal processes while complying with various information security controls
  • Maintain existing data solutions running on Hadoop stack using HDFS, Oozie, Impala, and Hive, handling some enhancements until the cloud migration.
To Be Successful, You Need:
  • Bachelor's Degree in Computer Science, Information Technology, or other relevant fields
  • Must be a US Citizen or a Green Card holder for over 3 years with the intent to become a US Citizen.
  • 7+ years of software development experience related to data engineering
  • Hands-on experience in Java, Python, or Scala with the ability to understand/write complex SQL queries
  • Proficient in AWS services such as S3, Glue, Athena, Lambda, RedShift, EC2, EMR, Spark, and DynamoDB using Java, Python, Scala, or PySpark
  • Experience deploying software solutions to the cloud platform through CI/CD in a DevOps model
  • General understanding of application and data security concepts with exposure to AWS IAM, CloudTrail, CloudWatch, AWS Config, Secrets Manager, and KMS
  • Hands-on experience with Hadoop technologies such as HDFS, Oozie, Impala, and Hive
  • Experience with Ansible, Terraform, or Cloud Formation scripts to develop or support Infrastructure as Code
  • Experience working with Hadoop-based Big Data architecture and solutions.
  • Experience working in an Agile development environment using Agile tools like Jira or Rally.
  • Proficiency with UNIX commands and shell scripts.
  • Ability to effectively communicate, collaborate, and work in a team environment to deliver high-quality work independently.
  • Nice to have experience with RDBMS and data warehouses
  • Nice to have experience with Machine Learning technologies and data visualization tools
Why xScion?
  • We have an amazing culture- We were named a Best Places to Work in Virginia 8 times, including 2025.
  • We are poised for rapid growth- We are on the cutting edge of digital transformation in Financial Services, Healthcare, Nonprofit and Public Sector and continuously welcome new clients to the xScion family.
  • We believe in your continuous development- We invest in our teams' development, including our Communities of Practice, technology partnerships, sandbox and paying for certifications and trainings to improve their skills because we are committed to collectively being the best at what we do.
  • We want you to make an impact in whatever you do- Our people are given the opportunity to provide impactful change to our clients and team.
  • We believe in equality - As a woman-owned organization, we believe in an inclusive and diverse culture where everyone's uniqueness makes us stronger.
  • Great Benefits: Medical, dental, 401(k) match, flexible spending and more, but we also have unique perks such as up to 27 days off a year (including your birthday!), remote work opportunities, parental leave, wellness benefits and many other things that inspire balance and flexibility.

We're Transforming RegTech Organizations:

At xScion, we Turn Change Into Value. We help clients in highly regulated industries start or accelerate their digital transformation initiatives by shifting their mindset and goals into smaller, actionable steps that create lasting value. With more than 20 years of experience supporting Regulatory Technology (RegTech), xScion provides both domain experts and tailored solutions to help organizations navigate complex compliance and technology requirements. We specialize in Business Agility, Cloud Transformation and Organizational Change Management solutions for clients in Financial Services, Public Sector, Nonprofits and Healthcare. Our experts help prepare and create change to clients' processes, technology and culture in order to improve operational efficiencies and the customer experience. As a certified Woman-Owned Small Business, we are proud to be the most trusted solutions partner that business and technology leaders count on to deliver lasting, impactful value.

All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or protected veteran status. xScion takes affirmative action in support of its policy to employ and advance in employment individuals who are minorities, women, protected veterans and individuals with disabilities.

You will be added to our talent community when you apply to this job. You may opt out at any time.

Want to Learn More about xScion?


Check us out on or socially at LinkedIn, Twitter and Glassdoor.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in San Francisco, CA vacancy
  •  ...Job Description Description: We're seeking a Senior Data Engineer to build and own our data platform and infrastructure. You will design systems that power transaction processing, analytics, reporting, and real-time insights across our global financial product... 
    Senior
    Flexible hours

    Serene Healthcare Staffing

    San Francisco, CA
    18 days ago
  •  ...Francisco, CA, with a global presence across the United States, EMEA, and APAC. Role Overview RZR Global is seeking a talented Data Engineer to join our growing engineering team. This role is ideal for an engineer with a strong background in building and operating... 
    Senior

    RZR Global Inc.

    San Francisco, CA
    4 days ago
  •  ...Data Engineering Role at Triumph Triumph is a skill-based real-money gaming platform in a period of rapid growth. Real money flows through every game, every matchmaking decision, and every payout, which means the data infrastructure powering those systems has to be... 
    Senior

    Triumph

    San Francisco, CA
    9 days ago
  • $226k - $254k

     ...and work relationships. Yes, you can build an exciting business AND have real-life real-customer impact. We are looking for a Data Engineer or Analytics Engineer to join our Data team. You will collaborate with the data scientist and engineers to design, build, and... 
    Senior
    Work experience placement
    Local area

    Kikoff

    San Francisco, CA
    2 days ago
  •  ...world's most complex manufacturing and logistics operations. Our Data Engineers are the backbone of that mission - designing, building, and...  ...the data infrastructure that powers our AI products. As a Senior Data Engineer on our India engineering team, you will own the... 
    Senior

    Daybreak AI, Inc

    San Francisco, CA
    3 days ago
  •  ...Senior Data Engineer, Investments Technology (Enterprise Data Management) At Liberty Mutual Investments Technology, we are seeking a highly skilled Senior Data Engineer to join our Financial – Enterprise Data Management team. This role is focused on developing and... 
    Senior
    Local area

    Venturefizz Product Management Community

    San Francisco, CA
    6 days ago
  • $25 per hour

     ...Data Engineer Point is building a modern and aspirational banking experience by bringing rewards and benefits to the everyday debit card. We are looking for a data engineer to pioneer the data team at Point and be responsible for building out the data pipelines and... 
    Senior
    Work experience placement
    Work at office
    Work from home
    Flexible hours

    Point Defunct

    San Francisco, CA
    4 days ago
  • $180k - $195k

     ...company is backed by climate-tech and Silicon Valley investors. For more information, please visit Role Description As a Senior Data Engineer at Gridware, you'll design and scale the data infrastructure that powers our real-time grid monitoring platform. You'll... 
    Senior

    Gridware

    San Francisco, CA
    4 days ago
  • A leading technology solutions provider is seeking an experienced CommVault Systems Engineer in San Francisco, California. The role involves designing, developing, and supporting data protection and recovery solutions for a federal government enterprise's environment. The... 
    Senior
    Full time

    CGS Federal (Contact Government Services)

    San Francisco, CA
    3 days ago
  •  ...About the job Senior Data Engineer Role: Senior Data Engineer We are seeking a Sr Data Engineer for our Data feeds team to provide batch data processing, real-time streaming, and pipeline orchestration capabilities. You'll be part of the Data Technology... 
    Senior
    Work experience placement

    Inizio Partners

    San Francisco, CA
    5 days ago
  •  ...Senior Data Engineer Tessera Labs is redefining how enterprises adopt and operationalize Artificial Intelligence. Backed by Foundation Capital and led by a world-class founding team, we build multi-agent AI systems that automate complex business workflows across platforms... 
    Senior

    Tessera Labs

    San Francisco, CA
    2 days ago
  • $180k - $220k

     ...truth for operational metrics, customer-facing reports, billing, actionable insights, and a host of business-critical KPIs. As a Data Engineer in the Data Engineering team, you will own the tooling, frameworks, data pipelines, integrations, databases, schemas and the... 
    Senior

    Finix

    San Francisco, CA
    4 days ago
  • $160k - $240k

     ...Senior Data Engineer San Francisco About the Role Together AI is looking for a Senior Data Engineer to help define, build, and operate the data infrastructure that handles millions of events every day to power Together's mission-critical systems. As a Senior... 
    Senior
    Full time

    Together AI

    San Francisco, CA
    3 days ago
  • $160k - $210k

     ...Senior Data Engineer San Francisco About Arena Club If you're fascinated by sports cards and memorabilia, your search ends here. Arena Club is pioneering the collectibles domain by introducing the first-ever digital card show. Spearheaded by 5x World Series Champion... 
    Senior

    Arena Club

    San Francisco, CA
    5 days ago
  • $240k - $300k

    EliseAI in San Francisco is seeking a skilled Senior Data Engineer to join our Engineering team. In this pivotal role, you will oversee the data pipeline, focusing on the design, implementation, and maintenance of our data infrastructure. This position plays a critical... 
    Senior

    EliseAI

    San Francisco, CA
    4 days ago
  • $170k - $220k

    Windfall Data, Inc. is seeking a Sr. Data Engineer to join their team in San Francisco, California. The role involves constructing data pipelines and collaborating with product and data science teams. Candidates should have 4-8 years of data engineering experience and strong... 
    Senior

    Windfall Data, Inc.

    San Francisco, CA
    5 days ago
  • DoorDash is seeking a Senior Data Engineer to enhance its data infrastructure and automate scaling operations. This hybrid role requires candidates to be based in Sunnyvale, San Francisco, or Seattle. The successful candidate will have significant experience in data engineering... 
    Senior

    Fairygodboss

    San Francisco, CA
    3 days ago
  • Salesforce is seeking a skilled Data Engineer to join our dynamic team in San Francisco. You will design, build, and scale data pipelines that power our analytics efforts, ensuring high-quality data alignments that enable actionable insights. With a minimum of 5 years in... 
    Senior

    Salesforce

    San Francisco, CA
    1 day ago
  • $150k - $220k

     ...center of this effort, collaborating across engineering, design, research, and education to...  ...Content & AI Systems team is building the data layer that powers the next generation of...  ...geographic location, prior experience, seniority, and demonstrated role related ability during... 
    Senior
    Permanent employment
    Full time
    Work experience placement
    Local area
    Flexible hours

    Kiddom

    San Francisco, CA
    2 days ago
  • Drata is looking for a Senior Data Engineer in San Francisco to join its fast-growing data team. You will help build and optimize data products, contribute to data governance, and work with cutting-edge technologies to ensure data accuracy across the organization. The... 
    Senior

    Careers at Drata

    San Francisco, CA
    4 days ago
  • Judgment Labs, based in San Francisco, is seeking a Senior Data Infrastructure Engineer to design and scale real-time data pipelines critical for agent behavior analysis. The ideal candidate should have over 6 years of experience managing high-throughput, petabyte-scale... 
    Senior

    Judgment Labs

    San Francisco, CA
    4 days ago
  • $225k - $285k

    A technology company in California is seeking a Senior Data Engineer to build the enrichment platform for contact datasets. This role requires over 5 years of data engineering experience, expertise in SQL, modern tooling, and knowledge of contact data economics. Responsibilities... 
    Senior

    Unify

    San Francisco, CA
    3 days ago
  • Drata is seeking a Senior Data Engineer to support its growing data team. The ideal candidate will have over 5 years of experience in data engineering, with fluency in SQL and Python. Your role will involve building data products, optimizing data processes, and creating... 
    Senior

    Drata

    San Francisco, CA
    5 days ago
  • $160k - $260k

    Kikoff, a thriving FinTech unicorn based in San Francisco, is seeking a Data Engineer or Analytics Engineer. The role involves collaborating to craft and scale data models, ensuring data quality, and building analytical dashboards. Ideal candidates should have a strong... 
    Senior

    Kikoff

    San Francisco, CA
    5 days ago
  • A cutting-edge biotech company in San Francisco is seeking a Data Engineer to build AI-powered data ingestion pipelines from various sources. The role demands strong expertise in data engineering and Python, with a focus on data normalization and quality control. As part... 
    Senior

    Mithrl

    San Francisco, CA
    2 days ago
  • $185k - $221.4k

     ...ll Do Build and own production data infrastructure. Design, implement, and operate...  ...shape at the right time. Uphold high engineering standards and collaborate broadly. Lead...  ...innovation. Autonomy. Small, senior teams give you room to architect and own... 
    Senior
    Remote work
    Flexible hours

    Foresite Labs

    San Francisco, CA
    2 days ago
  • $190k - $220k

     ...Senior Data Engineer Denver, CO;San Francisco, CA;New York, NY;Los Angeles, CA;Seattle, WA;Toronto, Ontario, CAN - Remote At Gusto, we're on a mission to grow the small business economy. We handle the hard stuff — payroll, health insurance, 401(k)s, and HR — so... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week

    Gusto

    San Francisco, CA
    1 day ago
  •  ...a skilled candidate for a unique role at the intersection of data engineering and investment analytics. This position demands the ability to...  ...data pipelines and provide insightful portfolio analytics to senior clients. The firm offers direct mentorship, a modern tech... 
    Senior

    Castleton-Tower

    San Francisco, CA
    5 days ago
  • 6Sense is looking for a Data Engineer in San Francisco to design and build robust big data systems and data transformations. Candidates should have a BS/MS in Computer Science or a related field, along with strong experience in Big Data technologies like Hadoop and Spark... 
    Senior

    6Sense

    San Francisco, CA
    5 days ago
  • A leading technology firm in San Francisco is looking for an experienced AWS Data Engineer to design and maintain data pipelines using AWS services. This role requires strong skills in Python and Spark, along with expertise in ETL development and data quality assurance.... 
    Senior

    Globalchannelmanagement

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!