Senior Backend Engineer (Spark, Scala, Python, AWS/GCP)
Cloud Analytics Technologies LLC
About the Role:
We are seeking a skilled and passionate Back-End Engineer with a strong background in data engineering to join our growing team. In this role, you will be responsible for designing, developing, and maintaining scalable and reliable data pipelines and back-end systems. You will work with large datasets, leverage cloud technologies, and collaborate with data scientists and other engineers to deliver impactful data-driven solutions. This position is available in both the United States and India.
Responsibilities:
* Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.
* Write efficient and optimized SQL queries for data extraction, transformation, and loading (ETL) processes.
* Work with DataFrames to manipulate and analyze large datasets.
* Implement data storage and processing solutions using cloud technologies (preferably AWS or GCP).
* Build and maintain real-time data streaming pipelines using MSK/Kafka.
* Utilize S3 for data storage and retrieval.
* Work with data lake technologies like Iceberg.
* Ensure data quality, integrity, and security.
* Collaborate with data scientists and other engineers to understand data requirements and deliver solutions.
* Participate in code reviews and contribute to improving our development processes.
* Troubleshoot and resolve issues in data pipelines and back-end systems.
* Bachelor’s degree in computer science or a related field (or equivalent experience).
* 5+ years of experience in back-end development with a focus on data engineering.
Required Skills: * Strong proficiency in Spark, Python, Scala, and Java.
* Expertise in SQL and working with relational databases.
* Experience with DataFrames for data manipulation and analysis.
* Experience with cloud technologies (preferably AWS or GCP).
* Experience with message streaming platforms like MSK/Kafka.
* Experience with S3 or similar object storage.
* Experience with data lake technologies like Iceberg.
* Solid understanding of data warehousing concepts.
* Excellent communication and collaboration skills.
Bonus Points:
* Experience with data modelling and schema design.
* Experience with data governance and data quality management.
* Experience with DevOps practices and CI/CD pipelines.
* Relevant certifications (e.g., AWS Certified Data Engineer, Google Cloud Certified Professional Data Engineer).
Vacancy posted 14 days ago
Similar jobs that could be interesting for youBased on the Senior Backend Engineer (Spark, Scala, Python, AWS/GCP) in Elk Grove, CA vacancy
- ...Data Engineer Location: Sunnyvale CA or Austin TX or Elk Grove CA /3 days in a week hybrid... ...working with cloud platforms (e.g., AWS) and tools like Snowflake 4. Familiar with... ...e.g., S3 + Athena, Delta Lake) 5. Strong Python skills for data manipulation (e.g., pandas...Amazon Web ServicePython3 days per week
RIT Solutions
Elk Grove, CA3 days ago - ...implement solutions to both frontend and backend problems from a non-technical specification... ...years professional coding with Go, PHP, Python, Ruby, or another server-side scripting... ...distributed systems on providers such as AWS Experience with docker or container technologies...Amazon Web ServicePythonFull timeWork at officeRemote work
- ...what's possible — we'd love for you to apply! Overview: The Senior Project Manager is responsible for documenting, planning,... ...Excel and Word Experience working with Amazon Web Services (AWS) Experience with Linear and Salesforce This position is...Amazon Web ServiceSeniorTemporary workRemote work
GrabJobs
Elk Grove, CA4 days ago - ...drive collaboration with suppliers and engineering disciplines and provide technical leadership... ...National Instruments LabVIEW MATLAB Python or similar test and automation tools.... ...designated Talent Acquisition member for the position. Required Experience: Senior IC...SeniorPythonFull timeWork experience placementImmediate start
ASML
Wilton, CA7 days ago $130k - $160k
...energy transition, we are helping drive it forward. Senior Power Systems Modeling Engineer, Real Time Simulation Rocklin, CA (Hybrid) Why Work... ...Proficiency with engineering and analytical software such as Python, MATLAB, ASPEN OneLiner, or similar tools for modeling,...SeniorPythonFull timeWork at officeVisa sponsorshipWork visaSMA America
Elk Grove, CA19 days ago- Senior Maximo Application Engineer Power Your Future with Qualus as a Senior Maximo Application Engineer. The Application Engineer supports the design... ...with scripting and development technologies such as Python, Java, JavaScript, SQL, Shell scripting, or similar languages...SeniorPythonPermanent employmentTemporary workFor contractorsCasual workWork at officeFlexible hoursAfternoon shift
- ...Data Scientist MAHIN-JOB-37405 Data Scientist Elkgrove, CA (Onsite from Day 1) Job Description : Tableau, SQL, and Python on a weekly basis for the past 5+ years Use Tableau to create visualizations Use SQL to manipulate and model data...Python
Keylent Inc
Elk Grove, CA1 day ago - Data Analyst/Engineer Location: Elk Grove, CA or Sunnyvale, CA or Austin, TX (Hybrid 3 days On-Site and 2 days Remote) Duration: 12 Months... ...make sure that candidates have been using Tableau, SQL, and Python on a weekly basis for the past 5+ years. Excellent communication...PythonRemote work
- Lorian Health in Sacramento is seeking a strategic Senior Clinical Recruiter to lead full-cycle recruitment for licensed healthcare professionals across our growing organization. This role focuses on building relationships, sourcing top talent, and partnering with leaders...Senior
- ...valuation, and wealth management services to individuals, businesses, and organizations throughout Chicagoland.We are looking for a Tax Senior to work directly with clients while gaining exposure to complex tax compliance, planning, and consulting engagements across a...SeniorWork at office
CyberCoders
Elk Grove, CA2 days ago - Center for Social Dynamics (CSD) is seeking a Board Certified Behavior Analyst (BCBA) to lead innovative ABA programs, supervise mid-level supervisors and clinicians, and ensure high-quality, ethical practice. You will review treatment plans, progress notes, and documentation...Senior
$20.9 - $21.15 per hour
Assistant Store Manager Hourly rate ranges from $20.90 to $21.15 and is dependent upon qualifications and experience. Benefits include: Company Paid Sick Time, Paid Vacation Time, Paid Holidays, Bereavement Pay, Jury Duty Pay, Contest Prize Awards, 401K Plan with...SeniorHourly payLocal areaSpencer Gifts
Elk Grove, CA5 days ago- Golden Years In-Home Senior Care is seeking an HCA Caregiver to provide compassionate in-home care in the Sacramento, CA area. The role includes personal care, light housekeeping, social engagement, and clear documentation of client progress. Qualified candidates must...SeniorFlexible hours
- AAA Mountain West Group in Elk Grove, CA is seeking skilled automotive technicians to join a team that values safety, workmanship, and career growth. Responsibilities include performing approved repairs, staying updated on industry procedures, and communicating with managers...Senior
- Ivy Park at Laguna Creek, managed by Oakmont Management Group, is seeking a dedicated Care Provider to assist residents with daily living activities and support independence. The role emphasizes compassionate care, safety, and respectful communication within a collaborative...SeniorFull timePart time
$40 - $48 per hour
Trillium Engineering Services in Elk Grove, CA is seeking a highly skilled Senior Machinist (Machinist III) with hands-on experience programming, setting up, and machining large, complex components on Horizontal Boring Mills. The pay range is $40.00-$48.00 per hour, depending...SeniorHourly pay- EmpowerMe Wellness is seeking therapists to deliver physical, occupational, or speech therapy to seniors within our integrated EmpowerMe 360 program. You will assess residents, develop personalized care plans, and collaborate with a multidisciplinary team to promote independence...SeniorFlexible hours
- EmpowerMe Wellness is seeking licensed therapy professionals to deliver physical, occupational, or speech therapies to older adults as part of EmpowerMe 360. You will assess, plan, and apply evidence-based interventions within a collaborative team and coordinate with caregivers...SeniorFlexible hours
- ...providing hands-on ADL help and vital signs monitoring. You will be part of an interdisciplinary team, ensuring safety and comfort for seniors in a vibrant day-center setting. You will collaborate with departments, assist with meals, and help coordinate care planning....Senior
- EmpowerMe Wellness seeks licensed therapists to join its EmpowerMe 360 program serving seniors across partner communities. You’ll provide physical, occupational, or speech therapy, perform assessments, and create personalized care plans within a collaborative team. Join...Senior
- Carlton Senior Living in Elk Grove, CA is seeking a part-time Medication Technician to support residents with their medications under nursing supervision. You will help prepare and pass medications and maintain organized medication storage. Responsibilities include communicating...SeniorPart time
- ...seeks a compassionate Nurse Practitioner or Physician Assistant to join our Mobile Primary Care Team serving older adults in homes and senior living communities in California. You will perform comprehensive assessments, develop individualized care plans, and manage chronic...Senior
$21 - $23 per hour
Carlton Senior Living in Elk Grove, CA is seeking an Administrative Assistant to support payroll, onboarding, billing, and front-desk duties. The role includes handling employee files, ensuring certifications, and assisting with collections and visitor reception. The position...SeniorHourly pay- Tenfold Senior Living in Elk Grove, CA is seeking compassionate team members to deliver personalized resident care, building relationships with residents and ensuring their comfort and safety. You will work closely with a dedicated team to support daily activities and...SeniorAfternoon shift
- Milestone is seeking an ON CALL - Medication Aide/Tech to provide medication management and support Activities of Daily Living (ADLs) for residents in Assisted Living and Memory Care. You will deliver care following resident service plans, communicate with medical professionals...SeniorLocal area
- Ivy Park at Laguna Creek, an Oakmont Management Group community in Elk Grove, California, seeks a Medication Technician to support residents with prescribed medications and daily care, emphasizing safety, dignity, and compassionate service within a collaborative team. You...Senior
- ...seeking compassionate caregivers to join their Amazing Caregiving Team. As a locally owned agency, they provide exceptional care to seniors in their homes and community. Responsibilities include offering support and companionship, while the qualifications involve a valid...SeniorFlexible hours
- Sky River Casino is seeking a Security Shift Supervisor to lead loss prevention, asset protection and guest safety across the casino floor and simulcast area. You will supervise investigations, train staff, and ensure compliance with gaming regulations while enforcing performance...SeniorShift work
- NPB Technology Group in Elk Grove, CA is seeking a Senior Machinist to program, set up, and machine complex 3D parts on a 4-axis horizontal CNC. This role emphasizes CAM programming, probing, and end‑to‑end ownership in a non‑production environment. You will use Mastercam...Senior
- Tenfold Senior Living is seeking a Med Tech to deliver personalized resident care and support daily living activities in our Elk Grove community. You will work closely with residents to understand their needs and ensure care plans are followed. Responsibilities include...SeniorFlexible hoursWeekend work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend Engineer (Spark, Scala, Python, AWS/GCP). Be the first to apply!
Related searches
- senior living Elk Grove, CA
- senior performance engineer Elk Grove, CA
- senior care Elk Grove, CA
- senior part time Elk Grove, CA
- senior manager diversity & inclusion Elk Grove, CA
- senior caregiver Elk Grove, CA
- senior application security Elk Grove, CA
- senior application administrator Elk Grove, CA
- senior level Elk Grove, CA
- senior activities Elk Grove, CA