Data Engineer - PySpark / SQL
iTCO Solutions
Senior Data Engineer
Remote (any state in India) About Us Our client is the top-performing AI Shopping Agent, delivering the best products from across the web with unmatched accuracy, quality, and trust.
The Role
We are seeking a Senior Data Engineer with deep expertise in Spark/PySpark/SQL to join our data team. This is a hands-on technical role for someone passionate about building scalable data systems, mentoring engineers and shaping data strategy. You'll architect systems that power high performance batch and real time data processing, enable advanced analytics and accelerate our AI initiatives.
Key Responsibilities:
- Design and evolve scalable, distributed data infrastructure across cloud platforms (GCP and AWS).
- Build and maintain real time and batch data processing pipelines supporting AI/ML workloads, consumer applications, and analytics.
- Develop and manage integrations with third party e-commerce platforms to expand our data ecosystem.
- Ensure data availability, reliability and quality through monitoring and automated auditing.
- Partner with engineering, AI and product teams on data solutions for business critical needs.
- Mentor and support data engineers, establishing best practices and code quality standards.
Must Haves
Bachelor's degree in Computer Science or a related field, or equivalent practical experience. Software development and data engineering experience with demonstrated ownership of production grade data infrastructure. Deep expertise scaling Spark/PySpark/SQL in production (Databricks, DataProc in GCP, etc). Strong understanding of distributed computing and modern data modeling for scalable systems. Proficient in Python with experience implementing software engineering best practices. Hands-on experience with both relational (MySQL) and NoSQL (MongoDB, Elasticsearch) databases. Strong communicator with experience influencing cross functional stakeholders.
Nice to Have
Experience with a job orchestrator and containerization, such as Airflow and Docker. Experience working with vector stores and knowledge graphs. Experience working in early-stage, high-growth environments. Familiarity with MLOps pipelines and integrating ML models into data workflows. Passionate about problem-solving with a proactive approach to finding innovative solutions.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - PySpark / SQL in United States vacancy
- ...Role: Sr. PySpark Data Engineer - Fulltime Location: Irving, TX Job Description: We are seeking a skilled PySpark Data... ...in cloud platforms (AWS, Azure, GCP). Utilize SQL and NoSQL databases for data storage and retrieval. Automate...SQLFull time
SARIAN Co
Irving, TX2 days ago - ...end ETL/ELT pipelines using Python and PySpark. Big Data Processing: Build large-scale data processing... ...of relational databases and SQL (PostgreSQL, MySQL) as well as NoSQL environments... ...). Professional Google Cloud Data Engineer certification. Soft Skills...SQLShift work
Zensar Technologies
United States5 days ago - ...Lead Data Engineer Candidate should have 12+ years of experience in Data Engineering. Must have strong work experience with onshore... ...How do you do Data profiling Hands-on experience with PySpark, Redshift (SQL) and Airflow at minimum Strong hands-on with required...SQLWork experience placementFlexible hours
Zortech Solutions
Jericho, NY2 days ago - ...Pyspark Data Engineer - Officer Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated... ...(Apache Iceberg, Trino, Deltalake) ~ Expertise in SQL and database technologies (e.g., Oracle, PostgreSQL, etc.)....SQL
Citi
Jersey City, NJ1 day ago - ...Role description Snowflake SQL Pyspark New York,NY Onsite Essential SQL ability to write complex queries in snowflake Analytical thinking ability to distill user feedback into broad issue categories test and compare the product with different settings...SQL
LTM
New York, NY2 days ago - ...Skills and Experience You Will Need: PySpark: Hands-on experience with Data Frames, RDDs, joins, transformations, and actions. Databricks... ...IAM, CloudWatch, and integration with Databricks. SQL: Strong query skills for analytics and ETL. Performance...SQLRemote work
Saxon Global
United States3 days ago $50 - $65 per hour
...Job Title: Senior Data Engineer (PySpark & AWS & Agentic AI ) Location: Malvern, PA ( Onsite ) Position : ( C2C Role ) Duration :... ...etc.) Must have hands on experience in CI/CD pipelines, SQL Experience in integrating Rest API's Diverse Lynx LLC...SQLDiverse Lynx
Malvern, PA1 day ago- Sentara Healthcare Inc is seeking a Data Engineer to support a modern data platform remotely.... ...responsible for developing data pipelines using PySpark and Databricks, ensuring data governance... ...of relevant experience, with strong SQL skills and familiarity with cloud...SQLRemote work
Sentara Healthcare
Virginia Beach, VA3 days ago - ...Data Engineer Primary tech skills – Databricks, Pyspark. Secondary tech skills – Azure, SAS, Synapse. Experience in building end to end architecture for Data... ...Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server. Experience with...SQL
Argyle Infotech
Passaic, NJ1 day ago - A technology services company is seeking a Senior Data Engineer to create scalable ETL pipelines and work with vast datasets. The role requires strong Python and SQL skills, along with experience in tools like PySpark and AWS. This full-time position is remote, offering...SQLFull timeRemote work
Lumenalta
Tampa, FL2 days ago - ...hands on experience with Databricks/Pyspark, Java/python, Webservices and SQL. Position is long term and will likely... ...performing code reviews, mentoring junior engineers. Must have strong SQL and backend experience, and working on data driven projects. Must have...SQLRemote work
DATAMAXIS
United States4 days ago - ...Job Title Required Skills: CICD, using GitHub, Jenkins, Python, Hadoop with PySpark, SQL. Work on Pyspark Framework to ingest data from different sources system to Hadoop and SQL Server regions. Sound knowledge in Python and Good to have enough knowledge...SQLWork experience placement
Syntricate Technologies
Charlotte, NC4 days ago - ...Data Engineer We are seeking a skilled Data Engineer with expertise in Databricks, Snowflake, Python, Pyspark, SQL, and Release Management to join our dynamic team. The ideal candidate will have a strong background in the banking domain and will be responsible for designing...SQL
Saxon Global
Washington DC1 day ago - ...Qualifications Strong hands-on expertise with: PySpark (RDD, Data Frames, Spark SQL, performance tuning) DPL (Data Pipeline Language /... ...-specific DPL) Proficiency in Python for data engineering workflows. Experience with distributed computing...SQL
Purple Drive
Jersey City, NJ3 days ago - ...Job Description: Must Have Technical/Functional Skills • Programming Languages: Proficient in SQL, Pyspark, Python • Data Pipeline & ETL: Proficiency in building ETL/ELT pipelines using tools like Apache Airflow, AWS EC2, EMR, S3, dbt, Azure Data factory • Database...SQL
Centraprise
Pontiac, MI2 days ago - ...Overview: Title: Data Engineer (PySpark / AWS) Location: Wilmington, DE - Onsite Type: Contract Job Overview We are seeking... ...Proficiency with Alteryx, Tableau, ThoughtSpot, and SQL . Deep understanding of advanced AWS concepts ( Glue,...SQLContract work
Purple Drive
Wilmington, DE1 day ago - ...Senior Data Engineer with Databricks/PySpark Location: NJ, hybrid 3X a week. Final round in person interview RESPONSIBILITIES • Build large-scale... ...REQUIREMENTS • Experience on Python scripting, Spark SQL PySpark is a must • Experience on ADLS, Azure...SQLWork experience placement
RIT Solutions, Inc.
New York, NY4 days ago - ...Data Engineer / Pyspark Location – Any Nearby TCS Office Location Duration – Fulltime Role Must Have Technical/Functional Skills... ...technologies and ETL solutions. ~8+ years of experience in ETL, SQL, UNIX/Linux scripting, and Big Data distributed systems. ~...SQLFull timeWork at office
Diverse Lynx
Salt Lake City, UT1 day ago - ...in computer science, Software Engineering, or a related field. Proven experience (7+ years) as a data Engineer, preferably with a focus... ...data technologies including SQL, Python, Spark, Scala, Hadoop... ...or Required? ~ GCP,Airflow,Pyspark,Tableau. What are the...SQLWork at office
Kaav Inc.
Sunnyvale, CA1 day ago - ...Data Engineer Plays a critical role in the design, development, and roll-out of the Data &... ...enhancements projects. Conducts data analysis (SQL, Excel, Data Discovery, etc.) on legacy... ...Power BI. Develop complex SQL/USQL/pySpark code for Data Engineering pipelines in...SQLWork experience placement
Software Technology Inc
Carlisle, PA1 day ago - ...prominent tech company seeks a skilled Data Engineer to design and implement data integration... ...role demands proficiency in Python and PySpark, along with experience in AWS services.... ...solutions. Ideal candidates should have strong SQL skills and experience with Agile...SQL
- Simplot Company in Boise, ID is seeking a Data Engineer III to solve complex data challenges using advanced data engineering... ...cloud data solutions with tools like Databricks and PySpark, requiring a deep proficiency in SQL and a Bachelor's degree in a related field....SQL
- S&P Global is looking for a Data Engineer to build and maintain scalable data processing pipelines that support critical data... ...in data engineering, and expertise in Python, SQL, and data ecosystems like PySpark and Databricks. You will contribute to various data solutions...SQL
$125k - $145k
...provider in New York is seeking a Senior Data Engineer to design and develop scalable data... ...initiatives. Responsibilities include building PySpark pipelines, optimizing workloads, and... ...Applicants should have expertise in Python, SQL, and experience with Databricks. The...SQL- ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where experience should be on both hands on and leading the team.) Candidate... ...maintain data pipelines and ETL workflows using PySpark, SQL, and Palantir Foundry. Required Skills & Qualifications...SQLRemote work
VBeyond
Jersey City, NJ3 days ago $110k - $180k
iTech Media is looking for a skilled Data Engineer to support a DoD data platform and analytics environment. The candidate will... ...experience in data engineering, strong skills in Databricks, PySpark, Python, and SQL. The role offers a competitive salary of $110,000 to $180...SQL$125k
...Data Engineer - Python/PySpark Position: Data Engineer - Python/PySpark Location: Irving, TX and Tampa, FL Rate: $125K (Including QPLC)... ...Hadoop, Kafka, and cloud platforms - Solid knowledge of SQL and NoSQL databases Design, develop, and maintain scalable...SQLDiverse Lynx
Tampa, FL1 day ago- ...Role - Data Engineer (Python / PySpark / GCP) Location - Dallas, TX /Hartford, CT / Woonsocket, RI (Onsite) Exp need - 6+ years... ...Composer o Google Cloud Storage (GCS) • Strong knowledge of SQL, including advanced window functions • Experience...SQL
Diverse Lynx
Dallas, TX1 day ago - ...Role: Data Engineer (SQL, PySpark and Python) Location: Pittsburgh, PA Hybrid ( 3 to 4 days from office) 6-12+ Months Contract [Possible Extension] ~ Design, develop, and optimize data pipelines and big data applications using SQL, PySpark, and Python...SQLContract workWork at officeRemote work
AceStack LLC
Millvale, PA4 days ago - ...Job title FOUNDARY DATA ENGINEER Job summary Foundary Data Engineer Experience 8to11yrs Required Skills Technical Skills- Python PySpark Domain Skills- Nice to have skills Technical Skills- Domain... ...to convert complex Stored Procedures SQL Triggers etc. logic using PySpark in...SQLShift work
3B Staffing LLC
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - PySpark / SQL. Be the first to apply!
Related searches
- junior data developer United States
- director data engineering United States
- junior big data engineer United States
- data engineer graduate United States
- senior data engineer United States
- data platform engineer United States
- sr information security engineer United States
- senior data integration developer United States
- data developer United States
- data engineer United States