Data Engineer
Quadrant IQ Solutions LLC
Get AI-powered advice on this job and more exclusive features. Job Type: W2 Visa's Accepted: H4-EAD, GC-EAD, L2S, GC, USC, H1B Must-Have Skills Python & PySpark – Expert-level proficiency with very strong Apache Spark experience (large-scale data processing, optimization, performance tuning). AWS Cloud ECS (Elastic Container Service) – Required AWS Glue and/or AWS Lake Formation – Strongly preferred Data Warehousing Snowflake or Teradata (hands-on experience with large analytical datasets) Core Responsibilities Design, build, and optimize high-performance Spark-based data pipelines using Python/PySpark. Develop and maintain ETL/ELT workflows for large-scale structured and semi-structured data. Deploy and manage data workloads on AWS ECS . Implement data ingestion, transformation, and governance using AWS Glue / Lake Formation . Integrate data pipelines with Snowflake or Teradata for analytics and reporting. Ensure scalability, reliability, and performance of distributed data processing systems. Collaborate with analytics, platform, and cloud engineering teams. Seniority level Mid-Senior level Employment type Full-time Job function Data Engineering We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr Quadrant IQ Solutions LLC
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer in New York, NY vacancy
- ...improvements. This position manages the installation and maintenance of mechanical systems at Data Centers and operations of specialized cooling systems. Acts as an Engineering resource for the complete H5 portfolio of mission critical facilities. Plans and monitors...SuggestedWork at officeImmediate start
H5 Data Centers
Secaucus, NJ19 days ago - ...Graph Data Engineer Local only. Must be able to work 4 days on site. NYC, NY. Long Term Consulting Assignment. Position Overview: The graph data engineer is responsible for developing and enhancing Jefferies knowledge graph to empower several applications in the...SuggestedLocal area
Anveta
New York, NY2 days ago - ...Big Data Engineer Location: Remote/USA Duration: 6-12+ Months Job Description: ~ BS degree in computer science, computer engineering or equivalent ~5 – 6 years of experience delivering enterprise software solutions ~ Proficient in Spark, Scala, Python...SuggestedRemote work
Zortech Solutions
New York, NY1 day ago - ...Job Description: Core Java, spring boot, Oracle, microservices, Kafka, app-engine (Containers), REST/Web services, Angular, CI/CD, Junit Must Have : Core Java , Spark experience (with Java) and Hive, Spring framework, Kafka (if not Kafka them relatively...Suggested
Texas State Library and Archives Commision
Jersey City, NJ2 days ago - ...Big Data Engineer We are seeking a highly skilled Big Data Engineer to design, develop, and maintain scalable data processing systems capable of handling large volumes of structured, semi-structured, and unstructured data. The ideal candidate will build and optimize...SuggestedFull timeRemote work
Ova Technologies
New York, NY4 days ago - ...Big Data Engineer Participate as a member of a small team to release the full potential of Big Data in AT&T through a combination of platform technology, collective human intelligence and the vast data resources available to our company. Will provide rich insight into...
Cardinal Integrated
New York, NY5 days ago - ...Amazon Glue, Google Dataflow, Talend MDM, Hadoop, Presto, Strong experience with MySQL, PostgreSQL, MongoDB, Cassandra. Role: Big Data Engineer Job Overview: We're seeking a highly skilled Data Engineer, Big Data Engineer to build scalable data pipelines, develop ML...
TechDigital Group
Jersey City, NJ3 days ago - ...seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are... ...strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open...
STEM Xpert
New York, NY4 days ago - A leading financial firm in New York is seeking a Lead Market Data Engineer to architect and optimize platforms delivering high-quality market data. This hands-on role involves designing scalable data pipelines and collaborating with teams to ensure smooth data integration...Full timeContract work
$125k - $140k
...the vision and achieving the goals of our three core lines of business: Indexing, Digital Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project managers, the platform team is the engine that drives forward the technical...$220k
Specialist Recruiter | Databricks Data Engineer Recruitment | Connecting Top Talent with Leading US Opportunities Job Title: Lead Data Engineer Location: Remote Employment Type: Full-time Compensation: Up to $220k + benefits About the Role We’re hiring experienced...Full timeRemote workFlexible hours$135k - $150k
New York, United States | Posted on 08/30/2023 The position of Lead Data Engineer is open in New YorkCity, New York, within the Insurance industry. The role offers flexiblework-from-home days while requiring occasional on-site presence for clientmeetings. The Lead Data...- Position Overview We are seeking a Lead Data Engineer to join a rapidly growing Data & Analytics organization responsible for delivering enterprise-scale data products, analytics solutions, and cloud-based data platforms. This role will lead the design, development, and...
$174k - $230k
The Job We are looking for our first in-house Data Engineer to own and evolve our core data infrastructure. This is an early and high-impact role. As the data engineering function grows under Engineering, you’ll have a real voice in shaping how it’s built - the processes...For contractorsRemote work- W Talent is partnering with a leading organisation within the Financial Services sector to appoint a Lead Data Engineer as part of a significant investment in its Data & Analytics capability. This is an excellent opportunity to join a growing team responsible for delivering...
- ...company on a mission to ethically democratize the benefits of data and AI . Since 2019, we have built one of the largest consented... ...room to shape the architecture and culture from the ground up. Engineers here own major surface areas , build 0→1 systems in large‑scale...Remote workFlexible hours
$170k - $220k
...Fleet and Fuel Card built on a cutting-edge spend management platform. About The Role We are looking for a leader of the Coast data engineering team to shape our company’s data culture and underlying infrastructure. Your work will enable the company across all functions...Work at officeLocal areaRelocation packageFlexible hours$220k - $230k
Who You Are You're a senior, hands‑on data engineer with 8+ years of experience designing, building, and operating production data platforms at scale — and you're ready to lead. You set the technical direction for data infrastructure, mentor other engineers, and raise the...Flexible hours$70 - $85 per hour
Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $70.00 - 85.00/hr Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Summary We are looking for a Lead Data Engineer who excels in data modeling and can build end-to-end data...Contract workLocal areaRemote workFlexible hours- ...Senior Python and Snowflake Developer to design, build, and optimize scalable data pipelines, develop robust backend services, implement Snowflake data models, and drive end-to-end data engineering solutions. The role involves collaborating with cross‑functional teams,...
$180k - $250k
...with your recruiter to learn more. Base pay range $180,000.00/yr - $250,000.00/yr A world-leading trading firm is seeking a Lead Data Engineer to architect, scale, and optimize the data infrastructure powering its multi-billion-dollar systematic trading business. In this...Full time- ...collaborate directly with the client's team, make business trips.... Digis islooking for anexperienced, proactive, and self-driven Lead Data Engineer tojoin our fully remote team. About the Project You’ll bepartofalarge-scale platform focused on performance management and...Remote work
$149.3k - $200.2k
...products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news. The Product & Data Engineering team is responsible for end to end development for Disney’s world-class consumer-facing products, including streaming...Work experience placementWorldwide- The position will lead technical and business analysis that is critical in discovery process requirement for additional data loads - this would include new and existing datasets supporting the taxonomy for JJMD - (Core & Non-core taxonomy subject areas) Strong collaboration...Work experience placementInterim role
- ...primarily in Python, increasingly leveraging generative AI and LLM-based tooling to accelerate development and surface insights. GraphQL Data Access : Query and transform data across multiple sources using GraphQL and SQL, building reliable data access layers that feed...
- ...simplicity at the heart of what we do. We bring trading capabilities, data, and analytics together for the first time on a digitized... ...motivated and enthusiastic summer interns to join our data engineering team. The internship provides hands‑on experience and support for...InternshipSummer internshipWork at officeMonday to Friday
Motive Partners
New York, NY3 days ago - ...treatments. Position Details: As part of the Center for Data Analytics, Innovation, and Rigor team, you will report to... ...manage a team of approximately 10 data scientists and software engineers and collaborate closely with the Clinical Project Manager and project...Full timeWork experience placementWork at officeLocal areaRemote workFlexible hours
Child Mind Institute
New York, NY4 days ago - ...Our client offers comprehensive equipment solutions tailored to customer needs in the realm of data communications. As an autonomous intermediary representing various prominent manufacturers, they guarantee the availability of an extensive selection of voice and data...Full time
RightClick LLC Defunct
New York, NY2 days ago - ...Job Description-Data Centre engineer Continuous improvement efforts drive our business and you will work with customer technical teams to provide solutions for customers’ internetworking communications requirements. You will be performing network design activity for our...Remote work
VortalSoft
New York, NY2 days ago - ...designed to accelerate deep learning and generative AI workloads. Based out of Oklahoma City, they are looking to hire a Sr. Data Center Operations Engineer on a Contract to Hire basis. Contract Duration: 6 Month Contract to hire (Potential for extension or conversion)...Full timeContract workTemporary workFlexible hours
Motion Recruitment
Brooklyn, NY3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- senior cloud data engineer New York, NY
- principal data engineer New York, NY
- finance data engineer New York, NY
- aws data engineer New York, NY
- data engineer New York, NY
- sr data engineer New York, NY
- software data engineer New York, NY
- junior data engineer remote New York, NY
- remote data engineer New York, NY
- junior data developer New York, NY