Senior Data Engineer
Equiliem
Position: Senior Data Engineer
Location: 99 Jefferson Rd, Parsippany, NJ 07054 (Onsite)
Duration: 6 Months Contrac Responsibility:
Location: 99 Jefferson Rd, Parsippany, NJ 07054 (Onsite)
Duration: 6 Months Contrac Responsibility:
- Helping the product owner and development team to achieve project outcomes. Build stories and prioritize as per the requirement.
- Analyze data platform requirements and design and document solutions.
- Build key infrastructure, frameworks and applications to support the needs of Data Engineers, Data Scientists and Business.
- Improve SDLC processes with the team of engineers and DevOps.
- Build effective/efficient and reusable data pipeline frameworks for various data source types, refresh patterns and transformations.
- Build data pipelines, jobs using Spark and Databricks to ingest into Data Lake/Delta Lake on AWS
- Support teams using the Data and AI/ML platform, design and validate their use case architecure, provide best practices for solutions, troubleshoot development issues with platform feature and frameworks.
- Partner with team members, product owner and other stakeholder to ideate, review and align on data validation approach.
- Maintain end-end data security (both at rest, transit) and data sharing mechanisms.
- Identify and build automation processes to support various data platform scenarios.
- Design and build Dev/Data/MLOps processes using cloud services.
- Strong technical skills and experience working with and supporting multiple engineering teams.
- Experience in building Big Data/ML/AI applications and optimizing data pipelines, architectures and data sets .
- 5+ years of technical experience with big data technologies . They should also have experience using the following software/tools:
- Experience with big data tools: Apache Spark, Databricks, Parquet/Delta, PySpark, SparkSQL, Spark Streaming, Kafka/Kinesis, S3, Glue
- Experience with Databricks using Unity Catalog and MLFlow is a big plus
- Experience with any relational/noSQL databases or any MPP databases like Snowflake and Redshift.
- Experience with data pipeline and workflow management tools: Step Functions, Airflow
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift, IAM, Security Group, VPC etc.
- Experience developing in Python and Notebooks/IDE
- Experience with Automation: Jenkins CI/CD, Terraform, CDK, Boto3
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Asbury Park, NJ vacancy
- ...One of our largest Telecom customers is seeking a Data Science consultant with a strong Computer Science background to support strategic... ...-facing platforms, performing data exploration, feature engineering, and predictive analytics to identify opportunities for personalization...Suggested
Insight Global
Middletown, NJ4 days ago - ...Job Description Experienced Data management specialist responsible for developing, overseeing, organizing, storing, and analyzing... ...development, testing, and quality assurance Work in tandem with our engineering team to identify and implement the most optimal solutions...Suggested
Inspiration Global
Red Bank, NJ1 day ago $110k - $185k
...parts. Recognized on the ENR 400, 500, and 600 lists for engineering and construction excellence, KIELY is a leading design-build,... ...Position Summary : Kiely Family of Companies is looking for a Senior Estimator to bid cost estimates for utility projects and...SeniorFull timeFor contractorsKIELY FAMILY OF COMPANIES
Eatontown, NJ13 days ago- ...Overview Navesink Tax & Advisory LLC is growing, evolving, and building for the future and we are looking for the right Senior Accountant to grow with us. This is not just another public accounting position. What we want from you Long-term opportunity Leadership and growth...SeniorFlexible hours
Navesink Tax & Advisory LLC
Ocean Grove, NJ2 days ago $120k - $140k
...reconciliations and variance analyses to ensure accuracy and completeness. Coordinate with internal departments to gather financial data and ensure consistency across reports. Support external audit requests and ensure compliance with US GAAP and internal policies....SeniorHire Point Recruiting
Belmar, NJ2 days ago- A leading auto parts retailer is seeking a Commercial Parts Pro in Neptune, NJ. This full-time position focuses on maintaining customer relationships, achieving sales goals, and providing supervisory support for team members. Candidates should have strong automotive system...SeniorFull time
$85k - $95k
...Our client, a family-owned environmental services and manufacturing company in Tinton Falls, NJ , is seeking a Senior Accountant to join their accounting team and lead their month end close process. With over 60 years of industry leadership and multiple divisions, this...SeniorFlexible hoursThe Axel Group, LLC
Ocean Grove, NJ4 days ago- ...Senior Accounting Clerk Responsibilities: Prepares monthly journal entries, accruals and account reconciliations for all business units Interprets, compiles and calculates information as required by management, audit or government agencies. Prepares daily reports for...SeniorWork at officeLocal areaWorldwide
CPA Recruiter Online
Oakhurst, NJ2 days ago $112.8k - $257k
...role combines strategic AI advising with hands-on observability engineering to support government initiatives and enterprise monitoring... ...of strong verbal and written communication skills for engaging senior leadershipGoogle Professional Machine Learning Engineer, Microsoft...SeniorFull timeContract workPart timeWork at officeLocal areaRemote work- ...Medication Aide / Med Tech – Deliver Safe, Accurate Medication Care for Our Residents At Sunrise Senior Living, we believe meaningful work starts with purpose. Our team members are passionate about making a positive difference in the lives of residents every day....SeniorShift work
Dignity Home Care Inc
Belmar, NJ23 hours ago $50k - $70k
...Executive Assistant Senior Monmouth Medical Center – Quality Resource Services – Full Time, Day Shift Salary: $50,000 – $70,000 per year (New Jersey) Job Overview The Executive Assistant Senior assists senior management in Quality Resource Services by efficiently managing...SeniorFull timeWork at officeFlexible hoursDay shiftRWJBarnabas Health
West Long Branch, NJ1 day ago$25 - $30 per hour
...progress, and ensuring compliance with Maintenance and Protection of Traffic (MPT) standards. About Artheon Artheon is a trusted engineering and consulting firm offering services that rival large organizations while maintaining the personalized client relationships of a...SeniorFor contractorsLocal areaArtheon
Ocean Grove, NJ23 hours ago$112k - $179k
ResponsibilitiesPeraton Labs is seeking a Senior AI Integration Developer to lead the... ...the intersection of applied AI, software engineering, and operational tooling.The core focus of... ...infrastructure that connects it to the application’s data, workflows, and services. Given the...SeniorContract workLocal areaShift work$85k - $110k
Credit Analyst Under general supervision and according to established policies and procedures, analyze new credit requests, renewals and annual reviews assigned by the Credit Manager. Develop and analyze credit information for commercial real estate loans, complex commercial...SeniorFull timeWork at officeRemote workMonday to FridayManasquan Bank
Belmar, NJ17 hours ago$23 - $31.25 per hour
...Overview The Senior Personal Banker is responsible for delivering exceptional service to both existing and prospective clients. This role manages the full client experience by identifying and addressing service needs, executing transactions accurately and building strong...SeniorFull timeWork at officeAfternoon shiftKearny Bank
Neptune, NJ3 days ago- ...progressive growth and stability Are you a experienced tax detail oriented ready to take the next step in your career? Our firm is seeking a Senior Tax Director or Tax Partner to join our leadership team. With offices in New Jersey and Florida, we offer a dynamic environment...SeniorFlexible hours
$80k - $95k
...Description Job Description: Title: Senior Account Manager - Commercial Lines Hybrid Preferred: 1-2 days in Columbia, SC... ...agency management systems and carrier/vendor platforms, ensuring data accuracy and completeness. ~ Activity Monitoring:...SeniorFor contractorsRemote workInsurance Office of America
Eatontown, NJ4 days ago$64.7k
...benefit from the security and stability of a large organization while maintaining a nimble and responsive approach to business. The Senior Underwriter is responsible for developing and managing a large block of stop loss business and partnering with our sales team to...SeniorWork experience placementWork at officeFlexible hours$100k - $120k
...Senior Manager, Procurement Solar Landscape is the leading commercial rooftop solar developer... ...Senior Manager, Procurement to drive data-informed decision-making and optimize... ...technical vendor evaluation, support value engineering efforts, and influence strategic supplier...SeniorPart timeSummer workWork at officeLocal areaRemote workFlexible hoursSolar Landscape
Asbury Park, NJ17 hours ago$90k - $110k
DescriptionKforce's client, a regional public accounting firm in Red Bank, NJ is seeking a Senior Tax Accountant. This firm offers a good work life balance, great training and benefits, opportunity to advance, annual bonus and a great culture.Responsibilities include,...Senior$105.4k
...large conglomerate. You will interact directly with all points from senior executives to customers, with visibility throughout the... ...risk selectionWork with existing programs to gather appropriate data for analysisPerform ad-hoc analyses as directedMaintain and update...SeniorWork at officeRemote work$53.9k
Crum & Forster Company Overview Crum & Forster (C&F) provides market leading property & casualty, accident & health, specialty and standard commercial lines insurance solutions. A true underwriting company, we have a 200-year history of helping our customers manage risk...SeniorRemote work$130k - $170k
A behavioral health provider in Middletown, NY is seeking a Psychiatric Mental Health Nurse Practitioner. You will perform assessments, establish diagnoses, and manage medication for elderly patients. The ideal candidate has a New York NP license and PMHNP certification...SeniorCordialhealthpc
Middletown, NJ4 days ago- Spencer's - - Responsibilities: Establish and maintain Guest Services; Support the Store Manager in daily store operations; Develop staff to maximize sales and profitability; Control expenses and shrinkage; Oversee merchandising and inventory controls in accordance with...Senior
Spencer Gifts
Red Bank, NJ23 hours ago - Hearing Center Manager Responsible for overseeing employees and directing operations of the Hearing Center and other areas of the warehouse. Addresses personnel issues and oversees tasks performed by employees. Participates in Licensed Hearing Aid Dispenser duties. ...SeniorFull timeTemporary workApprenticeshipWork at office
- ...Resident Experience, you will assist residents in loading and unloading, ensure safety, and coordinate with staff. Experience with seniors and strong communication are preferred. This role supports a caring community and offers the opportunity to grow professionally while...SeniorPart time
EmergencyMD
Brick, NJ4 days ago - ...We are partnered with an industry leading TPA here in the US on some new add claims positions. We have 4 Senior Workers Compensation Claims Adjuster openings focused on claims within the North Eastern States. In these roles you will handle lost time...SeniorRemote workFlexible hours
Oliver James
Red Bank, NJ4 days ago $82.9k
...Compliance department works with the underwriting areas in ensuring that all policies and/or certificates are properly issued.The Senior Compliance Analyst should be comfortable operating independently and in team-settings, and is responsible for drafting and filing policy...SeniorTemporary workWork experience placementWork at officeRemote work- Edward Jones invites you to join as a financial advisor in the City of Middletown, New York. You'll build your own practice with support from regional and home office teams while fostering relationships to acquire new clients. The position offers a comprehensive benefits...SeniorHome officeFlexible hours
Edward Jones
Middletown, NJ3 days ago - ...preparing presentations while exercising discretion within company policies. The ideal candidate has over 5 years of experience supporting senior executives, proficiency in Microsoft Office, and strong organizational and communication skills. A comprehensive benefits package...SeniorWork at office
AXIS Capital
Red Bank, NJ17 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- remote senior business analyst Asbury Park, NJ
- senior application administrator Asbury Park, NJ
- remote senior project manager Asbury Park, NJ
- senior performance engineer Asbury Park, NJ
- srs Asbury Park, NJ
- senior Asbury Park, NJ
- senior application security Asbury Park, NJ
- senior accountant remote Asbury Park, NJ
- senior financial analyst remote Asbury Park, NJ
- senior devops engineer remote Asbury Park, NJ