Big Data Developer
Samprasoft
Big Data Developer / Data Engineer
This position will focus on developing various database and data loading/transformation efforts. Initiatives could include multiple source files and/or files sourced both internally and externally. Candidate is required to interact with databases using AWS Lambda, AWS Glue (for transformations) Python and Spark. Possible work leveraging SnapLogic for ETL, depending upon use case. Work will be applicable to multiple applications. Knowledge of automated testing of data a plus.
Responsibilities:
Design and built data applications for analytical reporting. Analyze data and design ETL frameworks using Python and Spark technologies. Collaborate with business partners to gather requirements and translate that to technical specifications. Adhere to lean agile methodologies. Production Support including root cause analysis and long term fixes. Implement data pipelines to meet business requirements and adhere to best practices.
Required Skills:
Proficient in Python, Spark and database technologies. Experience with various AWS services like AWS Glue, IAM, RDS, S3, SQS, SNS, Lambdas, Cloud Formation, AWS Glue, Cloud Watch, Event Bridge, CLI. Experience with Unix/Linux. Experience with SQL. Experience with source code control, preferably Git.
- ...JD: ~10+ years of experience in big data and distributed computing. ~ Very Strong hands-on experience with PySpark, Apache Spark, and Python. ~ Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.). ~ Proficiency in...Big data
- ...highly skilled Sr. PySpark Engineer with extensive experience in big data, distributed computing, and cloud data platforms. The ideal... ...leadership, and mentoring skills. Key Responsibilities Design, develop, and maintain large-scale PySpark ETL pipelines. Optimize and...Big data
- ...Job Posting Data Management experience supporting asset management data domains such as client services, distribution, and marketing... ...execute on common goals. Superb communication skills to explain big story around various data scenarios and drive common understanding...Big data
- ...in Informatica PowerCenter . 10+ years of experience in big data and distributed computing . Strong hands-on experience... ...ability to lead a team . Responsibilities: Design, develop, modify, configure, and debug Informatica workflows using PowerCenter...Big data
- Job Title Need to have analytical skill, SQL, Python/ Pyspark, Snowflake and AWS proficiency. In addition, candidate should be able to handle pressure, constantly prioritizes, be able to learn new skills as needed and be a good team player. Candidate must be able to...Suggested
- ...Data Engineer This position will focus on developing various database and data loading/transformation efforts. Initiatives could include multiple source files and/or files sourced both internally and externally. Candidate is required to interact with databases using...
$140k - $160k
...remote from home! What you'll do: Under direct supervision, responsible for assisting in the efforts to design, develop, and maintain databases and data integration (ETL) systems to support business applications and business intelligence for the enterprise. Perform...Work experience placementRemote workWork from home$150k - $160k
...Data Scientist Thank you for considering IT Concepts dba Kentro, where innovation drives... ...Design creative AI and ML algorithms and develop robust analytic pipelines for analyzing... ...Technical Proficiency Programming & Big Data: Excellent skill in modern programming...Big dataWork at officeLocal area$96.5k - $164k
...highly regulated environment. Role Summary We are seeking a Senior Data Security Engineer with deep expertise in Data Loss Prevention (... ...written and verbal communication skills, including experience developing documentation, playbooks, metrics, and stakeholder reporting....Local areaRemote work3 days per week- T. Rowe Price is seeking a Senior Data Security Engineer to join their Enterprise Security team in Owings Mills, Maryland. The role focuses on designing and optimizing Data Loss Prevention (DLP) controls across various platforms to safeguard sensitive information. Applicants...
- ..., and fulfillment. We use machine learning and Internet-scale data to elevate customer experience, improve efficiency, and reduce cost... ...Tensor-based complementary recommendations, published at IEEE Big Data 2021 (Paper) Enhancing sequence-based recommendations for long...Big dataRemote jobPermanent employmentWork experience placementInternshipWork at officeWork from homeFlexible hours
- ...career development and educational opportunities.Job OverviewAs a Data Engineer in this role, you will apply advanced data engineering... ...are expected to demonstrate deep experience designing, developing, and optimizing enterprise-scale data solutions within Snowflake...Local area
$30 - $45 per hour
...join our growing practice to support construction phase work on data center sites across the United States. We are looking for a motivated... ...candidate with attention to detail, a passion to continue to develop as a professional, and a desire to be part of a strong team....Hourly payTemporary workFor contractorsWork at officeFlexible hours- ...Data Engineer Remote Opportunity Position Type: Direct Hire/ Permanent Citizenship or Permanent Residency Required- This position... .... This role is responsible for architecting, documenting, and developing data architecture models and business reporting applications,...Permanent employmentRemote work
- ...Data Engineer (Healthcare Data Pipelines) Contract | US Citizen | Remote ~ Contract (1 year+) ~100% Remote ~ Due to our... ...quality at scale. Responsibilities Will be responsible for developing code based on requirements, developing visualizations and...Contract workH1bRemote workVisa sponsorship
- ...What Is the Opportunity? Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by... ...You will bring a strong desire to guide team members’ growth and develop data solutions that translate complex data into user-friendly terminology...
- ...opportunities. Position Overview Index Analytics is seeking a Sr. Data Engineer to support Government clients to design, build, and... ...technical teams to gather requirements, document business rules and develop thorough understanding of the business context and objectives....Local area
- ...Job Title Required Skills: ~ Azure Data Factory ~ Microsoft Power Platforms (PowerBI, Power Automate, Power Apps) ~ Analytical Reporting and Dashboarding ~ Data Management and Pipelining (ETL) ~5+ years of Experience in the Analytical Reporting and Dashboarding...Flexible hours
$80k - $100k
...technical & consulting accuracy on client projects, including developing pricing and employee contributions strategies, modelling plan... ...Knowledge of health and welfare products & services Ability to learn big data analytic techniques preferred Intermediate/advanced knowledge...Big dataTemporary workWork at officeLocal areaRemote workVisa sponsorshipWork visaFlexible hours- The Travelers Companies, Inc. is seeking a Senior Associate Data Engineer to build and operationalize data solutions that enhance data accessibility across the enterprise. This role involves collaborating with teams to support data products and applying data quality solutions...
- What Is the Opportunity? Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by... ...communities we serve. We are committed to recruiting, retaining and developing the diverse talent of all of our employees and fostering an...Immediate start
- What Is the Opportunity? Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by... ...STEM related field or equivalent Five years of related experience Developing knowledge of tools, techniques, and manipulation including...
- ...: Project Management certifications (PMP, PMI-ACP, Certified ScrumMaster). Experience with Snowflake is preferred Experience with big data technologies (Spark, Hadoop, Databricks) and data warehousing (Snowflake, Redshift). Knowledge of security frameworks and compliance...Big dataContract workRemote work
$78k - $85k
...to join our dynamic team. In this role, you will transform raw data into actionable insights that drive business growth and innovation... ...of critical process information for existing and new products. Develop technical scope and requirements for digital and software...Temporary work- The ACI Group is seeking a Data/Integration Engineer to support a proof of concept project for CMS involving AWS and data engineering. Candidates should have at least 4 years of experience in Python or Node, and strong processing skills with SQL, ETL, or PySpark. Familiarity...Remote job
- Overview Data/Integration Engineer (AWS, ETL, APIs, Event-Driven), Remote Description Seeking a Data/Integration Engineer (AWS, ETL... ...using SQS. Requirements 4+ Years of hands-on advanced experience developing Python code or Node with strong data processing experience (SQL...Permanent employmentContract workH1bRemote workVisa sponsorship
- ...this position requires a solid background in mechanical engineering and the ability to work independently with minimal supervision. You will be part of a global expert network transforming real-world knowledge into high-quality AI training data. #J-18808-Ljbffr Micro1Remote job
- ...Python Developer Python Developer New York, NY 10003 or Owings Mills, MD 21117 6 Months Onsite Role: Hybrid Model: 2 -3 Days Onsite! Please note that this position is subject to COVID vaccination requirements Requirements: Typically requires a BS or MS degree...
- Duties This announcement serves as public notice. Applications submitted will be placed into a pool and will remain on file for selection as positions become available. Vacancies may be filled for up to 6 months after the closing date of this announcement. Applicants...
- ...program where you will be placed in one of the four designated Engineering tracks: Software, Data, Cybersecurity or Infrastructure & Cloud. Each track is designed to grow and develop your technical and self-leadership skills. Within your assigned track, you will receive a...Internship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Developer. Be the first to apply!


