Big Data Developer
Samprasoft
Big Data Developer / Data Engineer
This position will focus on developing various database and data loading/transformation efforts. Initiatives could include multiple source files and/or files sourced both internally and externally. Candidate is required to interact with databases using AWS Lambda, AWS Glue (for transformations) Python and Spark. Possible work leveraging SnapLogic for ETL, depending upon use case. Work will be applicable to multiple applications. Knowledge of automated testing of data a plus.
Responsibilities:
Design and built data applications for analytical reporting. Analyze data and design ETL frameworks using Python and Spark technologies. Collaborate with business partners to gather requirements and translate that to technical specifications. Adhere to lean agile methodologies. Production Support including root cause analysis and long term fixes. Implement data pipelines to meet business requirements and adhere to best practices.
Required Skills:
Proficient in Python, Spark and database technologies. Experience with various AWS services like AWS Glue, IAM, RDS, S3, SQS, SNS, Lambdas, Cloud Formation, AWS Glue, Cloud Watch, Event Bridge, CLI. Experience with Unix/Linux. Experience with SQL. Experience with source code control, preferably Git.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Big Data Developer in Owings Mills, MD vacancy
- ...Role: AWS Data engineer Location: Owings Mills, MD Onsite position... ...Minimum 12 plus experience required in Java developer Must have Banking Domain experience... ...over data stored in S3. Amazon EMR: Big data processing using Hadoop/Spark....Big data
Kaav Inc.
Owings Mills, MD2 days ago - ...JD: ~10+ years of experience in big data and distributed computing. ~ Very Strong hands-on experience with PySpark, Apache Spark, and Python. ~ Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.). ~ Proficiency in...Big data
SARIAN Co
Owings Mills, MD1 day ago - ...highly skilled Sr. PySpark Engineer with extensive experience in big data, distributed computing, and cloud data platforms. The ideal... ...leadership, and mentoring skills. Key Responsibilities Design, develop, and maintain large-scale PySpark ETL pipelines. Optimize and...Big data
- ...Data Engineer This position will focus on developing various database and data loading/transformation efforts. Initiatives could include multiple source files and/or files sourced both internally and externally. Candidate is required to interact with databases using...Suggested
Samprasoft
Owings Mills, MD4 days ago $150k - $160k
...Data Scientist Thank you for considering IT Concepts dba Kentro, where innovation drives... ...Design creative AI and ML algorithms and develop robust analytic pipelines for analyzing... ...Technical Proficiency Programming & Big Data: Excellent skill in modern programming...Big dataWork at officeLocal areaNavstar
Gwynn Oak, MD3 days ago- ...Data Engineer Remote Opportunity Position Type: Direct Hire/ Permanent Citizenship or Permanent Residency Required- This position... .... This role is responsible for architecting, documenting, and developing data architecture models and business reporting applications,...Permanent employmentRemote work
PSI (Proteam Solutions)
Cockeysville, MD2 days ago - ...Data Engineer (Healthcare Data Pipelines) Contract | US Citizen | Remote ~ Contract (1 year+) ~100% Remote ~ Due to our... ...quality at scale. Responsibilities Will be responsible for developing code based on requirements, developing visualizations and...Contract workH1bRemote workVisa sponsorship
The ACI Group
Gwynn Oak, MD3 days ago - ...solutions and cloud native applications. The role involves planning, implementing large-scale applications, and supporting complex data infrastructure. Candidates must have a Bachelor's degree in a related field and substantial experience with various data tools and ETL...
$61.72k - $108.33k
...the same. This means creating an environment where colleagues can develop new skills, build careers that match their ambitions and see the... ...for coding and designing analytical solutions that turn data into knowledge. This position will work closely with business and...Full timeWork at officeVisa sponsorshipWork visaFlexible hoursCovista
Catonsville, MD1 day ago- A staffing agency is seeking a Splunk Enterprise Security Engineer to develop detection content, optimize data flow, and manage a distributed Splunk environment. Candidates should have significant experience with Splunk ES and a strong background in security and data integration...
- What Is the Opportunity? Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by... ...STEM related field or equivalent Five years of related experience Developing knowledge of tools, techniques, and manipulation including...
- What Is the Opportunity? Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by... ...communities we serve. We are committed to recruiting, retaining and developing the diverse talent of all of our employees and fostering an...Immediate start
- What Is the Opportunity? Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the... ...will bring a strong desire to guide team members’ growth and develop data solutions that translate complex data into user-friendly terminology...
$75k - $88k
Data Engineer Federated IT - Joint Base Anacostia-Bolling, Maryland, United States About this position Bridge Defense is redefining modern defense technology delivery. Based in Washington, D.C., we provide full-spectrum national security solutions that combine secure...Relocation- The Travelers Companies, Inc. is seeking a Senior Associate Data Engineer to build and operationalize data solutions that enhance data accessibility across the enterprise. This role involves collaborating with teams to support data products and applying data quality solutions...
- Federated IT is seeking a Data Engineer based in Joint Base Anacostia-Bolling, Maryland. This role involves configuring and maintaining workflows that support intelligence production and collaborating on data management systems. Candidates should have experience turning...
- ...Python Developer Owings Mills, MD 21117: Hybrid Model – Onsite Day 1 12 + Months Locals Only! Onsite Day 1: Hybrid Model: 2 – 3 Days Onsite! Minimum Qualifications: 5+ years of progressive software engineering experience. Expert knowledge of Python and...Local area
Samprasoft
Owings Mills, MD4 days ago - Overview Data/Integration Engineer (AWS, ETL, APIs, Event-Driven), Remote Description Seeking a Data/Integration Engineer (AWS, ETL... ...using SQS. Requirements 4+ Years of hands-on advanced experience developing Python code or Node with strong data processing experience (SQL...Permanent employmentContract workH1bRemote workVisa sponsorship
- The ACI Group is seeking a Data/Integration Engineer to support a proof of concept project for CMS involving AWS and data engineering. Candidates should have at least 4 years of experience in Python or Node, and strong processing skills with SQL, ETL, or PySpark. Familiarity...Remote job
- Duties This announcement serves as public notice. Applications submitted will be placed into a pool and will remain on file for selection as positions become available. Vacancies may be filled for up to 6 months after the closing date of this announcement. Applicants...
US Government Jobs - Other Agencies
Gwynn Oak, MD3 days ago - ...program where you will be placed in one of the four designated Engineering tracks: Software, Data, Cybersecurity or Infrastructure & Cloud. Each track is designed to grow and develop your technical and self-leadership skills. Within your assigned track, you will receive a...Internship
- ...Lead Data Scientist A position is available for a Lead Data Scientist to support large-scale modernization efforts. The role involves... ...rules from legacy claims processing systems. Design, develop, and validate NLP models for automated parsing of legacy code structures...
Apex Systems
Gwynn Oak, MD2 days ago $129.59k - $175k
...and intelligence operations. HII designs, develops, integrates and manages the sensors,... ...operations and accelerated decision-making. With data fusion and mission management capabilities... ...Our capabilities range from C5ISR, AI and Big Data, cyber operations and synthetic...Big dataFull timeWork experience placementWork at officeLocal areaWorldwide- ...Responsibilities: Deploy and integrate machine learning models into production systems Build and maintain automated ML pipelines (data ingestion, preprocessing, training, validation, deployment) Manage cloud infrastructure for ML workloads (AWS, Docker,...Local area
3B Staffing LLC
Marriottsville, MD2 days ago $100k
...Cloud World/Oracle Java one (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023... ...looking for entry-level software programmers, Java full-stack developers, Python/Java developers, Data analysts/ Data Scientists, and Machine...Full timeH1bSynergisticIT
Towson, MD4 days ago$107.66k - $161.7k
...and our engineers are encouraged to think big and experiment with new ideas. Using... ...product. You will also play a key role in developing tools and abstractions that our other developers... ...Learning systems -- from prototyping, data pipelines and training, to realtime LLM...Remote jobFull timeWork experience placementInternshipQuora
Towson, MD14 hours ago- ...engineers and product leaders as part of your team. Together, you'll develop and enhance Instacart's marketplace systems. You will use... ...foundational problems executing on a high throughput system with dynamic data. About the Job: Design, develop, and deploy machine...Permanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
Instacart
Towson, MD14 hours ago - ...understand current and future hiring needs Develop sourcing strategies for cleared and... ...engineers, cloud engineers, DevOps engineers, data engineers, systems engineers, and other... ...capabilities. We specialize in cloud infrastructure, big data analytics, machine learning, software...Big dataFor contractors
$155.66k - $225.16k
...utility, trust, and constant adaptation. Responsibilities: Develop and maintain internal tools and systems that automate existing... ...Act as a high-trust owner of systems that may handle sensitive data or business-critical logic Work cross-functionally to ensure...Remote jobFull timeShift workQuora
Towson, MD14 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Developer. Be the first to apply!
