Data/Software Engineer
Roberts Recruiting
Opportunity By applying and enforcing standard and best practices, you will design and develop scalable, 24x7 data and reporting services to process billions of events per day. Specific duties will include developing enhancements to our Hadoop/Hive and Redshift based data pipeline and extend to streamed data processing; contributing to data reporting projects including generating internal and external reports or visualizations (CSV, Excel, PDF, interactive web graphics and others) and data distribution / reporting components, real-time bidding or optimization algo using a combination of SQL, Ruby, R, Go, Java, Javascript, D3, Bourne shell scripts, cron jobs, and other relevant technologies. Will also be expected to implement new services and algorithms to improve our product. The ideal candidate has hands-on data processing experience. Candidate must be familiar with current distributed computing data technologies on commodity servers and have experience with 24x7 production needs. Requirements
- Strong SQL skills on large-scale databases, knowledge of any of the following RDBMS such as MySQL, Postgres, Redshift, Hive or others.
- Experience with Linux or Unix based systems - including Bourne shell, cron and other Unix utilities.
- Strong software development skills, including experience with Java.
- Degree in Computer Science or a related field.
- Experience with at least one of Ruby/Python, Bourne Shell or other scripting languages.
- Experience with Hadoop/MapReduce and/or EMR, including experience in developing MapReduce Jobs in Java or developing Hive UDF.
- ETL Experience maintaining multiple data systems.
- Experience with Ooozie or other Hadoop workflow solutions and experience developing complex data processing pipelines, including experience developing regressions tests and deployment strategies for such environments.
- Experience with data reporting solutions - either developed in house or with 3rd party solutions.
- Working experience developing and supporting 24x7 production data services and pipelines on Linux systems - including experience being on-call supporting such services. Experience with AWS preferred.
- Reliably processing billions of events per day with no data loss 24x7 on commodity hardware.
- Processing events in near real-time.
- Building for the fragility of cloud and distributed services.
- Complex processing of large amounts of data in an efficient manner.
- Reporting, distribution of data, data analysis, data visualization and machine learning algorithms.
- Low latency data stores for use in bidding or algo optimization.
- Competitive comp based on experience level
- Healthcare HMO & PPO
- Stock options and 401k
- Flexible Spending and Transit Reimbursement Accounts
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data/Software Engineer in Boston, MA vacancy
- ...Analytical Software QA Engineer Location: Remote (CST Hours) - Houston, TX Duration: Full-Time About BigRio: BigRio is a remote-... ...ranging from custom development and software implementation to data analytics and machine learning/AI integrations. As a one-stop...SuggestedFull timeRemote workShift work
Saviance
Boston, MA18 hours ago - ...sponsorship, are not eligible to apply. Job Introduction: The Global Finance Technology organization is seeking a Data Integration Software Engineer to join the Data Subledger team within the OneGL program. This role supports the design, development, testing, and maintenance...SuggestedLocal areaRemote workVisa sponsorshipWork visaShift work
- Motorola Solutions, Inc. is seeking a Software Engineer Co-op for its Video Analytics team to join from July 2024 to December 2024. This full-time role involves developing video analytics software on embedded Linux platforms. Key responsibilities include using C and C++...SuggestedFull time
$125k - $225k
...Software Engineer, Data Interested in this role? Email us at ****@*****.***. Send a GitHub link or an example of a messy data problem you’ve solved — that’s what we care about! About Vardera Labs Vardera Labs is building the next generation of infrastructure for...SuggestedWork at officeWorldwideGaruda Ventures
Boston, MA4 days ago- ...A state government agency is seeking a Geospatial AI Data Engineer Co-op to work on GIS data and AI applications. This position offers a chance to develop skills in GIS and ML, assisting in data pipeline construction and architectural improvements. The ideal candidate...Suggested
Commonwealth of Massachusetts
Boston, MA4 days ago $146k - $241k
...Position Overview The Principal Data/AI Engineer helps drive the technical strategy and architecture of enterprise-scale data and AI platforms... ...field. ~12+ years of professional experience in data/software engineering, AI/ML engineering, or cloud platform engineering...Remote workWork from homeFUJIFILM Corporation
Boston, MA1 day ago$135k - $325k
Job Overview The Senior Software Engineer - Data Modeling will work within Research Systems as part of the Data Models, Forecast Platform team, and be focused on the implementation of our next generation platform as part of a modern research data platform. Working closely...Local area- Senior Software Engineer, Data & MarTech (Hybrid, Boston, Seaport District) #26571 PROJECT STACK and TEAM: We are seeking a high-impact Senior Software Engineer to help build and scale our world-class digital platforms. In this role, you will be a key contributor to our...
- Software Engineer - Data Focus (Full-Stack Python) Full-time Peppercorn Solutions is building the infrastructure layer that wealth management has been missing. RIAs and wealth managers are allocating more to alternatives than ever — interval funds, BDCs, evergreen structures...Remote jobFull timeInternshipVisa sponsorship
$149k - $198.5k
Mission Summary We are seeking an experienced full stack engineer to join our new AI Data Application team. This pivotal role will drive the development and execution of initiatives aimed at significantly accelerating our ML dataset generation and data search applications...Work at officeRemote work- CarGurus LLC in Boston, Massachusetts, is seeking a Software Engineer to enhance the search experience and performance. This role involves collaboration across teams to deliver innovative solutions, emphasizing software development best practices. The ideal candidate will...
- A leading grocery retailer is seeking a Co-op intern to work on innovative applications and data-driven solutions. This hybrid role offers hands-on experience in JavaScript development and .Net environments, with mentorship and networking opportunities to enhance your...Internship
$115k - $142.6k
Foundation Medicine in Boston is seeking a Software Engineer II to design and support software applications that assist doctors in patient treatment options. This role involves collaboration with project managers and stakeholders to clarify requirements, alongside responsibilities...- ...Intelligence compute . It is developing hardware, software and systems infrastructure that will... ...specialists, silicon designers, software engineers and systems architects, Graphcore brings... .... Job Summary Reporting to the Head of Data & Analytics, the Lead Analytics Engineer...Flexible hours
Graphcore
Cambridge, MA4 days ago - PTC Inc is seeking a Data Analyst/Analytics Engineer to develop and support analytics solutions for the Velocity business unit in Boston, MA. This hybrid role necessitates regular in-office presence and involves collaborating with stakeholders to deliver actionable insights...Work at office
- Motion Recruitment Partners LLC is seeking a full-time Senior Data Engineer (Applied AI/ML) based in Boston, MA. This role involves critical data engineering tasks combined with applied machine learning to tackle complex client challenges. The ideal candidate will lead...Full time
- A leading grocery retailer is offering a paid Co-op program for students pursuing degrees in Computer Science, Data Analytics, or Engineering. This 6-month position provides exposure to innovative projects, mentorship for career development, and the opportunity to work...
- Cacheflow in Boston is seeking a Forward Deployed Engineer to work directly with customers and deliver impactful data solutions using the Databricks platform. The ideal candidate should have over 6 years of experience in data engineering and analytics, and be proficient...
$155k - $235k
...approved, open position within the organization. About the Team The Data Platform team sits within Scribd’s Infrastructure organization... ..., and we care deeply about making data work for everyone — engineers, analysts, and business users alike. About the Role We’re...Local areaHome officeFlexible hours- Databricks Inc. is seeking a Forward Deployed Engineer (FDE) based in Boston, MA. In this hands-on role, you will work closely with customers to build and implement solutions that address their data and AI challenges using the Databricks platform. The ideal candidate will...
$152.3k - $209.45k
Menlo Ventures is seeking a Sr. Solutions Engineer based in Boston, MA, to lead technical strategies for large enterprises. The role involves... ...teams to success. Ideal candidates should have a background in data-driven transformations and programming alongside cloud...- ...Google Cloud Data Engineer Are you ready to step up to the New and take your technology expertise to the next level? Join and help transform... ...role, laterally or upward. As part of our Intelligent Software Engineering practice, you will lead technology innovation for...Work experience placement
ClifyX
Boston, MA4 days ago - NEXTLABS INC. is seeking a professional to support data protection and entitlement manager products. The role involves designing specifications for custom solutions, automating compliance requirements for SAP, and implementing solutions according to company standards....Remote job
- A leading technology company is seeking a Senior Software Engineer to join their Core Data team in Cambridge, MA. This position will involve scaling web APIs, managing distributed systems, and designing robust databases to handle peak loads. Candidates should possess a...
- Senior Software Engineer - Core Data Hadoop HBase Full-time SAAS Company Scaling web APIs to thousands of concurrent requests Working with distributed systems - gracefully handling failures and partitioning data for maximum throughput Designing databases and caching layers...Full time
$155k - $260k
...Boston is seeking a Quantitative Developer to join our Research group. This role involves writing Python and R code, performing complex data analysis, and enhancing our data science technology stack. The ideal candidate will have a quantitative background with programming...- ...including Menlo Ventures, Lightspeed Venture Partners, Matrix Partners, NVentures (venture arm of NVIDIA). About the Role As a Software Engineer in the Data Platform team at Suno, you will help build the systems and practices that ensure our data is secure, well‑managed, and...Full timeWork at officeLocal area
Dormont Manufacturing Company
Boston, MA3 days ago $120k - $230k
...A leading IT solutions provider seeks a Presales Solutions Engineer – Data Protection to act as a cloud security expert. This role involves working with clients to solve security challenges and delivering technical expertise for sales. Ideal candidates will have 5+ years...SHI GmbH
Boston, MA1 day ago- ...Job Title: Splunk/Cribl Data Engineer Location: Quincy, MA - Onsite 6-12 Months Contract - Possible Extension Job Description: We are seeking three (3) skilled Splunk/Cribl Data Engineers to support the onboarding and integration of security and infrastructure...Contract work
AceStack LLC
Quincy, MA1 day ago $135k - $325k
...Job Overview The Senior Software Engineer of the Shared Data Platform plays a pivotal role in designing and developing innovative services to enhance Arrowstreet Capital’s data infrastructure. The primary objective is to streamline the ingestion and transformation of...Local areaFlexible hoursArrowstreet Capital
Boston, MA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data/Software Engineer. Be the first to apply!
Related searches
- senior cloud data engineer Boston, MA
- principal data engineer Boston, MA
- finance data engineer Boston, MA
- aws data engineer Boston, MA
- data engineer Boston, MA
- sr data engineer Boston, MA
- software data engineer Boston, MA
- junior data engineer remote Boston, MA
- remote data engineer Boston, MA
- data engineer intern Boston, MA