Junior Software Engineer - Inference
$138k - $163kNeural Solutions
Software Engineer - AI Infrastructure
We’re seeking a software engineer to support our AI infrastructure team in Columbia, MD. In this role, you’ll help build and maintain the foundation for customer AI capabilities while supporting a broader ecosystem of AI-enabled applications.
Responsibilities:
- Procure, configure, and test new inference models, preparing them for release to our user base.
- Develop in-house services and techniques to guarantee continual high-quality inference service for our customer.
- Work with model vendor teams and representatives to create reliable pipelines for closed-source model usage.
- Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer.
- Engage with other teams in our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs.
Required Skills:
- Experience with Python and/or other modern programming languages.
- Familiarity with Argo CD and/or other CI/CD frameworks.
- Experience with Kubernetes/Helm.
- Familiarity with AWS or other cloud service providers.
- Ability to learn new technologies quickly.
- Strong communication skills and willingness to ask questions.
Nice to Have:
- Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
- Experience with other LLM hosting frameworks and practices.
- Experience supporting production software using Site Reliability Engineering (SRE) best practices.
- Experience with Elastic, Grafana/Prometheus, or other observability frameworks and practices.
- Experience with Docker and containerization.
- Experience in traffic shaping and quality-of-service engineering.
- Knowledge of and interest in hosting AI capabilities.
Experience Required: 3 years with Bachelor's degree in a technical discipline or 7 additional years without degree
Location: Columbia, MD
Clearance: TS/SCI with Polygraph required
Salary Range: $138,000 - $163,000
#J-18808-LjbffrVacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Junior Software Engineer - Inference in Columbia, MD vacancy
$204k - $247k
...Senior Software Engineer Join us in building the next generation of AI infrastructure that will power innovation across our organization... ...the highest available quality LLMs to users throughout the inference software stack. Responsibilities: Lead the evaluation,...SuggestedTemporary workNeural Solutions
Columbia, MD3 days ago- ...Visionist, Inc. is seeking a Junior Software Engineer on our largest PRIME contract, contingent on active TS/SCI clearance. The role involves embedding with analysts and engineers to craft AI-enabled tools for readiness, verification, and rapid iteration across operations...JuniorContract work
Visionist, Inc.
Columbia, MD2 days ago $197.5k - $232.5k
...What We Look For Bitwise hires talented engineers who are driven by purpose and who value... ...customer's organization, and we need a software engineer to help us do it. In this role,... ...quality LLMs to users throughout the inference software stack. Requirements shift quickly...SuggestedExtra incomeContract workTemporary workFlexible hoursShift workNight shiftBitwise
Laurel, MD4 days ago$282k - $332k
...What We Look For Bitwise hires talented engineers who are driven by purpose and who value... ...organization, and we need a senior software engineer to help lead the charge. In this... ...quality large language models across our inference software stack. As a Senior Software...SuggestedExtra incomeContract workTemporary workFlexible hoursShift workNight shiftBitwise
Laurel, MD4 days ago$70k - $190k
...Business Journal's (BBJ) Best Places to Work 2019, runner up in 2020 and a finalist in 2021! Belay Technologies is seeking a Software Engineer (AI Focus). We are seeking a Software Engineer I with a focus on AI to support analysts and operators by developing and refining...JuniorContract workWork experience placementFlexible hours$138k - $163k
...Software Engineer We're seeking a skilled software engineer to support our Platform team at Columbia, MD. In this role, you'll help build and maintain the foundation for AI capabilities while supporting a broader ecosystem of AI-enabled applications. Responsibilities...JuniorNeural Solutions
Columbia, MD3 days ago$8k
...Top Secret (TS/SCI) clearance with polygraph is required. Visionist has an exciting new, fully FUNDED opportunity for a Junior Software Engineer on our largest PRIME contract. Our team of Analysts and Engineers is motivated by the direct impact on the mission, crafting...JuniorPermanent employmentContract workTemporary workImmediate startFlexible hours- ...Bitwise is seeking a software engineer to build and maintain AI infrastructure supporting customer AI capabilities. You will ensure access to high-quality LLMs across the inference software stack and collaborate with teams to develop reliable pipelines for closed-source...
Bitwise
Laurel, MD4 days ago $85k - $175k
...Pega Software EngineerA day in the life: As a Pega Software Engineer, you will take an existing technical architecture that includes Pega Platform and create various innovation prototypes to address specific issues or problems. You will have to understand the problem,...JuniorSummer holidayImmediate startRed Alpha
Columbia, MD4 days ago$197.5k - $232.5k
...What We Look For Bitwise hires talented engineers who are driven by purpose and who value... ...customer's organization, and we need a software engineer to help us do it. In this role,... ...available quality LLMs to users throughout the inference software stack. Requirements shift...Extra incomeContract workTemporary workFlexible hoursShift workNight shift- ...Junior Software DeveloperYellow Duck Technologies is actively seeking Junior Software Developers who hold TS/SCI Full Scope Polygraph clearance. Requirements:Must have an active TS/SCI clearance with Full Scope Polygraph3+ years of experience and a bachelor's degree in...Junior
Yellow Duck Technologies Inc.
Annapolis Junction, MD4 days ago $101k - $129k
...support Analytical Application Integration by helping sustain software, maintain system interoperability, support testing, and assist... ...activities.You will work alongside experienced software and systems engineers to learn how mission applications connect to upstream and...JuniorImmediate startIntelliforce-IT Solutions Group, LLC.
Annapolis Junction, MD4 days ago$8k
...Junior Cloud Software EngineerActive Top Secret (TS/SCI) clearance with polygraph is required. Visionist has an exciting new, fully FUNDED opportunity for a Junior Cloud Software Engineer. You will be joining a critical mission supporting our customers big data processing...JuniorContract workTemporary workRemote workFlexible hoursVisionist, Inc.
Columbia, MD4 days ago- ...advanced cybersecurity capabilities to solve complex technical challenges. In this role, you'll work at the intersection of software engineering, reverse engineering, vulnerability research, and cloud technologies. You'll analyze complex software systems, identify critical...Junior
Top Echelon
Columbia, MD9 days ago - ...Position SummaryBase-2 Solutions is looking for a top-notch software engineer to join our team. We are driven to solve challenging customer problems by leveraging innovative technical solutions. Our software engineers develop the next-generation technologies that drive...Junior
Base2 Solutions
Annapolis Junction, MD3 hours ago $110k - $155k
...Junior Software EngineerFreedom Technology Solutions Group is seeking a motivated Software Engineer to join our team developing geospatial analysis, data processing, visualization, and AI-enabled solutions using modern cloud technologies and the ArcGIS Enterprise technology...JuniorContract workInternshipFlexible hoursNight shiftFreedom Technology Solutions Group, LLC
Annapolis Junction, MD4 days ago- Software Engineer Junior-Level (General) Full-Time | On-Site | TS/SCI with Full-Scope Polygraph Required Position Overview: Our client is seeking a junior level Software Engineer with a minimum of 4+ years of expertise and a technical Bachelor's degree to join our team...JuniorFull timeLocal area
- We are seeking an entry-level to early-career Software Developer to join our software engineering team and help design, build, test, and maintain software applications that support mission-critical systems. This role may include front-end, back-end, testing, or integration...JuniorFor contractorsInternship
$95k - $105k
Junior Software Engineer Crown Point Technologies, LLC is an Economically Disadvantaged Women-Owned Small Business dedicated to providing critical full-stack software development and data engineering solutions and services to both Government and commercial clients. Proudly...Junior- ...BigBear.ai is seeking a Full Stack Software Engineer to help build the next generation of AI... ...customer's AI capabilities. You will focus on inference services while supporting the broader... ...guidance and informal mentorship to junior engineers What you need to have ~...
$57.85k - $104.58k
...to customers in the national security, engineering, and health industries. We deliver innovative... ...technology-enabled services and mission software capabilities to support Intelligence... ...About the Opportunity Leidos is seeking a Junior Software Engineer to join a team...JuniorLocal areaImmediate start$179.77k - $184.35k
...insurance ~ Paid time off ~ Profit sharing ~ Vision insurance About the Role ACKtive Engineering Solutions LLC is looking for a talented iOS Software Developer. If you are passionate about native iOS development, then we want to hear from you! This position...JuniorHourly payImmediate startFlexible hoursACKtive Engineering Solutions LLC
Columbia, MD3 hours ago- ...Amentum is seeking a junior software engineer or Linux system administrator to support multiple projects in Hanover, MD. You will help set up development environments, apply security patches, and update libraries, while exploring configurations for lab and production...Junior
Amentum
Hanover, MD5 hours ago $70k - $190k
...Business Journal's (BBJ) Best Places to Work 2019, runner up in 2020 and a finalist in 2021! Belay Technologies is seeking a Software Engineer to join our intel team. Join us in building the next generation of AI infrastructure that will power innovation across the...JuniorFull timeContract workWork experience placementFlexible hoursShift workBelay Technologies
Maryland, MD12 days ago$55.29 - $79.33 per hour
Software Engineer, Junior EverWatch is a government solutions company providing advanced defense, intelligence, and deployed support to our country's most critical missions. We are a full-service government solutions company. Harnessing the most advanced technology and...JuniorHourly payContract workLocal area- ...all about making connections. Whatever IT goals you have, our software programmers can help achieve those. Our software development teams... ...degree or Masters degree in Computer Science, Computer Engineering, Electrical Engineering, Information Systems, ITHighly motivated...Junior
SynergisticIT
Columbia, MD5 days ago $94.3k - $115.2k
Title: JR Software Engineer Who We Are KBR Mission Technology Solutions delivers full life cycle professional and technical solutions that improve operational readiness and drive innovation. Our solutions help ensure mission success on land, air, sea, space and cyberspace...JuniorContract workTemporary workLocal areaRelocation packageFlexible hours- ...BigBear.ai is seeking a S oftware Engineer to support our AI infrastructure team.... ...customer's AI capabilities, focusing on inference services while supporting the broader ecosystem... ...guidance and informal mentorship to junior engineers What you need to have...
- Junior Software Engineer (Python) Annapolis Junction, MD ( Description We are searching for cleared professionals who are passionate about their work and ready to take the next step in their careers! The talented individuals we hire at Synergy are provided with a multitude...JuniorContract workWork at officeImmediate startFlexible hours
- ...Bitwise in Laurel, MD is seeking a Senior Software Engineer – Inference to lead evaluation, configuration, and deployment of inference models, ensuring access to high-quality LLMs within our AI infrastructure. You will mentor engineers, shape best practices, and collaborate...
Jobleads-US
Laurel, MD3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Junior Software Engineer - Inference. Be the first to apply!
Related searches
- software engineer amazon Columbia, MD
- information technology software engineer Columbia, MD
- federal - software developer Columbia, MD
- software engineer remote Columbia, MD
- junior software developer internship Columbia, MD
- remote entry level software developer Columbia, MD
- software engineer contract Columbia, MD
- network software engineer Columbia, MD
- intel software engineer Columbia, MD
- senior software engineer remote Columbia, MD