Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Python Engineer (AI Inference)

Mathpix

We are a small (but quickly-growing) and dedicated team committed to pushing the boundaries of what is possible in computer vision and AI-powered document processing. We are profitable and help power some of the world's biggest LLMs providers, EdTech, and AI companies. We are headquartered in Williamsburg, Brooklyn, NY but have a small remote team as well.

About the role:

We are seeking a Python engineer to join our team in the Brooklyn office, working on the AI inference pipeline. This powers our industry-leading OCR and computer vision products. We are open to junior and more experienced candidates for this position!

You’ll work closely with senior ML engineers to add new OCR features, improve existing models, and build tools that make experimentation and deployment faster and more reliable. It’s an exciting opportunity for an early-career developer who is passionate about algorithms, developer productivity, and machine learning, and who wants to contribute directly to advancing OCR technology.

Responsibilities:

  • Collaborate with senior ML engineers on developing and integrating new OCR features into our inference pipeline
  • Write clean, object-oriented Python code that supports scalability and maintainability
  • Work with SQL databases for data access, storage, and analysis in support of ML training and evaluation
  • Contribute to model development and evaluation for real-world computer vision problems
  • Implement algorithms and data structures in production code
  • Help build developer tools and utilities that make our ML workflows more efficient and reproducible

Required skills:

  • Proficiency in Python, with a solid understanding of object-oriented programming
  • Experience interacting with SQL databases
  • Strong interest in machine learning, computer vision, and developer tooling
  • Desire to learn from and collaborate with experienced engineers on real-world ML systems
  • PyTorch experience
  • Familiarity with containerization (Docker, Kubernetes) or cloud platforms (AWS, GCP, Azure)
  • Previous contributions to open-source projects, coursework, or personal projects related to ML or developer tooling

Mathpix values:

  • A strong sense of ownership and accountability for the systems you build
  • A collaborative mindset with a willingness to mentor and be mentored
  • Passion for solving complex problems with elegant, pragmatic solutions
  • Resilience and self-direction — the ability to thrive in a fast-paced startup environment, where priorities evolve and autonomy is key
Seniority level

Entry level

Employment type

Full-time

Job function

Engineering and Information Technology

Industries

Software Development

We offer medical insurance, vision insurance, and 401(k).

#J-18808-Ljbffr
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Python Engineer (AI Inference) in New York, NY vacancy
  •  ...A leading software development company in New York is seeking an entry-level Python engineer to join their team in the Brooklyn office. The role involves working on the AI inference pipeline that powers sophisticated OCR and computer vision products. Candidates should... 
    Suggested
    Full time
    Work at office

    Mathpix

    New York, NY
    2 days ago
  •  ...a rapidly growing Behavioral AI company on a mission to ethically...  ...culture from the ground up. Engineers here own major surface areas ,...  ...Learning Engineer focused on Inference and Serving at Yobi , you’ll design...  ...are comfortable bridging to Python for model integration and... 
    Suggested
    Remote work

    YOBI, LLC

    New York, NY
    3 days ago
  •  ..., Inc. is seeking a Staff Machine Learning Engineer to lead the development of a large-scale ML Inference Platform. Responsibilities include designing...  ...proficiency with tools like AWS and modern AI/ML frameworks such as Python and Pytorch. We offer competitive salaries... 
    Suggested

    Reddit

    New York, NY
    6 days ago
  • A leading Behavioral AI company is seeking a Machine Learning Engineer focused on inference and serving. In this role, you will design and optimize systems to operationalize AI models. The ideal candidate has deep expertise in model deployment, a strong low-latency mindset... 
    Suggested
    Remote work

    Yobi AI

    New York, NY
    13 days ago
  • $185.1k - $335.3k

     ...automotive company is seeking a Staff Compiler Engineer to enhance the model compilation stack...  ...role involves optimizing high-level AI models into inference artifacts, defining technical visions,...  ...of experience in compilers, strong Python/C++ skills, and familiarity with ML... 
    Suggested

    General Motors

    New York, NY
    6 days ago
  • $152k - $287.5k

     ...NVIDIA is seeking a Senior Software Engineer – AI Inference in New York. This role involves advancing open-source LLM serving by contributing...  ...requires 5+ years in production software and strong skills in Python, C++, and CUDA. Competitive salary ranges from $152,000 to... 

    NVIDIA

    New York, NY
    2 days ago
  •  ...Inference Engine Engineer We build and run the inference engine behind every Perplexity query and deploy dozens of model architectures...  ...scale with tight latency and cost budgets. Our stack is Rust, Python, CUDA, and CuTe DSL - and we need another engineer to join us... 

    Perplexity AI

    New York, NY
    9 days ago
  • $100 - $160 per hour

     ...Lead Data Scientist, Causal Inference & Clinical Outcomes New York City Lead Data Scientist...  ...100 - $160/hour Jaan Health is a leading AI-based care management company serving healthcare...  ...reporting infrastructure using SQL, Python, dbt, Redshift, and Looker. Project... 
    Full time
    Contract work
    Work at office
    Remote work
    Flexible hours

    Phamily

    New York, NY
    6 days ago
  •  ...Hiring experienced Software Engineers to support high-impact research collaborations with leading AI labs. Freelancers will contribute...  ...and the full task context to infer and infill the underlying thought...  ...) Strong proficiency in Python, JavaScript, TypeScript, or other... 
    Contract work
    Part time
    For contractors
    Freelance
    Immediate start
    Remote work

    YO HR Consultancy

    New York, NY
    6 days ago
  • $197.3k - $225.1k

     ...Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for...  ...technologies At least 4 years of experience programming with Python, Go, Scala, or Java Preferred Qualifications:... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $197.3k - $225.1k

     ...Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good....  ...technologies. At least 4 years of experience programming with Python, Go, Scala, or Java. Preferred Qualifications 6 years of... 
    Local area

    Capital One National Association

    New York, NY
    2 days ago
  •  ...Senior AI Engineer — Inference & Agent Systems United States Title: Applied AI Engineer — Inference & Agent Systems Location: United States What...  ...familiarity (we care more about depth than match): Go, Python, Temporal, Kafka, PostgreSQL, Docker Why This Role The problems... 

    Arcana Analytics Inc.

    New York, NY
    5 days ago
  • $229.9k - $262.4k

     ...Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform) Overview: At Capital One, we are creating responsible and reliable...  ...At least 6 years of experience programming with Python, Go, Scala, or Java Preferred Qualifications: ~7 years... 
    Full time
    Part time
    Local area

    Capital One Financial Corp

    New York, NY
    5 days ago
  • $197.3k - $225.1k

     ...Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good....  ...technologies At least 4 years of experience programming with Python, Go, Scala, or Java Preferred Qualifications: 6 years of... 
    Full time
    Part time
    Local area

    Capital One Financial Corp

    New York, NY
    3 days ago
  • $200k - $250k

     ...At Wizard AI, we’re building the top-performing AI Shopping Agent...  ...an experienced Senior MLOps Engineer to take ownership of how our machine...  ...scaling – for a custom-built inference platform powering a live...  ...production environments. Strong Python skills and software... 
    Remote work
    Flexible hours

    Wizard

    New York, NY
    6 days ago
  •  ...Overview We are looking for a Machine Learning Engineer focused on low-latency inference optimization to help build, tune, and productionize high-performance...  ...-like environments. Programming experience in Python, Java, C# etc. and at least one systems language such as... 

    Susquehanna International Group

    New York, NY
    2 days ago
  • $300k

     ...interpretable, and steerable AI systems. We want AI to be safe...  ...group of committed researchers, engineers, policy experts, and business...  ...AI systems. About The Role Our Inference team builds and maintains the...  ...infrastructure (AWS, GCP, Azure). Python or Rust proficiency.... 
    Worldwide

    Menlo Ventures

    New York, NY
    3 days ago
  • $100k - $140k

     ...consultancy is seeking a Data Scientist with expertise in statistical inference and causal analysis. This role involves designing measurement...  ...to define KPIs. Candidates should have proficiency in Python and SQL, along with experience in experimental design. The position... 

    Avenue Code

    New York, NY
    6 days ago
  •  ...A Behavioral AI company is seeking a Machine Learning Engineer to design and optimize systems for bringing their models to life. The role involves ensuring ML models are efficient and reliable, requiring experience in model deployment and robust coding skills. Candidates... 
    Remote work

    YOBI, LLC

    New York, NY
    2 days ago
  •  ...About the job Tech Lead, Data & Inference Engineer Our Client A fast moving and venture...  ...with a specialized vertical in Applied AI, Machine Learning, and Data Science. We...  ...query optimization on large datasets) and Python skills. ~ Hands-on experience with... 
    Full time

    Catalyst Labs, LLC

    New York, NY
    4 days ago
  •  ...Mitr Learning Media is seeking an experienced AI / ML Engineer to understand and maintain existing AI/ML codebases and lead the development...  ...workflows. The ideal candidate will have strong knowledge in Python, FastAPI, and experience working with Large Language Models,... 

    Mitr Learning Media

    New York, NY
    4 days ago
  •  ...About the Job We are looking for an experienced AI Model Engineer with deep expertise in kernel development, model optimization, fine‑tuning, and GPU acceleration. The engineer will extend the inference framework to support inference and fine‑tuning for language models... 
    Remote work

    Framework Ventures

    New York, NY
    6 days ago
  •  ...Mitr Learning Media is looking for a Python / AI/ ML Engineer / Developer to contribute to the development of new features in content generation workflows. The role involves supporting the optimization of AI/ML pipelines and working with Large Language Models for content... 

    Mitr Learning Media

    New York, NY
    3 days ago
  •  ...Location: Remote Role: Python Agentic AI/ML Engineer Job Description We are seeking a skilled Agentic AI/ML Engineer with a strong background in Python scripting and experience in developing AI solutions using LangChain and LangGraph. The ideal candidate will have a solid... 
    Remote work

    Saransh

    New York, NY
    6 days ago
  •  ...Analytics, LLC is seeking a Software Development Engineer – Risk to design and develop software...  ...VaR. Applicants should bring a strong Python development background and 7+ years in...  ...position offers opportunities to work with emerging AI technologies. #J-18808-Ljbffr... 

    Clearwater Analytics

    New York, NY
    2 days ago
  •  ...company in the United States seeks an ML Performance Engineer Principal Lead to optimize inference performance across its platforms. The role involves evaluating...  ...in ML performance optimization, proficiency in Python and C++, and a solid understanding of transformer architectures... 

    Akamai

    New York, NY
    6 days ago
  •  ...York City is seeking a Lead Data Scientist specializing in Causal Inference & Clinical Outcomes for a 16-week remote engagement. This role...  ...healthcare data, and proficiency in analytical tools such as Python and SQL. The position offers competitive compensation, medical... 
    Remote work

    Phamily

    New York, NY
    6 days ago
  • $80 per hour

    A leading AI consultancy is seeking remote, part-time Python engineers to work on Model Context Protocol (MCP) servers and related tools. Candidates should have 4+ years of development experience and skills in API building, Docker, and backend systems. This role offers... 
    Part time
    Remote work
    Flexible hours

    Mind Rift

    New York, NY
    3 days ago
  •  ...leading tech consultancy is seeking experienced Software Engineers to assist in high-impact AI research collaborations. The role involves annotating...  ...engineering experience and be proficient in languages such as Python and JavaScript. The position is remote with part-time... 
    Part time
    Remote work

    YO HR Consultancy

    New York, NY
    6 days ago
  •  ...A leading AI solutions provider is seeking a skilled Python Agentic AI/ML Engineer to work remotely. The ideal candidate will have extensive experience in Python scripting, along with proficiency in developing AI solutions using LangChain and LangGraph. Strong knowledge... 
    Remote work

    Saransh

    New York, NY
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Python Engineer (AI Inference). Be the first to apply!