Back to Jobs

[Remote] Senior Software Engineer - AI Engineering

Remote, USA Full-time Posted 2026-06-16

Note: The job is a remote job and is open to candidates in USA. Mercury is a company focused on leveraging AI to enhance its operations. The Senior Software Engineer - AI Engineering will be responsible for extending and scaling Mercury's internal AI platform, strengthening the shared company knowledge layer, and enabling faster prototyping and iteration across the company.


Responsibilities

  • Build and evolve MCP servers that connect internal systems and data sources into a coherent interface for agents and engineers
  • Expand and operate our LLM gateway infrastructure: routing, rate limiting, cost attribution, and observability across teams
  • Turn early patterns into durable defaults: shared prompt libraries, guardrails, and policy-as-code so teams can move fast safely
  • Shape and maintain structured context artifacts—clean, reliable, agent-consumable—so LLMs working in Mercury's systems can reason accurately about our domain
  • Improve internal knowledge discoverability and retrieval so both humans and agents can quickly find accurate answers
  • Partner with domain teams to standardize key sources of truth, and keep them fresh
  • Build and refine sandbox environments and tooling that let engineers experiment with AI safely and at speed
  • Create self-service scaffolding so non-engineers—PMs, ops, finance—can prototype and deploy AI-powered workflows with minimal hand-holding
  • Build playgrounds and evaluation harnesses so internal AI agents can be tested and iterated in controlled environments before hitting production

Skills

  • 5+ years of backend development experience in complex, production systems
  • Fluent across programming languages and can navigate platform engineering, infrastructure, and developer tooling without needing a map
  • Hands-on experience building LLM-powered systems—RAG pipelines, agents, eval frameworks—and has shipped at least one of these to production
  • Understands the real tradeoffs in AI deployments: cost modeling, observability, latency, and safety
  • High-agency and self-directed; can operate effectively without tightly-defined scope
  • Communicates clearly across technical and non-technical audiences

Benefits

  • The total rewards package at Mercury includes base salary, equity, and benefits.
  • Our salary and equity ranges are highly competitive within the SaaS and fintech industry and are updated regularly using the most reliable compensation survey data for our industry.
  • New hire offers are made based on a candidate’s experience, expertise, geographic location, and internal pay equity relative to peers.
  • Mercury values diversity & belonging and is proud to be an Equal Employment Opportunity employer.
  • We are committed to providing reasonable accommodations throughout the recruitment process for applicants with disabilities or special needs. If you need assistance, or an accommodation, please let your recruiter know once you are contacted about a role.

Company Overview

  • Mercury provides digital banking and financial tools tailored for startups and modern businesses. It was founded in 2017, and is headquartered in San Francisco, California, USA, with a workforce of 1001-5000 employees. Its website is https://mercury.com.

  • Company H1B Sponsorship

  • Mercury has a track record of offering H1B sponsorships, with 2 in 2026, 14 in 2025, 6 in 2024, 8 in 2023, 1 in 2022, 1 in 2021, 1 in 2020. Please note that this does not guarantee sponsorship for this specific role.

  •   Apply To This Job

    Similar Jobs