Senior Software Engineer - AI Platform Team

You will lead and own multi quarter high impact initiatives on the AI platform building scalable systems for LLM gateways, AI hubs, and agent runtimes. You will collaborate with engineers, security, legal, finance, and product partners to ship production ready AI agents and improve observability and governance. You will enable data sources to connect to knowledge bases apply ML including fine tuning where it beats prompting.

Responsibilities

• Own the LLM Gateway API for 60+ models across providers including self-hosted models with auth, PII redaction, quotas, fallbacks, and cost optimization
• Maintain AI Hub as a single front door for agents, skills, MCP servers, knowledge bases, models, memories, and keys
• Develop Agent and MCP runtime with microVM sandboxes per agent run, a governed MCP gateway over 125+ servers, cross trust agent identity, tier 1 agents for code, analytics, and exec personas
• Connect any data source to Knowledge Bases and enable vector and markdown stores, queryable by any agent over MCP
• Oversee AI Spend Hub with FinOps for AI, spend attribution and governance
• Build evaluation and observability tooling with in house LLM as judge harness with full tracing and eval tooling
• Support company wide chat and low code workflow surfaces used by thousands of weekly actives
• Collaborate with teams to embed with production agents refine feedback loops and apply traditional ML including fine tuning where it beats prompting