Engineering Manager - AI Agents (Agent Platform, LLMs, Evals)
United States1h ago
Key details
- Location
- United States
- Work style
- Remote
- Level
- Senior
- Job type
- Full-time
- Function
- Software engineering
- Focus area
- AI / ML
- Posted
- 1h ago
Skills
About the role
Engineering Manager - AI Agents (Agent Platform, LLMs, Evals)
Shape the future of trust in the age of AI
At Oscilar, we're building the most advanced AI Risk Decisioning™ Platform. Banks, fintechs, and digitally native organizations rely on us to manage their fraud, credit, and compliance risk with the power of AI. If you're passionate about solving complex problems and making the internet safer for everyone, this is your place.
Why join us:
Mission-driven teams: Work alongside industry veterans from Meta, Uber, Citi, and Confluent, all united by a shared goal to make the digital world safer.
Ownership and impact: We believe in extreme ownership. You'll be empowered to take responsibility, move fast, and make decisions that drive our mission forward.
Innovate at the cutting edge: Your work will shape how modern finance detects fraud and manages risk.
Background
Oscilar is seeking a US-based Manager of AI Agents to lead a team of engineers building and operating the production agent systems at the heart of our Agentic Risk Platform.
In this role, you will own the technical and people leadership for a team focused on agent orchestration, tool-calling, evaluation frameworks, reliability, and observability. You will partner closely with product, FDE and core platform engineering to raise the bar on what production-grade agents can deliver for fraud, AML, credit, and onboarding use cases.
This is a hands-on leadership role for someone who has been a software engineer, has shipped real agent systems in production, and has successfully built and managed engineering teams at a growing startup or scale-up. The right person is energized by technical depth, operational excellence, and turning ambitious agent ideas into reliable, customer-facing systems.
Responsibilities
Team leadership: Build, lead, and grow a high-performing team of 5–10 engineers focused on AI agent systems. Hire, coach, and develop talent while establishing strong technical and cultural standards. Create an environment where strong engineers want to stay and grow.
Production agent systems: Drive the design, development, and continuous improvement of production agent capabilities including orchestration, tool-calling (including MCP and related protocols), evaluation frameworks, reliability, observability, and safe failure modes. Agents are built on a governed platform where every new agent inherits shared evals, guardrails, and auditability.
Technical quality and judgment: Raise the bar on architecture, design quality, reliability, and service ownership for agent systems that operate in high-stakes, regulated environments.
Cross-functional impact: Partner with Forward-Deployed Engineers and customer teams to ship agents into customer environments and turn field feedback into platform improvements.
Operational excellence: Establish clear planning, execution, and incident processes that support predictable delivery without unnecessary overhead. Own reliability and post-incident learning for agent systems.
Talent and leadership development: Recruit senior individual contributors and emerging leaders. Create an environment where strong engineers want to stay and grow.
Scale and reliability: Ensure AI agent systems meet the performance, security, auditability, and reliability standards required by financial institutions that rely on our platform to process billions of risk decisions.
Requirements
Significant hands-on software engineering experience, with a track record of shipping production systems.
Proven experience building and shipping agent systems in production, including hands-on work with tool-calling, orchestration, evaluation frameworks (evals), and reliability engineering.
Experience managing and building engineering teams of 5+ people (direct reports or equivalent), including hiring, coaching, and raising technical standards.
Experience at a growing startup or scale-up, with comfort operating in fast-moving, ambiguous environments and creating structure where needed.
Strong technical judgment and enough depth to evaluate agent architectures, system design, failure modes, and engineering quality with credibility.
Excellent written and verbal communication skills, with experience partnering across product, data science, and distributed teams.
Experience with reliability, observability, and production operations for complex AI or distributed systems.
Experience in fintech, fraud, credit risk, AML, compliance, or other regulated industries is a strong plus.
Prior experience with Model Context Protocol (MCP), multi-agent orchestration, or large-scale agent evaluation systems is highly valued.
Our Tech stack: LangGraph (or similar agent frameworks), AWS Bedrock, Python + Java, MCP
This is a remote senior engineering leadership role based in the US. You will report into engineering leadership and have direct ownership of a critical part of Oscilar’s agent platform.
Benefits
Compensation: Competitive salary and equity packages, including a 401k
Flexibility: Remote-first culture — work from anywhere
Health: Comprehensive health, dental, and vision insurance with a top tier plan for you and your dependents (US)
Balance: Unlimited PTO policy
Technical: AI First company; both Co-Founders are engineers at heart; and over 50% of the company is Engineering and Product
Culture: Family-Friendly environment; Regular team events and offsites
Development: Unparalleled learning and professional development opportunities
Impact: Making the internet safer by protecting online transactions
How well do you match this job?
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.