Senior Server Engineer, Foundations
United States53m ago
Key details
- Location
- United States
- Work style
- Remote
- Level
- Senior
- Job type
- Full-time
- Experience
- 5–8 yrs
- Function
- Software engineering
- Focus area
- Infrastructure / Cloud
- Posted
- 53m ago
Skills
About the role
This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Senior Server Engineer, Foundations based in the United States.
This is an opportunity to shape the core engineering platform behind a high-scale consumer technology product. As a senior member of a small, high-impact Foundations team, you will modernize server architecture and build shared infrastructure, developer tools, and AI-powered workflows used across the entire engineering organization. You will take ownership of foundational systems, from LLM gateways and model routing to shared libraries, CI/CD, and production reliability. With significant autonomy over the team's roadmap, you will identify opportunities to make development safer, faster, and more effective for every engineering team. The role combines hands-on technical leadership, architectural decision-making, and practical AI innovation in a fast-moving environment. You will also mentor engineers and help establish the standards that support sustainable engineering excellence.
Accountabilities
-
Own shared engineering foundations
-
Design, build, and maintain the core platform components used across engineering teams, including AI infrastructure, server architecture, shared libraries, developer tooling, and continuous integration systems.
-
Develop and operate AI infrastructure such as LLM gateways, model routing, usage and spend tracking, and automated code review agents.
-
Listen to internal engineering teams, identify recurring challenges, and prioritize foundational improvements that make applications safer and easier to develop.
-
Lead server architecture modernization
-
Drive the evolution of backend architecture, identifying opportunities to improve scalability, maintainability, performance, and reliability.
-
Write technical specifications, evaluate architectural trade-offs, and define implementation plans.
-
Lead modernization initiatives from initial design through safe deployment and adoption across engineering teams.
-
Ensure architectural decisions support the long-term needs of a growing consumer-scale product.
-
Build AI-powered developer tooling
-
Develop and roll out AI-assisted development tools used throughout the engineering organization.
-
Build capabilities such as model-routing systems, evaluation frameworks, and cloud-based agents that review code and identify quality issues.
-
Establish standards and best practices for using AI tools effectively in software development.
-
Continuously evaluate emerging AI technologies and identify opportunities to improve engineering productivity and code quality.
-
Establish engineering standards
-
Set technical expectations through architecture and design reviews, code reviews, and clear documentation.
-
Create shared tools, workflows, and engineering practices that help teams deliver reliable software with greater confidence.
-
Promote consistency, maintainability, and effective collaboration across engineering teams.
-
Own operational excellence and reliability
-
Take responsibility for the full software development lifecycle of the systems you build, including CI/CD, observability, alerting, and security remediation.
-
Ensure production systems have appropriate monitoring and alarm coverage.
-
Participate in and support a healthy, blameless on-call rotation.
-
Act as an escalation point for complex production issues, leading deep technical debugging and resolution.
-
Mentor and support engineering teams
-
Help engineers develop their technical skills through pairing, code reviews, and constructive feedback.
-
Share architectural knowledge and practical engineering guidance.
-
Encourage a collaborative culture focused on ownership, continuous improvement, and effective use of technology.
-
At least 5 years of hands-on experience building and operating production server-side software.
-
Demonstrated ability to deliver scalable, maintainable backend systems and grow into a technical leadership role within an engineering organization.
-
Strong expertise in system design and software architecture, with advanced proficiency in Node.js and TypeScript.
-
Experience building and scaling production backend systems in a startup or similarly fast-paced environment.
-
Hands-on experience with MongoDB and/or PostgreSQL in production, including database performance tuning.
-
Experience owning platform, infrastructure, or developer productivity initiatives that other engineering teams depend on, such as:
-
Shared libraries and internal platforms.
-
CI/CD pipelines and developer tooling.
-
Observability and production reliability.
-
Security remediation and infrastructure improvements.
-
Proven ability to drive adoption of shared tools and platform capabilities across multiple teams.
-
Practical experience building and shipping products powered by LLMs or AI agents in production, beyond basic conversational interfaces or chat wrappers.
-
Strong interest in emerging AI tools, frameworks, and development practices, with the ability to evaluate and adopt useful technologies quickly.
-
Additional strengths that would distinguish you:
-
Experience leading major architectural migrations across codebases and successfully driving adoption by other engineering teams.
-
Familiarity with AI infrastructure and model-routing technologies such as LiteLLM, Amazon Bedrock, or comparable solutions.
-
Production experience with prompt engineering, model evaluations, or fine-tuning.
-
Infrastructure expertise with AWS, Docker, Kubernetes, CI/CD, and the security requirements of operating consumer products at scale.
-
A leverage-oriented mindset: you prefer solving recurring problems for the whole organization by building reusable tools, workflows, and practices, and measuring their impact.
-
Empathetic leadership and the ability to build strong relationships with colleagues and collaborative teams.
-
A strong bias toward shipping, experimentation, and iteration, with the ability to build quickly, learn from results, and continuously refine solutions.
-
Comprehensive medical and dental coverage.
-
Equity-based compensation.
-
Daily food delivery budget of $50.
-
Unlimited vacation.
-
12 weeks of paid parental leave.
-
Annual $1,000 travel allowance to visit somewhere new and experience different cultures.
-
Opportunities for professional learning and career development.
-
Collaborative, supportive company culture that values human connection, empathy, and curiosity.
-
Significant technical ownership and autonomy within a small team with broad engineering impact.
Requirements
Benefits
How well do you match this job?
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.