Gen AI Product Engineer
Bengaluru, KA, India12h ago
Key details
- Location
- Bengaluru, KA, India
- Work style
- Onsite
- Job type
- Full-time
- Function
- Software engineering
- Focus area
- AI / ML
- Posted
- 12h ago
Skills
About the role
Join us as a Gen AI Product Engineer
- In this key role, you’ll be responsible for designing, building, and scaling Generative AI (GenAI)-powered products and features that deliver tangible business value
- We’ll look to you to bridge product thinking and engineering execution, translating user needs into robust, production-ready AI solutions while driving innovation in the application of GenAI capabilities
- This is an opportunity to design and deliver production-grade GenAI solutions, including AI agents, conversational AI, and automation, with a focus on scalability, reliability, and performance
- We're offering this role at vice president level
What you'll do
As a Gen AI Product Engineer, you'll design, build, and deploy production-grade GenAI products and systems that turn user and business needs into secure, scalable, and reliable solutions. You'll also translate product and user requirements into scalable technical solutions, balancing model quality, latency, system complexity, and long-term maintainability, while building and integrating large language model (LLM) capabilities using modern frameworks and application programming interfaces (APIs).
This will include working across orchestration layers, retrieval pipelines, system integrations, prompt and context engineering, and model evaluation.
You'll also be:
- Converting ambiguous product requirements and research concepts into robust technical architectures, balancing model capability, latency, cost, complexity, and maintainability
- Ensuring all GenAI solutions meet enterprise security, governance, responsible AI, and risk management standards, with appropriate controls, escalation, and mitigation built into delivery
- Developing and operating LLM solutions, including Retrieval-Augmented Generation (RAG) pipelines, agent workflows, orchestration, prompt and content engineering, and model integration patterns
- Integrating GenAI capabilities into existing platforms through internal APIs, services, event flows, and data pipelines, ensuring resilience, observability, and maintainability in production environments
- Defining and applying approaches to model evaluation, benchmarking, monitoring, and continuous optimisation to improve quality, accuracy, reliability, and user outcomes
- Identifying and managing real-world AI system failure modes, including hallucinations, retrieval failures, tool-call errors, degraded model performance, and unsafe or non-compliant outputs
- Supporting production operations, including service monitoring, incident response, root-cause analysis, and on-call responsibilities where required for business-critical GenAI systems
The skills you'll need
We're looking for someone with proven experience designing, building, and operating production-grade GenAI software systems, with strong capabilities in Python, front-end design frameworks, distributed systems, API design, cloud-native engineering, observability, and performance-critical workloads. You should also bring experience translating ambiguous research concepts, emerging AI capabilities, user needs, and product requirements into secure, scalable, and maintainable production systems within fast-moving product or research-led environments.
To succeed in this role, you'll need experience delivering GenAI or LLM-powered products beyond the prototype stage, including self-hosted model inference with frameworks such as vLLM, OpenAI-compatible serving patterns, orchestration layers, software development kit integration, and production systems. You must also bring a practical understanding of LLM application architecture, including prompt and context engineering, embeddings, vector search, RAG pipelines, agent workflows, tool-calling patterns, memory and context management, and the mitigation of real-world AI system failure modes.
You'll also demonstrate:
- An understanding of model training, fine-tuning, adaptation, inference, and serving pipelines, including trade-offs in model selection, performance, cost, reliability, scalability, and operational complexity
- Experience evaluating, monitoring, and optimising AI systems, with working knowledge of responsible AI, model risk, security, governance, and operational controls in enterprise or regulated environments
- Hands-on experience deploying small language models for latency-, cost-, privacy-, or domain-specific use cases
Hours
45Job Posting Closing Date:
24/11/2026How well do you match this job?
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.