AI Agent Deployment- QA Engineer

About The Role

Location : Electronic city, Bangalore

We operate a growing portfolio of purpose-built AI agents serving engineering, commercial, and operational teams in Asia Pacific — spanning various industries. As our AI Agent Deployment & QA Engineer, you will be the operational backbone of our Agent Factory: deploying, testing, maintaining, and scaling agents across the business. No domain expertise required — what matters is fluency in enterprise AI agent platforms, structured QA thinking, and the ability to keep agents accurate and continuously improving.

Key Responsibilities

Deploy and configure AI agents on enterprise platforms (e.g. Microsoft Copilot Studio, Azure AI Foundry, or equivalent) — system instructions, knowledge base (KB) files, topic flows, connectors, and multi-agent orchestration
Manage KB file architecture, versioned updates, licensing, and environment provisioning
Design and execute structured test plans covering prompt coverage, edge cases, hallucination checks, and retrieval accuracy; maintain QA logs and run regression testing after every update
Collect and triage user feedback; translate into change requests and coordinate KB updates with domain knowledge owners
Maintain the agent registry (version history, owner, deployment status, KB sources) and support governance standards
Drive rollout of agents to new users, teams, and geographies; produce onboarding documentation and user guides

Required Qualifications

5–10 years in software/platform deployment, technical operations, or QA roles
Hands-on experience with one or more enterprise AI agent platforms (e.g. Microsoft Copilot Studio, Azure AI Foundry, AWS Bedrock Agents, or equivalent) — mandatory
Cloud platform administration knowledge (Microsoft 365 / Azure or equivalent); identity and access management
Familiarity with prompt engineering and LLM behaviour (grounding, retrieval, hallucination)
Basic REST API / JSON integration exposure; version control awareness
Detail-oriented, self-directed, and comfortable working with non-technical domain experts across time zones

Preferred

Microsoft certifications (PL-100, PL-200, PL-600, AI-102) or equivalent cloud AI credentials
Familiarity with Azure AI services (Azure OpenAI, AI Search) or equivalent
Background in system integration, technology consulting, or industrial sectors (Oil & Gas, Marine, Energy, Data Centres)

Why Join Us

Work on production-grade industrial AI — real deployments, not pilots
Build deep expertise across enterprise agent platforms in a structured, multi-vertical programme
Be part of a team designing what AI-native industrial services look like at scale

Who is Siemens Energy?

At Siemens Energy, we are more than just an energy technology company. With ~100,000 dedicated employees in more than 90 countries, we develop the energy systems of the future, ensuring that the growing energy demand of the global community is met reliably and sustainably. The technologies created in our research departments and factories drive the energy transition and provide the base for one sixth of the world's electricity generation.
Show more Show less