Wiki

Copilot Studio Governance and Agent Security Playbook

Five-phase lifecycle governance for Microsoft 365 agents: discovery, architecture, build, testing/deployment, and monitoring. Covers DLP policies, RBAC, MFA, sensitivity labels, and audit logging.

Summary

This playbook consolidates Microsoft’s two complementary guides for securing Copilot Studio agents and the Microsoft 365 agent ecosystem — the Copilot Studio Governance & Security Guide and the Agent Security Playbook — into a single five-phase lifecycle. It covers everything an administrator or COE lead needs to govern, secure, and monitor agents from initial planning through ongoing operations.

The five phases align with the Microsoft 365 agent governance zones:

PhaseGovernance ZoneFocus
1. Discovery & PlanningZone 1 — Personal productivityInitial governance, stakeholder alignment, licensing, data classification
2. Architecture & DesignZone 1Environment strategy, security controls, RBAC, DLP, network security
3. Build & IntegrationZone 1–2Solution development, connector validation, managed environments
4. Testing & DeploymentZone 2Automated testing, CI/CD, production rollout, monitoring setup
5. Monitoring & OptimizationZone 3Analytics, alerts, compliance auditing, continuous improvement

Phase 1: Discovery and Planning

Initial Governance Requirements

  • Stakeholder alignment: Involve IT, Security, Compliance, and Legal from the outset. Document data residency, retention, and privacy policies that will guide configuration decisions.
  • Compliance review: Outline applicable regulations (GDPR, HIPAA, etc.) and document your organization’s data and transcript retention requirements.

Key Objectives and Data Protection

  • Business alignment: Determine the target business scenarios and required system/data integrations; identify risks and implement security measures accordingly.
  • Restrict data sources: Document existing knowledge sources (SharePoint, Teams, Dataverse) and decide whether agents may use their own general AI knowledge.
  • Data protection & risk assessment: Classify data source sensitivity (general, confidential, etc.), evaluate leakage risks, and establish policies (e.g., blocking connectors), including data masking rules.

Naming and Guidelines

  • Adopt agent naming conventions (e.g., Contoso-CustomerServiceAgent).
  • Use consistent solution naming (e.g., ContosoCopilot) for ALM pipelines.
  • Document conversation disclaimers/warnings templates for each agent.
  • Identify mandatory shared components (knowledge sources, Topics) across agents.

Licensing and Budget

  • Assess M365, Power Platform, Dynamics 365, and Copilot license entitlements; determine additional licenses for premium features (enhanced search, managed environments).
  • Estimate costs for Gen AI and premium features (premium connectors, managed environments); choose a billing model (pay-as-you-go vs. capacity licensing).
  • Allocate message capacity per environment via “add-ons.”

Phase 2: Architecture and Design

Environment Strategy

  • Provide each Copilot maker their own Development environment with environment routing enabled.
  • Implement a healthy ALM process: build deployment pipelines for versioning and automation using in-product pipelines or Azure DevOps/GitHub.

Security and Access Controls

  • Secure the tenant: Enable Lockbox, Dataverse audit, IP firewall, and IP cookie binding.
  • Network security: Use Azure Private Link, firewalls, or service endpoints to minimize public exposure of agent endpoints.
  • Conditional Access: Apply Azure AD Conditional Access for corporate devices and networks.
  • Authentication model: Decide between Entra ID, manual auth, or no-auth; restrict Web Channel access as needed.
  • Restrict authoring access: Limit Copilot Studio authoring to specific security groups.
  • Geographic data residency: Evaluate data residency against compliance requirements.
  • Role-Based Access Control (RBAC): Use Power Platform RBAC and security groups to assign admin/maker/user roles.
  • MFA & identity: Enable MFA for all Power Platform and Copilot users via Microsoft Entra ID.
  • Least privilege: Restrict agent data source permissions; use service principal accounts for production deployment.

Governance and DLP Considerations

  • DLP policies: Establish environment- or tenant-level rules to restrict unused first-party (1P) and third-party (3P) connectors (business vs. non-business).
  • Shared connections: Decide whether agents run in user context or a dedicated service account.
  • Channel control: Enforce publishing channel restrictions (Direct Line, Teams, M365, Facebook, Omni).
  • Generative AI features: Choose orchestration type (classic vs. generative), agent triggers (autonomous vs. conversational), and the NLU model (default vs. custom CLU).

Phase 3: Build and Integration

Solution and Agent Development

  • Include required disclaimers, multi-language support, and organizational components.
  • Implement custom instructions/prompts following internal governance (e.g., “don’t include competitor information”, “friendly tone”).

Configuration and Connection Management

  • Validate connectors against DLP rules across Dev, Test, and Production environments.
  • Managed Environments & Environment Groups: Configure policies for all environments; refine tenant-wide DLP policies; determine if specific policies are needed to block connectors and prevent data exfiltration.
  • Agent-level settings: Define orchestration model, channels, and language settings.
  • Errors and warnings: Pay attention to security alerts; use the topic checker to monitor for warnings before publishing.

Phase 4: Testing, Deployment, and Launch

Testing and Validation

  • Use-case testing: Leverage the Power CAT Copilot Studio kit for automated scenario testing (security, data integrity).
  • CI/CD: Test deployment pipelines with Azure DevOps or GitHub for version control.

Final Security and Compliance Checks

  • DLP & RBAC validation: Confirm policies, roles, and connections in production match expectations.
  • Azure review: Approve app registrations, VNets, keys, and endpoints.
  • Production knowledge sources: Ensure all production SharePoint libraries and documents are correctly referenced.

Production Rollout

  • Deploy via the ALM pipeline, ensuring all dependencies are configured.
  • Launch communication: Announce agent availability, usage disclaimers, and training for internal stakeholders.

Enable Monitoring and Governance

  • Telemetry: Integrate Azure Application Insights for usage, performance, and error logging; use AKV for key rotation.
  • CoE Starter Kit: Implement for organization-wide agent monitoring.

Compliance and Auditing

  • Content moderation: Track blocked queries for Responsible AI initiatives in the Power Platform Admin Center.
  • Tenant/environment/agent security: Use the Power Platform admin security page for unified oversight.

Phase 5: Monitoring and Optimization

Analytics and Reporting

  • Use Copilot Studio’s built-in analytics dashboard for usage and KPI tracking.
  • Leverage Power BI and Application Insights for custom analytics.

Alerts and Incident Response

  • Configure Microsoft Sentinel to ingest audit logs from Microsoft Purview (requires assigned Microsoft 365 licenses per user).
  • Create custom detection rules in Sentinel for Copilot Studio events.
  • Use the PPAC Action Center (Advisor) and Copilot center for recommendations and alerts.

Continuous Improvement

  • User feedback: Gather input via Teams channels and surveys to refine flows and policies.
  • Feature updates: Pilot new Copilot features in test environments before wider release.
  • Governance reviews: Reassess environment configs, DLP settings, and compliance at least quarterly.
  • Capacity management: Monitor message usage and dependencies in Power Platform Admin Center to prevent overages and throttling.

Key Control Reference Tables

Tenant-Level Settings

SettingPurposeLocationPrivilege
Trial License ControlBlock free trial sign-ups without admin permissionAzure PowerShellAzure PowerShell Admin
Control agents with AI FeaturesBlock generative AI usage in Copilot agentsPPAC→SettingsPower Platform Admin
Copilot Studio Authors ControlRestrict Copilot Studio to a security groupPPAC→SettingsPower Platform Admin
Set Up Environment RoutingRoute makers to specific environment groupsPPAC→SettingsPower Platform Admin
AI Builder Credits ControlDecide if tenant AI credits can be used by envsPPAC→SettingsPower Platform Admin
Copilot Data CollectionEnable or block sharing prompts with MicrosoftPPAC→SettingsPower Platform Admin
Copilot Feedback ControlEnable or block feedback to MicrosoftPPAC→SettingsPower Platform Admin

Environment-Level Settings (via DLP or Capacity)

SettingPurposeLocationPrivilege
Message CapacityAllocate Copilot message capacity per environmentPPAC→CapacityPower Platform Admin
Telemetry/AppInsights ControlBlock agents from connecting to Application InsightsPPAC→DLP PoliciesPower Platform Admin
Authentication ControlDisable “No-Auth” and “Generic OAuth” as auth providersPPAC→DLP PoliciesPower Platform Admin
Channel ControlBlock channels (Direct Line)PPAC→DLP PoliciesPower Platform Admin
Knowledge Source ControlBlock SharePoint, OneDrive, documents, public websites as knowledge sourcesPPAC→DLP PoliciesPower Platform Admin
Skills ControlBlock Copilot makers from using SkillsPPAC→DLP PoliciesPower Platform Admin
HTTP Requests ControlPrevent HTTP requests to reduce data exfiltration riskPPAC→DLP PoliciesPower Platform Admin
Event Triggers ControlBlock autonomous/event-driven agent triggersPPAC→DLP PoliciesPower Platform Admin

Agent-Level Settings (within Copilot Studio)

SettingPurposeLocationPrivilege
Agent AuthenticationConfigure (No Auth, Entra ID, Certificates)Copilot Studio→Agent→Settings→Security→AuthAgent Author
Agent Web Channel SecurityManage secrets/tokens for Direct Line web channelCopilot Studio→Agent→Settings→Security→AuthAgent Author

Sources