You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
|[Browser Automation Agent](https://aka.ms/browser-automation)| Kickstart browser automation scenarios with this Azure Playwright powered template | Microsoft | Single-agent | Agent AI Agent Service | Beginner | Playwright |
13
+
|[Browser Automation Agent](https://aka.ms/browser-automation)| Kickstart browser automation scenarios with this Playwright Workspace powered template | Microsoft | Single-agent | Agent AI Agent Service | Beginner | Playwright Workspaces|
14
14
|[AI Red Teaming Agent](https://aka.ms/ai-red-teaming)| Facilitates the development of a copilot to accelerate your AI red teaming process: through multi-agent system that automates the generation, transformation, and execution of harmful prompts against target generative AI models or applications for AI red teaming purposes. Useful for streamlining safety testing workflows, surfacing guardrail bypasses, and guiding risk mitigation planning. | Microsoft | Multi-agent | Semantic Kernel | Advanced | NA |
15
15
|[Saifr Communication Compliance Agent](https://aka.ms/saifr-communication-agent)| The Saifr Communication Compliance Agent identifies potentially noncompliant text and generates a more compliant, fair, and balanced version, helping end users better adhere to relevant regulatory guidelines | Saifr from Fidelity Labs | Single-agent | Agent AI Agent Service | Intermediate | OpenAPI Specified Tool |
16
16
|[Auquan Due Diligence Risk Analyst](https://aka.ms/due-diligence-risk-analyst-agent)| Helps create agents that assess risks across financial, operational, regulatory, and ESG domains | Auquan | Single-agent | Agent AI Agent Service | Intermediate | OpenAPI Specified Tool |
Copy file name to clipboardExpand all lines: samples/agent-catalog/msft-agent-samples/foundry-agent-service-sdk/browser-automation-agent/README.md
+14-11Lines changed: 14 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,6 +1,6 @@
1
1
# 🌐 Browser Automation Agent
2
2
3
-
This template helps build an agent that enables users to perform real-world browser tasks through natural language prompts. Powered by **Azure AI Agent Service** and **Azure Playwright Service**, it facilitates multi-turn conversations to automate browser-based workflows such as searching, navigating, filling forms, and booking.
3
+
This template helps build an agent that enables users to perform real-world browser tasks through natural language prompts. Powered by **Azure AI Agent Service** and **Playwright Workspaces**, it facilitates multi-turn conversations to automate browser-based workflows such as searching, navigating, filling forms, and booking.
4
4
5
5
**WARNING:** Browser automation comes with significant security risks. Both errors in judgment by the AI and the presence of malicious or confusing instructions on web pages which the AI encounters may cause it to execute commands you or others do not intend, which could compromise the security of your or other users’ browsers, computers, and any accounts to which the browser or AI has access, including personal information, financial, or enterprise systems. We recommend that any agent built using this Browser Automation Agent code sample be used only in isolated environments and only with controlled access, such as browsers running within dedicated VMs. By using the Browser Automation Agent sample, you are acknowledging that you bear responsibility and liability for any use of it and of any resulting agents you create with it, including with respect to any other users to whom you make it or resulting agents available.
6
6
@@ -13,7 +13,7 @@ Certain Agent offerings may be subject to legal and regulatory requirements, may
13
13
This agent demonstrates a browser automation experience where the user interacts with a website conversationally—like booking a class online. Here's how it works:
14
14
15
15
1.**User Prompt**: The user asks for available classes.
16
-
2.**Session Provisioning**: The request is received by Azure AI Agent Service, which provisions a private browser session using Azure Playwright Service.
16
+
2.**Session Provisioning**: The request is received by Azure AI Agent Service, which provisions a private browser session using Playwright Workspaces.
17
17
3.**Web Interaction**: The browser performs Playwright-driven actions to retrieve and display class options.
18
18
4.**Follow-Up Commands**: The user provides further input to complete the booking, all within the same multi-turn thread.
19
19
@@ -32,8 +32,8 @@ This agent demonstrates a browser automation experience where the user interacts
32
32
33
33
This agent leverages **Azure AI Agent Service** and uses:
34
34
35
-
-**Browser Automation Tool** (via Playwright): Executes browser-based tasks on your behalf, securely and asynchronously.
36
-
-**Azure Playwright Service**: Powers the browser session backend with serverless browser capabilities.
35
+
-**Browser Automation Tool** (via Playwright Workspaces): Executes browser-based tasks on your behalf, securely and asynchronously.
36
+
-**Playwright Workspaces**: Powers the browser session backend with serverless browser capabilities.
37
37
38
38
The agent is configured through a Python script (`browser_automation.py`) and authenticated using managed identity.
39
39
@@ -51,15 +51,18 @@ The agent is configured through a Python script (`browser_automation.py`) and au
51
51
- AI Services resource
52
52
- AI Project
53
53
- Model deployment
54
-
3. Playwright Resource setup:
55
-
- Create a Microsoft Playwright Resource: https://learn.microsoft.com/en-us/azure/playwright-testing/how-to-manage-playwright-workspace?tabs=playwright
56
-
- Generate an API Key for the Playwright resource: https://learn.microsoft.com/en-us/azure/playwright-testing/how-to-manage-access-tokens
54
+
3. Playwright Workspace Resource setup:
55
+
- Create a Playwright Workspace Resource: https://aka.ms/pww/docs/manage-workspaces
56
+
- Generate an Access Token for the Playwright Workspace resource: https://aka.ms/pww/docs/manage-access-tokens
57
57
- Access the Workspace region endpoint from the Workspace Details.
58
-
4. Create a serverless connection in the Azure AI Foundry project with the Playwright workspace region endpoint and the Playwright Access Key.
58
+
- Give the Project Identity a "Contributor" role on the Playwright Workspace resource, or configure a custom role by following these instructions: https://aka.ms/pww/docs/manage-workspace-access
59
+
4. Create a serverless connection in the Azure AI Foundry project with the Playwright workspace region endpoint and the Playwright Workspace Access Token.
59
60
- Go to the Azure AI Foundry portal and select your AI Project. Go to the Management center and Click connected resources.
60
61
- Create a new connection of type Serverless Model and enter the following information.
61
-
- Target URI - Playwright Workspace Region Endpoint (example - wss://eastus.api.playwright.microsoft.com/accounts/eastus_xxxxxxxxxxxxxxxxxxxxxxx/browsers).
62
-
- Key - Playwright Access Key
62
+
- Target URI - Playwright Workspace Region Endpoint (example - wss://{region}.api.playwright.microsoft.com/playwrightworkspaces/{workspaceId}/browsers).
63
+
- To understand more on how to get this value: https://aka.ms/pww/docs/configure-service-endpoint
64
+
- Key - Playwright Access Token
65
+
- To understand more on how to get this value: https://aka.ms/pww/docs/generate-access-token
63
66
- For more info to create a connection, see [Create a connection](https://learn.microsoft.com/azure/ai-foundry/how-to/connections-add)
64
67
5. Python 3.8+
65
68
6. Azure CLI
@@ -71,6 +74,6 @@ Set the following environment variables before running the sample:
Copy file name to clipboardExpand all lines: samples/agent-catalog/msft-agent-samples/foundry-agent-service-sdk/browser-automation-agent/browser_automation.py
- Creating a Microsoft Playwright Resource: https://learn.microsoft.com/en-us/azure/playwright-testing/how-to-manage-playwright-workspace?tabs=playwright
9
-
- Give the Project Identity a "Contributor" role on the Playwright resource.
10
-
- Generate an API Key for the Playwright resource: https://learn.microsoft.com/en-us/azure/playwright-testing/how-to-manage-access-tokens
11
-
- Create a serverless connection in the Azure AI Foundry project with the Playwright endpoint and Access Key.
8
+
- Creating a Playwright Workspace Resource: https://aka.ms/pww/docs/manage-workspaces
9
+
- Give the Project Identity a "Contributor" role on the Playwright Workspace resource, or configure a custom role by following these instructions: https://aka.ms/pww/docs/manage-workspace-access
10
+
- Generate an Access Token for the Playwright Workspace resource: https://aka.ms/pww/docs/generate-access-token
11
+
- Create a serverless connection in the Azure AI Foundry project with the Playwright Workspace Browser endpoint and Access Token.
0 commit comments