Replace (or enhance) MultimodalWebSurfer with Hyperbrowser

[MrMarsMic]

While I am amazed by the potential of the AssistantAgent and the teams (especially SelectorGroupChat), I find that MultimodalWebSurfer has several weaknesses (even on elementary operations such as selecting an item within a dropdown list).

Since I am very little experienced in programming, I was wondering how complicated it would be to integrate Autogen (or enhance MultimodalWebSurfer) with Hyperbrowser.

Can anyone give me some suggestions about the real feasibility (maybe Autogen and Hyperbrowser are not compatible at all) and possibly some tips on how to proceed with the implementation?

Thanks in advance.

[SongChiYoung]

We offer two supported solutions for integration:

1. Using Tools
2. Using MCP (Model Context Protocol)

Both approaches are fully supported by Hyperbrowser.
📄 [Documentation Reference – Model Context Protocol]

Which Should You Use?

• ✅ If you are an experienced user of both AutoGen and Hyperbrowser:
  → Use Tools – it offers greater flexibility and control for advanced setups. However, since Hyperbrowser may not support AutoGen-style tools directly, some editing might be required, though it’s generally straightforward.

• ✅ For general or new users:
  → Use MCP – it's simpler, more standardized, and ideal for quick adoption.

[MrMarsMic]

Hi @SongChiYoung, thanks for your reply.
I checked your link and I have a couple of questions:

1. It looks like that Python is not supported, correct?
2. Am I wrong, or the capabilities are limited to web scraping, structured data extraction, and web crawling? My need is to have active browsing (e.g. filling forms, selecting items from dropdown lists, moving back and forth on pages, etc)

Thanks!

[SongChiYoung]

Hi @MrMarsMic,

1. Regarding Python support – I looked at this page, and it seems that Python is supported, at least for basic integration. However, I’m not an expert in Hyperbrowser myself, so I recommend checking the exact capabilities and SDK details in their docs.
2. I didn’t see those features at Hyperbrowser’s docs myself — but you might be right.
   If what you mean is something like “browser use” (like interacting with dropdowns or filling forms), it might be possible via MCP.
   If you share more details about what you’re trying to do, I’d be glad to look into it more with you.

[MrMarsMic]

Hi @SongChiYoung,

1. I know that there is an Python SDK for Hyperbrowser but I don't know exactly how to implement for my purpose that is...
2. (as per the initial message that originated this thread) replacing in full MultiModalWebSurfer, meaning that I want to still use Autogen/Agentchat but for operations in the websites instead using MultimodalWebSurfer, I want to use Hyperbrowser

Prompt / use case example: "find the direct flights available tomorrow from Los Angeles to New York of American Airlines and United, sort from the cheapest to the most expensive and provide me the results".
As a following prompt: "login to the airline site with username xxx and password yyy, then book the flight"