Commit 0e082b2
committed
feat(pixel-interaction): phase 1 - add mode enum and config support
Add BrowserInteractionMode enum and interaction_mode configuration
to support pixel-based browser interaction for vision models.
This is Phase 1 (Foundation) of pixel interaction mode implementation.
Phase 2 will add the ToolGenerator and integration.
Changes:
- Add BrowserInteractionMode enum (DEFAULT, FULL_VISION, PIXEL_INTERACTION)
- Update BrowserConfig to include interaction_mode field with DEFAULT value
- Add interactionMode parameter handling in ConfigLoader.from_kwargs()
- Supports both string and enum values for interaction_mode parameter
- Includes validation with helpful error messages
Related issue: #36801 parent 1aac8be commit 0e082b2
File tree
2 files changed
+38
-0
lines changed- camel
- toolkits/hybrid_browser_toolkit
- types
2 files changed
+38
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
14 | 14 | | |
15 | 15 | | |
16 | 16 | | |
| 17 | + | |
| 18 | + | |
17 | 19 | | |
18 | 20 | | |
19 | 21 | | |
| |||
48 | 50 | | |
49 | 51 | | |
50 | 52 | | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
51 | 56 | | |
52 | 57 | | |
53 | 58 | | |
| |||
125 | 130 | | |
126 | 131 | | |
127 | 132 | | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
128 | 145 | | |
129 | 146 | | |
130 | 147 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2070 | 2070 | | |
2071 | 2071 | | |
2072 | 2072 | | |
| 2073 | + | |
| 2074 | + | |
| 2075 | + | |
| 2076 | + | |
| 2077 | + | |
| 2078 | + | |
| 2079 | + | |
| 2080 | + | |
| 2081 | + | |
| 2082 | + | |
| 2083 | + | |
| 2084 | + | |
| 2085 | + | |
| 2086 | + | |
| 2087 | + | |
| 2088 | + | |
| 2089 | + | |
| 2090 | + | |
| 2091 | + | |
| 2092 | + | |
| 2093 | + | |
0 commit comments