Skip to content

Commit 6435448

Browse files
authored
Update Documentation (#2)
Update Documentation
1 parent e2856ef commit 6435448

File tree

7 files changed

+96
-37
lines changed

7 files changed

+96
-37
lines changed

README.md

Lines changed: 26 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,23 @@
1-
# Chrome DevTools frontend with Agentic Framework (Browser Operator)
1+
# Browser Operator [Chrome DevTools with Agentic Framework]
22

33
This version provides an user interface to run multi-agent workflows directly on the browser using a stateful, orchestration framework.
44

5-
### Demos
5+
## Key Capabilities
6+
7+
* Built in Agent Framework for running tasks / workflows.
8+
* Ability to perform actions such as: Navigate URLs, Perform Actions (Clicks, Fill Form, Scroll).
9+
* Access to rendered web page with ability to summarize content.
10+
* Integrates with LLM Models (OpenAI GPT-4.1 and O4-Mini Models).
11+
* Customize workflows or agent behavior with config changes.
12+
13+
![Architecture Flow](front_end/panels/ai_chat/docs/ArchitectureFlow.png)
14+
15+
## Demos
616

717
Watch Browser Operator in action with our demo videos:
818

919
#### Overview Demo
1020
See how Browser Operator transforms your browser into an intelligent agentic platform.
11-
[Watch Demo](https://player.vimeo.com/video/1081705645)
1221

1322
https://github.com/user-attachments/assets/d6ffc034-ca38-4afa-861e-c65b3ec79906
1423

@@ -44,26 +53,30 @@ https://github.com/user-attachments/assets/90150f0e-e8c8-4b53-b6a6-c739f143f4a0
4453

4554
### Steps to run project
4655

47-
1. Follow this instructions to [set up](chromium.googlesource.com) devtools
48-
2. Update the code to this fork implementation
49-
3. Use this to run the [code](https://github.com/tysonthomas9/browser-operator-devtools-frontend/blob/main/front_end/panels/ai_chat/Readme.md)
56+
[Download the pre-built Chromium Browser for MacOS](front_end/panels/ai_chat/docs/PreBuilt.md)
57+
58+
Or
5059

51-
### Source code and documentation
60+
[Set up the dev tools on your system](front_end/panels/ai_chat/Readme.md)
5261

53-
The frontend is available on [chromium.googlesource.com]. Check out the [Chromium DevTools
54-
documentation] for instructions to [set up], use, and maintain a DevTools front-end checkout,
55-
as well as design guidelines, and architectural documentation.
5662

57-
#### Agentic Framework Documentation
63+
### DevTools Documentation
64+
65+
- [Agentic Framework Documentation](front_end/panels/ai_chat/Readme.md)
66+
- [Chromium Devtools Original Documentation](https://chromium.googlesource.com/devtools/devtools-frontend/+/main/docs/README.md)
67+
68+
### Agentic Framework Documentation
5869

5970
* [`front_end/panels/ai_chat/core/Readme.md`](front_end/panels/ai_chat/core/Readme.md): Explains how to customize the `BaseOrchestratorAgent` to add new top-level agent types and UI buttons, and details its graph-based workflow.
6071
* [`front_end/panels/ai_chat/agent_framework/Readme.md`](front_end/panels/ai_chat/agent_framework/Readme.md): Describes the AI Agent Framework, its core components (`ConfigurableAgentTool`, `AgentRunner`, `ToolRegistry`), and how to create, configure, and register new custom agents, including agent handoff mechanisms.
6172

62-
#### General DevTools Documentation
73+
### Contributing
6374

64-
- DevTools user documentation: [devtools.chrome.com](https://devtools.chrome.com)
75+
Found a bug 🐛 or have a feature idea ✨? Please create issues [here](https://github.com/tysonthomas9/browser-operator-devtools-frontend/issues)
6576

6677
### Join Us
6778

79+
If you like this project, don't hesitate to ⭐ star this repository. For those who'd like to contribute code or just hang out with the community please join our Discord.
80+
6881
[![Discord](https://img.shields.io/badge/Discord-5865F2?style=for-the-badge&logo=discord&logoColor=white)](https://discord.gg/JKYuuubr)
6982
[![X (Twitter)](https://img.shields.io/badge/X_(Twitter)-000000?style=for-the-badge&logo=x&logoColor=white)](https://x.com/BrowserOperator)

front_end/panels/ai_chat/Readme.md

Lines changed: 41 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,47 @@
22

33
This panel is a Multi-Agent Framework that allows a user to connect an existing LLM with the chromium browser.
44

5+
### Steps to run project
6+
7+
1. Setup the depot_tools to fetch the chromium dev tools using the instructions provided [here](https://www.chromium.org/developers/how-tos/get-the-code/)
8+
```sh
9+
git clone https://chromium.googlesource.com/chromium/tools/depot_tools.git
10+
export PATH="$PATH:/path/to/depot_tools"
11+
```
12+
2. Follow this instructions to [set up](https://chromium.googlesource.com/devtools/devtools-frontend/+/main/docs/get_the_code.md) dev tools
13+
14+
```sh
15+
# fetching code
16+
mkdir devtools
17+
cd devtools
18+
fetch devtools-frontend
19+
20+
# Build steps
21+
cd devtools-frontend
22+
gclient sync
23+
npm run build
24+
```
25+
26+
3. Update the code to this fork implementation
27+
```sh
28+
git remote add upstream git@github.com:tysonthomas9/browser-operator-devtools-frontend.git
29+
git checkout upstream/main
30+
```
31+
32+
4. Use this to run the [code](https://github.com/tysonthomas9/browser-operator-devtools-frontend/blob/main/front_end/panels/ai_chat/Readme.md)
33+
```sh
34+
npm run build
35+
python -m http.server
36+
```
37+
38+
5. Run Chrome or Chromium Browser instance
39+
```sh
40+
<path-to-devtools-frontend>/third_party/chrome/chrome-<platform>/chrome --disable-infobars --custom-devtools-frontend=http://localhost:8000/
41+
42+
# MacOS Example
43+
/Applications/Google\ Chrome\ Canary.app/Contents/MacOS/Google\ Chrome\ Canary --custom-devtools-frontend=http://localhost:8000/
44+
```
45+
546
### Setup and Development
647

748
1. Build the project and use watch mode
@@ -32,29 +73,5 @@ The AI Chat Panel uses the multi-agent framework with the following components:
3273
2. **Tools**: Provides capabilities for DOM inspection, network analysis, and code execution
3374
3. **Workflow**: Defines the agent's reasoning process and decision-making flow
3475

35-
### Implementation Details
36-
37-
The agent implementation is located in `front_end/panels/ai_chat/agent/` and consists of:
38-
39-
- `AgentService.ts`: Main service that interfaces between UI and Graph Workflow
40-
- `State.ts`: Defines the agent's state schema
41-
- `Tools.ts`: Implements DevTools-specific tools
42-
- `Graph.ts`: Defines the agent's workflow and decision-making process
43-
44-
### Usage Example
45-
46-
```typescript
47-
import { AgentService } from './agent/AgentService.js';
48-
49-
// Initialize the agent service
50-
const agentService = new AgentService();
51-
52-
// Send a message to the agent
53-
async function sendMessage(text: string) {
54-
const response = await agentService.sendMessage(text);
55-
// Update UI with response
56-
}
57-
```
58-
5976
## Reference
6077
https://chromium.googlesource.com/devtools/devtools-frontend/+/main/docs/get_the_code.md#Standalone-checkout-Checking-out-source

front_end/panels/ai_chat/docs/1.png

71.4 KB
Loading

front_end/panels/ai_chat/docs/2.png

116 KB
Loading

front_end/panels/ai_chat/docs/3.png

508 KB
Loading
Loading
Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
## Custom Chromium Build for macOS M-Series
2+
3+
### Introduction
4+
This document guides you through installing a special version of the Chromium browser. This build includes experimental features, such as AI capabilities, that are currently under development.
5+
6+
**Warning:** This build includes experimental AI features. Using these features may involve sending data to external services for processing. For your privacy and security, please avoid entering sensitive personal or work information while using this build.
7+
8+
### Download
9+
Please download the latest macOS build from the [releases page](https://github.com/tysonthomas9/browser-operator-devtools-frontend/releases).
10+
11+
### Updates
12+
**Note:** This build does not include the standard Chromium auto-update feature. If you plan to use it regularly, please check the releases page weekly for the latest version. We are working on adding an official auto-update capability in the future.
13+
14+
### Installation Security Workaround
15+
Because this build is not yet officially verified by Apple, macOS security settings will initially block the installation. Please follow these steps to allow the installation:
16+
17+
1. Attempt to open the downloaded Chromium application file. You will likely see a warning message.
18+
![Warning Message](1.png)
19+
2. Open **System Settings** on your Mac and navigate to **Privacy & Security**.
20+
![Settings](2.png)
21+
3. Look for a message in the **Privacy & Security** settings window (usually near the bottom) mentioning that "Chromium" was blocked. Click the **"Open Anyway"** or **"Allow"** button next to this message.
22+
![Privacy](3.png)
23+
4. You may need to confirm your intent again. After allowing it, try opening the Chromium application file again to proceed with the installation or first run.
24+
25+
### Using AI Features
26+
This build contains experimental AI agents. To enable and use these features, you will need an API key from OpenAI. If you do not have one or are unfamiliar with OpenAI API keys, you can learn more and obtain one from the [OpenAI website](https://openai.com/). You will be prompted to enter this key within the browser's AI panel when you first try to use an AI feature.
27+
28+
Note: We plan to support additional operating systems such as linux and windows soon.
29+

0 commit comments

Comments
 (0)