Headful Debugging (VNC)
figranium includes powerful Headful Debugging capabilities that allow you to see and interact with the automation as it runs. This is powered by a ...
Why Headful?#
- Debugging: Step through tasks visually to identify why a selector fails.
- Manual Intervention: Solve CAPTCHAs or complete complex 2FA flows that automation cannot handle.
- Exploration: Browse sites naturally to discover selectors and API endpoints.
- Recording: Create high-fidelity video demonstrations of your automation.
Starting a Headful Session#
- Editor: Open a task in the editor.
- Run: Click Open Browser in the editor panel to log in or debug visually.
The browser window will open inside the VNC viewer embedded in the UI.
Controls#
The VNC interface provides a standard desktop environment:
- Mouse/Keyboard: Full interaction support.
- Clipboard: Copy/paste text between your host and the remote browser.
- Resolution: The viewport resizes dynamically (default 1920x1080).
Persistence#
Headful sessions share the same Cookie Jar (storage_state.json) as automated tasks. This means:
- Login once: Log in manually in the headful session.
- Automate: Run an Agent task that reuses the session cookies.
Stateless Option: Enable statelessExecution to launch a clean, incognito-like session that won't save cookies.
API Integration#
You can start a headful session programmatically:
curl -X POST http://localhost:11345/api/tasks/headful \
-H "Content-Type: application/json" \
-d '{"url": "https://example.com"}'
The response includes the VNC connection URL.
Stopping#
Click Close Browser in the Editor to terminate the session and close the browser. This ensures resources are freed.