vxcontrol/pentagi
1
0
Fork 0
mirror of https://github.com/vxcontrol/pentagi.git synced 2026-07-21 08:15:23 -04:00
Code Issues 45 Packages Projects Releases 9 Wiki Activity

[GH-ISSUE #80] [Bug]: browser tool always fails with unsupported protocol scheme #48

New Issue
Closed
opened 2026-06-06 22:08:46 -04:00 by yindo · 2 comments
yindo commented 2026-06-06 22:08:46 -04:00
Owner
Copy Link
Copy Source

Originally created by @schniggie on GitHub (Nov 2, 2025).
Original GitHub issue: https://github.com/vxcontrol/pentagi/issues/80

Originally assigned to: @asdek on GitHub.

Affected Component

Security Tools Integration

Describe the bug

Everytime the browser tool is used, I see the following kind of errors. Using OpenAI with default mode config.

pentagi     | 2025/11/02 19:54:36 Trying to get content from https://crt.sh/?q=%25.be-a-hacker.cf
pentagi     | time="2025-11-02T19:54:36Z" level=error msg="browser tool failed" error="failed to fetch content by url 'https://crt.sh/?q=%25.be-a-hacker.cf': failed to fetch data by scraper '/html?url=https%3A%2F%2Fcrt.sh%2F%3Fq%3D%2525.be-a-hacker.cf': Get \"/html?url=https%3A%2F%2Fcrt.sh%2F%3Fq%3D%2525.be-a-hacker.cf\": unsupported protocol scheme \"\"" result= screen= tool=browser url="https://crt.sh/?q=%25.be-a-hacker.cf"

Steps to Reproduce

Start any task where web browsing in involved.

System Configuration

Docker Image: vxcontrol/pentagi,latest,007492e4c5bf

Logs and Artifacts

No response

Screenshots or Recordings

No response

Verification

  • I have checked that this issue hasn't been already reported
  • I have provided all relevant configuration files (with sensitive data removed)
  • I have included relevant logs and error messages
  • I am running the latest version of PentAGI
Originally created by @schniggie on GitHub (Nov 2, 2025). Original GitHub issue: https://github.com/vxcontrol/pentagi/issues/80 Originally assigned to: @asdek on GitHub. ### Affected Component Security Tools Integration ### Describe the bug Everytime the browser tool is used, I see the following kind of errors. Using OpenAI with default mode config. ``` pentagi | 2025/11/02 19:54:36 Trying to get content from https://crt.sh/?q=%25.be-a-hacker.cf pentagi | time="2025-11-02T19:54:36Z" level=error msg="browser tool failed" error="failed to fetch content by url 'https://crt.sh/?q=%25.be-a-hacker.cf': failed to fetch data by scraper '/html?url=https%3A%2F%2Fcrt.sh%2F%3Fq%3D%2525.be-a-hacker.cf': Get \"/html?url=https%3A%2F%2Fcrt.sh%2F%3Fq%3D%2525.be-a-hacker.cf\": unsupported protocol scheme \"\"" result= screen= tool=browser url="https://crt.sh/?q=%25.be-a-hacker.cf" ``` ### Steps to Reproduce Start any task where web browsing in involved. ### System Configuration Docker Image: vxcontrol/pentagi,latest,007492e4c5bf ### Logs and Artifacts _No response_ ### Screenshots or Recordings _No response_ ### Verification - [x] I have checked that this issue hasn't been already reported - [x] I have provided all relevant configuration files (with sensitive data removed) - [x] I have included relevant logs and error messages - [x] I am running the latest version of PentAGI
yindo added the bug label 2026-06-06 22:08:46 -04:00
yindo closed this issue 2026-06-06 22:08:46 -04:00
yindo commented 2026-06-06 22:08:47 -04:00
Author
Owner
Copy Link
Copy Source

@asdek commented on GitHub (Nov 2, 2025):

hello @schniggie

I checked this payload on my side and it works, please, check these env vars in your .env file SCRAPER_PUBLIC_URL and SCRAPER_PRIVATE_URL, at least SCRAPER_PRIVATE_URL should be valid URL to your scraper instance like from .env.example
SCRAPER_PRIVATE_URL=https://someuser:somepass@scraper/

Have you been using installer tool or did you configure .env file manually?

<!-- gh-comment-id:3478268353 --> @asdek commented on GitHub (Nov 2, 2025): hello @schniggie I checked this payload on my side and it works, please, check these env vars in your `.env` file `SCRAPER_PUBLIC_URL` and `SCRAPER_PRIVATE_URL`, at least `SCRAPER_PRIVATE_URL` should be valid URL to your scraper instance like from `.env.example` `SCRAPER_PRIVATE_URL=https://someuser:somepass@scraper/` Have you been using installer tool or did you configure `.env` file manually?
yindo commented 2026-06-06 22:08:47 -04:00
Author
Owner
Copy Link
Copy Source

@schniggie commented on GitHub (Nov 3, 2025):

@asdek again kudos to your fast response :)

For installation I just followed: https://pentagi.com/get-started and did the Quick Installation.
.env is as example with my OPEN_AI_KEY and PENTAGI_LISTEN_IP=0.0.0.0, scraper config in unchanged:

## Scraper URLs and settings
SCRAPER_PUBLIC_URL=
SCRAPER_PRIVATE_URL=https://someuser:somepass@scraper/
LOCAL_SCRAPER_USERNAME=someuser
LOCAL_SCRAPER_PASSWORD=somepass
LOCAL_SCRAPER_MAX_CONCURRENT_SESSIONS=10

All containers are fine:

 docker compose ps
NAME         IMAGE                                                   COMMAND                  SERVICE      CREATED        STATUS        PORTS
pentagi      vxcontrol/pentagi:latest                                "/opt/pentagi/bin/en…"   pentagi      14 hours ago   Up 14 hours   0.0.0.0:8443->8443/tcp
pgexporter   quay.io/prometheuscommunity/postgres-exporter:v0.16.0   "/bin/postgres_expor…"   pgexporter   17 hours ago   Up 14 hours   127.0.0.1:9187->9187/tcp
pgvector     vxcontrol/pgvector:latest                               "docker-entrypoint.s…"   pgvector     17 hours ago   Up 14 hours   127.0.0.1:5432->5432/tcp
scraper      vxcontrol/scraper:latest                                "sh -c '/usr/local/b…"   scraper      17 hours ago   Up 14 hours   3000/tcp, 127.0.0.1:9443->443/tcp

In regards to the scraper service, I see regularly in the log:

craper     | 2025-11-03T05:17:14.180Z browserless:server Health check stats: CPU 15%,15% MEM: 62%,61%
scraper     | 2025-11-03T05:17:14.180Z browserless:server Current period usage: {"date":1762146734280,"error":0,"rejected":0,"successful":0,"timedout":0,"totalTime":0,"maxTime":0,"minTime":0,"meanTime":0,"maxConcurrent":0,"units":0}

Never seen the scraper doing anything, alwasys stays at 0 for all values.

<!-- gh-comment-id:3478946447 --> @schniggie commented on GitHub (Nov 3, 2025): @asdek again kudos to your fast response :) For installation I just followed: https://pentagi.com/get-started and did the Quick Installation. .env is as example with my `OPEN_AI_KEY` and `PENTAGI_LISTEN_IP=0.0.0.0`, scraper config in unchanged: ``` ## Scraper URLs and settings SCRAPER_PUBLIC_URL= SCRAPER_PRIVATE_URL=https://someuser:somepass@scraper/ LOCAL_SCRAPER_USERNAME=someuser LOCAL_SCRAPER_PASSWORD=somepass LOCAL_SCRAPER_MAX_CONCURRENT_SESSIONS=10 ``` All containers are fine: ``` docker compose ps NAME IMAGE COMMAND SERVICE CREATED STATUS PORTS pentagi vxcontrol/pentagi:latest "/opt/pentagi/bin/en…" pentagi 14 hours ago Up 14 hours 0.0.0.0:8443->8443/tcp pgexporter quay.io/prometheuscommunity/postgres-exporter:v0.16.0 "/bin/postgres_expor…" pgexporter 17 hours ago Up 14 hours 127.0.0.1:9187->9187/tcp pgvector vxcontrol/pgvector:latest "docker-entrypoint.s…" pgvector 17 hours ago Up 14 hours 127.0.0.1:5432->5432/tcp scraper vxcontrol/scraper:latest "sh -c '/usr/local/b…" scraper 17 hours ago Up 14 hours 3000/tcp, 127.0.0.1:9443->443/tcp ``` In regards to the scraper service, I see regularly in the log: ``` craper | 2025-11-03T05:17:14.180Z browserless:server Health check stats: CPU 15%,15% MEM: 62%,61% scraper | 2025-11-03T05:17:14.180Z browserless:server Current period usage: {"date":1762146734280,"error":0,"rejected":0,"successful":0,"timedout":0,"totalTime":0,"maxTime":0,"minTime":0,"meanTime":0,"maxConcurrent":0,"units":0} ``` Never seen the scraper doing anything, alwasys stays at 0 for all values.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
enhancement
help wanted
pull-request
Mirrored from GitHub Pull Request
 question
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: vxcontrol/pentagi#48
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?