variablechange/visit-website-reworked • LM Studio Hub
Description
Reworded plugin with proxy functionality that provides LLMs with the capacity to "visit" websites by providing them with the links, image URLs and text content of any web page.
An upgraded website-reading plugin for LM Studio with stronger reliability on modern websites, better diagnostics, and graceful fallback behavior.
Tools
Visit Website: fetches and returns key page data (title, headings, links, images, text content).
Download Images: downloads remote image URLs (or extracts from a page) and makes them viewable in the chat.
What was problematic before
The previous implementation worked on simple pages, but had major issues on real-world websites:
Hard failures on many websites (403, 401, 429, 503) with no recovery path.
Frequent anti-bot/WAF blocks (Cloudflare-like pages) ended in immediate tool failure.
Weak network resilience (no retry logic for transient failures).
Low-visibility errors (Forbidden) with almost no context for debugging.
Poor behavior on JS-heavy / WAF-protected pages where HTML extraction was insufficient.
Image extraction often missed lazy-loaded attributes (data-src, srcset, etc.).
Fallback content via r.jina.ai could contain useful markdown image links, but those were not previously extracted as images.
Tool naming/semantics caused orchestration confusion in some model flows.
What is improved in this reworked version
Reliability and fallback
Added retry logic for direct page fetches.
Added automatic fallback via r.jina.ai when direct fetch is blocked or fails.
Added block/challenge detection for common anti-bot scenarios.
Added broader image extraction support:
Better observability
Visit Website now returns fetch metadata:
source (direct or jina)
Request quality tuning
Header strategy adjusted to reduce unnecessary bot-triggering patterns.
Keeps ranking/selection behavior, while making extraction resilient to modern page patterns.
Download Images behavior
Tool renamed from View Images to Download Images to better reflect function intent.
Intended usage is now explicit: remote HTTP(S) image URLs or websiteURL.
Supports normalization of image references (including markdown links and local paths) to reduce parser/tool-call failures in practical assistant workflows.
Use 0 to exclude a section, or -1 for auto defaults where supported. Don't forget to allow LLM to call the tool.
Usage
Ask the assistant to open a URL and extract page information.
For blocked pages, the plugin now attempts fallback automatically and reports fetch source.
Works great with Analyze Images and Duck-Duck-Go Reworked
LLM can use DuckDuckGo Reworked to find relevant URLs, then Visit Website to extract structured page content and images. Then view the content of the images via Analyze.
