ModelsDocsBlogEnterpriseLM LinkNew

Login or Signup

Models

Developer Docs

LM Link

Careers

Blog

Changelog

Enterprise Solutions

Privacy Policy

Terms of Use

👾 Element Labs, Inc. © 2026

LinkedIn GitHub Discord Twitter / X

Product

Download the app Models LM LinkNew LM Studio Hub Beta Releases Changelog

Developer

Developer Docs lmstudio-js lmstudio-python LM Studio CLI (lms)llms.txt llms-full.txt

Company

CareersWe're Hiring!

Enterprise Solutions

Legal

bakit/crawler • LM Studio Hub

crawler

Public

crawler
/
src
/
services

Project Files

src

search

providers

DuckDuckGoProvider.ts

SearchProvider.ts

services

crawlPage.ts

retryFetch.ts

structuredExtraction.ts

tools

crawlSpecificPage.ts

index.ts

searchWeb.ts

tools.ts

utils

blockedExtensions.ts

constants.ts

domainFilter.ts

relevance.ts

url.ts

userAgents.ts

index.ts

.gitignore

LICENSE

manifest.json

package-lock.json

package.json

README.md

tsconfig.json

src / services /

...

crawlPage.ts

4 KB

retryFetch.ts

6 KB

structuredExtraction.ts

6 KB