vs-crawler
volcengine/SearchCLISkill
Crawl websites (news, blogs, papers, GitHub, product docs, RSS feeds) into a fixed-schema JSONL file, then create a dataset and a searchable application in Viking AI Search. Supports one-time crawl and scheduled recurring crawl with automatic incremental sync.
Why this score
This repo hosts 10 skills, so its 1,189 stars are split between them (about 119 each) for scoring.
Popularity score: 68/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 21, 2026 at commit cba429a719e3, with Cisco's open-source skill-scanner.
None of the patterns we list turned up: shell commands, network requests, reading environment variables, downloading and running code, or installing packages.
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Other makers' add-ons that do the same job, next to this one.
| Name | Score | Stars | Context | Updated |
|---|---|---|---|---|
| This onevs-crawler volcengine/SearchCLI · Skill | 68 | ★ 1.2k | ≈68 always | 19d ago |
| node-crawler bda-research/node-crawler · Skill Both about crawler | 80 | ★ 6.8k | ≈22 always | 5mo ago |
| geo-crawlers zubair-trabzada/geo-seo-claude · Skill Both about crawler | 81 | ★ 11k | ≈65 always | 16d ago |
| paper-crawler andrehuang/academic-writing-agents · Subagent Both about crawler and paper | 51 | ★ 220 | ≈26 in chat | 6mo ago |
| archive-crawler garrytan/gbrain · Skill Both about crawler | 85 | ★ 31k | ≈79 always | 16d ago |
| seo-ai-crawlers Hainrixz/claude-seo-ai · Skill Both about crawler and vs | 53 | ★ 77 | ≈133 always | 2mo ago |