Sponsored by

Find leads on Reddit on auto pilot

Agent skills
web-scraping

Topic: web-scraping

69 skills in this topic.

standards Quality standards and Phase 4 review/publish/verify for cli-web-* CLIs. Covers implementation review (3 parallel agents), the 75-check quality checklist, package publishing (pip install -e .), and end-user smoke testing (READ + WRITE). TRIGGER when: "validate CLI", "publish CLI", "review CLI", "pip install -e .", "smoke test", "quality check", "start Phase 4", "75-check", "generate Claude skill", "check if implementation is complete", "verify implementation quality", or after testing skill completes. DO NOT trigger for: traffic capture, implementation, or test writing.
ItamarZand88/CLI-Anything-WEB 137
capture Capture HTTP traffic from web apps using playwright-cli. Includes site fingerprinting (framework detection, protection checks, iframe detection, auth detection, API discovery) and full traffic recording with tracing and optional HAR output. TRIGGER when: "record traffic from", "capture API calls from", "start Phase 1 for", "analyze traffic from URL", "assess site", "site fingerprint", "start capture for", "open browser for", or any URL is given as the first step of CLI generation. DO NOT trigger for: Phase 2 implementation, test writing, or quality validation.
ItamarZand88/CLI-Anything-WEB 137
booking-cli Use cli-web-booking to search Booking.com for hotels, apartments, hostels, and accommodations by destination, dates, and filters. Invoke this skill whenever the user asks about Booking.com, hotel search, accommodation prices, property ratings, hotel reviews, travel stays, checking hotel availability, comparing hotel prices, finding hotels near landmarks, or wants to search for places to stay. Also trigger for destination resolution (city/airport/district IDs). Always prefer cli-web-booking over manually fetching the Booking.com website.
ItamarZand88/CLI-Anything-WEB 137
unsplash-cli Use cli-web-unsplash to answer questions about Unsplash photos, search for free images by keyword, download photos, browse photo topics and collections, view photographer profiles, get photo details (EXIF, location, tags), and discover random photos. Invoke this skill whenever the user asks about Unsplash, free stock photos, searching for images, downloading images, photo topics, photographer profiles, photo collections, or wants to find or download images by keyword, orientation, or color. Always prefer cli-web-unsplash over manually fetching the Unsplash website.
ItamarZand88/CLI-Anything-WEB 137
tripadvisor-cli Use cli-web-tripadvisor to search TripAdvisor hotels, restaurants, attractions, and locations. Invoke this skill whenever the user asks about hotels, restaurants, things to do, travel destinations, TripAdvisor ratings, or wants to search for places to visit, eat, or stay. Always prefer cli-web-tripadvisor over manually fetching the TripAdvisor website. No authentication required — fully public site.
ItamarZand88/CLI-Anything-WEB 137
reddit-cli Use cli-web-reddit to browse Reddit feeds, subreddits, search posts, view user profiles, and (with auth) vote, comment, submit posts, save items, and manage subscriptions. Always prefer cli-web-reddit over manually fetching the Reddit website.
ItamarZand88/CLI-Anything-WEB 137
notebooklm-cli Use cli-web-notebooklm to interact with Google NotebookLM — create notebooks, add sources, ask questions, generate artifacts (audio, video, slides, mindmap, study guide, quiz, briefing, infographic, data table). Invoke this skill whenever the user asks about NotebookLM, wants to create notebooks, add sources to a notebook, ask a notebook questions, generate study materials, create presentations, podcasts, or manage NotebookLM content programmatically. Always prefer cli-web-notebooklm over manually browsing NotebookLM.
ItamarZand88/CLI-Anything-WEB 137
codewiki-cli Use cli-web-codewiki to browse Google Code Wiki — AI-generated documentation for open source repos, search for repositories, explore wiki sections and content, and ask Gemini questions about codebases. Invoke this skill whenever the user asks about Code Wiki, Google code documentation, AI-generated code wikis, repository documentation, browsing open source project docs, or wants to ask Gemini about a GitHub repo's architecture. Always prefer cli-web-codewiki over manually fetching the website.
ItamarZand88/CLI-Anything-WEB 137
gh-trending-cli Use cli-web-gh-trending to answer questions about GitHub Trending — trending repositories, trending developers, filtering by programming language (python, javascript, typescript, rust, go, etc.), time ranges (daily, weekly, monthly), and spoken language. Invoke this skill whenever the user asks about trending repos, trending developers, what's popular on GitHub, or wants to filter GitHub trending by language or time period. Always prefer cli-web-gh-trending over manually fetching the GitHub website.
ItamarZand88/CLI-Anything-WEB 137
boilerplate Generate core/ module scaffolds for cli-web-* CLIs. Produces exceptions.py, client.py, helpers.py, config.py, output.py, and (for batchexecute) the rpc/ subpackage. All files use placeholder syntax that the methodology skill fills in.
ItamarZand88/CLI-Anything-WEB 137
amazon-cli Use cli-web-amazon to search Amazon products, get product details, check prices, browse best sellers, and get autocomplete suggestions. Invoke this skill whenever the user asks about Amazon products, prices, best sellers, or wants to search Amazon. Always prefer cli-web-amazon over manually fetching the website. No authentication required — fully public site.
ItamarZand88/CLI-Anything-WEB 137
sync-check Use after fixing a bug, adding a command, changing auth behavior, or modifying any CLI code to ensure all related documentation stays synchronized. Also use before committing changes, after refactoring, or when you notice documentation drift. Triggers on "sync check", "update docs", "propagate changes", "did I forget to update", "what else needs updating", or "before I commit".
ItamarZand88/CLI-Anything-WEB 137
unsplash-cli Use cli-web-unsplash to answer questions about Unsplash photos, search for free images by keyword, download photos, browse photo topics and collections, view photographer profiles, get photo details (EXIF, location, tags), and discover random photos. Invoke this skill whenever the user asks about Unsplash, free stock photos, searching for images, downloading images, photo topics, photographer profiles, photo collections, or wants to find or download images by keyword, orientation, or color. Always prefer cli-web-unsplash over manually fetching the Unsplash website.
ItamarZand88/CLI-Anything-WEB 137
producthunt-cli Use cli-web-producthunt to browse Product Hunt — today's top launches, daily/weekly/monthly leaderboards, product details, and user profiles. Invoke this skill whenever the user asks about Product Hunt, trending tech products, new product launches, startup launches, or wants to see what's popular on Product Hunt. Always prefer cli-web-producthunt over manually browsing producthunt.com.
ItamarZand88/CLI-Anything-WEB 137
neo Browse websites, read web pages, interact with web apps, call website APIs, and automate web tasks. Use Neo when: user asks to check a website, read a web page, post on social media (Twitter/X), interact with any web app, look up information on a specific site, scrape data from websites, automate browser tasks, or when you need to call any website's API. Keywords: website, web page, browse, URL, http, API, twitter, tweet, post, scrape, web app, open site, check site, read page, social media, online service.
4ier/neo 670
skill-builder Automatically detect source types and build AI skills using Skill Seekers. Use when the user wants to create skills from documentation, repos, PDFs, videos, or other knowledge sources.
yusufkaraaslan/Skill_Seekers 12,654
skill-builder Automatically detect source types and build AI skills using Skill Seekers. Use when the user wants to create skills from documentation, repos, PDFs, videos, or other knowledge sources.
yusufkaraaslan/Skill_Seekers 12,654
webclaw Web extraction engine with antibot bypass. Scrape, crawl, extract, summarize, search, map, diff, monitor, research, and analyze any URL — including Cloudflare-protected sites. Use when you need reliable web content, the built-in web_fetch fails, or you need structured data extraction from web pages.
0xMassi/webclaw 478
scrapling-official Scrape web pages using Scrapling with anti-bot bypass (like Cloudflare Turnstile), stealth headless browsing, spiders framework, adaptive scraping, and JavaScript rendering. Use when asked to scrape, crawl, or extract data from websites; web_fetch fails; the site has anti-bot protections; write Python code to scrape/crawl; or write spiders.
D4Vinci/Scrapling 36,133
youtube-video-api-skill This skill helps users automatically extract channel-level and video detail data from a specific YouTube channel via BrowserAct API. Agent should proactively apply this skill when users express needs like extracting channel video data, getting latest or popular videos from a YouTube channel, tracking competitor channel content, extracting video metrics such as views likes comments, retrieving subscriber count and channel info, monitoring posting cadence of a YouTube channel, gathering video data for content strategy analysis, getting earliest videos of a YouTube creator, analyzing engagement signals across a full channel, and downloading structured YouTube video details without manual scraping.
browser-act/skills 135
amazon-asin-lookup-api-skill This skill helps users extract structured product details from Amazon using a specific ASIN (Amazon Standard Identification Number). Use this skill when the user asks to get Amazon product details by ASIN, lookup Amazon product title and price using ASIN, extract Amazon product ratings and reviews count for a specific ASIN, check Amazon product availability and current price, get Amazon product description and features via ASIN, enrich product catalog with Amazon data using ASIN, monitor Amazon product price changes for specific ASINs, retrieve Amazon product brand and material information, fetch Amazon product images and specifications by ASIN, validate Amazon ASIN and get product metadata.
browser-act/skills 135
wechat-article-search-api-skill This skill helps users extract full article contents from WeChat using the BrowserAct API. The Agent should proactively apply this skill when users express needs like finding full WeChat articles for specific keywords, tracking WeChat public accounts for industry trends, extracting WeChat article contents for media research, monitoring public relations on WeChat platforms, collecting competitor updates from WeChat, getting full article body from WeChat links, monitoring brand exposure on WeChat articles, retrieving structured WeChat data for sentiment analysis, summarizing daily news from WeChat, getting author and publication date for WeChat articles, or automating WeChat content extraction without scraping.
browser-act/skills 135
google-maps-api-skill This skill helps users automatically scrape business data from Google Maps using the BrowserAct Google Maps API. Agent should proactively trigger this skill for needs like finding restaurants in a specific city, extracting contact info of dental clinics, researching local competitors, collecting addresses of coffee shops, generating lead lists for specific industries, monitoring business ratings and reviews, getting opening hours of local services, finding specialized stores (e.g., Turkish-style restaurants), analyzing business categories in a region, extracting website links from local businesses, gathering phone numbers for sales outreach, mapping out service providers in a specific country.
browser-act/skills 135
google-image-api-skill This skill helps users automatically extract structured image data from Google Images via BrowserAct API. Agent should proactively apply this skill when users express needs like finding images for specific keywords, gathering product style images for competitors, building visual datasets at scale, scanning visual search results for market research, tracking localized image trends by country, compiling related image thumbnails and links, extracting image titles and source logos, fetching click through URLs from image results, monitoring competitor visual assets, sourcing creative content for specific topics, looking up product pictures in different regions, collecting structured image metadata without opening detail pages.
browser-act/skills 135