Agent skill
web-scraping
Extract structured data from web pages using CSS selectors and XPath
Install this agent skill to your Project
npx add-skill https://github.com/tatat/agents-playground/tree/main/skills/web-scraping
SKILL.md
Web Scraping
Extract structured data from web pages.
Capabilities
- Fetch HTML content from URLs
- Parse and extract specific elements (tables, lists, text)
- Handle pagination
- Output in JSON or CSV format
Supported Selectors
- CSS selectors:
.class,#id,tag - XPath expressions
- Text patterns (regex)
Rate Limiting
Always respect robots.txt and implement delays between requests. Default delay: 1 second between requests.
Example
Scrape product names and prices from example.com/products
Output as JSON with fields: name, price, url
Recommended Agent Skills
Expand your agent's capabilities with these related and highly-rated skills.
research-assistant
Conduct research, synthesize information, and create structured summaries
presentation-builder
Structure compelling presentations with clear narratives and visual suggestions
sql-query
Generate and optimize SQL queries for data retrieval and analysis
language-tutor
Teach languages with lessons, practice exercises, and conversation practice
fitness-coach
Create personalized workout plans and provide exercise guidance
api-integration
Connect to REST APIs, handle authentication, and process JSON responses
Didn't find tool you were looking for?