ReddRadar
Agent skill
topic-modeling-text-mining
Apply LDA, NMF, and other computational methods to discover patterns in large text corpora with appropriate parameter tuning
Install this agent skill to your Project
npx add-skill https://github.com/a5c-ai/babysitter/tree/main/library/specializations/domains/social-sciences-humanities/humanities/skills/topic-modeling-text-mining
SKILL.md
Topic Modeling and Text Mining
Apply LDA, NMF, and other computational methods to discover patterns in large text corpora with appropriate parameter tuning.
Overview
This skill enables computational analysis of large text collections. It encompasses topic modeling, text mining techniques, and pattern discovery to reveal structures and themes in textual data for humanistic inquiry.
Capabilities
Topic Modeling
- LDA implementation
- NMF analysis
- Structural topic models
- Dynamic topic models
- Parameter optimization
Text Preprocessing
- Tokenization
- Stopword removal
- Lemmatization/stemming
- N-gram extraction
- Document-term matrices
Pattern Discovery
- Word frequency analysis
- Collocation detection
- Named entity recognition
- Sentiment analysis
- Network extraction
Visualization
- Word clouds
- Topic distributions
- Temporal trends
- Network graphs
- Interactive displays
Usage Guidelines
Analysis Process
- Prepare text corpus
- Preprocess documents
- Select modeling approach
- Tune parameters
- Run analysis
- Interpret results
- Validate findings
Parameter Considerations
- Number of topics
- Iteration counts
- Hyperparameters
- Coherence metrics
- Validation approaches
Interpretation Guidelines
- Examine topic words
- Review representative documents
- Consider domain knowledge
- Validate with close reading
- Acknowledge limitations
Integration Points
Related Processes
- Text Mining and Distant Reading
- Corpus Linguistics Analysis
- Network Analysis for Humanities
Collaborating Skills
- tei-text-encoding
- gis-mapping-humanities
- literary-close-reading
References
- Digital humanities methodology
- Topic modeling tutorials
- Text analysis tools
- Computational linguistics resources
Recommended Agent Skills
Expand your agent's capabilities with these related and highly-rated skills.
a5c-ai/babysitter
gsd-tools
Central utility skill for GSD operations. Provides config parsing, slug generation, timestamps, path operations, and orchestrates calls to other specialized skills. Acts as the unified entry point that the original gsd-tools.cjs provided via its lib/ modules (commands, config, core, init).
a5c-ai/babysitter
model-profile-resolution
Resolve model profile (quality/balanced/budget) at orchestration start and map agents to specific models. Enables cost/quality tradeoffs by selecting appropriate AI models for each agent role.
a5c-ai/babysitter
verification-suite
Plan structure validation, phase completeness checks, reference integrity verification, and artifact existence confirmation. Provides the structured verification layer ensuring GSD artifacts are well-formed and complete.
a5c-ai/babysitter
state-management
STATE.md reading, writing, and field-level updates. Provides cross-session state persistence via .planning/STATE.md with structured fields for current task, completed phases, blockers, decisions, and quick tasks.
a5c-ai/babysitter
git-integration
Git commit patterns, formats, and conventions for GSD methodology. Provides atomic commits per task, structured commit messages, planning file commits, branch management, and milestone tag operations.
a5c-ai/babysitter
frontmatter-parsing
YAML frontmatter parsing and manipulation for .planning/ documents. Provides read, write, update, query, and validation operations on frontmatter blocks in GSD markdown artifacts.
Didn't find tool you were looking for?