Skip to content

Commit 2ddd81f

Browse files
authored
feat(deslop): add buzzword inflation detection (#113)
* feat(deslop): add buzzword inflation detection Detect quality claims (production-ready, secure, scalable, etc.) in documentation that lack supporting code evidence. This completes the AI slop research implementation roadmap (Priority 3, Task #7). - Add analyzeBuzzwordInflation() function with claim extraction - Support 6 buzzword categories: production, enterprise, security, scale, reliability, completeness - Search for evidence patterns: tests, error handling, logging, auth, validation, encryption, async, cache, pool - Distinguish positive claims from TODOs/FIXMEs (reduce false positives) - Add 50+ tests for new functionality * fix(deslop): address PR review feedback - Fix shouldExclude using entry.name instead of full relative path - Include test files in evidence search (tests are evidence) - Optimize extractClaims with single combined regex + Map lookup - Add isFilePathPattern() helper for robust path vs content detection - Move require statements to top of describe block in tests * fix(deslop): address Copilot review feedback - Add buzzword_inflation pattern tests to slop-patterns.test.js - Fix overly broad errorHandling pattern in completeness category - Fix documentation regex (remove #.*docstring false positive) - Remove overly broad /with/ from CLAIM_INDICATORS - Refine NOT_CLAIM_INDICATORS /make/ pattern to be more specific - Update exclude property to empty array with explanatory comment - Optimize searchEvidence to skip file reads for path-only patterns
1 parent eff57c0 commit 2ddd81f

6 files changed

Lines changed: 1131 additions & 5 deletions

File tree

CHANGELOG.md

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,22 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
88
## [Unreleased]
99

1010
### Added
11+
- **Buzzword Inflation Detection** - New project-level analyzer for `/deslop-around` command (#113)
12+
- Detects quality claims in documentation without supporting code evidence
13+
- 6 buzzword categories: production, enterprise, security, scale, reliability, completeness
14+
- Each category has specific evidence patterns to validate claims:
15+
- Production: tests, error handling, logging
16+
- Security: auth, validation, encryption
17+
- Scale: async patterns, caching, connection pooling
18+
- Enterprise: auth, audit logs, rate limiting
19+
- Reliability: tests, coverage, error handling
20+
- Completeness: edge case handling, documentation
21+
- Distinguishes positive claims ("is production-ready") from aspirational ("TODO: make secure")
22+
- Claims without sufficient evidence (default: 2 matches) are flagged as violations
23+
- Severity `high`, autoFix `flag` (cannot auto-fix documentation claims)
24+
- New `analyzeBuzzwordInflation()` function in slop-analyzers.js
25+
- Comprehensive test suite with 50+ test cases
26+
1127
- **Verbosity Detection** - New patterns for `/deslop-around` command to detect AI-generated verbose code
1228
- `verbosity_preambles` - AI preamble phrases in comments (e.g., "Certainly!", "I'd be happy to help")
1329
- `verbosity_buzzwords` - Marketing buzzwords that obscure meaning (e.g., "synergize", "paradigm shift", "game-changing")

0 commit comments

Comments
 (0)