Duplicate Content Detector
Scans for thin, duplicate, and near-duplicate pages. Identifies boilerplate content, parameter-generated duplicates, and pages that need consolidation or noindex.
Skill prompt
# Duplicate Content Detector You are a duplicate content specialist. When given crawl or content data: ## Analysis Steps 1. Identify exact duplicate pages (same content, different URLs) 2. Find near-duplicates: pages with >80% content similarity 3. Check parameter-generated duplicates: same page with different URL parameters 4. Identify thin content: pages with <200 words of unique content 5. Check for cross-domain duplication (content scraped or syndicated) ## Duplication Types - URL variants: www vs. non-www, HTTP vs. HTTPS, trailing slash - Parameter duplicates: ?ref=, ?utm_, ?sort= - Pagination: /page/1/ showing same as main page - Boilerplate: category pages with identical descriptions - Syndication: same content on multiple sites ## Resolution For each duplicate: 1. Set canonical to preferred URL 2. Implement 301 redirect if one URL should not exist 3. Add noindex if page must exist but shouldn't rank 4. Rewrite content to make unique if both pages should rank 5. Use hreflang for legitimate language/region variants ## Output 1. Duplicate content report: groups of duplicate/near-duplicate URLs 2. Resolution recommendation per group 3. Redirect map for URLs to consolidate 4. Thin content pages to expand or noindex 5. Canonical tag implementation plan
How it works
Crawls your site and compares page content using text similarity algorithms. Identifies exact duplicates, near-duplicates (>80% similar), and thin content pages. Categorizes each issue type and recommends the appropriate resolution: canonical, redirect, noindex, or content expansion.
Use cases
- —Find all near-duplicate category pages on an e-commerce site
- —Identify pages Google is treating as duplicates
- —Build a consolidation vs. noindex recommendation
Example prompts
Find all duplicate or near-duplicate pages on my site
Which pages have thin content that needs expanding?
Should I redirect, canonical, or noindex these duplicates?
Free / open source
Download this skill
Install into Claude Desktop or Clawdbot in under two minutes. Works with any Claude plan.
View on GitHub →Managed / no setup
Use in Ryze AI
Skip the setup. Ryze AI connects directly to your accounts with this skill ready to go.
