Duplicate content is when the same or very similar content appears at more than one URL. It's far more common than most site owners realise — and it quietly undermines rankings by splitting authority between versions of the same page and confusing Google about which version to index.
What duplicate content is
Duplicate content is content that appears in substantially identical or very similar form at multiple URLs. This can be:
- Exact duplication: the same HTML content accessible at two different URLs (e.g.
/servicesand/services/both returning identical content) - Near-duplication: content that's almost identical across pages, with minor variations (e.g. location pages that swap city names but keep all other content the same)
- Cross-domain duplication: the same content published on multiple different websites
The majority of duplicate content is accidental — produced by CMS configurations, URL parameter handling, HTTP/HTTPS and www/non-www variants, and syndication — not by deliberate copying.
Common causes of duplicate content
HTTP and HTTPS versions
A page accessible at both http://yoursite.com/page and https://yoursite.com/page is duplicate content. Fix: redirect all HTTP URLs to HTTPS at the server level. See the redirect guide for implementation.
www and non-www versions
Similarly, www.yoursite.com/page and yoursite.com/page are technically different URLs. Pick one canonical version and redirect the other to it permanently.
Trailing slash variations
/services and /services/ may both return the same content. Standardise one format and redirect the other consistently across the entire site.
URL parameters
Filtering, sorting, and tracking parameters create multiple URLs for the same content:
/products?sort=price/products?sort=name/products?utm_source=email
All three may return the same product listing. Fix with canonical tags pointing to the canonical URL (without parameters) or by configuring Google Search Console to tell Google how to handle specific parameters.
Paginated content
Paginated listings (/blog/page/2, /products?page=3) often contain largely the same template content with only the product/post listings differing. Use canonical tags pointing to the first page, or self-referential canonicals on each paginated page, combined with clear internal linking.
Session IDs in URLs
Some older e-commerce systems append session IDs to URLs: /product?sessionid=abc123. Every user session creates a unique URL for the same page. Fix at the server level by not including session IDs in URLs, or with canonical tags.
Printer-friendly pages
Printer-friendly versions of pages (/page?print=1) create near-duplicates. Add noindex to print versions or canonical tags pointing to the standard page.
CMS-generated duplicates
WordPress and other CMSs often create multiple routes to the same content: tag archives, category archives, author archives, date archives, and the post itself all potentially show the same content. Audit your CMS's archive pages and noindex any that don't serve a genuine purpose.
Location pages with identical content
A business creating location pages for every city it serves (/web-design-london, /web-design-manchester, /web-design-bristol) with only the city name changed and all other content identical creates near-duplicate pages. Each page needs substantively unique content to avoid this — see the service business SEO guide for how to approach this correctly.
How duplicate content affects rankings
When the same content exists at multiple URLs, Google has to decide which version to index and rank — a process called canonicalisation. Google usually makes this decision correctly, but it:
- Splits link equity between the duplicate URLs (backlinks pointing to
/servicesand/services/separately, instead of consolidating on one version) - Wastes crawl budget — Google's crawlers spend time on duplicate pages that could be spent on unique content
- Creates uncertainty about which URL to surface in search results, sometimes resulting in a weaker version being indexed
- Dilutes relevance signals across multiple versions instead of concentrating them
For most sites, the effect is moderate — Google is generally good at identifying the canonical version. But for sites with significant duplication (many URL parameters, many location pages, a large archive of near-duplicates), the cumulative effect on crawl efficiency and link equity consolidation can be meaningful.
How to find duplicate content
Google Search Console → Indexing → Pages: look for "Duplicate without user-selected canonical" and "Duplicate, Google chose different canonical than user" — both indicate Google has identified duplicate content situations on your site.
Screaming Frog: crawl your site and look at the "Duplicate Content" report. This identifies near-exact page duplicates by comparing content hashes. Also check the "Canonicals" tab for pages where the canonical is set incorrectly.
Manual URL testing: test the key URL variants manually: try HTTP, HTTPS, www, non-www, trailing slash, no trailing slash for your homepage and a few sample pages. All variants should redirect to a single canonical URL.
site: search in Google: search site:yoursite.com "exact phrase from your page" — if the same quote appears under multiple URLs, those pages are duplicates in Google's index.
Fix: canonical tags
A canonical tag tells Google which version of a page is the primary, indexable version. It's the right solution when you can't (or don't want to) eliminate the duplicate URLs, but want to consolidate signals on one version.
<link rel="canonical" href="https://yoursite.com/services/" />
Use canonical tags for:
- URL parameter variations you can't eliminate server-side
- Paginated content (pages 2, 3, 4 canonical to page 1)
- Printer-friendly page versions
- Syndicated content (point to the original)
- Near-duplicate location or variant pages where the URL structure must be kept
Fix: 301 redirects
When you can eliminate a duplicate URL entirely — because it's a variant that shouldn't exist rather than a necessary URL — a 301 redirect is the cleanest solution. It consolidates link equity, eliminates crawl waste, and permanently resolves the duplication.
Use 301 redirects for:
- HTTP → HTTPS (redirect all HTTP URLs to HTTPS equivalents)
- www → non-www (or vice versa)
- Trailing slash normalisation
- Merging two near-duplicate content pages into one
See the full redirect guide for implementation details.
Fix: noindex
For pages that need to exist at their URL but shouldn't appear in search results at all, use a noindex meta tag:
<meta name="robots" content="noindex">
Use noindex for:
- CMS archive pages that don't add search value (tag archives, date archives, author pages)
- Thank-you pages, confirmation pages, login pages
- Internal search results pages
- Staging or development pages that are live but shouldn't be indexed
Note: noindex removes a page from the index, but doesn't consolidate its link equity to a canonical version the way a canonical tag or redirect would. For duplicate content where you want to preserve link equity, canonical or redirect is usually better than noindex.
Cross-domain duplication and syndication
When the same content appears on multiple different domains — either because you've syndicated your content to other sites, or because others have scraped and republished yours — the same canonicalisation logic applies.
For content you've syndicated: ask the publishing site to add a rel="canonical" pointing back to the original on your domain. Some publishers will do this; others won't. If they won't, a noindex tag on the syndicated version is the next best option.
For content scraped from you: Google's systems are generally effective at identifying the original source based on publication date, crawl history, and backlink patterns. If you discover widespread scraping that's causing ranking issues, you can submit a DMCA takedown request to Google, which may result in the scraper being deindexed.
Thin content vs duplicate content
Thin content and duplicate content are related but distinct problems. Thin content is pages with very little substantive content — too short, too generic, or too low-quality to serve a real user need. Duplicate content is pages that repeat what's on another URL.
They often co-occur: thin location pages that swap a city name but have no genuine unique content are both thin and near-duplicate. The fix for both is the same: either add substantive unique content to make each page genuinely valuable, or consolidate/noindex/redirect the pages that don't.
Google's helpful content system demotes sites with significant amounts of thin or unhelpful content, regardless of whether it's technically duplicated elsewhere. See the E-E-A-T guide for how to ensure your content meets Google's quality expectations.