Lernen Detecting Duplicate Content | On-Page and Technical SEO Analysis with Python

Duplicate content occurs when identical or very similar content appears on multiple web pages within a site or across different domains. This is a significant SEO risk because search engines may struggle to determine which version to index or rank, sometimes resulting in lower rankings or even exclusion from search results. Duplicate content can also dilute link equity and reduce the effectiveness of your SEO efforts. Python can help you systematically identify duplicate content by comparing the text of different pages, making it easier to address these issues proactively.


              12345678910111213141516171819202122
            
# Hardcoded list of page contents
page_contents = [
    "Welcome to our blog. Learn SEO tips and tricks.",
    "Shop the best shoes online. Huge discounts available.",
    "Welcome to our blog. Learn SEO tips and tricks.",
    "Contact us for more information.",
    "Shop the best shoes online. Huge discounts available.",
    "Read our privacy policy here."
]

# Dictionary to map content to list of page indices
content_map = {}
for idx, content in enumerate(page_contents):
    if content in content_map:
        content_map[content].append(idx)
    else:
        content_map[content] = [idx]

# Find and print duplicate content pages
for content, indices in content_map.items():
    if len(indices) > 1:
        print(f"Duplicate content found on pages: {indices}")

This logic works by mapping each unique page content to the indices of the pages where it appears. As you iterate through the list of page contents, you add each page's index to a dictionary entry keyed by the content itself. If the same content appears on multiple pages, the list of indices for that content will have more than one entry. By checking which lists have more than one index, you can efficiently identify and report all sets of duplicate pages. This method is especially useful for small to medium-sized sites, allowing you to quickly spot and address duplicate content issues.


              12345678910111213141516171819202122
            
def find_duplicate_pages(page_contents):
    content_map = {}
    for idx, content in enumerate(page_contents):
        if content in content_map:
            content_map[content].append(idx)
        else:
            content_map[content] = [idx]
    duplicates = []
    for indices in content_map.values():
        if len(indices) > 1:
            duplicates.extend(indices)
    return sorted(list(set(duplicates)))

# Example usage:
pages = [
    "About our company.",
    "Our services and solutions.",
    "About our company.",
    "Contact details here.",
    "Our services and solutions."
]
print(find_duplicate_pages(pages))  # Output: [0, 1, 2, 4]

1. Why is duplicate content a problem for SEO?

2. What Python data structure helps detect duplicates efficiently?

3. Fill in the blank: To add an item to a set, use _ _ _ .

War alles klar?

Danke für Ihr Feedback!

Abschnitt 3. Kapitel 4

Fragen Sie AI

Fragen Sie alles oder probieren Sie eine der vorgeschlagenen Fragen, um unser Gespräch zu beginnen

Swipe um das Menü anzuzeigen