SiteInformation (sites.py)

sherlock · scraping

Sherlock Sites Information Module This module supports storing information about websites. This is the raw data that will be used to search for usernames.

# Source: https://github.com/sherlock-project/sherlock | License: MIT | Copyright 2019 Sherlock Project
# Provided via justclaw.it.com; keep this notice with the code.
"""Sherlock Sites Information Module

This module supports storing information about websites.
This is the raw data that will be used to search for usernames.
"""
import json
import requests
import secrets


MANIFEST_URL = "https://data.sherlockproject.xyz"
EXCLUSIONS_URL = "https://raw.githubusercontent.com/sherlock-project/sherlock/refs/heads/exclusions/false_positive_exclusions.txt"

class SiteInformation:
    def __init__(self, name, url_home, url_username_format, username_claimed,
                information, is_nsfw, username_unclaimed=secrets.token_urlsafe(10)):
        """Create Site Information Object.

        Cont

... (truncated -- full source via MCP)

See the full source, get the GitHub permalink, and search 40K more like it.

Get a free API key