• Natanael@infosec.pub
    link
    fedilink
    English
    arrow-up
    3
    ·
    8 hours ago

    The ability to block crawling is separate from the ability to delist old pages. The latter usually happens after domains change owners