Any crawler that we dont have a formal agreement with, were now blocking.
While Reddit and Microsoft attempted to make a deal, their negotiations ended without agreement.
We are selective about who we work with and trust with large-scale access to Reddit content.
We respect robots.txt, the industry accepted signal for blocking web crawling.
