robots.txt reports

nytimes.com

4 reports, newest first

  1. https://nytimes.comCurrent84 B
  2. https://nytimes.comOutdated84 B
  3. https://nytimes.comOutdated84 B
  4. https://nytimes.comOutdated84 B