Article URL: https://evgeniipendragon.com/posts/i-was-wrong-about-robots-txt/Comments URL: https://news.ycombinator.com/item?id=44588437Points: 3# Comments: 0