.Google restricts robots.txt help to 4 fields, clarifying its own posture on unsupported instructions.Google.com just assists four certain robots.txt areas.Unsupported regulations in robots.txt are going to be disregarded.Think about auditing your robots.txt data because of this upgrade.