This bulk robots.txt checker lets you check in bulk whether URLs may be visited by crawlers.
Use below the Bulk robots.txt checker