extra credit Search 85,062 technologies ⌘K Download for Mac

spatie/robots-txt

Determine if a page may be crawled from robots.txt and robots meta tags

composer require spatie/robots-txt
↑↓ move ↵ open