robots-parser
A specification compliant robots.txt parser with wildcard (*) matching support.
$
npm install robots-parserOfficial docs outline
Extra Credit builds an outline of robots-parser's docs the first time your work uses it. Until then, start at the official documentation.
More in npm packages
All 9,484-
@xhmikosr/decompress-unzip decompress zip plugin
-
onnxruntime-web A Javascript library for running ONNX models on browsers
-
bmp-js A pure javascript BMP encoder and decoder
-
@radix-ui/react-icons Radix UI React Icon Set
-
@grammyjs/types Telegram Bot API type declarations for grammY
-
eslint-plugin-playwright ESLint plugin for Playwright testing.
-
react-number-format React component to format number in an input or as a text.
-
@lexical/rich-text This package contains rich text helpers for Lexical.
-
@changesets/write Writes a changeset to a file
-
@parcel/watcher-linux-arm64-glibc A native C++ Node module for querying and subscribing to filesystem events. Used by Parcel 2.
-
linkedom A triple-linked lists based DOM implementation
-
@nx/js The JS plugin for Nx contains executors and generators that provide the best experience for developing JavaScript and TypeScript projects.