Crawler Directives

Instructions for the crawler on what to crawl and index on your site.

Literal Meanings of Crawler Directives

Crawler:

Meanings of Crawler:
  1. A person who has been physically or verbally abused and who returns the applicant to the abuser.

  2. Secretly.

  3. A child who can crawl on his hands and knees, but cannot walk.

  4. Crawling swimmer.

  5. Caterpillar tractor, a motorized vehicle that uses tracks instead of wheels.

  6. A software bot that autonomously follows connected paths, such as links to web pages.

  7. Mutable developmental stage of non-motile hemiptera insects, such as mealybugs, usually in the first instar.

Directives:

Meanings of Directives:
  1. A directive or instruction that specifies how to perform an action or achieve a goal.

  2. A construction in the source code that specifies how to handle it, but is not necessarily part of an executable program.

  3. An important decision by a binding or non-binding official body.

  4. (European Union Law) A type of legislation addressed to member states. The Directive obliges Member States to include certain objectives in their national legislation.

  5. Political affairs.

Crawler Directives