Constants

Starlark built in constants

Starlark defines fundamental values and functions needed by all Starlark programs like None, True and False. The complete list of Starlark built in constants and functions can be found here.

Status

Scope Checker defines a number of constants to be used as result of scope evaluation. The different statuses corresponds to the special status codes used in Veidemann logs which in turn is an extended set of Heritrix status codes.

Include

Candidate URI is in scope. The status code will be the result of fetching the actual resource.

Blocked

Candidate URL is blocked from fetch. Status code is -5001.

BlockedByCustomProcessor

Blocked by a custom processor. Status code is -5002.

ChaffDetection

Chaff detection of traps/content with negligible value applied. Status code is -4000.

IllegalUri

Candidate URI is unsupported or has illegal format. Status code is -7.

RuntimeException

Evaluation of script failed. Status code is -5.

TooManyHops

Candidate URL was too many hops away from seed. Status code is -4001.

TooManyTransitiveHops

The URI is too many embed/transitive hops away from the last URI in scope. Status code is -4002.