Vega strike Python Modules doc  0.5.1
Documentation of the " Modules " folder of Vega strike
•All Data Structures Namespaces Files Functions Variables
Data Structures | Variables
robotparser Namespace Reference

Data Structures

class  RobotFileParser
 
class  RuleLine
 
class  Entry
 
class  URLopener
 

Variables

list __all__ = ["RobotFileParser"]
 
int debug = 0
 

Detailed Description

robotparser.py

    Copyright (C) 2000  Bastian Kleineidam

    You can choose between two licenses when using this package:
    1) GNU GPLv2
    2) PYTHON 2.0 OPEN SOURCE LICENSE

    The robots.txt Exclusion Protocol is implemented as specified in
    http://info.webcrawler.com/mak/projects/robots/norobots-rfc.html

Variable Documentation

list __all__ = ["RobotFileParser"]

Definition at line 14 of file robotparser.py.

int debug = 0

Definition at line 16 of file robotparser.py.