robots.c File Reference

(2017-03-20 09:59:37 +0100, (build 8610300))

Robots Exclusion file parser. More...

#include <config.h>
#include <strings.h>
#include <string.h>
#include <ctype.h>
#include <wget.h>
#include "private.h"

Include dependency graph for robots.c:

Functions
ROBOTS *	wget_robots_parse (const char *data, const char *client)
void	wget_robots_free (ROBOTS **robots)

Detailed Description

Robots Exclusion file parser.