com.croftsoft.apps.spider
Class Spider

java.lang.Object
  com.croftsoft.apps.spider.Spider

All Implemented Interfaces:

Commissionable, Destroyable, Initializable, Lifecycle, Resumable, Startable, Stoppable

public final class Spider
extends Object
implements Lifecycle

Web spider.

Since:

2003-04-09

Version:

$Id: Spider.java,v 1.5 2008/09/26 20:27:32 croft Exp $

Author:

David Wallace Croft

Constructor Summary

Spider(Consumer<URL> urlConsumer)

Spider(Consumer<URL> urlConsumer, Filter urlFilter, Filter contentTypeFilter)

Method Summary

void	destroy()
URL	getCurrentURL()
void	init()
static void	main(String[] args)
boolean	push(String urlString)
void	setContentTypeFilter(Filter contentTypeFilter)
void	setUrlFilter(Filter urlFilter)
void	start()
void	stop()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Spider

public Spider(Consumer<URL> urlConsumer,
              Filter urlFilter,
              Filter contentTypeFilter)

Spider

public Spider(Consumer<URL> urlConsumer)

Method Detail

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception

getCurrentURL

public URL getCurrentURL()

push

public boolean push(String urlString)

setContentTypeFilter

public void setContentTypeFilter(Filter contentTypeFilter)

setUrlFilter

public void setUrlFilter(Filter urlFilter)

init

public void init()

Specified by:

init in interface Initializable

start

public void start()

Specified by:

start in interface Startable

stop

public void stop()

Specified by:

stop in interface Stoppable

destroy

public void destroy()

Specified by:

destroy in interface Destroyable