- A highly configurable and customizable Web Spider engine.
- Developed under the LGPL Open Source license
- In 100% pure Java
You can use it to :
- Check your site for errors (internal server errors, …)
- Outgoing and/or internal link checking
- Analyze your site structure (creating a sitemap, …)
- Download complete web sites
- Any task you want, if you write a JSpider plugin.