PHP-Crawler is a very simple crawl/search script with fulltext support for small websites. Simple, based on PHP and MySQL. No shell access required, crawling can be run from browser. Created ages ago (back in year 2006) it stays one of the most popular php crawler scripts in the world.
- Full text indexing
- Crawling is limited by depth setting
- Safe spidering: allow to limit maximum page size
- MySQL based
- Simple installation
- PHP 4.3.10+
- MySQL 3.23.56+
Last version available on SourceForge under terms of BSD Licence.