quick installation : screenshots : download php-crawler
PHP-Crawler is a very simple crawl/search script with fulltext support for small websites. Simple, based on PHP and MySQL. No shell access required, crawling can be run from browser. Created ages ago (back in year 2006) it stays one of the most popular php crawler scripts in the world.
Features
- Full text indexing
- Crawling is limited by depth setting
- Safe spidering: allow to limit maximum page size
- Following “href=” links on web page, in HTML or JavaScripts
- MySQL based
- Simple installation
Requirements
- PHP 4.3.10+
- MySQL 3.23.56+
Distribution
Last version available on SourceForge under terms of BSD Licence.
sunel says:
hi your php crawler was very useful for our small project but i need help ,this works within my localhost only i need to make it work int entire web ….i look forward for u help please thank u in advance …..
vlad says:
You may want to set $CRAWL_ENTRY_POINT_URL in config file pointing out of your localhost (for 0.7.7-alpha), but please note, that PHP-crawler is not designed to crawl the entire web