Scribd
Upload
84 views1 page

PHP Crawler PDF

PHP-Crawler is an open-source PHP and MySQL-based web crawling and search script. It was created to implement simple local website search and has become popular for small websites on shared hosting. Some key features include full-text search via MySQL indexes, crawling limits, following href links, and requiring only PHP and MySQL without SSH access.

Uploaded by

Chrétien Kenfack
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
84 views1 page

PHP Crawler PDF

PHP-Crawler is an open-source PHP and MySQL-based web crawling and search script. It was created to implement simple local website search and has become popular for small websites on shared hosting. Some key features include full-text search via MySQL indexes, crawling limits, following href links, and requiring only PHP and MySQL without SSH access.

Uploaded by

Chrétien Kenfack
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 1

1 <?

php
2
3 /*PHP-CrawlerPHP-Crawler
4 PHP-Crawler is an open-source crawling script based on PHP and MySQL. Created to implement simple as possible local website search it became popular for small websites on shared
hosting. Script set is distributed under the terms of BSD License
5
6 Features
7 Full text search support via MySQL FT indexes
8 As a general PHP script it allows running crawler manually from browser, requires no SSH access to the hosting.
9 Crawling is limited by depth setting or amount
10 Following "href=" links on web page, in HTML or JavaScripts
11 Requirements
12 PHP 4.3.10+
13 MySQL 3.23.56+
14 External links
15 Official website
16 PHP-Crawler on SourceForge.net
17
18 PHP-Crawler is a very simple crawl/search script with fulltext support for small websites. Simple, based on PHP and MySQL. No shell access required, crawling can be run from browser.
Created ages ago (back in year 2006) it stays one of the most popular php crawler scripts in the world.
19
20 Features
21
22 Full text indexing
23 Crawling is limited by depth setting
24 Safe spidering: allow to limit maximum page size
25 Following “href=” links on web page, in HTML or JavaScripts
26 MySQL based
27 Simple installation
28 Requirements
29
30 PHP 4.3.10+
31 MySQL 3.23.56+
32 Distribution
33 Last version available on SourceForge under terms of BSD Licence.
34 PHP Crawler is a simple website search script for small-to-medium websites. The only requrements are PHP and MySQL, no shell access required.
35 */
36
37
38 ?>

You might also like