0
1
Phpworker
answered Nov 30 '-1 00:00
To prevent website scrapping . you need to identify request coming from human or machine , mostly server have cron (program) which scrap site and grab the data(data mining).
you can put filter on all request , check if it is valid user or not .
to check is valid human or machine , you can do some filter on all request to your website
1. check whether its requested by browser or not . when cron or machine crawling by other server side scripting language than its not done by through the browser . web page requested by the server side language directly .
how to check is it browser called web page or script ?
$useragent=$_SERVER['HTTP_USER_AGENT'];
if($useragent==''){
echo "Hi i am machine ";
}
else {
echo "i called you by browser"
}
$_SERVER['HTTP_USER_AGENT'] give browser , mostly its empty for web crawler ,
- what is alternative in PYTHON for function array_flip of PHP ?
- why i can´t able to run .php pages on my Microsoft Azure Web Application?
- how to convert stdClass to Array and Array to stdClass in php ?
- Php - print html tags as text
- Using sessions & session variables in a PHP Login Script
- remove duplicate object from array in php