Taming the Bing bot - Joomla! Forum - community, help and support

-

the bing bot 1 of worst bots there is. it's generating 1/3 of traffic site (3000 hits on 24 hours), more twice as google bot (1300 hits), though i've set crawl rate bing enormously slow (in webmaster tools in robots.txt). seems crawl delay respected each separate bing server, not whole. bing bot no. 1 come every n seconds, in meantime bing bot no. 2 comes along, bot no. 3 etc.

what i've noticed bing not using sitemap (set osmap), tries use rss feed encounters sitemap. when @ sitemaps in bing webmaster tools, url's ?format=feed show up. if remove these, appear again within days. , bing seems crawl more pages needed.

i've setup bing webmaster tools ignore url parameters 'format', doesn't seem te respect preferences. i've added line robots.txt, ignored too:

code: select all

disallow: /*?*format=


has idea how tame bing bot? i'm not paying hosting provider please bing, since accounts less 1% of referral traffic.






Comments

Post a Comment

Popular posts from this blog

Falang and too many redirects - Joomla! Forum - community, help and support

-
hello i don't know if i'm posting in right place , i'm apologise have searched solution long time , couldn't find . my problem starts when have install component falang (translation component ). after time decided uninstall , problem starts. go extension tab meny in left column press manage button, list on right found falang component , delete it, when did website not accessible did stupidest thing install falang package file 1 more time , here problem, when trying open website message showing: "website redirected many times. try clearing cookies. err_too_many_redirects" i have cleared cookies didn't help. have used tool "header checker tool" , result "301 moved permanently " please because don't know do. thank you setka Board index Joomla! 3.x - Ask Support Questions Here Extensions for Joomla! 3.x
Read more

Infinite loop detected in JErrorInfinite loop detected in JError - Joomla! Forum - community, help and support

-
after migrating site new server see error below infinite loop detected in jerrorinfinite loop detected in jerror please can me it means there mis-configuration configuration.php file. can refer post - viewtopic.php?t=830509 https://docs.joomla.org/infinite_loop_d ... joomla_1.7 Board index Joomla! 3.x - Ask Support Questions Here General Questions/New to Joomla! 3.x
Read more

logged out from joomla! - Joomla! Forum - community, help and support

-
Image
good morning you! since joomla! version still running on 3.7.5, trying update current version 23.8.1. tried, got white page due incompatibility 1 of extension (page builder pro). decided first upgrade extension, , trying again. tried update, received error message of dublicated tables. went phpmyadmin , deleted these tables manually. same error appeared again, when tried update part. extension. in order rid of extension, tried remove extension via extension manager. hit "remove" button, got logged out. while trying log admin, got message: you not have access administrator section of site. . yes, changed _user table in phpmyadmin, , checked configuration.php, i'm still not able lock admin. however, checked , browsed internet solution, couldn't find hint, excepted, had similar issue , asked post output of "forum assistant". have no idea if narrow problem, @ least gotta try! of appreciated! thank in advance! part i: forum post assistant (v1.3.5) : 2nd november ...
Read more