欧美亚洲日韩偷拍自综合,国产亚洲精品合集久久久久

日本少妇高潮久久久久久_东京热一区二区三区无码视频_国内精品人妻久久毛片app_男人撕开奶罩揉吮奶头视频_少妇交换做爰做到高潮_睡错了人妻公h_国产男女猛烈无遮挡a片漫画_男女啪啪做爰高潮全过有多钱_国产猛男猛女超爽免费视频

通過robots.txt文件屏蔽蜘蛛抓取不存在的后綴

通過網(wǎng)站日志分析，會(huì)發(fā)現(xiàn)搜索引擎蜘蛛抓取了一些網(wǎng)站上不存在的文件后綴，如：.php、.asp、.aspx等。

搜外網(wǎng)站后臺(tái)日志分析結(jié)果如下圖：

image.

搜外主站實(shí)際上不存在php后綴的URL地址。

可通過robots.txt文件禁止蜘蛛抓取不存在的后綴，減少出現(xiàn)404返回值。

在robots.txt文件填寫屏蔽規(guī)則如下：

Disallow: /*.asp$

Disallow: /*.php$

Disallow: /*.aspx$

注意前面一個(gè)*，后面一個(gè)$，代表后綴。

參考搜外的robots.txt文件寫法，點(diǎn)擊這里

來源：搜外網(wǎng)

Public @ 2015-07-18 16:09:24

我設(shè)置了301跳轉(zhuǎn)，多久可以生效？答：目前百度無法承諾301跳轉(zhuǎn)的生效時(shí)間，因?yàn)檎鹃L(zhǎng)感受到的生效時(shí)間會(huì)受多因素影響，比如Baiduspider再次抓取這個(gè)頁面發(fā)現(xiàn)其設(shè)置了301的時(shí)間、網(wǎng)頁的重要程度以及自身質(zhì)量等。來源：百度搜索資源平臺(tái) 百度搜索學(xué)堂

Public @ 2019-11-23 16:09:07

什么是死鏈接？

簡(jiǎn)單地講，死鏈接指原來正常，后來失效的鏈接。死鏈接發(fā)送請(qǐng)求時(shí)，服務(wù)器返回404錯(cuò)誤頁面。在這些情況下出現(xiàn)死鏈接：動(dòng)態(tài)鏈接在數(shù)據(jù)庫不再支持的條件下，變成死鏈接。某個(gè)文件或網(wǎng)頁移動(dòng)了位置，導(dǎo)致指向它的鏈接變成死鏈接。網(wǎng)頁內(nèi)容更新并換成其他的鏈接，原來的鏈接變成死鏈接。網(wǎng)站服務(wù)器設(shè)置錯(cuò)誤。從用戶的角度來看，死鏈接和錯(cuò)誤鏈接的表現(xiàn)是一樣的，所以一般我們并不需要區(qū)別死鏈接和錯(cuò)誤鏈接。作為SEO人員或網(wǎng)站管理

Public @ 2021-12-09 15:56:17

robots.txt文件有什么必要？

什么是robots.txt文件?搜索引擎機(jī)器人通過鏈接抵達(dá)互聯(lián)網(wǎng)上的每個(gè)網(wǎng)頁，并抓取網(wǎng)頁信息。搜索引擎機(jī)器人在訪問一個(gè)網(wǎng)站時(shí)，會(huì)首先檢查該網(wǎng)站的根目錄下是否有一個(gè)叫做robots.txt的純文本文件。當(dāng)我們的網(wǎng)站有一些內(nèi)容不想被搜索引擎收錄，我們可以通過設(shè)置robots.txt文件告知搜索引擎機(jī)器人。如果網(wǎng)站上沒有禁止搜索引擎收錄的內(nèi)容，則不用設(shè)置robots.txt文件，或設(shè)置為空。robots

Public @ 2018-10-22 16:09:22

百度搜索robots協(xié)議全新升級(jí)公告

尊敬的用戶：為了更好地保護(hù)網(wǎng)站主的合法權(quán)益、提升百度搜索用戶搜索體驗(yàn)，百度搜索于2020年10月27日發(fā)布了新版robots協(xié)議，主要特性包括： 1. 支持抓取控制與數(shù)據(jù)保護(hù)視角的并存新增規(guī)定了兩個(gè)特殊的抓取指令： allow-if-previously-blocked 和 noindex-if-previously-indexed，用于方便網(wǎng)站主在控制抓取行為的同時(shí)，保護(hù)網(wǎng)站內(nèi)容的安全

Public @ 2023-06-20 23:50:22

更多您感興趣的搜索

基本文件流程錯(cuò)誤 SQL 調(diào)試

/www/wwwroot/briline.net/public/index.php ( 0.79 KB )
/www/wwwroot/briline.net/public/public.php ( 1.08 KB )
/www/wwwroot/briline.net/thinkphp/start.php ( 0.73 KB )
/www/wwwroot/briline.net/thinkphp/base.php ( 2.66 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Loader.php ( 19.47 KB )
/www/wwwroot/briline.net/vendor/composer/autoload_namespaces.php ( 0.21 KB )
/www/wwwroot/briline.net/vendor/composer/autoload_psr4.php ( 0.84 KB )
/www/wwwroot/briline.net/vendor/composer/autoload_classmap.php ( 0.14 KB )
/www/wwwroot/briline.net/vendor/composer/autoload_files.php ( 0.42 KB )
/www/wwwroot/briline.net/vendor/qiniu/php-sdk/src/Qiniu/functions.php ( 7.10 KB )
/www/wwwroot/briline.net/vendor/qiniu/php-sdk/src/Qiniu/Config.php ( 0.70 KB )
/www/wwwroot/briline.net/vendor/topthink/think-captcha/src/helper.php ( 1.59 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Route.php ( 59.82 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Config.php ( 6.03 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Validate.php ( 40.27 KB )
/www/wwwroot/briline.net/vendor/topthink/think-queue/src/config.php ( 0.77 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Console.php ( 21.22 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Error.php ( 3.59 KB )
/www/wwwroot/briline.net/thinkphp/convention.php ( 10.31 KB )
/www/wwwroot/briline.net/thinkphp/library/think/App.php ( 21.04 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Request.php ( 50.94 KB )
/www/wwwroot/briline.net/app/config.php ( 11.25 KB )
/www/wwwroot/briline.net/app/database.php ( 1.41 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Hook.php ( 4.76 KB )
/www/wwwroot/briline.net/app/tags.php ( 1.16 KB )
/www/wwwroot/briline.net/app/common/behavior/InitBase.php ( 8.17 KB )
/www/wwwroot/briline.net/app/common.php ( 23.29 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Env.php ( 1.25 KB )
/www/wwwroot/briline.net/thinkphp/helper.php ( 17.86 KB )
/www/wwwroot/briline.net/app/function.php ( 0.78 KB )
/www/wwwroot/briline.net/app/extend.php ( 13.29 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Debug.php ( 7.06 KB )
/www/wwwroot/briline.net/app/common/model/Config.php ( 0.78 KB )
/www/wwwroot/briline.net/app/common/model/ModelBase.php ( 12.18 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Model.php ( 66.83 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Db.php ( 6.54 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Log.php ( 5.84 KB )
/www/wwwroot/briline.net/thinkphp/library/think/db/connector/Mysql.php ( 3.94 KB )
/www/wwwroot/briline.net/thinkphp/library/think/db/Connection.php ( 29.97 KB )
/www/wwwroot/briline.net/thinkphp/library/think/db/Query.php ( 86.80 KB )
/www/wwwroot/briline.net/thinkphp/library/think/db/builder/Mysql.php ( 2.16 KB )
/www/wwwroot/briline.net/thinkphp/library/think/db/Builder.php ( 30.47 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Cache.php ( 6.17 KB )
/www/wwwroot/briline.net/thinkphp/library/think/cache/driver/File.php ( 7.46 KB )
/www/wwwroot/briline.net/thinkphp/library/think/cache/Driver.php ( 5.52 KB )
/www/wwwroot/briline.net/app/common/behavior/InitHook.php ( 1.25 KB )
/www/wwwroot/briline.net/app/common/model/Hook.php ( 0.77 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Lang.php ( 6.95 KB )
/www/wwwroot/briline.net/thinkphp/lang/zh-cn.php ( 3.85 KB )
/www/wwwroot/briline.net/app/route.php ( 0.91 KB )
/www/wwwroot/briline.net/app/index/config.php ( 0.96 KB )
/www/wwwroot/briline.net/app/index/common.php ( 0.68 KB )
/www/wwwroot/briline.net/app/index/controller/Wiki.php ( 2.44 KB )
/www/wwwroot/briline.net/app/index/controller/IndexBase.php ( 1.10 KB )
/www/wwwroot/briline.net/app/common/controller/ControllerBase.php ( 4.75 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Controller.php ( 6.20 KB )
/www/wwwroot/briline.net/thinkphp/library/traits/controller/Jump.php ( 4.97 KB )
/www/wwwroot/briline.net/thinkphp/library/think/View.php ( 6.86 KB )
/www/wwwroot/briline.net/thinkphp/library/think/view/driver/Think.php ( 5.61 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Template.php ( 46.46 KB )
/www/wwwroot/briline.net/thinkphp/library/think/template/driver/File.php ( 2.24 KB )
/www/wwwroot/briline.net/app/index/logic/Wiki.php ( 6.16 KB )
/www/wwwroot/briline.net/app/index/logic/IndexBase.php ( 0.79 KB )
/www/wwwroot/briline.net/app/common/logic/LogicBase.php ( 0.83 KB )
/www/wwwroot/briline.net/app/common/model/Article.php ( 0.78 KB )
/www/wwwroot/briline.net/app/common/model/ArticleTongji.php ( 0.79 KB )
/www/wwwroot/briline.net/thinkphp/library/think/paginator/driver/Bootstrap.php ( 5.90 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Paginator.php ( 9.45 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Collection.php ( 8.63 KB )
/www/wwwroot/briline.net/runtime/temp/ead4923c25a6b3f986358f7070f93dfa.php ( 56.51 KB )
/www/wwwroot/briline.net/thinkphp/library/think/Response.php ( 8.64 KB )
/www/wwwroot/briline.net/thinkphp/library/think/debug/Html.php ( 4.27 KB )

[ DB ] CONNECT:[ UseTime:0.025529s ] mysql:dbname=briline.net;host=106.14.77.182;port=3306;charset=utf8
[ SQL ] SHOW COLUMNS FROM `ob_article` [ RunTime:0.018189s ]
[ SQL ] SELECT * FROM `ob_article` WHERE `id` = 4434 LIMIT 1 [ RunTime:0.017206s ]
[ EXPLAIN : array ( 'id' => 1, 'select_type' => 'SIMPLE', 'table' => 'ob_article', 'type' => 'const', 'possible_keys' => 'PRIMARY', 'key' => 'PRIMARY', 'key_len' => '4', 'ref' => 'const', 'rows' => 1, 'extra' => NULL, ) ]
[ SQL ] select * from `ob_article_tongji` where category_id=12 and mark_type='cate' order by times desc limit 15 [ RunTime:0.017512s ]
[ EXPLAIN : array ( 'id' => 1, 'select_type' => 'SIMPLE', 'table' => 'ob_article_tongji', 'type' => 'ALL', 'possible_keys' => NULL, 'key' => NULL, 'key_len' => NULL, 'ref' => NULL, 'rows' => 608, 'extra' => 'Using where; Using filesort', ) ]
[ SQL ] select * from `ob_article_tongji` where category_id=12 and mark_type='tags' order by times desc limit 100 [ RunTime:0.017652s ]
[ EXPLAIN : array ( 'id' => 1, 'select_type' => 'SIMPLE', 'table' => 'ob_article_tongji', 'type' => 'ALL', 'possible_keys' => NULL, 'key' => NULL, 'key_len' => NULL, 'ref' => NULL, 'rows' => 608, 'extra' => 'Using where; Using filesort', ) ]
[ SQL ] select * from `ob_article_tongji` where category_id=12 and mark_type='tags' order by rand() limit 30 [ RunTime:0.017868s ]
[ EXPLAIN : array ( 'id' => 1, 'select_type' => 'SIMPLE', 'table' => 'ob_article_tongji', 'type' => 'ALL', 'possible_keys' => NULL, 'key' => NULL, 'key_len' => NULL, 'ref' => NULL, 'rows' => 608, 'extra' => 'Using where; Using temporary; Using filesort', ) ]
[ SQL ] SELECT * FROM `ob_article` WHERE `id` = 4434 LIMIT 1 [ RunTime:0.017247s ]
[ EXPLAIN : array ( 'id' => 1, 'select_type' => 'SIMPLE', 'table' => 'ob_article', 'type' => 'const', 'possible_keys' => 'PRIMARY', 'key' => 'PRIMARY', 'key_len' => '4', 'ref' => 'const', 'rows' => 1, 'extra' => NULL, ) ]
[ SQL ] update `ob_article` set views=views+2 where id=4434 [ RunTime:0.020489s ]
[ SQL ] SELECT COUNT(*) AS tp_count FROM `ob_article` WHERE `category_id` = 12 AND `cate` = '威海網(wǎng)站結(jié)構(gòu)優(yōu)化' AND `status` <> -1 LIMIT 1 [ RunTime:0.023829s ]
[ EXPLAIN : array ( 'id' => 1, 'select_type' => 'SIMPLE', 'table' => 'ob_article', 'type' => 'ALL', 'possible_keys' => NULL, 'key' => NULL, 'key_len' => NULL, 'ref' => NULL, 'rows' => 8035, 'extra' => 'Using where', ) ]
[ SQL ] SELECT * FROM `ob_article` WHERE `category_id` = 12 AND `cate` = '威海網(wǎng)站結(jié)構(gòu)優(yōu)化' AND `status` <> -1 ORDER BY rand() LIMIT 0,2 [ RunTime:0.038399s ]
[ EXPLAIN : array ( 'id' => 1, 'select_type' => 'SIMPLE', 'table' => 'ob_article', 'type' => 'ALL', 'possible_keys' => NULL, 'key' => NULL, 'key_len' => NULL, 'ref' => NULL, 'rows' => 8035, 'extra' => 'Using where; Using temporary; Using filesort', ) ]
[ SQL ] SELECT COUNT(*) AS tp_count FROM `ob_article` WHERE `category_id` = 12 AND `tags` = '威海Robots' AND `status` <> -1 LIMIT 1 [ RunTime:0.023714s ]
[ EXPLAIN : array ( 'id' => 1, 'select_type' => 'SIMPLE', 'table' => 'ob_article', 'type' => 'ALL', 'possible_keys' => NULL, 'key' => NULL, 'key_len' => NULL, 'ref' => NULL, 'rows' => 8035, 'extra' => 'Using where', ) ]
[ SQL ] SELECT * FROM `ob_article` WHERE `category_id` = 12 AND `tags` = '威海Robots' AND `status` <> -1 ORDER BY rand() LIMIT 0,2 [ RunTime:0.034410s ]
[ EXPLAIN : array ( 'id' => 1, 'select_type' => 'SIMPLE', 'table' => 'ob_article', 'type' => 'ALL', 'possible_keys' => NULL, 'key' => NULL, 'key_len' => NULL, 'ref' => NULL, 'rows' => 8035, 'extra' => 'Using where; Using temporary; Using filesort', ) ]

0.467351s

Categories

Tags

通過robots.txt文件屏蔽蜘蛛抓取不存在的后綴

我設(shè)置了301跳轉(zhuǎn)，多久可以生效？

什么是死鏈接？

robots.txt文件有什么必要？

百度搜索robots協(xié)議全新升級(jí)公告

更多您感興趣的搜索

Categories

Tags

通過robots.txt文件屏蔽蜘蛛抓取不存在的后綴

我設(shè)置了301跳轉(zhuǎn)，多久可以生效？

什么是死鏈接？

robots.txt文件有什么必要？

百度搜索robots協(xié)議全新升級(jí)公告

更多您感興趣的搜索

我設(shè)置了301跳轉(zhuǎn)，多久可以生效？

什么是死鏈接？