-- 編碼：utf-8 --

導(dǎo)入 scrapy
from scrapy.http import Request, FormRequest
from scrapy.selector import Selector

類 StackSpiderSpider(scrapy.Spider):

雷雷

調(diào)試信息
2017-04-18 11:19:23 [scrapy.utils.log] INFO: Scrapy 1.3.3 已啟動(dòng)（bot: text5）
2017-04-18 11:19:23 [scrapy.utils.log ] 信息：覆蓋設(shè)置：{'NEWSPIDER_MO
DULE'：'text5.spiders'，'SPIDER_MODULES'：['text5.spiders']，'BOT_NAME'：'text5'
}
2017-04-18 11:19： 23 [scrapy.middleware]信息：?jiǎn)⒂脭U(kuò)展：
['scrapy.extensions.logstats.LogStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.corestats.CoreStats']
2017-04- 18 11:19:24 [scrapy.middleware] 信息：?jiǎn)⒂孟螺d器中間件：
['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware' ,
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy .downloader中間件.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2017-04-18 11:19:24 [scrapy.middleware]信息：?jiǎn)⒂弥┲胫虚g件：
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spi中間件.depth.DepthMiddleware']
2017-04-18 11:19:24 [scrapy.middleware] INFO: 啟用項(xiàng)目管道:
[]
2017-04-18 11:19:24 [scrapy.core.engine] INFO : 蜘蛛打開(kāi)了
2017-04-18 11:19:24 [scrapy.extensions.logstats] INFO: 抓取了 0 個(gè)頁(yè)面 (at 0 pag
es/min)，抓取了 0 個(gè)項(xiàng)目 (at 0 items/min)
2017-04 -18 11:19:24 [scrapy.extensions.telnet] DEBUG：Telnet 控制臺(tái)監(jiān)聽(tīng) 127.0.0.1:6023
2017-04-18 11:19:24 [scrapy.core.engine] DEBUG：已爬網(wǎng)（200 ) overflow.com/users/login>; (參考：無(wú))
1145f3f2e28e56c298bc28a1a735254b

2017-04-18 11:19:25 [scrapy.core.engine] 調(diào)試：已爬網(wǎng)（404）overflow.com/search?q=&ssrc=&openid_username=&oauth_server=&oauth_version=&fkey =
1145f3f2e28e56c298bc28a1a735254b&密碼=wanglihong1993&email=1067863906%40qq.c
om&openid_identifier=> （參考：https://stackoverflow.com/use...
2017-04-18 11:19:25 [scrapy.spidermiddlewares.httperror] 信息：忽略響應(yīng)
<404 https://stackoverflow.com/sea ...
auth_version=&fkey=1145f3f2e28e56c298bc28a1a735254b&password=wanglihong1993&emai
l=1067863906%40qq.com&openid_identifier=>：HTTP狀態(tài)代碼未處理或不允許
2017-04-18 11 :19:25 [scrapy.core。引擎] INFO: 關(guān)閉蜘蛛（已完成）
2017-04-18 11:19:25 [scrapy.statscollectors] INFO: 轉(zhuǎn)儲(chǔ) Scrapy stats:
{'downloader/request_bytes': 881,
'downloader/request_count': 2,
'下載器/request_method_count/GET': 2,
'下載器/response_bytes': 12631,
'下載器/response_count': 2,
'下載器/response_status_count/200': 1,
'下載器/response_status_count/404': 1 ,
'finish_reason': '完成',
'finish_time': datetime.datetime(2017, 4, 18, 3, 19, 25, 143000),
'log_count/DEBUG': 3,
'log_count/INFO': 8,
'request_depth_max': 1,
'response_received_count': 2,
'調(diào)度器/出隊(duì)': 2,
'調(diào)度器/出隊(duì)/內(nèi)存': 2,
'調(diào)度器/入隊(duì)': 2,
'調(diào)度器/入隊(duì)' /內(nèi)存': 2,
'start_time': datetime.datetime(2017, 4, 18, 3, 19, 24, 146000)}
2017-04-18 11:19:25 [scrapy.core.engine] 信息:蜘蛛關(guān)閉（完成）