scrapy [boto] ERROR: Caught exception reading instance data URLError:

來源：程序員人生   發布時間：2016-02-28 10:38:52 閱讀次數：4310次

履行進程中出現毛病：

2015-09-09 11:13:26 [boto] DEBUG: Retrieving credentials from metadata server. 2015-09-09 11:13:27 [boto] ERROR: Caught exception reading instance data Traceback (most recent call last): File "D:anzhuangAnacondalibsite-packagesotoutils.py", line 210, in retry_url r = opener.open(req, timeout=timeout) File "D:anzhuangAnacondaliburllib2.py", line 431, in open response = self._open(req, data) File "D:anzhuangAnacondaliburllib2.py", line 449, in _open _open, req) File "D:anzhuangAnacondaliburllib2.py", line 409, in _call_chain result = func(*args) File "D:anzhuangAnacondaliburllib2.py", line 1227, in http_open return self.do_open(httplib.HTTPConnection, req) File "D:anzhuangAnacondaliburllib2.py", line 1197, in do_open raise URLError(err) URLError:2015-09-09 11:13:27 [boto] ERROR: Unable to read instance data, giving up

在setting.py中禁用s3 download就能夠了
解決方法：

DOWNLOAD_HANDLERS = {S3: None,}

在stackoverflow上有些解釋,有時間可以看看這篇毛病分析毛病
下面是我貼的部份內容。
That particular error message is being generated by boto (boto 2.38.0 py27_0), which is used to connect to Amazon S3. Scrapy doesn’t have this enabled by default.

EDIT: In reply to the comments, this appears to be a bug with Scrapy when boto is present (bug here).

In response “how to disable the Download handler”, add the following to your settings.py file:

DOWNLOAD_HANDLERS = { S3:None, }

Your settings.py file should be in the root of your Scrapy project folder, (one level deeper than your scrapy.cfg file).

If you’ve already got DOWNLOAD_HANDLERS in your settings.py file, just add a new entry for ‘s3’ with a None value.

EDIT 2: I’d highly recommend looking at setting up virtual environments for your projects. Look into virtualenv, and it’s usage. I’d make this recommendation regardless of packages used for this project, but doubly so with your extreme number of packages.

生活不易，碼農辛苦
如果您覺得本網站對您的學習有所幫助,可以手機掃描二維碼進行捐贈