周末在家撸代码了,写了一个小脚本爬取alexa网上的top500的域名,使用了多进程,但是报错了,
Traceback (most recent call last): File "alexa.py", line 116, insite.multiprocess() File "alexa.py", line 83, in multiprocess self.domain = multiprocessing.Manager().list() File "/home/rocky/python/lib/python2.7/multiprocessing/managers.py", line 667, in temp token, exp = self._create(typeid, *args, **kwds) File "/home/rocky/python/lib/python2.7/multiprocessing/managers.py", line 565, in _create conn = self._Client(self._address, authkey=self._authkey) File "/home/rocky/python/lib/python2.7/multiprocessing/connection.py", line 175, in Client answer_challenge(c, authkey) File "/home/rocky/python/lib/python2.7/multiprocessing/connection.py", line 432, in answer_challenge message = connection.recv_bytes(256) # reject large message IOError: [Errno 11] Resource temporarily unavailable
脚本地址alexaTop500
应该是进程太多引起的