danoz@neutrino ~/net.danoz.xdi.frontend.crawler $ ./crawler.py --debug
1/QueryOne: SELECT COUNT(*) FROM datum WHERE ((datum.location) = ('/data/more/broke/¸HP¸.BBS'))
1/QueryR : SELECT COUNT(*) FROM datum WHERE ((datum.location) = ('/data/more/broke/¸HP¸.BBS'))
1/COMMIT : auto
Traceback (most recent call last):
File "./crawler.py", line 363, in <module>
c.crawl()
File "./crawler.py", line 241, in crawl
addFile(path)
File "./crawler.py", line 171, in addFile
f=open(path,'rb')
UnicodeEncodeError: 'ascii' codec can't encode character u'\xb8' in position 17: ordinal not in range(128)