Issue 183 in html5lib: HTMLSanitizer can't be used as a tokenizer

[h***@public.gmane.org]

Status: New
Owner: ----

New issue 183 by akvadr...-***@public.gmane.org: HTMLSanitizer can't be used as a
tokenizer
http://code.google.com/p/html5lib/issues/detail?id=183

version html5lib-0.95_dev

/html5lib/html5parser.py line 242 in parseFragment
self._parse(stream, True, container=container, encoding=encoding)
/html5lib/html5parser.py line 110 in _parse
parser=self, **kwargs)
TypeError: __init__() got an unexpected keyword argument 'parser'

[h***@public.gmane.org]

Comment #1 on issue 183 by akvadr...-***@public.gmane.org: HTMLSanitizer can't be used
as a tokenizer
http://code.google.com/p/html5lib/issues/detail?id=183

This is a workaround and slightly safer design. There is no need for the
mixin or to hardcode the __init__ arguments:


from html5lib import HTMLParser
from html5lib.tokenizer import HTMLTokenizer
from html5lib.sanitizer import HTMLSanitizerMixin
from cgi import escape

class Sanitizer(HTMLTokenizer):
def __init__(self, *a, **kw):
HTMLTokenizer.__init__(self, *a, **kw)
self._saner = HTMLSanitizerMixin()

def __iter__(self):
for token in HTMLTokenizer.__iter__(self):
saner = self._saner.sanitize_token(token)
if saner: yield saner

PARSER = HTMLParser(tokenizer=Sanitizer)

def sanitize(html):
return PARSER.parseFragment(html).toxml()

[h***@public.gmane.org]

Updates:
Status: GitHub

Comment #2 on issue 183 by geoffers: HTMLSanitizer can't be used as a
tokenizer
http://code.google.com/p/html5lib/issues/detail?id=183

https://github.com/html5lib/html5lib-python/issues/9
--
You received this message because this project is configured to send all
issue notifications to this address.
You may adjust your notification preferences at:
https://code.google.com/hosting/settings