Skip to content

Commit dd50ab6

Browse files
committed
fix two tests, try fixing test_tokenizer a bit
--HG-- extra : convert_revision : svn%3Aacbfec75-9323-0410-a652-858a13e371e0/trunk%40367
1 parent 8179a78 commit dd50ab6

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

tests/test_tokenizer.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -36,6 +36,10 @@ def processEndTag(self, token):
3636
def processComment(self, token):
3737
self.outputTokens.append([u"Comment", token["data"]])
3838

39+
def processSpaceCharacters(self, token):
40+
self.outputTokens.append([u"Character", token["data"]])
41+
self.processSpaceCharacters = self.processCharacters
42+
3943
def processCharacters(self, token):
4044
self.outputTokens.append([u"Character", token["data"]])
4145

0 commit comments

Comments
 (0)