Use requests's r.text so we dont have to deal with charsets

pull/1/head
Leigh Morresi 2021-01-29 13:05:31 +01:00
rodzic 8b775f9188
commit 324c54fe46
1 zmienionych plików z 1 dodań i 1 usunięć

Wyświetl plik

@ -63,7 +63,7 @@ class perform_site_check(Thread):
try:
r = requests.get(self.url, headers=headers, timeout=15, verify=False)
stripped_text_from_html = html2text.html2text(r.content.decode('utf-8'))
stripped_text_from_html = html2text.html2text(r.text)
# @todo This should be a config option.
# Many websites include junk in the links, trackers, etc.. Since we are really a service all about text changes..