5 Commity (main)

Autor	SHA1	Wiadomość	Data
Slatian	34d6df3830	Removed "note:" from heuristics as too many sites are affected negatively by this	2022-11-22 13:52:32 +01:00
Slatian	c72ea4c6ca	Improved heuristics for enlish language text to skip over most fluff paragraphs to get better samples of sites	2022-11-22 13:52:32 +01:00
Slatian	cbaa6e06b1	Add a default configuration that mostly works …	2022-11-22 13:52:32 +01:00
idk	21ef8aac08	Allows the configuration of a proxy (#9) ... * Add proxy support, capability to crawl using SOCKS proxies	2022-03-29 14:36:48 +02:00
cblgh	28d052f4c3	launch	2021-02-03 09:12:30 +01:00