6 Commits

Author	SHA1	Message	Date
bitscuit	a09bc1da54	Check if file size small enough	2021-05-08 20:58:00 +02:00
bitscuit	9fa95aba03	Also parse non-index urls	2021-05-08 20:31:44 +02:00
bitscuit	0462614a22	Cleaned logging	2021-05-08 19:58:05 +02:00
bitscuit	5ca786b1ae	Added exception handling during get	2021-05-08 18:15:32 +02:00
bitscuit	a9a07aabea	Don't load already visited sites	2021-05-08 18:00:49 +02:00
bitscuit	3866b2be0f	Wrote first version	2021-05-08 17:43:31 +02:00