 bitscuit
|
9850fdf2b3
|
Added counter for number of fetched sites
|
2021-05-09 13:19:27 +02:00 |
|
bitscuit
|
2d399a5325
|
Added regex timout and optimized regex
|
2021-05-09 13:16:01 +02:00 |
|
bitscuit
|
d88f95abfa
|
Optimized regex
|
2021-05-09 12:51:53 +02:00 |
|
bitscuit
|
27514741be
|
Added GPLv3 license and copyright notice
|
2021-05-09 08:44:53 +02:00 |
|
bitscuit
|
fecb3ea7c2
|
Closed stream request after reading Content-Length
|
2021-05-09 08:38:10 +02:00 |
|
bitscuit
|
6bbaeab49e
|
Only sham if right time of day
|
2021-05-09 08:04:39 +02:00 |
|
bitscuit
|
8ed9889267
|
Moved static vars to configuration file and added code to create default config
|
2021-05-09 07:51:34 +02:00 |
|
bitscuit
|
477814c480
|
Added sleep
|
2021-05-08 21:28:13 +02:00 |
|
bitscuit
|
52b3612a8d
|
Fixed some small issues
|
2021-05-08 21:15:33 +02:00 |
|
bitscuit
|
95e4b27bc3
|
Added timeout
|
2021-05-08 21:07:00 +02:00 |
|
bitscuit
|
a09bc1da54
|
Check if file size small enough
|
2021-05-08 20:58:00 +02:00 |
|
bitscuit
|
9fa95aba03
|
Also parse non-index urls
|
2021-05-08 20:31:44 +02:00 |
|
bitscuit
|
0462614a22
|
Cleaned logging
|
2021-05-08 19:58:05 +02:00 |
|
bitscuit
|
5ca786b1ae
|
Added exception handling during get
|
2021-05-08 18:15:32 +02:00 |
|
bitscuit
|
a9a07aabea
|
Don't load already visited sites
|
2021-05-08 18:00:49 +02:00 |
|
bitscuit
|
3866b2be0f
|
Wrote first version
|
2021-05-08 17:43:31 +02:00 |