Commit Graph

17 Commits

Author SHA1 Message Date
fbd47ae7cd Make the number of lines to store dynamic (#40) 2023-02-14 12:13:57 +00:00
d9faf231a0 Use Mastodon's API to fetch hashtagged statuses (#39) 2023-02-11 16:14:15 +00:00
6fd7804d6c fix NRE when OrderedItems is null (and log it, I'm curious) (#38) 2023-02-09 12:26:25 +00:00
91ac0e2385 If we can't pull the robots information, don't break completely (#37) 2023-02-04 21:29:44 +00:00
32280c334b Store the last 5000 urls 2023-01-12 19:16:24 -03:00
1b1a8d5d0b Get PinnedTags from database, use them if "PinnedTags": true
This need `GRANT SELECT ON web_settings TO mastodon_read;`
Fixes #25
2022-12-24 17:09:59 +01:00
2c11b898ff Moar logging (#21) 2022-12-22 12:44:34 +00:00
83ca6bb63b Do up to 2 * tags concurrent requests (#20) 2022-12-22 09:37:29 -03:00
44b47acbfe Improve error message when it fails to pull tags (#19) 2022-12-21 03:24:45 +00:00
23be734a5e Check robots.txt and use a user agent (#17) 2022-12-21 00:15:13 -03:00
80bae5652b Use null reference checks (and enforce them) (#11) 2022-12-21 02:11:57 +00:00
4ccfaad15f Make it possible to scrape followed tags from the instance (#6) 2022-12-17 22:27:04 -03:00
e71904e1a3 Make it trimmable 2022-12-16 01:54:49 -03:00
0c7589c177 catch errors pulling data from other instances 2022-12-09 18:19:15 -03:00
28fe45a075 make it more parallel 2022-12-05 08:56:11 -03:00
54828b9469 Rename! 2022-12-05 08:38:07 -03:00
4434af951e Use FakeRelay, build a docker image and set things in a config file 2022-12-05 00:37:07 -03:00