Commit Graph

61 Commits

Author SHA1 Message Date
Gervasio Marchand
91a2e5ebae
Build: Improve speed and build a manifest for both architectures (#49) 2024-01-03 21:04:11 -03:00
Gervasio Marchand
cbc49531ad
Handle 429s gracefully (#48) 2023-12-15 19:19:39 -03:00
Gervasio Marchand
3577a6072b
Fix download-artifact (#47) 2023-12-15 09:12:53 -03:00
Gervasio Marchand
586cede38d
Restore and publish on separate steps (#46) 2023-12-15 08:59:00 -03:00
Gervasio Marchand
5919c3bc6f
Upgrade .net (#45) 2023-12-15 08:50:42 -03:00
Gervasio Marchand
fe7703bd9f
Handle non-json responses from instances #41 (#42) 2023-06-12 12:31:11 +00:00
Chris Wood
6dcc1a0327
Addresses issue #26 - getting tags via the Mastodon API. (#36) 2023-02-14 12:30:01 +00:00
Gervasio Marchand
fbd47ae7cd
Make the number of lines to store dynamic (#40) 2023-02-14 12:13:57 +00:00
Gervasio Marchand
d9faf231a0
Use Mastodon's API to fetch hashtagged statuses (#39) 2023-02-11 16:14:15 +00:00
Gervasio Marchand
6fd7804d6c
fix NRE when OrderedItems is null (and log it, I'm curious) (#38) 2023-02-09 12:26:25 +00:00
Gervasio Marchand
91ac0e2385
If we can't pull the robots information, don't break completely (#37) 2023-02-04 21:29:44 +00:00
Gervasio Marchand
32280c334b
Store the last 5000 urls 2023-01-12 19:16:24 -03:00
Gervasio Marchand
8efdc77e51
new dotnet version (#33) 2023-01-11 19:10:41 +00:00
Gervasio Marchand
6431c9505f
Create an ARM docker image as well (#29) 2022-12-25 17:50:58 -03:00
Gervasio Marchand
92e34f7086
Merge pull request #28 from nberlee/PinnedTags
Columns of PinnedTags can have Include additional tags for this colum…
2022-12-25 12:46:49 -08:00
Nico Berlee
04af58dde1
Columns of PinnedTags can have Include additional tags for this column enabled
This adds not only filter capabilities, which are not relevent to this project
like `not` and `all` but also has the `any` field, which is an array where
you may add more tags.

Unfortunatly, I was unable to create a precise select query for this, as the
database field `data` is not jsonb. I think parsing json  is really the most
optimal way under these circumstances.
2022-12-25 21:28:32 +01:00
Gervasio Marchand
780b61d17c
Update README 2022-12-24 14:30:53 -03:00
Gervasio Marchand
6b3d3cfd28
Merge pull request #27 from nberlee/PinnedTags
Get PinnedTags from database, use them if "PinnedTags": true
2022-12-24 09:19:00 -08:00
Nico Berlee
1b1a8d5d0b
Get PinnedTags from database, use them if "PinnedTags": true
This need `GRANT SELECT ON web_settings TO mastodon_read;`
Fixes #25
2022-12-24 17:09:59 +01:00
Gervasio Marchand
db4023797a
Action branding changes 2022-12-23 15:08:15 -03:00
Gervasio Marchand
d6e916034a
derp 2022-12-23 15:02:05 -03:00
Gervasio Marchand
23d9209b95
Update readme and do a minor change to the action 2022-12-23 15:00:57 -03:00
Gervasio Marchand
888b859ca6
Remove the offer of an executable 2022-12-23 10:40:43 -03:00
Gervasio Marchand
08d4aed8e9
Remove another config.json example 2022-12-23 10:39:18 -03:00
Gervasio Marchand
da7e696dfb
Readme updates (#24) 2022-12-23 10:22:40 -03:00
Gervasio Marchand
bf27d2a414
Don't use Docker on the action 2022-12-23 09:25:48 -03:00
Gervasio Marchand
72569297f3
Merge pull request #23 from chdorner/feat/gh-action
Add GH action
2022-12-23 03:46:49 -08:00
Christof Dorner
a8514a8f0d Add GH action
This can run GetMoarFediverse from another repo. It uses action artifacts to store the list of already imported statuses.
2022-12-23 12:37:09 +01:00
Gervasio Marchand
f97c4d8270
Keep the artifact name consistent across releases (#22) 2022-12-22 22:51:42 +00:00
Gervasio Marchand
2c11b898ff
Moar logging (#21) 2022-12-22 12:44:34 +00:00
Gervasio Marchand
83ca6bb63b
Do up to 2 * tags concurrent requests (#20) 2022-12-22 09:37:29 -03:00
Gervasio Marchand
44b47acbfe
Improve error message when it fails to pull tags (#19) 2022-12-21 03:24:45 +00:00
Gervasio Marchand
23be734a5e
Check robots.txt and use a user agent (#17) 2022-12-21 00:15:13 -03:00
Gervasio Marchand
d535512a6b
Also build the trimmed artifacts on the required check (#18) 2022-12-21 00:12:19 -03:00
Gervasio Marchand
8ec1c89309
run build on main and don't error if I don't create a tag (#14) 2022-12-21 02:30:45 +00:00
Gervasio Marchand
47a3e4acd4
Mastodon connection helper tweaks (#13) 2022-12-21 02:26:06 +00:00
Gervasio Marchand
80bae5652b
Use null reference checks (and enforce them) (#11) 2022-12-21 02:11:57 +00:00
Gervasio Marchand
ac83a1f8a9
Fix build so that it runs on PRs (#10) 2022-12-20 23:09:32 -03:00
Gervasio Marchand
518b51fcf6
Fix NRE when Tags is null and error if both tags and connection string are specified (#9) 2022-12-20 21:34:43 -03:00
Gervasio Marchand
a88e9f9fd5
Update README and add LICENSE (#8) 2022-12-20 18:06:23 -03:00
Gervasio Marchand
875b2fe26e
Deprecate Sites in favor of Instances (#7) 2022-12-20 17:03:06 -03:00
Gervasio Marchand
4ccfaad15f
Make it possible to scrape followed tags from the instance (#6) 2022-12-17 22:27:04 -03:00
Gervasio Marchand
79177f8bf9
Update README (#5) 2022-12-16 11:57:30 -03:00
Gervasio Marchand
29bc4435e8
Merge pull request #4 from g3rv4/moar-runtimes
Add more executable runtimes
2022-12-15 21:08:17 -08:00
Gervasio Marchand
9f8c5bac15
Add more executable runtimes 2022-12-16 02:07:33 -03:00
Gervasio Marchand
e71904e1a3
Make it trimmable 2022-12-16 01:54:49 -03:00
Gervasio Marchand
41821ea23a
Create tags with manual gate 2022-12-15 19:24:58 -03:00
Gervasio Marchand
241f20632b
Merge pull request #3 from qwertzipups/patch-1
Update README.md
2022-12-15 13:07:43 -08:00
qwertzipups
83a68e445b
Update README.md
Changed to "--rm importdata" in the cron example.
2022-12-15 21:08:14 +01:00
Gervasio Marchand
0c7589c177
catch errors pulling data from other instances 2022-12-09 18:19:15 -03:00