Commit Graph

51 Commits

Author SHA1 Message Date
Gervasio Marchand
91ac0e2385
If we can't pull the robots information, don't break completely (#37) 2023-02-04 21:29:44 +00:00
Gervasio Marchand
32280c334b
Store the last 5000 urls 2023-01-12 19:16:24 -03:00
Gervasio Marchand
8efdc77e51
new dotnet version (#33) 2023-01-11 19:10:41 +00:00
Gervasio Marchand
6431c9505f
Create an ARM docker image as well (#29) 2022-12-25 17:50:58 -03:00
Gervasio Marchand
92e34f7086
Merge pull request #28 from nberlee/PinnedTags
Columns of PinnedTags can have Include additional tags for this colum…
2022-12-25 12:46:49 -08:00
Nico Berlee
04af58dde1
Columns of PinnedTags can have Include additional tags for this column enabled
This adds not only filter capabilities, which are not relevent to this project
like `not` and `all` but also has the `any` field, which is an array where
you may add more tags.

Unfortunatly, I was unable to create a precise select query for this, as the
database field `data` is not jsonb. I think parsing json  is really the most
optimal way under these circumstances.
2022-12-25 21:28:32 +01:00
Gervasio Marchand
780b61d17c
Update README 2022-12-24 14:30:53 -03:00
Gervasio Marchand
6b3d3cfd28
Merge pull request #27 from nberlee/PinnedTags
Get PinnedTags from database, use them if "PinnedTags": true
2022-12-24 09:19:00 -08:00
Nico Berlee
1b1a8d5d0b
Get PinnedTags from database, use them if "PinnedTags": true
This need `GRANT SELECT ON web_settings TO mastodon_read;`
Fixes #25
2022-12-24 17:09:59 +01:00
Gervasio Marchand
db4023797a
Action branding changes 2022-12-23 15:08:15 -03:00
Gervasio Marchand
d6e916034a
derp 2022-12-23 15:02:05 -03:00
Gervasio Marchand
23d9209b95
Update readme and do a minor change to the action 2022-12-23 15:00:57 -03:00
Gervasio Marchand
888b859ca6
Remove the offer of an executable 2022-12-23 10:40:43 -03:00
Gervasio Marchand
08d4aed8e9
Remove another config.json example 2022-12-23 10:39:18 -03:00
Gervasio Marchand
da7e696dfb
Readme updates (#24) 2022-12-23 10:22:40 -03:00
Gervasio Marchand
bf27d2a414
Don't use Docker on the action 2022-12-23 09:25:48 -03:00
Gervasio Marchand
72569297f3
Merge pull request #23 from chdorner/feat/gh-action
Add GH action
2022-12-23 03:46:49 -08:00
Christof Dorner
a8514a8f0d Add GH action
This can run GetMoarFediverse from another repo. It uses action artifacts to store the list of already imported statuses.
2022-12-23 12:37:09 +01:00
Gervasio Marchand
f97c4d8270
Keep the artifact name consistent across releases (#22) 2022-12-22 22:51:42 +00:00
Gervasio Marchand
2c11b898ff
Moar logging (#21) 2022-12-22 12:44:34 +00:00
Gervasio Marchand
83ca6bb63b
Do up to 2 * tags concurrent requests (#20) 2022-12-22 09:37:29 -03:00
Gervasio Marchand
44b47acbfe
Improve error message when it fails to pull tags (#19) 2022-12-21 03:24:45 +00:00
Gervasio Marchand
23be734a5e
Check robots.txt and use a user agent (#17) 2022-12-21 00:15:13 -03:00
Gervasio Marchand
d535512a6b
Also build the trimmed artifacts on the required check (#18) 2022-12-21 00:12:19 -03:00
Gervasio Marchand
8ec1c89309
run build on main and don't error if I don't create a tag (#14) 2022-12-21 02:30:45 +00:00
Gervasio Marchand
47a3e4acd4
Mastodon connection helper tweaks (#13) 2022-12-21 02:26:06 +00:00
Gervasio Marchand
80bae5652b
Use null reference checks (and enforce them) (#11) 2022-12-21 02:11:57 +00:00
Gervasio Marchand
ac83a1f8a9
Fix build so that it runs on PRs (#10) 2022-12-20 23:09:32 -03:00
Gervasio Marchand
518b51fcf6
Fix NRE when Tags is null and error if both tags and connection string are specified (#9) 2022-12-20 21:34:43 -03:00
Gervasio Marchand
a88e9f9fd5
Update README and add LICENSE (#8) 2022-12-20 18:06:23 -03:00
Gervasio Marchand
875b2fe26e
Deprecate Sites in favor of Instances (#7) 2022-12-20 17:03:06 -03:00
Gervasio Marchand
4ccfaad15f
Make it possible to scrape followed tags from the instance (#6) 2022-12-17 22:27:04 -03:00
Gervasio Marchand
79177f8bf9
Update README (#5) 2022-12-16 11:57:30 -03:00
Gervasio Marchand
29bc4435e8
Merge pull request #4 from g3rv4/moar-runtimes
Add more executable runtimes
2022-12-15 21:08:17 -08:00
Gervasio Marchand
9f8c5bac15
Add more executable runtimes 2022-12-16 02:07:33 -03:00
Gervasio Marchand
e71904e1a3
Make it trimmable 2022-12-16 01:54:49 -03:00
Gervasio Marchand
41821ea23a
Create tags with manual gate 2022-12-15 19:24:58 -03:00
Gervasio Marchand
241f20632b
Merge pull request #3 from qwertzipups/patch-1
Update README.md
2022-12-15 13:07:43 -08:00
qwertzipups
83a68e445b
Update README.md
Changed to "--rm importdata" in the cron example.
2022-12-15 21:08:14 +01:00
Gervasio Marchand
0c7589c177
catch errors pulling data from other instances 2022-12-09 18:19:15 -03:00
Gervasio Marchand
f38c7ec00d
do IsNullOrEmpty instead 2022-12-07 20:31:14 -03:00
Gervasio Marchand
082d261116
Add ability to take the fake relay api key from env variable 2022-12-07 20:28:31 -03:00
Gervasio Marchand
f757ce4818
Link to the Docker on Windows demo 2022-12-07 09:16:24 -03:00
Gervasio Marchand
2caa81872d
Merge pull request #1 from sanderdatema/patch-1
Update README.md
2022-12-05 05:57:15 -08:00
Sander Datema
a7ad90018e
Update README.md
The name of the container in the `docker-compose.yml` example is `importdata` and not `import`.
2022-12-05 14:53:14 +01:00
Gervasio Marchand
c7992e21e1
one more README update 2022-12-05 10:15:57 -03:00
Gervasio Marchand
f40eb83673
Update README 2022-12-05 09:08:30 -03:00
Gervasio Marchand
28fe45a075
make it more parallel 2022-12-05 08:56:11 -03:00
Gervasio Marchand
54828b9469
Rename! 2022-12-05 08:38:07 -03:00
Gervasio Marchand
4434af951e
Use FakeRelay, build a docker image and set things in a config file 2022-12-05 00:37:07 -03:00