Gervasio Marchand
91ac0e2385
If we can't pull the robots information, don't break completely ( #37 )
2023-02-04 21:29:44 +00:00
Gervasio Marchand
32280c334b
Store the last 5000 urls
2023-01-12 19:16:24 -03:00
Gervasio Marchand
8efdc77e51
new dotnet version ( #33 )
2023-01-11 19:10:41 +00:00
Gervasio Marchand
6431c9505f
Create an ARM docker image as well ( #29 )
2022-12-25 17:50:58 -03:00
Gervasio Marchand
92e34f7086
Merge pull request #28 from nberlee/PinnedTags
...
Columns of PinnedTags can have Include additional tags for this colum…
2022-12-25 12:46:49 -08:00
Nico Berlee
04af58dde1
Columns of PinnedTags can have Include additional tags for this column enabled
...
This adds not only filter capabilities, which are not relevent to this project
like `not` and `all` but also has the `any` field, which is an array where
you may add more tags.
Unfortunatly, I was unable to create a precise select query for this, as the
database field `data` is not jsonb. I think parsing json is really the most
optimal way under these circumstances.
2022-12-25 21:28:32 +01:00
Gervasio Marchand
780b61d17c
Update README
2022-12-24 14:30:53 -03:00
Gervasio Marchand
6b3d3cfd28
Merge pull request #27 from nberlee/PinnedTags
...
Get PinnedTags from database, use them if "PinnedTags": true
2022-12-24 09:19:00 -08:00
Nico Berlee
1b1a8d5d0b
Get PinnedTags from database, use them if "PinnedTags": true
...
This need `GRANT SELECT ON web_settings TO mastodon_read;`
Fixes #25
2022-12-24 17:09:59 +01:00
Gervasio Marchand
db4023797a
Action branding changes
2022-12-23 15:08:15 -03:00
Gervasio Marchand
d6e916034a
derp
2022-12-23 15:02:05 -03:00
Gervasio Marchand
23d9209b95
Update readme and do a minor change to the action
2022-12-23 15:00:57 -03:00
Gervasio Marchand
888b859ca6
Remove the offer of an executable
2022-12-23 10:40:43 -03:00
Gervasio Marchand
08d4aed8e9
Remove another config.json example
2022-12-23 10:39:18 -03:00
Gervasio Marchand
da7e696dfb
Readme updates ( #24 )
2022-12-23 10:22:40 -03:00
Gervasio Marchand
bf27d2a414
Don't use Docker on the action
2022-12-23 09:25:48 -03:00
Gervasio Marchand
72569297f3
Merge pull request #23 from chdorner/feat/gh-action
...
Add GH action
2022-12-23 03:46:49 -08:00
Christof Dorner
a8514a8f0d
Add GH action
...
This can run GetMoarFediverse from another repo. It uses action artifacts to store the list of already imported statuses.
2022-12-23 12:37:09 +01:00
Gervasio Marchand
f97c4d8270
Keep the artifact name consistent across releases ( #22 )
2022-12-22 22:51:42 +00:00
Gervasio Marchand
2c11b898ff
Moar logging ( #21 )
2022-12-22 12:44:34 +00:00
Gervasio Marchand
83ca6bb63b
Do up to 2 * tags concurrent requests ( #20 )
2022-12-22 09:37:29 -03:00
Gervasio Marchand
44b47acbfe
Improve error message when it fails to pull tags ( #19 )
2022-12-21 03:24:45 +00:00
Gervasio Marchand
23be734a5e
Check robots.txt and use a user agent ( #17 )
2022-12-21 00:15:13 -03:00
Gervasio Marchand
d535512a6b
Also build the trimmed artifacts on the required check ( #18 )
2022-12-21 00:12:19 -03:00
Gervasio Marchand
8ec1c89309
run build on main and don't error if I don't create a tag ( #14 )
2022-12-21 02:30:45 +00:00
Gervasio Marchand
47a3e4acd4
Mastodon connection helper tweaks ( #13 )
2022-12-21 02:26:06 +00:00
Gervasio Marchand
80bae5652b
Use null reference checks (and enforce them) ( #11 )
2022-12-21 02:11:57 +00:00
Gervasio Marchand
ac83a1f8a9
Fix build so that it runs on PRs ( #10 )
2022-12-20 23:09:32 -03:00
Gervasio Marchand
518b51fcf6
Fix NRE when Tags is null and error if both tags and connection string are specified ( #9 )
2022-12-20 21:34:43 -03:00
Gervasio Marchand
a88e9f9fd5
Update README and add LICENSE ( #8 )
2022-12-20 18:06:23 -03:00
Gervasio Marchand
875b2fe26e
Deprecate Sites in favor of Instances ( #7 )
2022-12-20 17:03:06 -03:00
Gervasio Marchand
4ccfaad15f
Make it possible to scrape followed tags from the instance ( #6 )
2022-12-17 22:27:04 -03:00
Gervasio Marchand
79177f8bf9
Update README ( #5 )
2022-12-16 11:57:30 -03:00
Gervasio Marchand
29bc4435e8
Merge pull request #4 from g3rv4/moar-runtimes
...
Add more executable runtimes
2022-12-15 21:08:17 -08:00
Gervasio Marchand
9f8c5bac15
Add more executable runtimes
2022-12-16 02:07:33 -03:00
Gervasio Marchand
e71904e1a3
Make it trimmable
2022-12-16 01:54:49 -03:00
Gervasio Marchand
41821ea23a
Create tags with manual gate
2022-12-15 19:24:58 -03:00
Gervasio Marchand
241f20632b
Merge pull request #3 from qwertzipups/patch-1
...
Update README.md
2022-12-15 13:07:43 -08:00
qwertzipups
83a68e445b
Update README.md
...
Changed to "--rm importdata" in the cron example.
2022-12-15 21:08:14 +01:00
Gervasio Marchand
0c7589c177
catch errors pulling data from other instances
2022-12-09 18:19:15 -03:00
Gervasio Marchand
f38c7ec00d
do IsNullOrEmpty instead
2022-12-07 20:31:14 -03:00
Gervasio Marchand
082d261116
Add ability to take the fake relay api key from env variable
2022-12-07 20:28:31 -03:00
Gervasio Marchand
f757ce4818
Link to the Docker on Windows demo
2022-12-07 09:16:24 -03:00
Gervasio Marchand
2caa81872d
Merge pull request #1 from sanderdatema/patch-1
...
Update README.md
2022-12-05 05:57:15 -08:00
Sander Datema
a7ad90018e
Update README.md
...
The name of the container in the `docker-compose.yml` example is `importdata` and not `import`.
2022-12-05 14:53:14 +01:00
Gervasio Marchand
c7992e21e1
one more README update
2022-12-05 10:15:57 -03:00
Gervasio Marchand
f40eb83673
Update README
2022-12-05 09:08:30 -03:00
Gervasio Marchand
28fe45a075
make it more parallel
2022-12-05 08:56:11 -03:00
Gervasio Marchand
54828b9469
Rename!
2022-12-05 08:38:07 -03:00
Gervasio Marchand
4434af951e
Use FakeRelay, build a docker image and set things in a config file
2022-12-05 00:37:07 -03:00