pezcurrel
|
b929d06302
Don’t INSERT an instance if it did not respond: it was useful before instance “deadness” was autonomously managed by peerscrawl.php
|
1 year ago |
pezcurrel
|
e8d588c0f2
Refactored language management
|
1 year ago |
pezcurrel
|
2b37228a1c
Fixed some flaws in detecting if Thumb and AdmAvatar are to be set to “unavailable”; fixed “noindex” logic, now it also explictly set AdmAccount to special “OPTED OUT” value when noindex=true
|
1 year ago |
pezcurrel
|
6f5de9730e
When server thumb or admin avatar are unavailable, set them to “unavailable”
|
1 year ago |
pezcurrel
|
ce66aa56e9
Added instance blocks support
|
1 year ago |
pezcurrel
|
c0b9c19469
Added keys check on instance info fetched from api v2 and v1; subordinated language checks to “$instaswered”; made get_toot_languages better cope with possible errors
|
1 year ago |
pezcurrel
|
f7f1ac4cb2
logfile has .gii.log extension, handy to select only these files when run from crawler.php
|
1 year ago |
pezcurrel
|
463ef7cd37
Removed a dangling “}” which was breaking the script
|
1 year ago |
pezcurrel
|
3c1621df1d
Added “LastOkCheckTS” to $instints (array of Instances columns of integer type)
|
1 year ago |
pezcurrel
|
1e1b2a99e9
Dropped Instances.Dead, using Instances.LastOkCheckTS now instead
|
1 year ago |
pezcurrel
|
95b9ccfc31
Renamed “LastCheckOk” to “WasLastCheckOk”
|
1 year ago |
pezcurrel
|
00caa1dcb9
Changed default for “deadline” option from 62 to 31 days
|
1 year ago |
pezcurrel
|
5312aea0cc
Added writing server rules in the db
|
1 year ago |
pezcurrel
|
1d0c6b799a
Small edit to “logminmsglev” and “tuiminmsglev” TUI option parsing errors
|
1 year ago |
pezcurrel
|
9fabb3853b
Infatti
|
1 year ago |
pezcurrel
|
89a2ea0b26
Fixed “trending tags” ordering and fetching
|
1 year ago |
pezcurrel
|
706c831e23
Little change in a message
|
1 year ago |
pezcurrel
|
f8cdf2cf3b
Changed check against “activity” values, which are strings, not integers
|
1 year ago |
pezcurrel
|
c6c3feb500
Removed leftovers of “jsonwrite” option
|
1 year ago |
pezcurrel
|
732ea79480
Moved $mastodons definition upper
|
1 year ago |
pezcurrel
|
0d74dbf243
Got rid of akeavinn; other minor changes
|
1 year ago |
pezcurrel
|
2c86580bfb
The regexp to decide whether an instance is Mastodon or not is now based on the Platforms table; made ckratelimit more precise about possible missing headers; added code to set Version from /api/v1/instance when it was not already set from nodeinfo
|
1 year ago |
pezcurrel
|
f6dc080ed6
Major rewrite: it was a mess, now it is less :-)
|
1 year ago |
pezcurrel
|
835e02c171
Removed code referencing New, Good and Chosen columns
|
1 year ago |
pezcurrel
|
e9b88d6735
Made $jsonfp be written into run dir
|
1 year ago |
pezcurrel
|
a32a25e095
Many many changes :-))
|
1 year ago |
pezcurrel
|
441d16a42d
ckratelimit goes to sleep only when x-ratelimit-remaining==0; can spit debug info; limit fetching chunks from users directories is now 40
|
1 year ago |
pezcurrel
|
2d1d28b002
Fixed regexp checking if max_charcters is an integer; made mexit use eecho again, moving the closing of logf after eecho(s); made logf be opened only if logminmsglev < 4
|
1 year ago |
pezcurrel
|
7629a1caae
Moved from subdir “crawlernew”
|
1 year ago |