pezcurrel
|
a4486403c7
|
Made language fetching normalize language code to a form with _ insted of -
|
2023-01-01 16:51:20 +01:00 |
|
pezcurrel
|
a4215c943d
|
Added a notify() to getlangid() to be done if Languages contains more than 1 record with given language code
|
2022-12-31 07:19:00 +01:00 |
|
pezcurrel
|
0c2f4e6b27
|
Added “intness” check on values from “tag trands history”
|
2022-12-31 07:13:02 +01:00 |
|
pezcurrel
|
b8e84c72c5
|
Fixed a misleading comment
|
2022-12-30 19:20:48 +01:00 |
|
pezcurrel
|
b40e474e76
|
Added code to set TotChecks and OkChecks
|
2022-12-30 18:12:07 +01:00 |
|
pezcurrel
|
f2d4119dfa
|
Fixed bug on domain block entity format check
|
2022-12-30 14:07:22 +01:00 |
|
pezcurrel
|
b39eafdb80
|
Fixed getlangid missing $opts; fixed array_pop on inexistent $languages var
|
2022-12-29 12:49:38 +01:00 |
|
pezcurrel
|
ec33912ff8
|
Restructured a bit the language management code
|
2022-12-28 23:47:23 +01:00 |
|
pezcurrel
|
db749d2e7d
|
Consider the possibility that “our languages” have been locked
|
2022-12-28 19:17:05 +01:00 |
|
pezcurrel
|
b929d06302
|
Don’t INSERT an instance if it did not respond: it was useful before instance “deadness” was autonomously managed by peerscrawl.php
|
2022-12-28 18:59:09 +01:00 |
|
pezcurrel
|
e8d588c0f2
|
Refactored language management
|
2022-12-28 18:34:57 +01:00 |
|
pezcurrel
|
2b37228a1c
|
Fixed some flaws in detecting if Thumb and AdmAvatar are to be set to “unavailable”; fixed “noindex” logic, now it also explictly set AdmAccount to special “OPTED OUT” value when noindex=true
|
2022-12-28 17:09:25 +01:00 |
|
pezcurrel
|
6f5de9730e
|
When server thumb or admin avatar are unavailable, set them to “unavailable”
|
2022-12-28 07:01:29 +01:00 |
|
pezcurrel
|
ce66aa56e9
|
Added instance blocks support
|
2022-12-27 23:02:31 +01:00 |
|
pezcurrel
|
c0b9c19469
|
Added keys check on instance info fetched from api v2 and v1; subordinated language checks to “$instaswered”; made get_toot_languages better cope with possible errors
|
2022-12-27 09:05:31 +01:00 |
|
pezcurrel
|
f7f1ac4cb2
|
logfile has .gii.log extension, handy to select only these files when run from crawler.php
|
2022-12-26 22:10:20 +01:00 |
|
pezcurrel
|
463ef7cd37
|
Removed a dangling “}” which was breaking the script
|
2022-12-26 18:06:54 +01:00 |
|
pezcurrel
|
3c1621df1d
|
Added “LastOkCheckTS” to $instints (array of Instances columns of integer type)
|
2022-12-26 13:29:19 +01:00 |
|
pezcurrel
|
1e1b2a99e9
|
Dropped Instances.Dead, using Instances.LastOkCheckTS now instead
|
2022-12-26 12:25:15 +01:00 |
|
pezcurrel
|
95b9ccfc31
|
Renamed “LastCheckOk” to “WasLastCheckOk”
|
2022-12-26 05:30:35 +01:00 |
|
pezcurrel
|
00caa1dcb9
|
Changed default for “deadline” option from 62 to 31 days
|
2022-12-26 05:17:59 +01:00 |
|
pezcurrel
|
5312aea0cc
|
Added writing server rules in the db
|
2022-12-26 05:08:17 +01:00 |
|
pezcurrel
|
1d0c6b799a
|
Small edit to “logminmsglev” and “tuiminmsglev” TUI option parsing errors
|
2022-12-25 11:29:34 +01:00 |
|
pezcurrel
|
9fabb3853b
|
Infatti
|
2022-12-23 19:13:37 +01:00 |
|
pezcurrel
|
89a2ea0b26
|
Fixed “trending tags” ordering and fetching
|
2022-12-23 11:22:25 +01:00 |
|
pezcurrel
|
706c831e23
|
Little change in a message
|
2022-12-22 11:28:29 +01:00 |
|
pezcurrel
|
f8cdf2cf3b
|
Changed check against “activity” values, which are strings, not integers
|
2022-12-22 07:40:41 +01:00 |
|
pezcurrel
|
c6c3feb500
|
Removed leftovers of “jsonwrite” option
|
2022-12-22 07:05:21 +01:00 |
|
pezcurrel
|
732ea79480
|
Moved $mastodons definition upper
|
2022-12-21 22:06:10 +01:00 |
|
pezcurrel
|
0d74dbf243
|
Got rid of akeavinn; other minor changes
|
2022-12-21 07:54:11 +01:00 |
|
pezcurrel
|
2c86580bfb
|
The regexp to decide whether an instance is Mastodon or not is now based on the Platforms table; made ckratelimit more precise about possible missing headers; added code to set Version from /api/v1/instance when it was not already set from nodeinfo
|
2022-12-21 06:53:31 +01:00 |
|
pezcurrel
|
f6dc080ed6
|
Major rewrite: it was a mess, now it is less :-)
|
2022-12-20 23:00:22 +01:00 |
|
pezcurrel
|
835e02c171
|
Removed code referencing New, Good and Chosen columns
|
2022-12-18 18:26:03 +01:00 |
|
pezcurrel
|
e9b88d6735
|
Made $jsonfp be written into run dir
|
2022-12-18 07:00:19 +01:00 |
|
pezcurrel
|
a32a25e095
|
Many many changes :-))
|
2022-12-18 00:34:27 +01:00 |
|
pezcurrel
|
441d16a42d
|
ckratelimit goes to sleep only when x-ratelimit-remaining==0; can spit debug info; limit fetching chunks from users directories is now 40
|
2022-12-17 22:54:02 +01:00 |
|
pezcurrel
|
2d1d28b002
|
Fixed regexp checking if max_charcters is an integer; made mexit use eecho again, moving the closing of logf after eecho(s); made logf be opened only if logminmsglev < 4
|
2022-12-17 17:33:46 +01:00 |
|
pezcurrel
|
7629a1caae
|
Moved from subdir “crawlernew”
|
2022-12-17 15:00:36 +01:00 |
|