Commit graph

882 commits

Author SHA1 Message Date
pezcurrel
3309da4721 Improved help text; changed $oldline from 31 to 30 days 2023-01-03 18:58:58 +01:00
pezcurrel
043e8fab41 Added a blocklist mechanism, based for now on http Referer header; improved a bit muoribene function 2023-01-03 18:52:47 +01:00
pezcurrel
30c137862c Changed $gracetime from 31 to 30 days 2023-01-03 18:50:30 +01:00
pezcurrel
59dd8cd307 Blocklist 2023-01-03 18:49:57 +01:00
pezcurrel
1f2165249d “Advanced criteria” are always displayed; removed “reset advanced criteria to default”; restructured code 2023-01-03 05:43:57 +01:00
pezcurrel
1d754f9588 Fixed getlangid: it used $lang instead of $code 2023-01-03 00:11:59 +01:00
pezcurrel
3c85ed78a0 Fixed a bug with $mincdef and $_GET["minc"] 2023-01-02 13:54:36 +01:00
pezcurrel
21fe338c12 Didn’t pass a graceline to dispinst, now it does 2023-01-02 08:52:26 +01:00
pezcurrel
95bd83786e Fixed a bug that caused “languages” to be always saved as “ourlanguages” 2023-01-02 08:37:07 +01:00
pezcurrel
6f296a1d27 Fixed writing langs ids to InstOurLangs; made detected languages fall back to declared languages when they can't be detected 2023-01-01 19:50:57 +01:00
pezcurrel
fa97078fe4 Passing calling __LINE__ through getlangsidsarr and getlangsid the right way 2023-01-01 19:26:39 +01:00
pezcurrel
87fbbbd2f9 Added validity check on declared and detected lang codes to getlangid function - when lang code is not valide it falls back to “en” default; added a getlangsidsarr function to cope with possible dupes and spare code 2023-01-01 19:21:21 +01:00
pezcurrel
c039d85d76 A little script to fix InstLangs, InstOurLangs and Languages table as of 2023-01-01 2023-01-01 18:23:34 +01:00
pezcurrel
24b9f9b911 Made it canonicalize lang codes in getlangid 2023-01-01 18:22:48 +01:00
pezcurrel
a4486403c7 Made language fetching normalize language code to a form with _ insted of - 2023-01-01 16:51:20 +01:00
pezcurrel
184cf49d16 Added “Show instances where...” string to instances.php 2023-01-01 14:47:58 +01:00
pezcurrel
91aa3e0b68 Added “Show instances where” string and an “horizontal ruler” div between “include” and “exclude” criteria 2023-01-01 14:44:50 +01:00
pezcurrel
dd4cc24a36 Added .sddesc and .hrd classes 2023-01-01 14:43:33 +01:00
pezcurrel
5afbdac010 Modified a bit a string 2023-01-01 11:57:00 +01:00
pezcurrel
6814b8060e Put out of echoed html the “popupback” divs and commented them out 2023-01-01 11:37:40 +01:00
pezcurrel
5236126ef1 Added nl language 2023-01-01 11:16:52 +01:00
pezcurrel
5ffd28f906 Added nl language 2023-01-01 11:14:25 +01:00
pezcurrel
bb30be31ca Little update 2023-01-01 11:11:49 +01:00
pezcurrel
322d24fdaf Merge branch 'main' into weblate after adding and modifying some strings in instances.php 2023-01-01 11:09:10 +01:00
pezcurrel
655c180aea Added and modified some strings in the search form of instances.php 2023-01-01 11:06:17 +01:00
pezcurrel
c3b58faa23 Added the possibility to include only instances where max chars per post is at least x; added som strings; modified some others 2023-01-01 11:05:51 +01:00
Oliebol
b38a39e8b5
Added translation using Weblate (Dutch) 2022-12-31 15:04:18 +01:00
pezcurrel
ac6c5b0585 Changed and splitted some strings in about.php 2022-12-31 12:31:14 +01:00
pezcurrel
683a2027a9 Changed my mastodon address, splitted translation there 2022-12-31 12:24:18 +01:00
pezcurrel
2a59e13064 Removed redundant closing body and html tags from “under construction” stuff 2022-12-31 10:22:55 +01:00
pezcurrel
af7c2e1f6e Added missing closing body and html tags to “under construction” stuff 2022-12-31 10:22:00 +01:00
pezcurrel
d981e429f6 If the script is called directly, exit with a redirection tip 2022-12-31 10:19:09 +01:00
pezcurrel
0863c32703 Added InstChecks cleaning to “clean” action 2022-12-31 09:46:28 +01:00
pezcurrel
80ce9f56c9 Added missing “users” page definition 2022-12-31 07:25:42 +01:00
pezcurrel
a4215c943d Added a notify() to getlangid() to be done if Languages contains more than 1 record with given language code 2022-12-31 07:19:00 +01:00
pezcurrel
0c2f4e6b27 Added “intness” check on values from “tag trands history” 2022-12-31 07:13:02 +01:00
pezcurrel
b8e84c72c5 Fixed a misleading comment 2022-12-30 19:20:48 +01:00
pezcurrel
a2660e737b Added 3 strings about TotChecks and OkChecks 2022-12-30 18:18:29 +01:00
pezcurrel
d6982752bb Added succesful checks / total checks ratio showing and ordering 2022-12-30 18:14:09 +01:00
pezcurrel
d87cc7f5cc Added dida100 class 2022-12-30 18:12:33 +01:00
pezcurrel
b40e474e76 Added code to set TotChecks and OkChecks 2022-12-30 18:12:07 +01:00
pezcurrel
b9392a0c25 Little script to set Instances.TotChecks and Instances.OkChecks according to records stored in InstChecks table 2022-12-30 17:16:11 +01:00
pezcurrel
478aa4d0b0 Made the “advice for admins of instances missing server thumb” show up only if instance responded to last check, otherwise it’s probably missing just because the whole instance is not responding 2022-12-30 16:59:59 +01:00
pezcurrel
f2d4119dfa Fixed bug on domain block entity format check 2022-12-30 14:07:22 +01:00
pezcurrel
90e2263af8 Added “cursor: help;” to “nulltip” class 2022-12-30 11:24:24 +01:00
pezcurrel
82d0049f75 Added “We record this value only since October 14, 2020 ;-)” string to instances.php 2022-12-30 10:00:53 +01:00
pezcurrel
4d05060b69 Added a tip (for now it’s just a “title” attribute) about the “Before October 14, 2020” that “First sight” can show 2022-12-30 09:57:33 +01:00
pezcurrel
d0f0e527fe Added “nulltip” class 2022-12-30 09:55:42 +01:00
pezcurrel
65523d49c3 Added “Before October 14, 2020” string to instances.php 2022-12-30 09:18:06 +01:00
pezcurrel
9bc4d4cde6 When FirstSeen is < 2022-10-14, just say “First sight” has occurred before that date, because we don’t have the actual value before that date 2022-12-30 09:16:47 +01:00
pezcurrel
a677033529 Added act class 2022-12-30 09:15:11 +01:00
pezcurrel
86ff6bd4ab Added popupback and dhelp classes 2022-12-30 09:14:43 +01:00
pezcurrel
7b1cd91704 Translated missing strings to it 2022-12-29 23:38:39 +01:00
pezcurrel
2197e832c8 Added some strings to instances.php 2022-12-29 23:34:21 +01:00
pezcurrel
a2c6b49403 Added some sort criteria; added “first sight” and “last successful check” 2022-12-29 23:33:23 +01:00
pezcurrel
e66a6f9e2b Dotted line under links sucked on chrome, now it sucks less (tm) 2022-12-29 21:43:24 +01:00
pezcurrel
cae51fc141 Enhanced a bit strip function 2022-12-29 21:42:44 +01:00
pezcurrel
3db59734d1 Changed function ldate to show timezone (always UTC) even when it displays only the date 2022-12-29 21:08:17 +01:00
pezcurrel
0bb759ddd0 Translated “Display name” 2022-12-29 19:46:24 +01:00
pezcurrel
57e075858b Changed some strings in admin account section of instances.php 2022-12-29 19:40:36 +01:00
pezcurrel
25dc018f69 Improved strip function; minor changes 2022-12-29 19:40:05 +01:00
pezcurrel
60b6ce1f78 Commented out of strip function an ongoing attempt at improving it that in some cases has some bad side effects 2022-12-29 13:37:49 +01:00
pezcurrel
b39eafdb80 Fixed getlangid missing $opts; fixed array_pop on inexistent $languages var 2022-12-29 12:49:38 +01:00
pezcurrel
64073fa12e Added classes for instances.php strip function 2022-12-29 12:41:03 +01:00
pezcurrel
b21b4f2ec2 Improved strip function 2022-12-29 12:40:35 +01:00
pezcurrel
1762e1cc7e Fixed wrong class for “moderated servers” list (“nobot” -> “nobott”) 2022-12-29 10:25:48 +01:00
pezcurrel
073cdb9ffb Assigned “.nobott” css class to server rules ordered list and moderated servers unordered list 2022-12-29 10:15:13 +01:00
pezcurrel
8af570ff9c Added “.idesc ul|ol.nobott” classes 2022-12-29 10:13:55 +01:00
pezcurrel
fd60944df4 Shortened the “wrong server thumbnail URL” message 2022-12-29 09:55:25 +01:00
pezcurrel
bf92c42a83 Shortened the “wrong server thumbnail URL” message 2022-12-29 09:54:55 +01:00
pezcurrel
f2b3642bcd Added “wrong server thumbnail URL” message 2022-12-29 09:46:40 +01:00
pezcurrel
3047472fda Added missing space character between software and version 2022-12-29 09:45:45 +01:00
pezcurrel
dd91bbde38 Added “unavmsg” class 2022-12-29 09:30:42 +01:00
pezcurrel
594447e2a5 Added a “message to admins” that gets shown when server thumbnail is unavailable, explaining how to try and fix it 2022-12-29 09:30:06 +01:00
pezcurrel
94bfec5f78 “$list” paramater of function “crawl” is now passed by reference; “$list” now gets unset in any case after it has been looped through; this hopefully will decrease a bit the amount of memory used by the script 2022-12-29 09:28:18 +01:00
pezcurrel
9e7868461a Added “Opted out of search engines indexing” string 2022-12-29 00:15:53 +01:00
pezcurrel
5bdff13983 Merge branch 'weblate' with new translated strings for deutsch and ukrainian 2022-12-28 23:54:28 +01:00
Pongrèbio
52a056352f
Translated using Weblate (Ukrainian)
Currently translated at 100.0% (409 of 409 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/uk/
2022-12-28 23:53:30 +01:00
Ігор Андреєв
b431738881
Translated using Weblate (Ukrainian)
Currently translated at 100.0% (409 of 409 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/uk/
2022-12-28 23:50:17 +01:00
nichu42
f05c09a9c8
Translated using Weblate (German)
Currently translated at 95.8% (392 of 409 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/de/
2022-12-28 23:50:16 +01:00
pezcurrel
ec33912ff8 Restructured a bit the language management code 2022-12-28 23:47:23 +01:00
pezcurrel
db749d2e7d Consider the possibility that “our languages” have been locked 2022-12-28 19:17:05 +01:00
pezcurrel
b929d06302 Don’t INSERT an instance if it did not respond: it was useful before instance “deadness” was autonomously managed by peerscrawl.php 2022-12-28 18:59:09 +01:00
pezcurrel
e7eb303094 Updated comment describing what to do when a site language (translation) is added 2022-12-28 18:56:29 +01:00
pezcurrel
e8d588c0f2 Refactored language management 2022-12-28 18:34:57 +01:00
pezcurrel
01f9465625 Placeholder image to load by instances.php when server Thumb is “unavailable” 2022-12-28 18:33:26 +01:00
pezcurrel
c80290511a Placeholder image to load when AdmAvatar is “unavailable” 2022-12-28 18:32:54 +01:00
pezcurrel
a970bd81f6 Fixed AdmAccount showing logic, added string with message when it’s set to “OPTED OUT” special value 2022-12-28 17:11:17 +01:00
pezcurrel
2b37228a1c Fixed some flaws in detecting if Thumb and AdmAvatar are to be set to “unavailable”; fixed “noindex” logic, now it also explictly set AdmAccount to special “OPTED OUT” value when noindex=true 2022-12-28 17:09:25 +01:00
pezcurrel
870e3524ca Fixed $maxround not set to actual max round 2022-12-28 17:06:39 +01:00
pezcurrel
9d877986a5 When server thumb or admin avatar are set to “unavailable”, show an “unavailable” image 2022-12-28 07:02:17 +01:00
pezcurrel
6f5de9730e When server thumb or admin avatar are unavailable, set them to “unavailable” 2022-12-28 07:01:29 +01:00
pezcurrel
cf158ceb73 Now it makes a tar.xz with “run” directory contents and remove them before running commands 2022-12-28 05:25:56 +01:00
pezcurrel
242b728f43 Cope with the possibility that “Software” and-or “Version” are null 2022-12-27 23:33:31 +01:00
Pongrèbio
8883460cac
Translated using Weblate (Italian)
Currently translated at 100.0% (409 of 409 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/it/
2022-12-27 23:17:26 +01:00
pezcurrel
2add5a8066 Added string “Moderated servers” 2022-12-27 23:14:04 +01:00
pezcurrel
e484298feb Added instance blocks (“moderated servers”) support 2022-12-27 23:03:31 +01:00
pezcurrel
ce66aa56e9 Added instance blocks support 2022-12-27 23:02:31 +01:00
pezcurrel
430c35e17a Little change in progress string 2022-12-27 23:01:39 +01:00
Pongrèbio
ff2eb79173
Translated using Weblate (Italian)
Currently translated at 100.0% (406 of 406 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/it/
2022-12-27 18:17:49 +01:00
pezcurrel
0363280e7e Added “Server rules” string 2022-12-27 16:45:50 +01:00
pezcurrel
9ae4e81f1c Added “Server rules” showing 2022-12-27 16:45:02 +01:00
pezcurrel
540b5ccce6 Styled better some <ol> and <ul>, mainly to better show “Server rules” 2022-12-27 16:44:36 +01:00
pezcurrel
73469fa012 Default pool size back to 10 2022-12-27 15:39:46 +01:00
pezcurrel
c0b9c19469 Added keys check on instance info fetched from api v2 and v1; subordinated language checks to “$instaswered”; made get_toot_languages better cope with possible errors 2022-12-27 09:05:31 +01:00
pezcurrel
5ae8fc562d Cleaner; now returns error code too 2022-12-26 22:37:05 +01:00
pezcurrel
f7f1ac4cb2 logfile has .gii.log extension, handy to select only these files when run from crawler.php 2022-12-26 22:10:20 +01:00
pezcurrel
ea0118d445 cmd now prepends exec to command; pipes get closed 2022-12-26 22:09:18 +01:00
pezcurrel
463ef7cd37 Removed a dangling “}” which was breaking the script 2022-12-26 18:06:54 +01:00
pezcurrel
ff2d6c09a8 Removed “peers.all” file; made the script write to “peers files” only on exit (be it clean or by interruption) 2022-12-26 16:40:10 +01:00
pezcurrel
44b6456695 Made check on peers more strict, made the script abandon checking when a peers entry is malformed 2022-12-26 15:27:14 +01:00
pezcurrel
d301d25fcc Removed witches.live, have to check why on the server it takes so long to check its peers, here it doesn’t, it’s probably just that we should increase the server ram and-or cpu 2022-12-26 15:02:50 +01:00
pezcurrel
3f7a5ff69c Moved $graceline definition up, fixing a bug; made peers checking msgs more informative 2022-12-26 15:01:35 +01:00
pezcurrel
97f5b99654 Removed ckpeers function, it was overkill; added a preliminary check for “stringness” to the checks on each peer 2022-12-26 14:51:42 +01:00
pezcurrel
a4b2ae731c Added witches.live since its peers list is huge and full of .activitypub-troll.cf 2022-12-26 14:50:26 +01:00
pezcurrel
926b1b0d73 Added ckpeers function to check if the json array returned by api/v1/instance/peers is well formed 2022-12-26 14:12:06 +01:00
pezcurrel
3c1621df1d Added “LastOkCheckTS” to $instints (array of Instances columns of integer type) 2022-12-26 13:29:19 +01:00
pezcurrel
e820845775 Consider instances which have LastOkCheckTS=null but InsertTS>=$graceline as not dead, and to be checked 2022-12-26 13:28:09 +01:00
pezcurrel
d6d8adee49 Updated to last changes 2022-12-26 12:30:56 +01:00
pezcurrel
61da12100f Removed comment with Instances columns 2022-12-26 12:29:08 +01:00
pezcurrel
ebc458cc2c Removed “resurrect” option and references to Instances.Dead 2022-12-26 12:28:21 +01:00
pezcurrel
d18775fd52 Defines $gracetime, first commit 2022-12-26 12:27:08 +01:00
pezcurrel
1e1b2a99e9 Dropped Instances.Dead, using Instances.LastOkCheckTS now instead 2022-12-26 12:25:15 +01:00
pezcurrel
9b3cca9a45 Script to reasonably set Instances.LastOkCheckTS, first commit 2022-12-26 12:21:47 +01:00
pezcurrel
95b9ccfc31 Renamed “LastCheckOk” to “WasLastCheckOk” 2022-12-26 05:30:35 +01:00
pezcurrel
00caa1dcb9 Changed default for “deadline” option from 62 to 31 days 2022-12-26 05:17:59 +01:00
pezcurrel
44f437c928 Translated initial comment, made it more terse 2022-12-26 05:09:09 +01:00
pezcurrel
5312aea0cc Added writing server rules in the db 2022-12-26 05:08:17 +01:00
pezcurrel
337eb32f51 Made mail optional, inactive by default 2022-12-25 23:45:31 +01:00
pezcurrel
429ab42ff5 Added 2 debug messages stating how mani dead instances the script got from Instances and Peers tables 2022-12-25 18:55:54 +01:00
pezcurrel
e3968a5ace Updated to last changes 2022-12-25 18:54:55 +01:00
pezcurrel
119c9119c2 Made the logic for “deadline” much more terse 2022-12-25 18:41:13 +01:00
pezcurrel
acde202b2e Made it write summary from crawl run into a log file of its own 2022-12-25 18:40:21 +01:00
pezcurrel
ba171bd5f2 Use specifically bash since we use &> redirect 2022-12-25 11:43:30 +01:00
pezcurrel
ec9b65e42f Little script to run peerscrawl.php in loop; first commit 2022-12-25 11:32:49 +01:00
pezcurrel
10e2e1b58a Added “lecho” for “message levels”, removed “gecho”, removed “verbose” option; removed “loop” option (do loop from a shell script if needed) 2022-12-25 11:32:08 +01:00
pezcurrel
1d0c6b799a Small edit to “logminmsglev” and “tuiminmsglev” TUI option parsing errors 2022-12-25 11:29:34 +01:00
pezcurrel
d95bc70b8a Exposed “deadline” option; minor changes 2022-12-25 09:47:04 +01:00
pezcurrel
c0802de828 Removed “restore” option: could work, but it’s not very useful and would require a big hassle; added loops and new found instances counters; made sighandler use mexit 2022-12-25 09:24:23 +01:00
pezcurrel
d6b77b0e29 Removed option “-p peers” from crawler cmdline because now peerscrawl directly writes new instances into the db 2022-12-24 08:59:33 +01:00
pezcurrel
9fabb3853b Infatti 2022-12-23 19:13:37 +01:00
pezcurrel
96aa6f3aa9 Quella roba lì 2022-12-23 19:12:18 +01:00
pezcurrel
05fed0142c Lowered a bit default values for “timeout” and “curltimeout” 2022-12-23 11:23:32 +01:00
pezcurrel
89a2ea0b26 Fixed “trending tags” ordering and fetching 2022-12-23 11:22:25 +01:00
pezcurrel
edee66b834 Temporarily disabled “restore” option because it needs more work to actually work 2022-12-22 15:32:30 +01:00
pezcurrel
61d0fcb3d8 Added “loop” option allowing to run the crawl in an infinite loop or until sig(int|hup|term) received; other minor changes 2022-12-22 15:05:55 +01:00
pezcurrel
6477e8812f Exposed “curltimeout” option; changed “timeout” default from 5 to 10; changed “curltimeout” default from 10 to 20 2022-12-22 14:24:48 +01:00
pezcurrel
6d4ce26f98 Adapted “restore” code to the new workings; minor changes and fixes 2022-12-22 14:04:29 +01:00
pezcurrel
a47ccdd5e2 Merge branch 'weblate': new strings have been translated to russian 2022-12-22 11:41:12 +01:00
pezcurrel
562639fb5c Updated after adding Peers and PeersCheck tables 2022-12-22 11:37:00 +01:00