Jones/MastodonHelp
1
0
Fork 0
Code Issues Pull requests Releases Wiki Activity
1167 commits 2 branches 0 tags 58 MiB
Commit graph

1072 commits

Author SHA1 Message Date
pezcurrel
05607aba5b Changed some strings in instances.php 2023-01-07 12:59:44 +01:00
pezcurrel
fac6a32d87 Show dates in localized format 2023-01-07 12:56:32 +01:00
pezcurrel
9cb1f272cc Always detect browser first accepted language if available and store it into $blang: it’s needed in instances.php 2023-01-07 12:55:43 +01:00
pezcurrel
f69f2853db Trap more signals; added shutdown function 2023-01-07 12:54:07 +01:00
pezcurrel
861fdb5345 Removed useless extra newline in signalHandler 2023-01-07 12:53:25 +01:00
pezcurrel
50b1b880a4 Made error messages in case of failed charset setting report mysql error number too 2023-01-06 22:06:40 +01:00
pezcurrel
03aa9cb786 Updated 2023-01-06 22:05:22 +01:00
pezcurrel
85559ac1a4 Fixed $graceline to start of current day - $gracetime 2023-01-06 18:43:07 +01:00
pezcurrel
ce539e520b Merge branch 'weblate' with new translated strings for uk and fr 2023-01-06 18:07:20 +01:00
J. Lavoie
632d68255a
Translated using Weblate (French) 
Currently translated at 93.1% (411 of 441 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/fr/
 2023-01-06 18:06:38 +01:00
pezcurrel
74ad6943e7 Removed condition “FirstSeen IS NOT NULL” from all the queries since now it’s implied in “LastOkCheckTS>=$graceline” 2023-01-06 18:01:01 +01:00
pezcurrel
0be17601f8 Made it run peerscrawl.php with a gracetime of 1 year once after the 26th of the month; minor changes 2023-01-06 17:08:07 +01:00
pezcurrel
2c66514b37 Made it run crawler.php with a gracetime of 1 year on first of the month; minor changes 2023-01-06 17:06:44 +01:00
pezcurrel
662e789bbf Removed useless ability to write to a log file; other minor changes 2023-01-06 17:05:47 +01:00
pezcurrel
b22befdec2 Removed “excludead” option: use a high “gracetime” when needed; other minor changes 2023-01-06 17:03:41 +01:00
pezcurrel
3f656e0fa1 Removed useless ability to write to a log file; other minor changes 2023-01-06 17:02:04 +01:00
J. Lavoie
dfd3e0d4e9
Translated using Weblate (French) 
Currently translated at 91.6% (404 of 441 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/fr/
 2023-01-06 00:55:34 +01:00
Ігор Андреєв
d04fff7531
Translated using Weblate (Ukrainian) 
Currently translated at 100.0% (441 of 441 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/uk/
 2023-01-05 21:51:28 +01:00
pezcurrel
874479fac7 Maintainance script, unifying crawl.bash and backup.bash; first commit 2023-01-05 20:08:13 +01:00
pezcurrel
63690b1cf6 Sample mysql/mysqldump config file, first commit 2023-01-05 20:07:10 +01:00
pezcurrel
f88b08a85a Added eecho function; other minor changes 2023-01-05 20:03:36 +01:00
pezcurrel
99fd5feb50 Renamed all the exclusion inputs to more sensible names 2023-01-04 23:42:16 +01:00
pezcurrel
5e84c8501d Rate limit exceeded error page for mod_qos, first commit 2023-01-04 22:26:39 +01:00
pezcurrel
662d506f4c Made “Random, recommended first” ordering available only for italian language 2023-01-04 20:28:53 +01:00
pezcurrel
296bd9e035 Made possible mysql connection errors messages nicer 2023-01-04 20:28:10 +01:00
pezcurrel
b07e773dcf Removed rough and already commented out “ratelimiting” code, we now use apache mod_qos 2023-01-04 15:16:22 +01:00
pezcurrel
e750aad3f5 Now sleeps in the end 0.25 seconds rather than 0.5 2023-01-04 13:43:34 +01:00
pezcurrel
83d3c6b5c5 Changed “discovered instances” to “instances responded” in message “working on ...” 2023-01-04 13:41:55 +01:00
pezcurrel
25fd358666 Commented out “tar” line for “run” dir: took long and wasn’t very useful 2023-01-04 13:40:53 +01:00
pezcurrel
3f86fc689b “$instanswered” got set to true if nodeinfo responded; now it gets set to true only if api/v2/instance or api/v1/instance responded 2023-01-04 13:39:10 +01:00
pezcurrel
b114deba61 Report elapsed time in message for finished procs 2023-01-04 13:37:05 +01:00
pezcurrel
388ddbbe55 Commented out rough ratelimiting cause it’s too rough :-)) --- added a tiny usleep(500000) at the end for now 2023-01-04 00:05:05 +01:00
pezcurrel
ed7820b636 Ratelimiter now keeps previous time for other sessions 2023-01-03 23:43:35 +01:00
pezcurrel
5372572966 Cache dir with placeholder file; first commit 2023-01-03 23:32:49 +01:00
pezcurrel
8bc4075a04 Removed blocklist and rough database based ratelimiting; added rough file based ratelimiting; cleaned up a bit 2023-01-03 23:31:38 +01:00
pezcurrel
3a95bf779e Deleted 2023-01-03 23:13:04 +01:00
pezcurrel
42b1ac164c Changed translation for “URI, name or descriptions contain” 2023-01-03 19:54:41 +01:00
pezcurrel
bc131006ea Changed the help text in instances.php 2023-01-03 19:49:08 +01:00
pezcurrel
42a821798c Changed a bit the help text 2023-01-03 19:48:42 +01:00
pezcurrel
f021e25cdc Fixed a typo in a string (“descriptions contains” -> “descriptions contain”) 2023-01-03 19:06:05 +01:00
pezcurrel
3309da4721 Improved help text; changed $oldline from 31 to 30 days 2023-01-03 18:58:58 +01:00
pezcurrel
043e8fab41 Added a blocklist mechanism, based for now on http Referer header; improved a bit muoribene function 2023-01-03 18:52:47 +01:00
pezcurrel
30c137862c Changed $gracetime from 31 to 30 days 2023-01-03 18:50:30 +01:00
pezcurrel
59dd8cd307 Blocklist 2023-01-03 18:49:57 +01:00
pezcurrel
1f2165249d “Advanced criteria” are always displayed; removed “reset advanced criteria to default”; restructured code 2023-01-03 05:43:57 +01:00
pezcurrel
1d754f9588 Fixed getlangid: it used $lang instead of $code 2023-01-03 00:11:59 +01:00
pezcurrel
3c85ed78a0 Fixed a bug with $mincdef and $_GET["minc"] 2023-01-02 13:54:36 +01:00
pezcurrel
21fe338c12 Didn’t pass a graceline to dispinst, now it does 2023-01-02 08:52:26 +01:00
pezcurrel
95bd83786e Fixed a bug that caused “languages” to be always saved as “ourlanguages” 2023-01-02 08:37:07 +01:00
pezcurrel
6f296a1d27 Fixed writing langs ids to InstOurLangs; made detected languages fall back to declared languages when they can't be detected 2023-01-01 19:50:57 +01:00
pezcurrel
fa97078fe4 Passing calling __LINE__ through getlangsidsarr and getlangsid the right way 2023-01-01 19:26:39 +01:00
pezcurrel
87fbbbd2f9 Added validity check on declared and detected lang codes to getlangid function - when lang code is not valide it falls back to “en” default; added a getlangsidsarr function to cope with possible dupes and spare code 2023-01-01 19:21:21 +01:00
pezcurrel
c039d85d76 A little script to fix InstLangs, InstOurLangs and Languages table as of 2023-01-01 2023-01-01 18:23:34 +01:00
pezcurrel
24b9f9b911 Made it canonicalize lang codes in getlangid 2023-01-01 18:22:48 +01:00
pezcurrel
a4486403c7 Made language fetching normalize language code to a form with _ insted of - 2023-01-01 16:51:20 +01:00
pezcurrel
184cf49d16 Added “Show instances where...” string to instances.php 2023-01-01 14:47:58 +01:00
pezcurrel
91aa3e0b68 Added “Show instances where” string and an “horizontal ruler” div between “include” and “exclude” criteria 2023-01-01 14:44:50 +01:00
pezcurrel
dd4cc24a36 Added .sddesc and .hrd classes 2023-01-01 14:43:33 +01:00
pezcurrel
5afbdac010 Modified a bit a string 2023-01-01 11:57:00 +01:00
pezcurrel
6814b8060e Put out of echoed html the “popupback” divs and commented them out 2023-01-01 11:37:40 +01:00
pezcurrel
5236126ef1 Added nl language 2023-01-01 11:16:52 +01:00
pezcurrel
5ffd28f906 Added nl language 2023-01-01 11:14:25 +01:00
pezcurrel
bb30be31ca Little update 2023-01-01 11:11:49 +01:00
pezcurrel
322d24fdaf Merge branch 'main' into weblate after adding and modifying some strings in instances.php 2023-01-01 11:09:10 +01:00
pezcurrel
655c180aea Added and modified some strings in the search form of instances.php 2023-01-01 11:06:17 +01:00
pezcurrel
c3b58faa23 Added the possibility to include only instances where max chars per post is at least x; added som strings; modified some others 2023-01-01 11:05:51 +01:00
Oliebol
b38a39e8b5
Added translation using Weblate (Dutch) 2022-12-31 15:04:18 +01:00
pezcurrel
ac6c5b0585 Changed and splitted some strings in about.php 2022-12-31 12:31:14 +01:00
pezcurrel
683a2027a9 Changed my mastodon address, splitted translation there 2022-12-31 12:24:18 +01:00
pezcurrel
2a59e13064 Removed redundant closing body and html tags from “under construction” stuff 2022-12-31 10:22:55 +01:00
pezcurrel
af7c2e1f6e Added missing closing body and html tags to “under construction” stuff 2022-12-31 10:22:00 +01:00
pezcurrel
d981e429f6 If the script is called directly, exit with a redirection tip 2022-12-31 10:19:09 +01:00
pezcurrel
0863c32703 Added InstChecks cleaning to “clean” action 2022-12-31 09:46:28 +01:00
pezcurrel
80ce9f56c9 Added missing “users” page definition 2022-12-31 07:25:42 +01:00
pezcurrel
a4215c943d Added a notify() to getlangid() to be done if Languages contains more than 1 record with given language code 2022-12-31 07:19:00 +01:00
pezcurrel
0c2f4e6b27 Added “intness” check on values from “tag trands history” 2022-12-31 07:13:02 +01:00
pezcurrel
b8e84c72c5 Fixed a misleading comment 2022-12-30 19:20:48 +01:00
pezcurrel
a2660e737b Added 3 strings about TotChecks and OkChecks 2022-12-30 18:18:29 +01:00
pezcurrel
d6982752bb Added succesful checks / total checks ratio showing and ordering 2022-12-30 18:14:09 +01:00
pezcurrel
d87cc7f5cc Added dida100 class 2022-12-30 18:12:33 +01:00
pezcurrel
b40e474e76 Added code to set TotChecks and OkChecks 2022-12-30 18:12:07 +01:00
pezcurrel
b9392a0c25 Little script to set Instances.TotChecks and Instances.OkChecks according to records stored in InstChecks table 2022-12-30 17:16:11 +01:00
pezcurrel
478aa4d0b0 Made the “advice for admins of instances missing server thumb” show up only if instance responded to last check, otherwise it’s probably missing just because the whole instance is not responding 2022-12-30 16:59:59 +01:00
pezcurrel
f2d4119dfa Fixed bug on domain block entity format check 2022-12-30 14:07:22 +01:00
pezcurrel
90e2263af8 Added “cursor: help;” to “nulltip” class 2022-12-30 11:24:24 +01:00
pezcurrel
82d0049f75 Added “We record this value only since October 14, 2020 ;-)” string to instances.php 2022-12-30 10:00:53 +01:00
pezcurrel
4d05060b69 Added a tip (for now it’s just a “title” attribute) about the “Before October 14, 2020” that “First sight” can show 2022-12-30 09:57:33 +01:00
pezcurrel
d0f0e527fe Added “nulltip” class 2022-12-30 09:55:42 +01:00
pezcurrel
65523d49c3 Added “Before October 14, 2020” string to instances.php 2022-12-30 09:18:06 +01:00
pezcurrel
9bc4d4cde6 When FirstSeen is < 2022-10-14, just say “First sight” has occurred before that date, because we don’t have the actual value before that date 2022-12-30 09:16:47 +01:00
pezcurrel
a677033529 Added act class 2022-12-30 09:15:11 +01:00
pezcurrel
86ff6bd4ab Added popupback and dhelp classes 2022-12-30 09:14:43 +01:00
pezcurrel
7b1cd91704 Translated missing strings to it 2022-12-29 23:38:39 +01:00
pezcurrel
2197e832c8 Added some strings to instances.php 2022-12-29 23:34:21 +01:00
pezcurrel
a2c6b49403 Added some sort criteria; added “first sight” and “last successful check” 2022-12-29 23:33:23 +01:00
pezcurrel
e66a6f9e2b Dotted line under links sucked on chrome, now it sucks less (tm) 2022-12-29 21:43:24 +01:00
pezcurrel
cae51fc141 Enhanced a bit strip function 2022-12-29 21:42:44 +01:00
pezcurrel
3db59734d1 Changed function ldate to show timezone (always UTC) even when it displays only the date 2022-12-29 21:08:17 +01:00
pezcurrel
0bb759ddd0 Translated “Display name” 2022-12-29 19:46:24 +01:00
pezcurrel
57e075858b Changed some strings in admin account section of instances.php 2022-12-29 19:40:36 +01:00
pezcurrel
25dc018f69 Improved strip function; minor changes 2022-12-29 19:40:05 +01:00
pezcurrel
60b6ce1f78 Commented out of strip function an ongoing attempt at improving it that in some cases has some bad side effects 2022-12-29 13:37:49 +01:00
pezcurrel
b39eafdb80 Fixed getlangid missing $opts; fixed array_pop on inexistent $languages var 2022-12-29 12:49:38 +01:00
pezcurrel
64073fa12e Added classes for instances.php strip function 2022-12-29 12:41:03 +01:00
pezcurrel
b21b4f2ec2 Improved strip function 2022-12-29 12:40:35 +01:00
pezcurrel
1762e1cc7e Fixed wrong class for “moderated servers” list (“nobot” -> “nobott”) 2022-12-29 10:25:48 +01:00
pezcurrel
073cdb9ffb Assigned “.nobott” css class to server rules ordered list and moderated servers unordered list 2022-12-29 10:15:13 +01:00
pezcurrel
8af570ff9c Added “.idesc ul|ol.nobott” classes 2022-12-29 10:13:55 +01:00
pezcurrel
fd60944df4 Shortened the “wrong server thumbnail URL” message 2022-12-29 09:55:25 +01:00
pezcurrel
bf92c42a83 Shortened the “wrong server thumbnail URL” message 2022-12-29 09:54:55 +01:00
pezcurrel
f2b3642bcd Added “wrong server thumbnail URL” message 2022-12-29 09:46:40 +01:00
pezcurrel
3047472fda Added missing space character between software and version 2022-12-29 09:45:45 +01:00
pezcurrel
dd91bbde38 Added “unavmsg” class 2022-12-29 09:30:42 +01:00
pezcurrel
594447e2a5 Added a “message to admins” that gets shown when server thumbnail is unavailable, explaining how to try and fix it 2022-12-29 09:30:06 +01:00
pezcurrel
94bfec5f78 “$list” paramater of function “crawl” is now passed by reference; “$list” now gets unset in any case after it has been looped through; this hopefully will decrease a bit the amount of memory used by the script 2022-12-29 09:28:18 +01:00
pezcurrel
9e7868461a Added “Opted out of search engines indexing” string 2022-12-29 00:15:53 +01:00
pezcurrel
5bdff13983 Merge branch 'weblate' with new translated strings for deutsch and ukrainian 2022-12-28 23:54:28 +01:00
Pongrèbio
52a056352f
Translated using Weblate (Ukrainian) 
Currently translated at 100.0% (409 of 409 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/uk/
 2022-12-28 23:53:30 +01:00
Ігор Андреєв
b431738881
Translated using Weblate (Ukrainian) 
Currently translated at 100.0% (409 of 409 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/uk/
 2022-12-28 23:50:17 +01:00
nichu42
f05c09a9c8
Translated using Weblate (German) 
Currently translated at 95.8% (392 of 409 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/de/
 2022-12-28 23:50:16 +01:00
pezcurrel
ec33912ff8 Restructured a bit the language management code 2022-12-28 23:47:23 +01:00
pezcurrel
db749d2e7d Consider the possibility that “our languages” have been locked 2022-12-28 19:17:05 +01:00
pezcurrel
b929d06302 Don’t INSERT an instance if it did not respond: it was useful before instance “deadness” was autonomously managed by peerscrawl.php 2022-12-28 18:59:09 +01:00
pezcurrel
e7eb303094 Updated comment describing what to do when a site language (translation) is added 2022-12-28 18:56:29 +01:00
pezcurrel
e8d588c0f2 Refactored language management 2022-12-28 18:34:57 +01:00
pezcurrel
01f9465625 Placeholder image to load by instances.php when server Thumb is “unavailable” 2022-12-28 18:33:26 +01:00
pezcurrel
c80290511a Placeholder image to load when AdmAvatar is “unavailable” 2022-12-28 18:32:54 +01:00
pezcurrel
a970bd81f6 Fixed AdmAccount showing logic, added string with message when it’s set to “OPTED OUT” special value 2022-12-28 17:11:17 +01:00
pezcurrel
2b37228a1c Fixed some flaws in detecting if Thumb and AdmAvatar are to be set to “unavailable”; fixed “noindex” logic, now it also explictly set AdmAccount to special “OPTED OUT” value when noindex=true 2022-12-28 17:09:25 +01:00
pezcurrel
870e3524ca Fixed $maxround not set to actual max round 2022-12-28 17:06:39 +01:00
pezcurrel
9d877986a5 When server thumb or admin avatar are set to “unavailable”, show an “unavailable” image 2022-12-28 07:02:17 +01:00
pezcurrel
6f5de9730e When server thumb or admin avatar are unavailable, set them to “unavailable” 2022-12-28 07:01:29 +01:00
pezcurrel
cf158ceb73 Now it makes a tar.xz with “run” directory contents and remove them before running commands 2022-12-28 05:25:56 +01:00
pezcurrel
242b728f43 Cope with the possibility that “Software” and-or “Version” are null 2022-12-27 23:33:31 +01:00
Pongrèbio
8883460cac
Translated using Weblate (Italian) 
Currently translated at 100.0% (409 of 409 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/it/
 2022-12-27 23:17:26 +01:00
pezcurrel
2add5a8066 Added string “Moderated servers” 2022-12-27 23:14:04 +01:00
pezcurrel
e484298feb Added instance blocks (“moderated servers”) support 2022-12-27 23:03:31 +01:00
pezcurrel
ce66aa56e9 Added instance blocks support 2022-12-27 23:02:31 +01:00
pezcurrel
430c35e17a Little change in progress string 2022-12-27 23:01:39 +01:00
Pongrèbio
ff2eb79173
Translated using Weblate (Italian) 
Currently translated at 100.0% (406 of 406 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/it/
 2022-12-27 18:17:49 +01:00
pezcurrel
0363280e7e Added “Server rules” string 2022-12-27 16:45:50 +01:00
pezcurrel
9ae4e81f1c Added “Server rules” showing 2022-12-27 16:45:02 +01:00
pezcurrel
540b5ccce6 Styled better some <ol> and <ul>, mainly to better show “Server rules” 2022-12-27 16:44:36 +01:00
pezcurrel
73469fa012 Default pool size back to 10 2022-12-27 15:39:46 +01:00
pezcurrel
c0b9c19469 Added keys check on instance info fetched from api v2 and v1; subordinated language checks to “$instaswered”; made get_toot_languages better cope with possible errors 2022-12-27 09:05:31 +01:00
pezcurrel
5ae8fc562d Cleaner; now returns error code too 2022-12-26 22:37:05 +01:00
pezcurrel
f7f1ac4cb2 logfile has .gii.log extension, handy to select only these files when run from crawler.php 2022-12-26 22:10:20 +01:00
pezcurrel
ea0118d445 cmd now prepends exec to command; pipes get closed 2022-12-26 22:09:18 +01:00
pezcurrel
463ef7cd37 Removed a dangling “}” which was breaking the script 2022-12-26 18:06:54 +01:00
pezcurrel
ff2d6c09a8 Removed “peers.all” file; made the script write to “peers files” only on exit (be it clean or by interruption) 2022-12-26 16:40:10 +01:00
pezcurrel
44b6456695 Made check on peers more strict, made the script abandon checking when a peers entry is malformed 2022-12-26 15:27:14 +01:00
pezcurrel
d301d25fcc Removed witches.live, have to check why on the server it takes so long to check its peers, here it doesn’t, it’s probably just that we should increase the server ram and-or cpu 2022-12-26 15:02:50 +01:00
pezcurrel
3f7a5ff69c Moved $graceline definition up, fixing a bug; made peers checking msgs more informative 2022-12-26 15:01:35 +01:00
pezcurrel
97f5b99654 Removed ckpeers function, it was overkill; added a preliminary check for “stringness” to the checks on each peer 2022-12-26 14:51:42 +01:00
pezcurrel
a4b2ae731c Added witches.live since its peers list is huge and full of .activitypub-troll.cf 2022-12-26 14:50:26 +01:00
pezcurrel
926b1b0d73 Added ckpeers function to check if the json array returned by api/v1/instance/peers is well formed 2022-12-26 14:12:06 +01:00
pezcurrel
3c1621df1d Added “LastOkCheckTS” to $instints (array of Instances columns of integer type) 2022-12-26 13:29:19 +01:00
pezcurrel
e820845775 Consider instances which have LastOkCheckTS=null but InsertTS>=$graceline as not dead, and to be checked 2022-12-26 13:28:09 +01:00
pezcurrel
d6d8adee49 Updated to last changes 2022-12-26 12:30:56 +01:00
pezcurrel
61da12100f Removed comment with Instances columns 2022-12-26 12:29:08 +01:00
pezcurrel
ebc458cc2c Removed “resurrect” option and references to Instances.Dead 2022-12-26 12:28:21 +01:00
pezcurrel
d18775fd52 Defines $gracetime, first commit 2022-12-26 12:27:08 +01:00
pezcurrel
1e1b2a99e9 Dropped Instances.Dead, using Instances.LastOkCheckTS now instead 2022-12-26 12:25:15 +01:00
pezcurrel
9b3cca9a45 Script to reasonably set Instances.LastOkCheckTS, first commit 2022-12-26 12:21:47 +01:00
pezcurrel
95b9ccfc31 Renamed “LastCheckOk” to “WasLastCheckOk” 2022-12-26 05:30:35 +01:00
pezcurrel
00caa1dcb9 Changed default for “deadline” option from 62 to 31 days 2022-12-26 05:17:59 +01:00
pezcurrel
44f437c928 Translated initial comment, made it more terse 2022-12-26 05:09:09 +01:00
pezcurrel
5312aea0cc Added writing server rules in the db 2022-12-26 05:08:17 +01:00
pezcurrel
337eb32f51 Made mail optional, inactive by default 2022-12-25 23:45:31 +01:00
pezcurrel
429ab42ff5 Added 2 debug messages stating how mani dead instances the script got from Instances and Peers tables 2022-12-25 18:55:54 +01:00
pezcurrel
e3968a5ace Updated to last changes 2022-12-25 18:54:55 +01:00
pezcurrel
119c9119c2 Made the logic for “deadline” much more terse 2022-12-25 18:41:13 +01:00
pezcurrel
acde202b2e Made it write summary from crawl run into a log file of its own 2022-12-25 18:40:21 +01:00
pezcurrel
ba171bd5f2 Use specifically bash since we use &> redirect 2022-12-25 11:43:30 +01:00
pezcurrel
ec9b65e42f Little script to run peerscrawl.php in loop; first commit 2022-12-25 11:32:49 +01:00
pezcurrel
10e2e1b58a Added “lecho” for “message levels”, removed “gecho”, removed “verbose” option; removed “loop” option (do loop from a shell script if needed) 2022-12-25 11:32:08 +01:00
pezcurrel
1d0c6b799a Small edit to “logminmsglev” and “tuiminmsglev” TUI option parsing errors 2022-12-25 11:29:34 +01:00
pezcurrel
d95bc70b8a Exposed “deadline” option; minor changes 2022-12-25 09:47:04 +01:00
pezcurrel
c0802de828 Removed “restore” option: could work, but it’s not very useful and would require a big hassle; added loops and new found instances counters; made sighandler use mexit 2022-12-25 09:24:23 +01:00
pezcurrel
d6b77b0e29 Removed option “-p peers” from crawler cmdline because now peerscrawl directly writes new instances into the db 2022-12-24 08:59:33 +01:00
pezcurrel
9fabb3853b Infatti 2022-12-23 19:13:37 +01:00
pezcurrel
96aa6f3aa9 Quella roba lì 2022-12-23 19:12:18 +01:00
pezcurrel
05fed0142c Lowered a bit default values for “timeout” and “curltimeout” 2022-12-23 11:23:32 +01:00
pezcurrel
89a2ea0b26 Fixed “trending tags” ordering and fetching 2022-12-23 11:22:25 +01:00
pezcurrel
edee66b834 Temporarily disabled “restore” option because it needs more work to actually work 2022-12-22 15:32:30 +01:00
pezcurrel
61d0fcb3d8 Added “loop” option allowing to run the crawl in an infinite loop or until sig(int|hup|term) received; other minor changes 2022-12-22 15:05:55 +01:00
pezcurrel
6477e8812f Exposed “curltimeout” option; changed “timeout” default from 5 to 10; changed “curltimeout” default from 10 to 20 2022-12-22 14:24:48 +01:00
pezcurrel
6d4ce26f98 Adapted “restore” code to the new workings; minor changes and fixes 2022-12-22 14:04:29 +01:00
pezcurrel
a47ccdd5e2 Merge branch 'weblate': new strings have been translated to russian 2022-12-22 11:41:12 +01:00
pezcurrel
562639fb5c Updated after adding Peers and PeersCheck tables 2022-12-22 11:37:00 +01:00
pezcurrel
c27053314a Added code to store and consider “instance checks” made by the script to independently mark peers ad dead 2022-12-22 11:32:18 +01:00
pezcurrel
f6bc6a12d4 Made it output full admin account address, linked to their profile page 2022-12-22 11:29:44 +01:00
pezcurrel
706c831e23 Little change in a message 2022-12-22 11:28:29 +01:00
pezcurrel
335944add8 Removed “minimum number of known instances” from criteria, because domain_count is gone from /api/v2/instance 2022-12-22 07:51:51 +01:00
pezcurrel
f8cdf2cf3b Changed check against “activity” values, which are strings, not integers 2022-12-22 07:40:41 +01:00
pezcurrel
c6c3feb500 Removed leftovers of “jsonwrite” option 2022-12-22 07:05:21 +01:00
pezcurrel
277296512c Explicitly set idn_to_ascii flags, otherwise with php 7.3 it complained 2022-12-21 22:15:40 +01:00
pezcurrel
9316e686b9 Bir rewrite, made it shorter and hopefully a bit more readable 2022-12-21 22:07:05 +01:00
pezcurrel
732ea79480 Moved $mastodons definition upper 2022-12-21 22:06:10 +01:00
pezcurrel
1c524ffd69 Moved mysqli_close after the optional loading of dead instances from the db; renamed $eta to $tet 2022-12-21 22:05:15 +01:00
pezcurrel
0d74dbf243 Got rid of akeavinn; other minor changes 2022-12-21 07:54:11 +01:00
pezcurrel
d803d6f667 When curl error is unknown, the message is now “reason unknown” instead of “unknown” 2022-12-21 06:54:58 +01:00
pezcurrel
2c86580bfb The regexp to decide whether an instance is Mastodon or not is now based on the Platforms table; made ckratelimit more precise about possible missing headers; added code to set Version from /api/v1/instance when it was not already set from nodeinfo 2022-12-21 06:53:31 +01:00
pezcurrel
d42499747e Updated to new version: added indexes; changed Instances.AdmCreatedAt from float to int 2022-12-20 23:05:02 +01:00
pezcurrel
4fdf287686 Little change in delete prompt 2022-12-20 23:02:53 +01:00
pezcurrel
d8f15f4b3a Does delete from UserFields much faster 2022-12-20 23:01:13 +01:00
pezcurrel
f6dc080ed6 Major rewrite: it was a mess, now it is less :-) 2022-12-20 23:00:22 +01:00
pezcurrel
f3081612da Multibyte lower case first char of a string; first commit 2022-12-20 22:59:24 +01:00
Alex Maryson Jr
d2214b6ef3
Translated using Weblate (Russian) 
Currently translated at 55.0% (219 of 398 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/ru/
 2022-12-20 19:47:12 +01:00
pezcurrel
8eaeaf0d96 Removed references to New, Good, Chosen columns, since they’re gone 2022-12-18 18:45:39 +01:00
pezcurrel
d07b5e4efd “New” is now based on “InsertTS” 2022-12-18 18:44:33 +01:00
pezcurrel
bee3a04b19 Updated to last changes 2022-12-18 18:43:38 +01:00
pezcurrel
f30bcc7e5e Updated to new delinstbyuid function form 2022-12-18 18:43:09 +01:00
pezcurrel
e744ae9d20 Fixed validhostname; added and using myq function for mysql queries; changed some exit codes; made connection error management better 2022-12-18 18:42:11 +01:00
pezcurrel
f29f636a70 Added mysql error code to error message that is echoed if a query fails 2022-12-18 18:40:22 +01:00
pezcurrel
cd16eabce5 Using new form of delinstbyuid function; removed references to New column 2022-12-18 18:27:22 +01:00
pezcurrel
835e02c171 Removed code referencing New, Good and Chosen columns 2022-12-18 18:26:03 +01:00
pezcurrel
f4aa3cb804 A script to set InsertTS field to something suitable when it is null 2022-12-18 18:24:35 +01:00
pezcurrel
c5debcb463 A function to delete an Instance record by ID, and all references to it in other tables; first commit 2022-12-18 18:23:52 +01:00
pezcurrel
820bc3180d Made browser language detection more flexible (eg: if browser language has pt, use pt_BR since we don’t have pt yet, if ever) 2022-12-18 11:46:01 +01:00
pezcurrel
ccc9f517fd Moved code to delete an Instances record and all its references in other tables to function delinstbyid in lib/delinstbyid.php; minor changes 2022-12-18 11:44:11 +01:00
pezcurrel
2b0e2398ae Made validhostname accept only valid hostnames :-)) (no ports or path specs) 2022-12-18 11:42:32 +01:00
pezcurrel
32251d1ba8 Added “deleteinstswhere” action 2022-12-18 11:41:09 +01:00
pezcurrel
7d2875075b Deleted 2022-12-18 09:35:24 +01:00
pezcurrel
690b54521b Moved 2022-12-18 09:35:04 +01:00
pezcurrel
f269bb901d Little cosmetic change 2022-12-18 07:00:49 +01:00
pezcurrel
e9b88d6735 Made $jsonfp be written into run dir 2022-12-18 07:00:19 +01:00
pezcurrel
a3ada274e7 Removed stdout/err redirect in cmd; passing proper descriptor and pipe to proc_open; minor changes 2022-12-18 06:59:25 +01:00
pezcurrel
a32a25e095 Many many changes :-)) 2022-12-18 00:34:27 +01:00
pezcurrel
d6dd03694c Removed $context 2022-12-17 22:54:32 +01:00
pezcurrel
441d16a42d ckratelimit goes to sleep only when x-ratelimit-remaining==0; can spit debug info; limit fetching chunks from users directories is now 40 2022-12-17 22:54:02 +01:00
pezcurrel
ca4367b719 Removed the unlinking attempt at lockfp before exit: it was already done before by shutdown; other little changes about open files closing and the like 2022-12-17 18:43:13 +01:00
pezcurrel
e5ad18e619 Fixed a typo 2022-12-17 18:40:55 +01:00
pezcurrel
5c605cbe5b Some little cosmetic (readability of log files) changes 2022-12-17 18:40:22 +01:00
pezcurrel
2571396253 Tuned to recent changes in crawler.php (and getinstinfo.php) 2022-12-17 17:36:46 +01:00
pezcurrel
ad8fa26306 Made mysql connection and charset setting errors more graceful; added “users” page to updstats; other minor changes 2022-12-17 17:35:35 +01:00
pezcurrel
2d1d28b002 Fixed regexp checking if max_charcters is an integer; made mexit use eecho again, moving the closing of logf after eecho(s); made logf be opened only if logminmsglev < 4 2022-12-17 17:33:46 +01:00
pezcurrel
d1f088a026 Command for subprocesses gets now built on the fly using cmd function; logfile doesn’t get opened if logminmsglev < 4; other minor changes 2022-12-17 17:31:24 +01:00
pezcurrel
6d897cfdff Removed “crawlernew” directory 2022-12-17 15:03:11 +01:00
pezcurrel
c7d5b50377 Adapted to new crawler version 2022-12-17 15:02:52 +01:00
pezcurrel
0b9e892aef Splitted old crawler.php in 2; this is the part that coordinates 2022-12-17 15:02:20 +01:00
pezcurrel
7629a1caae Moved from subdir “crawlernew” 2022-12-17 15:00:36 +01:00
pezcurrel
b46469bfbb Cope with mysql errors even with php ver. < 8; check if $link is false before trying to close mysql connection in function mexit 2022-12-16 22:39:51 +01:00
pezcurrel
e46a82d923 Added suffix “s” to option “-t” in $cmd definition; cope with mysql errors even with php ver. < 8; other small changes 2022-12-16 22:38:16 +01:00
pezcurrel
17164166ee Merge branch 'weblate' for newly translated strings 2022-12-16 22:03:29 +01:00
Ігор Андреєв
b4adda3e10
Translated using Weblate (Ukrainian) 
Currently translated at 100.0% (398 of 398 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/uk/
 2022-12-16 22:01:47 +01:00
J. Lavoie
7087cafb3f
Translated using Weblate (Italian) 
Currently translated at 100.0% (398 of 398 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/it/
 2022-12-16 22:01:46 +01:00
J. Lavoie
62e4c1fa0f
Translated using Weblate (French) 
Currently translated at 98.7% (393 of 398 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/fr/
 2022-12-16 22:01:46 +01:00
pezcurrel
3804171253 Renamed getfc to gurl 2022-12-16 21:59:26 +01:00
pezcurrel
1bdd59dca7 Deleted 2022-12-16 21:58:06 +01:00
pezcurrel
d7ffe48214 Renamed from getfc.php 2022-12-16 21:57:45 +01:00
pezcurrel
a1a6d1ec5d Renamed “getfc” to “gurl” 2022-12-16 21:35:38 +01:00
pezcurrel
fe99014208 Made “CURLOPT_TIMEOUT” variable, set it to 45 secs by default 2022-12-16 21:24:42 +01:00
pezcurrel
d75a6445ae Fixed sleep and relative message to actually use $options['udirfailst']; changed some options’ default; changed a bit the help text; changed a bit some messages in the “fetchusers” section 2022-12-16 21:23:14 +01:00
pezcurrel
b666fcfdda Use parsetime for “--timeout” too, changed a bit the help text accordingly 2022-12-16 21:19:34 +01:00
pezcurrel
2d31b7ca79 Changed a bit how option “jsonwrite” works; other minor changes 2022-12-16 19:25:45 +01:00
pezcurrel
f193bd294c A very tiny db test, first commit 2022-12-16 19:12:17 +01:00
pezcurrel
1deed93b6f Some preliminary work reusing “index.php” code 2022-12-16 19:11:39 +01:00
pezcurrel
6ff4752dd7 Made it cope with time values < 1 second; changed the way of passing suffixes; other minore changes 2022-12-16 19:10:29 +01:00
pezcurrel
d59eb396eb Added preliminary support to “Users” page 2022-12-16 19:08:39 +01:00
pezcurrel
9529a938a7 Lots of changes, not very important :-)) 2022-12-16 19:06:47 +01:00
pezcurrel
bab5bd5dd2 Added mysqli_query error management for older php versions to function myq; minor changes 2022-12-16 19:05:46 +01:00
pezcurrel
4522bc3ea8 Added mysqli_query error management for older php versions to function myq 2022-12-16 19:02:41 +01:00
pezcurrel
513981b7e2 Fetches info from an instance, first commit 2022-12-16 00:00:37 +01:00
pezcurrel
1cafbe05ea Crawler new version, “multithreaded”, coordinator script, first commit 2022-12-16 00:00:06 +01:00
pezcurrel
1430cd80fb Time spec parser, first commit 2022-12-15 23:57:31 +01:00
pezcurrel
fdc7ddbd1f Made it use an array for output 2022-12-15 23:52:32 +01:00
pezcurrel
f7c32d00ef Made it cope with “accept-encoding” more properly 2022-12-15 14:38:26 +01:00
pezcurrel
8cf8c416ed Made it cope with gzip encoded content 2022-12-15 12:45:52 +01:00
pezcurrel
3a720a90ac Added a warning when nodeinfo specs couldn’t be fetched; made it set New=1 even when host doesn’t respond and is not in the db 2022-12-15 12:45:20 +01:00
Affir Vega
d9ccf5cdfe
Translated using Weblate (Russian) 
Currently translated at 51.7% (206 of 398 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/ru/
 2022-12-13 13:48:32 +01:00
nichu42
f17453b0c9
Translated using Weblate (German) 
Currently translated at 98.4% (392 of 398 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/de/
 2022-12-13 13:48:32 +01:00
pezcurrel
9360bdc481 Made false positives for “IsMastodon” less likely (impossible?) 2022-12-12 22:40:17 +01:00
pezcurrel
483fbcd103 Added the possibility, for each set of records with the same URI, to choose one record to keep and delete the others, or to automatically keep the record with the lowest ID and delete the others 2022-12-12 21:32:35 +01:00
pezcurrel
90e85f8182 Took away “-t 10” option from crawler.php calls since 10 is now its default timeout 2022-12-12 17:06:51 +01:00
pezcurrel
e07fba673d Fixed call to non-existent function ”mysq” to “myq” 2022-12-12 08:36:18 +01:00
pezcurrel
ec6324fb4f Made langs() shorten to a maximum of 5 elements the $languages array 2022-12-12 08:29:18 +01:00
pezcurrel
d80ba5ddc4 Fixed double “,” in a query inside langs() 2022-12-12 08:24:26 +01:00
pezcurrel
6f9260e08e myq() did not return results, now it does 2022-12-12 08:17:01 +01:00
pezcurrel
f6752a34bc Added function “myq” as a wrapper for mysqli_query managing exceptions; used it throughout the whole script 2022-12-12 08:12:29 +01:00
pezcurrel
2649e7d137 Info from nodeinfo didn’t end up into $info, now they do 2022-12-12 00:47:06 +01:00
pezcurrel
879a86a211 Merge branch 'weblate' with newly pt_BR translated strings 2022-12-11 23:38:08 +01:00
Fábio Rodrigues Ribeiro
5cc375af50
Translated using Weblate (Portuguese (Brazil)) 
Currently translated at 100.0% (398 of 398 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/pt_BR/
 2022-12-11 23:36:28 +01:00
pezcurrel
783e54a9f9 Little script to convert a unix timestamp in input to a date 2022-12-11 23:33:09 +01:00
pezcurrel
1701a2cfe6 Little script to search for records with the same “URI” in Instances table 2022-12-11 23:32:42 +01:00
pezcurrel
853be9f0e0 Little script to fix uris beginning with “https://” 2022-12-11 23:31:47 +01:00
pezcurrel
b16515f4e8 Lots of changes :-)) 2022-12-11 23:29:51 +01:00
pezcurrel
882222bdb9 Added “Code” section to “About” page 2022-12-11 05:38:42 +01:00
pezcurrel
7e52c5683f Merge newly translated strings from branch 'weblate' 2022-12-11 05:22:41 +01:00
Ігор Андреєв
718efc01f9
Translated using Weblate (Ukrainian) 
Currently translated at 100.0% (396 of 396 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/uk/
 2022-12-11 05:20:52 +01:00
pezcurrel
72655faa88 Added a “Code” section linking git.lattuga.net, and a link to Ігор Андреєв’s Mastodon profile 2022-12-11 05:18:26 +01:00
pezcurrel
61ad655a62 Disabled fetching profile’s page when “noindex” is not set in account because it takes too long; disabled featured tags fetching fro the same reason; other minor changes 2022-12-10 23:32:58 +01:00
pezcurrel
f343cb702e Changed some eecho messages importance 2022-12-10 13:57:30 +01:00
pezcurrel
4b7f6a199c Added truncs where needed; added code to check for “noindex” on user’s profile page when “noindex” is not set in accounts info 2022-12-10 12:35:22 +01:00
pezcurrel
eeb3ce6edf Made it wait up to 30 seconds for contents 2022-12-10 12:33:21 +01:00
Pongrèbio
4c721f7bad
Translated using Weblate (Russian) 
Currently translated at 46.4% (184 of 396 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/ru/
 2022-12-09 23:47:47 +01:00
Pongrèbio
b39aa9e284
Translated using Weblate (Persian) 
Currently translated at 77.5% (307 of 396 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/fa/
 2022-12-09 23:47:46 +01:00
J. Lavoie
3feca8f402
Translated using Weblate (French) 
Currently translated at 98.7% (391 of 396 strings)

Translation: mastodon.help/Site
Translate-URL: https://hosted.weblate.org/projects/mastodon-help/site/fr/
 2022-12-09 23:47:46 +01:00
pezcurrel
18ce06871b Added ckratelimit() where useful; made it more flexible with lowercasing every header key; more work on fetching users from users directories 2022-12-09 22:53:18 +01:00
pezcurrel
8341f0e209 Fixed a cosmetic bug; some more work into users directories fetching 2022-12-09 19:25:44 +01:00