Commit graph

51 commits

Author SHA1 Message Date
pezcurrel
238ac44485 Changed “done” message 2024-01-02 01:22:04 +01:00
pezcurrel
6914551daa Fixed “deadinsts” loading queries; changed default “conntimeout” and “functimeout” 2024-01-02 00:52:20 +01:00
pezcurrel
618ebfa54b Added 'Accept: application/json' to every “gurl” call 2023-12-31 23:16:16 +01:00
pezcurrel
4e5973e874 Fixed a flaw in “dead instances” loading queries 2023-12-31 22:57:07 +01:00
pezcurrel
a9b0e049b4 Changed “conntimeout” default from 5 to 3 and “functimeout” default from 10 to 5 2023-12-31 20:31:41 +01:00
pezcurrel
6a750a2f3c Added “round [number]” to every status “eecho”; changed all “echo('...')” to “echo '...'” 2023-12-29 13:02:40 +01:00
pezcurrel
d502fde347 Removed useless, redundant code filtering the list of instances at the beginning of the “crawl” function: filtering already happens before adding an instance to next round list 2023-12-29 12:21:50 +01:00
pezcurrel
a677d3301b Added “-i, --includedead” option explanation to help text 2023-12-29 11:05:04 +01:00
pezcurrel
83868504d7 Super-optimized it; made it a bit more verbose and clearer 2023-12-29 10:04:05 +01:00
pezcurrel
943c65b2ba Added regexps check before adding an inst to “Instances” and “Peers” tables 2023-12-27 21:55:33 +01:00
pezcurrel
540c9d4440 Optimized, fixed a flaw 2023-12-27 16:42:31 +01:00
pezcurrel
721d892f64 Refactored directory tree 2023-12-26 11:17:54 +01:00
pezcurrel
6ae7e07e77 Fixed bug in loading dead instances 2023-10-13 17:37:17 +02:00
pezcurrel
b22befdec2 Removed “excludead” option: use a high “gracetime” when needed; other minor changes 2023-01-06 17:03:41 +01:00
pezcurrel
83d3c6b5c5 Changed “discovered instances” to “instances responded” in message “working on ...” 2023-01-04 13:41:55 +01:00
pezcurrel
94bfec5f78 “$list” paramater of function “crawl” is now passed by reference; “$list” now gets unset in any case after it has been looped through; this hopefully will decrease a bit the amount of memory used by the script 2022-12-29 09:28:18 +01:00
pezcurrel
870e3524ca Fixed $maxround not set to actual max round 2022-12-28 17:06:39 +01:00
pezcurrel
430c35e17a Little change in progress string 2022-12-27 23:01:39 +01:00
pezcurrel
ff2d6c09a8 Removed “peers.all” file; made the script write to “peers files” only on exit (be it clean or by interruption) 2022-12-26 16:40:10 +01:00
pezcurrel
44b6456695 Made check on peers more strict, made the script abandon checking when a peers entry is malformed 2022-12-26 15:27:14 +01:00
pezcurrel
3f7a5ff69c Moved $graceline definition up, fixing a bug; made peers checking msgs more informative 2022-12-26 15:01:35 +01:00
pezcurrel
97f5b99654 Removed ckpeers function, it was overkill; added a preliminary check for “stringness” to the checks on each peer 2022-12-26 14:51:42 +01:00
pezcurrel
926b1b0d73 Added ckpeers function to check if the json array returned by api/v1/instance/peers is well formed 2022-12-26 14:12:06 +01:00
pezcurrel
1e1b2a99e9 Dropped Instances.Dead, using Instances.LastOkCheckTS now instead 2022-12-26 12:25:15 +01:00
pezcurrel
00caa1dcb9 Changed default for “deadline” option from 62 to 31 days 2022-12-26 05:17:59 +01:00
pezcurrel
429ab42ff5 Added 2 debug messages stating how mani dead instances the script got from Instances and Peers tables 2022-12-25 18:55:54 +01:00
pezcurrel
119c9119c2 Made the logic for “deadline” much more terse 2022-12-25 18:41:13 +01:00
pezcurrel
10e2e1b58a Added “lecho” for “message levels”, removed “gecho”, removed “verbose” option; removed “loop” option (do loop from a shell script if needed) 2022-12-25 11:32:08 +01:00
pezcurrel
d95bc70b8a Exposed “deadline” option; minor changes 2022-12-25 09:47:04 +01:00
pezcurrel
c0802de828 Removed “restore” option: could work, but it’s not very useful and would require a big hassle; added loops and new found instances counters; made sighandler use mexit 2022-12-25 09:24:23 +01:00
pezcurrel
96aa6f3aa9 Quella roba lì 2022-12-23 19:12:18 +01:00
pezcurrel
05fed0142c Lowered a bit default values for “timeout” and “curltimeout” 2022-12-23 11:23:32 +01:00
pezcurrel
edee66b834 Temporarily disabled “restore” option because it needs more work to actually work 2022-12-22 15:32:30 +01:00
pezcurrel
61d0fcb3d8 Added “loop” option allowing to run the crawl in an infinite loop or until sig(int|hup|term) received; other minor changes 2022-12-22 15:05:55 +01:00
pezcurrel
6477e8812f Exposed “curltimeout” option; changed “timeout” default from 5 to 10; changed “curltimeout” default from 10 to 20 2022-12-22 14:24:48 +01:00
pezcurrel
6d4ce26f98 Adapted “restore” code to the new workings; minor changes and fixes 2022-12-22 14:04:29 +01:00
pezcurrel
c27053314a Added code to store and consider “instance checks” made by the script to independently mark peers ad dead 2022-12-22 11:32:18 +01:00
pezcurrel
277296512c Explicitly set idn_to_ascii flags, otherwise with php 7.3 it complained 2022-12-21 22:15:40 +01:00
pezcurrel
9316e686b9 Bir rewrite, made it shorter and hopefully a bit more readable 2022-12-21 22:07:05 +01:00
pezcurrel
e744ae9d20 Fixed validhostname; added and using myq function for mysql queries; changed some exit codes; made connection error management better 2022-12-18 18:42:11 +01:00
pezcurrel
2b0e2398ae Made validhostname accept only valid hostnames :-)) (no ports or path specs) 2022-12-18 11:42:32 +01:00
pezcurrel
d6dd03694c Removed $context 2022-12-17 22:54:32 +01:00
pezcurrel
ca4367b719 Removed the unlinking attempt at lockfp before exit: it was already done before by shutdown; other little changes about open files closing and the like 2022-12-17 18:43:13 +01:00
pezcurrel
3804171253 Renamed getfc to gurl 2022-12-16 21:59:26 +01:00
pezcurrel
6c2672ea00 Fixed and added some “gecho” messages 2022-12-08 00:07:31 +01:00
pezcurrel
fb357a12d4 Changed short form for option “excludedead” from “-d” to “-E” 2022-12-02 06:04:25 +01:00
pezcurrel
9087c4d015 Declare N as constant 2022-12-01 05:44:06 +01:00
pezcurrel
0082da0c27 Got rid of some redundancies and nailed a bit validhostname() 2022-11-11 21:57:30 +01:00
pezcurrel
a8bcef7a58 Added timestamps to the messages 2022-07-13 12:45:57 +02:00
pezcurrel
049c1d839a ... 2020-10-21 15:26:31 +02:00