blallo/tt-rss
1
0
Fork 0
Code Issues Pull requests Releases Wiki Activity
7287 commits 3 branches 0 tags 76 MiB
Commit graph

221 commits

Author SHA1 Message Date
Barak Korren
8401101d50 Moved hard-coded fetch timeout values into config file to allow site-level tuning 2013-04-01 15:08:21 +03:00
Andrew Dolgov
5e736e4592 implement stop action 2013-03-31 19:28:36 +04:00
Andrew Dolgov
ee0542ce28 daemon: do not schedule user-disabled feeds (2) 2013-03-31 14:36:06 +04:00
Andrew Dolgov
cd7ebb39e4 daemon: do not schedule user-disabled feeds 2013-03-31 14:24:13 +04:00
Andrew Dolgov
e81610d9ef daemon: sort by random 2013-03-30 16:28:21 +04:00
Andrew Dolgov
8292d05b7c daemon: show feeds/minute stats 2013-03-30 16:25:10 +04:00
Andrew Dolgov
17e74b21cf update_rss_feed: bailout if cache is considered valid, but older than last_updated 2013-03-30 15:42:27 +04:00
Andrew Dolgov
31623bfa99 if-modified-since: also take last_updated into account 2013-03-30 15:35:16 +04:00
Andrew Dolgov
7a01dc776e support If-Modified-Since 2013-03-30 15:12:20 +04:00
Andrew Dolgov
7b11aa80ab Revert "Avoid updating feed based on user pref DEFAULT_UPDATE_INTERVAL if it is set to -1 (no update)" 
This reverts commit bca1cfbb95.
 2013-03-30 13:26:15 +04:00
all
bca1cfbb95 Avoid updating feed based on user pref DEFAULT_UPDATE_INTERVAL if it is set to -1 (no update) 2013-03-30 09:43:37 +01:00
Andrew Dolgov
0d6943b097 Revert "order feeds selected for update randomly" 
This reverts commit 13b33a3fc3.
 2013-03-29 17:25:07 +04:00
Andrew Dolgov
13b33a3fc3 order feeds selected for update randomly 2013-03-29 15:36:40 +04:00
Andrew Dolgov
32b05702ff daemon: do not show feed urls twice 2013-03-29 14:32:11 +04:00
Andrew Dolgov
30ac8d1f86 update: exclude feeds with disabled updates 2013-03-29 12:31:53 +04:00
Andrew Dolgov
1c4421fcd7 experimentally rework update daemon to process all feeds with the same url sequentially to minimize network access and better utilize caches 2013-03-29 12:21:40 +04:00
Andrew Dolgov
4f9cbdff1d cache simplepie object instead of xml feed data 2013-03-29 11:50:58 +04:00
Andrew Dolgov
d5974daa33 remove feed update interval debugging 2013-03-29 11:32:22 +04:00
Andrew Dolgov
f074ffe945 cache downloaded feed data to minimize network access 2013-03-29 11:31:10 +04:00
Joschasa
ca5ff2d9fb Remove 2 useless line breaks. One got printed even with --quiet. 2013-03-28 20:30:06 +01:00
Andrew Dolgov
be574731fc modify sorting by date_entered: set date_entered per-batch; use updated as a secondary criteria 2013-03-27 13:34:04 +04:00
saperduper
30123fe630 Handle future pubDate 
Posts with pubDate in the future always appear at the top, which is ruining the
whole "newest at top" idea. One way to handle this is to use time() instead.
This is what google reader does and seems reasonable.
 2013-03-25 18:49:11 +02:00
Andrew Dolgov
a3a896a127 let us rejoice on being able to create double negative filters (refs #631) 2013-03-25 19:46:43 +04:00
Andrew Dolgov
227d5e4168 label auto matcher: preg_quote() label 2013-03-24 22:49:43 +04:00
Andrew Dolgov
9811276da7 rssfuncs: do not try to match on empty label 2013-03-23 09:23:02 +04:00
Andrew Dolgov
3972bf5981 db_escape_string: specify link parameter for consistency; sessions: do not force-close db connection in _close() 2013-03-22 09:14:55 +04:00
Andrew Dolgov
f0bd8e6531 rework image caching to work without permanent article content rewriting (refs #582) 2013-03-19 09:25:36 +04:00
Andrew Dolgov
f935d98e5d properly fix the cache_images issue (refs #578) 2013-03-19 00:42:59 +04:00
Andrew Dolgov
7873d58822 implement proper last_marked/last_published feeds for proper sorting of 
published and marked virtual feeds, remove sorting by last_read
workaround
api: add pubsubhubbub ping when article is being set published
bump schema
 2013-03-17 15:38:21 +04:00
Andrew Dolgov
1f45c8571f fix escaping of entry content being broken by cache_images() rewriting 2013-03-16 18:50:13 +04:00
Andrew Dolgov
8349a32e75 remove cache_content remnants 2013-03-16 16:11:58 +04:00
Andrew Dolgov
cc38c8e549 remove LIBXML_NOEMPTYTAG because of double <br/>s - the #357 issue with 
htmlpurifier might not be relevant anymore because of htmLawed switch,
but <br/>s are annoying
 2013-03-16 16:07:11 +04:00
Andrew Dolgov
96f98cb091 escape fetch error message before saving in the db (closes #550) 2013-03-11 14:14:28 +04:00
Andrew Dolgov
41acdf4c11 remove purging of inactive feeds in daemon_common (causes duplicates) 2013-03-07 09:03:42 +04:00
Andrew Dolgov
f161869541 when purging inactive feeds, set last_updated to NOW() 2013-03-04 21:49:14 +04:00
Andrew Dolgov
be17885789 pluginhost: add get_debug()/set_debug() for plugins to detect if debugging is allowed 2013-02-26 19:30:19 +04:00
Andrew Dolgov
70caff4811 done collecting data debug message: remove title 2013-02-26 19:26:38 +04:00
Andrew Dolgov
5321e775f9 remove update on checksum change (updated status has been removed); rtl stuff (unused) 2013-02-26 19:20:58 +04:00
Andrew Dolgov
5d56d100f1 force disable simplepie unnecessarily sanitizing data 2013-02-26 18:27:40 +04:00
Andrew Dolgov
2ea09bdef6 update_daemon_common: purge inactive/not updated feeds 2013-02-26 16:16:04 +04:00
Andrew Dolgov
ada103f234 simplepie init: hide errors 2013-02-23 18:47:05 +04:00
Andrew Dolgov
5de51df7f8 rssfuncs: show fetch done debug message in appropriate place 2013-02-23 18:42:14 +04:00
Andrew Dolgov
ab457a9c96 rssfuncs: load pluginhost stuff properly 2013-02-23 18:40:48 +04:00
Andrew Dolgov
017401ddce implement HOOK_FEED_FETCHED 2013-02-23 18:38:50 +04:00
Andrew Dolgov
e02555c1b8 add af_* plugin workaround for already processed article 2013-02-23 12:07:46 +04:00
Andrew Dolgov
b30abdadd2 prevent article filters from modifying article GUID; add separate plugin_data field for this 2013-02-21 22:24:06 +04:00
Andrew Dolgov
750cfcd2fa remove processing of ttrss_feeds.icon_url 2013-02-08 17:19:43 +04:00
Andrew Dolgov
0a3fd79b0e fix image caching not working on plugin-rewritten content; remove content cache stuff 2013-02-04 13:00:50 +04:00
Andrew Dolgov
87d7e8507a split some more functions from functions.php 2013-01-22 22:32:17 +04:00
Andrew Dolgov
c5e3995f8c disable content caching if _FEEDS_CONTENT_CACHE is not enabled 2013-01-22 16:12:50 +04:00
Andrew Dolgov
3a4c897382 force separate data in ttrss_entries between users 2013-01-18 17:50:18 +04:00
Andrew Dolgov
ba946ba276 use force_feed() 2013-01-10 11:04:05 +04:00
Andrew Dolgov
9e222305f7 allow plugin modification of article guid 2012-12-30 12:22:29 +04:00
Andrew Dolgov
455b1401cd properly load user plugins and data on update 2012-12-30 11:33:13 +04:00
Andrew Dolgov
bb566dc263 fix overflow of various 250 char fields in rssfuncs 2012-12-26 22:06:47 +04:00
Andrew Dolgov
d2a421e3cb more work on user-selectable plugins; properly process system and user plugins 2012-12-25 10:02:08 +04:00
Andrew Dolgov
f16116834e split digest stuff into digest.php 2012-12-24 15:52:59 +04:00
Andrew Dolgov
356a991a7b update_rss_feed: escape error string immediately 2012-12-24 14:17:24 +04:00
Andrew Dolgov
4412b877d0 implement HOOK_FEED_PARSED, add example plugin (refs #424) 2012-12-24 14:13:03 +04:00
Andrew Dolgov
fa6fbd3659 do not preg_match() tags from article content 2012-12-24 13:56:36 +04:00
Andrew Dolgov
1b35d30c1f prevent escaping of article link in the database when using simplepie (refs #472) 2012-12-24 13:53:38 +04:00
Andrew Dolgov
19b3992b78 remove magpie, fix article filter plugins 2012-12-24 13:45:34 +04:00
Andrew Dolgov
19c7350770 experimental new plugin system 2012-12-23 14:52:18 +04:00
Andrew Dolgov
83e6e313be support comments on simplepie properly 2012-12-22 13:43:48 +04:00
Andrew Dolgov
35cb2b8f67 Revert "support comments for simplepie" 
This reverts commit d020a86c36.
 2012-12-22 13:41:13 +04:00
Andrew Dolgov
d020a86c36 support comments for simplepie 2012-12-22 11:33:03 +04:00
Andrew Dolgov
2bbd699475 update: feed escaping issue 2012-12-16 13:38:50 +04:00
Andrew Dolgov
2a91b6ff78 add built-in expiring of obsolete lockfiles 2012-12-12 09:46:02 +04:00
Andrew Dolgov
d5e9cf28f1 remove uid from ccache guid prefix 2012-11-29 14:56:05 +04:00
Andrew Dolgov
765509c572 create separate guids for cached and authorized content to prevent unnecessary data sharing 2012-11-29 14:55:03 +04:00
Andrew Dolgov
8054439f47 wait a bit before initial content fetching 2012-11-26 14:52:18 +04:00
Andrew Dolgov
130b078109 minor cached content updating tweaks 2012-11-26 14:48:22 +04:00
Andrew Dolgov
cc85704f3c implement experimental article on-import data filters 2012-11-26 14:33:18 +04:00
Andrew Dolgov
cb93a5dee8 fix inserting cached content on first update 2012-11-25 18:42:03 +04:00
Andrew Dolgov
87764a50cf implement ttrss_feeds.cache_content 2012-11-23 13:22:34 +04:00
Andrew Dolgov
d03ae73e93 get_article_filters: strip newlines from content before matching 2012-11-20 21:27:53 +04:00
Andrew Dolgov
72d1d0678e fix title and content filters only working on title (closes #512) 2012-11-13 09:31:26 +04:00
Andrew Dolgov
4021d61ada enable manual filters to work on complete html content 2012-10-30 18:44:17 +04:00
Andrew Dolgov
e8291805dd update: only load existing labels of previously imported articles 2012-10-30 15:10:52 +04:00
Andrew Dolgov
bb894b2990 fix update stopped by get_article_labels() 2012-10-30 14:59:09 +04:00
Andrew Dolgov
3fc6e71ac8 apply filters and detect labels based on article content without tags 2012-10-30 13:09:38 +04:00
Andrew Dolgov
b24504b121 add ability to auto-assign articles to labels (bump schema) 2012-10-30 12:58:35 +04:00
Andrew Dolgov
92c14e9d53 move article filter functions to rssfuncs.php 2012-10-30 12:11:46 +04:00
Andrew Dolgov
24be5e836f remove sanitize_article_content (CDATA handled by htmLawed) 2012-10-29 23:51:32 +04:00
Andrew Dolgov
b3682750bb Revert "sanitize article content when importing data from feed" 
This reverts commit c7fe1b4e9e.

Conflicts:
	include/functions.php
	include/rssfuncs.php
 2012-10-29 12:17:28 +04:00
Andrew Dolgov
e1e3f972b6 update_rss_feed: fix broken title/content escaping 2012-10-29 10:13:14 +04:00
Andrew Dolgov
c7fe1b4e9e sanitize article content when importing data from feed 2012-10-28 12:44:10 +04:00
Andrew Dolgov
c0c2abbaa7 force refetch feed when clicking update/clicking on same feed in the tree 2012-10-25 13:15:14 +04:00
Andrew Dolgov
67bd0b1f26 allow filters to work on child categories 2012-10-09 19:09:50 +04:00
Andrew Dolgov
0f556e3edb lower default DAEMON_SLEEP_INTERVAL 2012-09-15 20:53:12 +04:00
Andrew Dolgov
304aadb907 remove twitter-specific code 2012-09-07 10:23:46 +04:00
Andrew Dolgov
6aff784575 implement multiple rule/action filters 2012-08-31 12:13:47 +04:00
Andrew Dolgov
9aceda3afc remove hook-based plugins 2012-08-21 14:37:43 +04:00
Andrew Dolgov
369dbc19d6 rework class system to use subdirectories 
add placeholder plugin/hook system
 2012-08-17 14:22:33 +04:00
Andrew Dolgov
2ea9bbfd07 implement proof of concept postgresql pg_trgm N-gram based marking of similar article titles as read automatically 2012-07-09 19:49:48 +04:00
Andrew Dolgov
0e4a7d7a94 remove memcached stuff 2012-07-06 14:37:03 +04:00
Andrew Dolgov
f2798eb6e6 properly update favicon_last_checked 2012-05-24 16:45:54 +04:00
Andrew Dolgov
d3158e2250 expire files in cache/export 2012-05-24 16:36:54 +04:00
Andrew Dolgov
382268c6c9 rate-limit requests for favicons when not present to conserve traffic (refs #457) 2012-05-24 16:20:03 +04:00
Andrew Dolgov
1bd11fdf95 Revert "get favicon from icon atom feeds & search for icons not only in html head (closes #457)" 
This reverts commit 882311d9ad.
 2012-05-17 22:58:08 +04:00
Andrew Dolgov
eb38af4ee4 fix warning when entry content is used as array unnecessarily 2012-05-17 14:56:36 +04:00
Andrew Dolgov
882311d9ad get favicon from icon atom feeds & search for icons not only in html head (closes #457) 2012-05-15 12:06:52 +04:00
Andrew Dolgov
941e48a402 apply patch from gmargo to differentiate between manual and new feed after-subscription update 2012-05-05 22:28:46 +04:00
Andrew Dolgov
6cb2269c03 disable internal magpie/simplepie cache for manual updates 2012-04-09 11:58:00 +04:00
Andrew Dolgov
ecbd7b91fe allow manual updates for feeds with disabled automatic updates 2012-04-01 09:35:56 +04:00
Andrew Dolgov
2ab20c313c expire_cached_files: check for glob() returning false 2012-02-24 13:43:50 +04:00
Andrew Dolgov
7b8ff151ed fix various tags being stuck because of invalid HTML markup being generated (closes #357) 2012-02-21 12:16:29 +04:00
Andrew Dolgov
8437c066e1 implement digestTest back 
misc digest updates and improvements
 2012-01-31 16:27:51 +04:00
Andrew Dolgov
61c1812f29 implement preferred time for sending out digests 2012-01-30 16:34:45 +04:00
Andrew Dolgov
ec418193a8 fetch_twitter_rss: include magpie libraries 2012-01-26 13:32:16 +04:00
Andrew Dolgov
0cf816377f misc fixes in site_url/icon_url parsing 2012-01-17 10:22:47 +04:00
Andrew Dolgov
b8379e6979 cache_images: set a lower size limit for stuff to cache 2012-01-12 12:52:55 +04:00
Andrew Dolgov
a3e0bdcffc fix tmhOAuth missing query parameters (closes #416) 2012-01-10 12:49:10 +04:00
Andrew Dolgov
f1e511c8f2 remove simplepie force_feed() (closes #414) 2011-12-31 15:08:00 +04:00
Andrew Dolgov
487f0750c8 workaround against markup being broken by cache_images() 2011-12-28 23:03:55 +04:00
Andrew Dolgov
c58677987b only try to cache images when cache dir is writable 2011-12-26 13:18:16 +04:00
Andrew Dolgov
3c696512fc universal image caching and automatic cache directories maintenance 2011-12-26 13:11:08 +04:00
Andrew Dolgov
036cd3a410 globalUpdateFeeds: disable debugging info 2011-12-25 00:17:22 +04:00
Andrew Dolgov
09e8bdfd18 simplify default global config, expand sanity_check messages 2011-12-13 19:20:26 +04:00
Andrew Dolgov
791780621b split several functions to related classes 2011-12-13 16:27:46 +04:00
Andrew Dolgov
2c08214a7f split rss updating stuff into separate include file 2011-12-13 16:06:25 +04:00