Andrew Dolgov
52d88392da
move db-prefs to OO
2013-04-18 12:00:01 +04:00
Andrew Dolgov
3f6f085769
add better gzdecode support for php native fetch, use curl under open_basedir
2013-04-18 11:36:13 +04:00
Andrew Dolgov
d0d86316ee
Revert "do automatic gzcdecode on feed data"
...
This reverts commit aea03558bb
2013-04-18 11:19:25 +04:00
Andrew Dolgov
aea03558bb
do automatic gzcdecode on feed data
2013-04-18 09:15:55 +04:00
Andrew Dolgov
48cb253625
get_article_filter: fix missing argument
2013-04-17 19:25:15 +04:00
Andrew Dolgov
a42c55f02b
fix blank character after opening bracket in function calls
2013-04-17 18:34:18 +04:00
Andrew Dolgov
7440a7fe3c
daemon2: use passthrough to daemon-loop
2013-04-17 18:19:28 +04:00
Andrew Dolgov
6322ac79a0
remove $link
2013-04-17 16:48:41 +04:00
Andrew Dolgov
857efe49e6
add schema checking to feed updating and update script
2013-04-17 12:10:35 +04:00
Andrew Dolgov
e2261e177b
implement old log entry purging in update_daemon_common; add some more error types; tweak error log display
2013-04-16 20:34:20 +04:00
Andrew Dolgov
5e3d5480f7
use hashed guids in a hopefully backwards compatible fashion
2013-04-15 19:28:11 +04:00
Andrew Dolgov
bc7a144dd5
properly remove and replace favicon color when favicon gets manually removed/uploaded
2013-04-15 18:22:48 +04:00
Andrew Dolgov
12a6bd28ac
remove hsl stuff from classes/feeds, we take care of this when choosing the color
2013-04-15 17:07:06 +04:00
Andrew Dolgov
6ac722d5b1
try to improve color guessing algorithm a bit
2013-04-15 17:01:51 +04:00
Andrew Dolgov
63c323f736
only enable colored favicons in vfeeds; fix RGB triplet packing
2013-04-15 15:17:12 +04:00
Andrew Dolgov
687a4f59c8
store favicon color as #rrggbb; process existing favicons
2013-04-15 15:08:00 +04:00
moontear
2cfbb448fb
Added average color calculation of feeds' favicons for banded display.
2013-04-15 12:28:52 +02:00
Andrew Dolgov
044cff2d74
implement basic feed authentication parameter encryption in the database (FEED_CRYPT_KEY)
2013-04-13 18:24:41 +04:00
Andrew Dolgov
c5569ff8d3
decode html entities in article title on import
2013-04-12 16:30:40 +04:00
Andrew Dolgov
3306daecf4
implement upload-related support for open_basedir
2013-04-11 19:12:00 +04:00
Andrew Dolgov
5929a0c1e4
updater: prevent duplicate feed ids being scheduled for update
2013-04-04 13:20:44 +04:00
Barak Korren
32b7a340ad
Merge branch 'master' into tunable-fetches
...
Conflicts:
include/rssfuncs.php
2013-04-01 16:05:48 +03:00
Barak Korren
8401101d50
Moved hard-coded fetch timeout values into config file to allow site-level tuning
2013-04-01 15:08:21 +03:00
Andrew Dolgov
5e736e4592
implement stop action
2013-03-31 19:28:36 +04:00
Andrew Dolgov
ee0542ce28
daemon: do not schedule user-disabled feeds (2)
2013-03-31 14:36:06 +04:00
Andrew Dolgov
cd7ebb39e4
daemon: do not schedule user-disabled feeds
2013-03-31 14:24:13 +04:00
Andrew Dolgov
e81610d9ef
daemon: sort by random
2013-03-30 16:28:21 +04:00
Andrew Dolgov
8292d05b7c
daemon: show feeds/minute stats
2013-03-30 16:25:10 +04:00
Andrew Dolgov
17e74b21cf
update_rss_feed: bailout if cache is considered valid, but older than last_updated
2013-03-30 15:42:27 +04:00
Andrew Dolgov
31623bfa99
if-modified-since: also take last_updated into account
2013-03-30 15:35:16 +04:00
Andrew Dolgov
7a01dc776e
support If-Modified-Since
2013-03-30 15:12:20 +04:00
Andrew Dolgov
7b11aa80ab
Revert "Avoid updating feed based on user pref DEFAULT_UPDATE_INTERVAL if it is set to -1 (no update)"
...
This reverts commit bca1cfbb95
2013-03-30 13:26:15 +04:00
all
bca1cfbb95
Avoid updating feed based on user pref DEFAULT_UPDATE_INTERVAL if it is set to -1 (no update)
2013-03-30 09:43:37 +01:00
Andrew Dolgov
0d6943b097
Revert "order feeds selected for update randomly"
...
This reverts commit 13b33a3fc3
2013-03-29 17:25:07 +04:00
Andrew Dolgov
13b33a3fc3
order feeds selected for update randomly
2013-03-29 15:36:40 +04:00
Andrew Dolgov
32b05702ff
daemon: do not show feed urls twice
2013-03-29 14:32:11 +04:00
Andrew Dolgov
30ac8d1f86
update: exclude feeds with disabled updates
2013-03-29 12:31:53 +04:00
Andrew Dolgov
1c4421fcd7
experimentally rework update daemon to process all feeds with the same url sequentially to minimize network access and better utilize caches
2013-03-29 12:21:40 +04:00
Andrew Dolgov
4f9cbdff1d
cache simplepie object instead of xml feed data
2013-03-29 11:50:58 +04:00
Andrew Dolgov
d5974daa33
remove feed update interval debugging
2013-03-29 11:32:22 +04:00
Andrew Dolgov
f074ffe945
cache downloaded feed data to minimize network access
2013-03-29 11:31:10 +04:00
Joschasa
ca5ff2d9fb
Remove 2 useless line breaks. One got printed even with --quiet.
2013-03-28 20:30:06 +01:00
Andrew Dolgov
be574731fc
modify sorting by date_entered: set date_entered per-batch; use updated as a secondary criteria
2013-03-27 13:34:04 +04:00
saperduper
30123fe630
Handle future pubDate
...
Posts with pubDate in the future always appear at the top, which is ruining the
whole "newest at top" idea. One way to handle this is to use time() instead.
This is what google reader does and seems reasonable.
2013-03-25 18:49:11 +02:00
Andrew Dolgov
a3a896a127
let us rejoice on being able to create double negative filters (refs #631 )
2013-03-25 19:46:43 +04:00
Andrew Dolgov
227d5e4168
label auto matcher: preg_quote() label
2013-03-24 22:49:43 +04:00
Andrew Dolgov
9811276da7
rssfuncs: do not try to match on empty label
2013-03-23 09:23:02 +04:00
Andrew Dolgov
3972bf5981
db_escape_string: specify link parameter for consistency; sessions: do not force-close db connection in _close()
2013-03-22 09:14:55 +04:00
Andrew Dolgov
f0bd8e6531
rework image caching to work without permanent article content rewriting (refs #582 )
2013-03-19 09:25:36 +04:00
Andrew Dolgov
f935d98e5d
properly fix the cache_images issue (refs #578 )
2013-03-19 00:42:59 +04:00
Andrew Dolgov
7873d58822
implement proper last_marked/last_published feeds for proper sorting of
...
published and marked virtual feeds, remove sorting by last_read
workaround
api: add pubsubhubbub ping when article is being set published
bump schema
2013-03-17 15:38:21 +04:00
Andrew Dolgov
1f45c8571f
fix escaping of entry content being broken by cache_images() rewriting
2013-03-16 18:50:13 +04:00
Andrew Dolgov
8349a32e75
remove cache_content remnants
2013-03-16 16:11:58 +04:00
Andrew Dolgov
cc38c8e549
remove LIBXML_NOEMPTYTAG because of double <br/>s - the #357 issue with
...
htmlpurifier might not be relevant anymore because of htmLawed switch,
but <br/>s are annoying
2013-03-16 16:07:11 +04:00
Andrew Dolgov
96f98cb091
escape fetch error message before saving in the db ( closes #550 )
2013-03-11 14:14:28 +04:00
Andrew Dolgov
41acdf4c11
remove purging of inactive feeds in daemon_common (causes duplicates)
2013-03-07 09:03:42 +04:00
Andrew Dolgov
f161869541
when purging inactive feeds, set last_updated to NOW()
2013-03-04 21:49:14 +04:00
Andrew Dolgov
be17885789
pluginhost: add get_debug()/set_debug() for plugins to detect if debugging is allowed
2013-02-26 19:30:19 +04:00
Andrew Dolgov
70caff4811
done collecting data debug message: remove title
2013-02-26 19:26:38 +04:00
Andrew Dolgov
5321e775f9
remove update on checksum change (updated status has been removed); rtl stuff (unused)
2013-02-26 19:20:58 +04:00
Andrew Dolgov
5d56d100f1
force disable simplepie unnecessarily sanitizing data
2013-02-26 18:27:40 +04:00
Andrew Dolgov
2ea09bdef6
update_daemon_common: purge inactive/not updated feeds
2013-02-26 16:16:04 +04:00
Andrew Dolgov
ada103f234
simplepie init: hide errors
2013-02-23 18:47:05 +04:00
Andrew Dolgov
5de51df7f8
rssfuncs: show fetch done debug message in appropriate place
2013-02-23 18:42:14 +04:00
Andrew Dolgov
ab457a9c96
rssfuncs: load pluginhost stuff properly
2013-02-23 18:40:48 +04:00
Andrew Dolgov
017401ddce
implement HOOK_FEED_FETCHED
2013-02-23 18:38:50 +04:00
Andrew Dolgov
e02555c1b8
add af_* plugin workaround for already processed article
2013-02-23 12:07:46 +04:00
Andrew Dolgov
b30abdadd2
prevent article filters from modifying article GUID; add separate plugin_data field for this
2013-02-21 22:24:06 +04:00
Andrew Dolgov
750cfcd2fa
remove processing of ttrss_feeds.icon_url
2013-02-08 17:19:43 +04:00
Andrew Dolgov
0a3fd79b0e
fix image caching not working on plugin-rewritten content; remove content cache stuff
2013-02-04 13:00:50 +04:00
Andrew Dolgov
87d7e8507a
split some more functions from functions.php
2013-01-22 22:32:17 +04:00
Andrew Dolgov
c5e3995f8c
disable content caching if _FEEDS_CONTENT_CACHE is not enabled
2013-01-22 16:12:50 +04:00
Andrew Dolgov
3a4c897382
force separate data in ttrss_entries between users
2013-01-18 17:50:18 +04:00
Andrew Dolgov
ba946ba276
use force_feed()
2013-01-10 11:04:05 +04:00
Andrew Dolgov
9e222305f7
allow plugin modification of article guid
2012-12-30 12:22:29 +04:00
Andrew Dolgov
455b1401cd
properly load user plugins and data on update
2012-12-30 11:33:13 +04:00
Andrew Dolgov
bb566dc263
fix overflow of various 250 char fields in rssfuncs
2012-12-26 22:06:47 +04:00
Andrew Dolgov
d2a421e3cb
more work on user-selectable plugins; properly process system and user plugins
2012-12-25 10:02:08 +04:00
Andrew Dolgov
f16116834e
split digest stuff into digest.php
2012-12-24 15:52:59 +04:00
Andrew Dolgov
356a991a7b
update_rss_feed: escape error string immediately
2012-12-24 14:17:24 +04:00
Andrew Dolgov
4412b877d0
implement HOOK_FEED_PARSED, add example plugin (refs #424 )
2012-12-24 14:13:03 +04:00
Andrew Dolgov
fa6fbd3659
do not preg_match() tags from article content
2012-12-24 13:56:36 +04:00
Andrew Dolgov
1b35d30c1f
prevent escaping of article link in the database when using simplepie (refs #472 )
2012-12-24 13:53:38 +04:00
Andrew Dolgov
19b3992b78
remove magpie, fix article filter plugins
2012-12-24 13:45:34 +04:00
Andrew Dolgov
19c7350770
experimental new plugin system
2012-12-23 14:52:18 +04:00
Andrew Dolgov
83e6e313be
support comments on simplepie properly
2012-12-22 13:43:48 +04:00
Andrew Dolgov
35cb2b8f67
Revert "support comments for simplepie"
...
This reverts commit d020a86c36
2012-12-22 13:41:13 +04:00
Andrew Dolgov
d020a86c36
support comments for simplepie
2012-12-22 11:33:03 +04:00
Andrew Dolgov
2bbd699475
update: feed escaping issue
2012-12-16 13:38:50 +04:00
Andrew Dolgov
2a91b6ff78
add built-in expiring of obsolete lockfiles
2012-12-12 09:46:02 +04:00
Andrew Dolgov
d5e9cf28f1
remove uid from ccache guid prefix
2012-11-29 14:56:05 +04:00
Andrew Dolgov
765509c572
create separate guids for cached and authorized content to prevent unnecessary data sharing
2012-11-29 14:55:03 +04:00
Andrew Dolgov
8054439f47
wait a bit before initial content fetching
2012-11-26 14:52:18 +04:00
Andrew Dolgov
130b078109
minor cached content updating tweaks
2012-11-26 14:48:22 +04:00
Andrew Dolgov
cc85704f3c
implement experimental article on-import data filters
2012-11-26 14:33:18 +04:00
Andrew Dolgov
cb93a5dee8
fix inserting cached content on first update
2012-11-25 18:42:03 +04:00
Andrew Dolgov
87764a50cf
implement ttrss_feeds.cache_content
2012-11-23 13:22:34 +04:00
Andrew Dolgov
d03ae73e93
get_article_filters: strip newlines from content before matching
2012-11-20 21:27:53 +04:00
Andrew Dolgov
72d1d0678e
fix title and content filters only working on title ( closes #512 )
2012-11-13 09:31:26 +04:00
Andrew Dolgov
4021d61ada
enable manual filters to work on complete html content
2012-10-30 18:44:17 +04:00
Andrew Dolgov
e8291805dd
update: only load existing labels of previously imported articles
2012-10-30 15:10:52 +04:00
Andrew Dolgov
bb894b2990
fix update stopped by get_article_labels()
2012-10-30 14:59:09 +04:00
Andrew Dolgov
3fc6e71ac8
apply filters and detect labels based on article content without tags
2012-10-30 13:09:38 +04:00
Andrew Dolgov
b24504b121
add ability to auto-assign articles to labels (bump schema)
2012-10-30 12:58:35 +04:00
Andrew Dolgov
92c14e9d53
move article filter functions to rssfuncs.php
2012-10-30 12:11:46 +04:00
Andrew Dolgov
24be5e836f
remove sanitize_article_content (CDATA handled by htmLawed)
2012-10-29 23:51:32 +04:00
Andrew Dolgov
b3682750bb
Revert "sanitize article content when importing data from feed"
...
This reverts commit c7fe1b4e9e
2012-10-29 12:17:28 +04:00
Andrew Dolgov
e1e3f972b6
update_rss_feed: fix broken title/content escaping
2012-10-29 10:13:14 +04:00
Andrew Dolgov
c7fe1b4e9e
sanitize article content when importing data from feed
2012-10-28 12:44:10 +04:00
Andrew Dolgov
c0c2abbaa7
force refetch feed when clicking update/clicking on same feed in the tree
2012-10-25 13:15:14 +04:00
Andrew Dolgov
67bd0b1f26
allow filters to work on child categories
2012-10-09 19:09:50 +04:00
Andrew Dolgov
0f556e3edb
lower default DAEMON_SLEEP_INTERVAL
2012-09-15 20:53:12 +04:00
Andrew Dolgov
304aadb907
remove twitter-specific code
2012-09-07 10:23:46 +04:00
Andrew Dolgov
6aff784575
implement multiple rule/action filters
2012-08-31 12:13:47 +04:00
Andrew Dolgov
9aceda3afc
remove hook-based plugins
2012-08-21 14:37:43 +04:00
Andrew Dolgov
369dbc19d6
rework class system to use subdirectories
...
add placeholder plugin/hook system
2012-08-17 14:22:33 +04:00
Andrew Dolgov
2ea9bbfd07
implement proof of concept postgresql pg_trgm N-gram based marking of similar article titles as read automatically
2012-07-09 19:49:48 +04:00
Andrew Dolgov
0e4a7d7a94
remove memcached stuff
2012-07-06 14:37:03 +04:00
Andrew Dolgov
f2798eb6e6
properly update favicon_last_checked
2012-05-24 16:45:54 +04:00
Andrew Dolgov
d3158e2250
expire files in cache/export
2012-05-24 16:36:54 +04:00
Andrew Dolgov
382268c6c9
rate-limit requests for favicons when not present to conserve traffic (refs #457 )
2012-05-24 16:20:03 +04:00
Andrew Dolgov
1bd11fdf95
Revert "get favicon from icon atom feeds & search for icons not only in html head ( closes #457 )"
...
This reverts commit 882311d9ad
2012-05-17 22:58:08 +04:00
Andrew Dolgov
eb38af4ee4
fix warning when entry content is used as array unnecessarily
2012-05-17 14:56:36 +04:00
Andrew Dolgov
882311d9ad
get favicon from icon atom feeds & search for icons not only in html head ( closes #457 )
2012-05-15 12:06:52 +04:00
Andrew Dolgov
941e48a402
apply patch from gmargo to differentiate between manual and new feed after-subscription update
2012-05-05 22:28:46 +04:00
Andrew Dolgov
6cb2269c03
disable internal magpie/simplepie cache for manual updates
2012-04-09 11:58:00 +04:00
Andrew Dolgov
ecbd7b91fe
allow manual updates for feeds with disabled automatic updates
2012-04-01 09:35:56 +04:00
Andrew Dolgov
2ab20c313c
expire_cached_files: check for glob() returning false
2012-02-24 13:43:50 +04:00
Andrew Dolgov
7b8ff151ed
fix various tags being stuck because of invalid HTML markup being generated ( closes #357 )
2012-02-21 12:16:29 +04:00
Andrew Dolgov
8437c066e1
implement digestTest back
...
misc digest updates and improvements
2012-01-31 16:27:51 +04:00
Andrew Dolgov
61c1812f29
implement preferred time for sending out digests
2012-01-30 16:34:45 +04:00
Andrew Dolgov
ec418193a8
fetch_twitter_rss: include magpie libraries
2012-01-26 13:32:16 +04:00
Andrew Dolgov
0cf816377f
misc fixes in site_url/icon_url parsing
2012-01-17 10:22:47 +04:00
Andrew Dolgov
b8379e6979
cache_images: set a lower size limit for stuff to cache
2012-01-12 12:52:55 +04:00
Andrew Dolgov
a3e0bdcffc
fix tmhOAuth missing query parameters ( closes #416 )
2012-01-10 12:49:10 +04:00
Andrew Dolgov
f1e511c8f2
remove simplepie force_feed() ( closes #414 )
2011-12-31 15:08:00 +04:00
Andrew Dolgov
487f0750c8
workaround against markup being broken by cache_images()
2011-12-28 23:03:55 +04:00
Andrew Dolgov
c58677987b
only try to cache images when cache dir is writable
2011-12-26 13:18:16 +04:00
Andrew Dolgov
3c696512fc
universal image caching and automatic cache directories maintenance
2011-12-26 13:11:08 +04:00
Andrew Dolgov
036cd3a410
globalUpdateFeeds: disable debugging info
2011-12-25 00:17:22 +04:00
Andrew Dolgov
09e8bdfd18
simplify default global config, expand sanity_check messages
2011-12-13 19:20:26 +04:00
Andrew Dolgov
791780621b
split several functions to related classes
2011-12-13 16:27:46 +04:00
Andrew Dolgov
2c08214a7f
split rss updating stuff into separate include file
2011-12-13 16:06:25 +04:00
