boyska/rss-bridge
1
0
Fork 0
forked from blallo/rss-bridge
Code Releases Activity
No description
1647 commits 1 branch 0 tags 2.9 MiB
PHP 98.7%
CSS 1%
JavaScript 0.3%
Find a file
logmanoriginal ee78e7613f [contents] Replace file_get_contents by cURL 
cURL is a powerful library specifically designed to connect to many
different types of servers with different types of protocols. For
more detailed information refer to the PHP cURL manual:

- http://php.net/manual/en/book.curl.php

Due to this change some parameters for the getContents function were
necessary (also applies to getSimpleHTMLDOM and getSimpleHTMLDOMCached):

> $use_include_path removed

  This parameter has never been used and doesn't even make sense in
  this context; If set to true file_get_contents would also search
  for files in the include_path (specified in php.ini).

> $context replaced by $header and $opts

  The $context parameter allowed for customization of the request in
  order to change how file_get_contents would acquire the data (i.e.
  using POST instead of GET, sending custom header, etc...)

  cURL also provides facilities to specify custom headers and change
  how it communicates to severs. cURL, however, is much more advanced.

  - $header is an optional parameter (empty by default). It receives
    an array of strings to send in the HTTP request header.

    See 'CURLOPT_HTTPHEADER':

    "An array of HTTP header fields to set, in the format
    array('Content-type: text/plain', 'Content-length: 100')"

    - php.net/manual/en/function.curl-setopt.php

  - $opts is an optional parameter (empty by default). It receives
    an array of options, where each option is a key-value-pair of
    a cURL option (CURLOPT_*) and it's associated parameter. This
    parameter accepts any of the CURLOPT_* settings.

    Example (sending POST instead of GET):

    $opts = array(
      CURLOPT_POST => 1,
      CURLOPT_POSTFIELDS => '&action=none'
    );
    $html = getContents($url, array(), $opts);

    Refer to the cURL setopt manual for more information:
    - php.net/manual/en/function.curl-setopt.php

> $offset and $maxlen removed

  These options were supported by file_get_contents, but there doesn't
  seem to be an equivalent in cURL. Since no caller uses them they are
  safe to remove.

Compressed data / Encoding

  By using cURL instead of file_get_contents RSS-Bridge no longer has
  to handle compressed data manually.

  See 'CURLOPT_ENCODING':

  "[...] Supported encodings are "identity", "deflate", and "gzip".
  If an empty string, "", is set, a header containing all supported
  encoding types is sent."

  - http://php.net/manual/en/function.curl-setopt.php

  Notice: By default all encoding types are accepted (""). This can
  be changed by setting a custom option via $opts.

    Example:

    $opts = array(CURLOPT_ENCODING => 'gzip');
    $html = getContents($url, array(), $opts);

Proxy

The proxy implementation should still work, but there doesn't seem
to be an equivalent for 'request_fulluri = true'. To my understanding
this isn't an issue because cURL knows how to handle proxy communication.
2018-04-06 20:42:19 +02:00
bridges [FacebookBridge] Return error if username starts with slash 2018-03-23 21:23:30 +01:00
cache PHP settings 2016-11-05 21:33:31 +01:00
caches [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
formats [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
lib [contents] Replace file_get_contents by cURL 2018-04-06 20:42:19 +02:00
static [index] Show bridge options when loading with URL fragment 2017-08-11 19:39:16 +02:00
vendor/simplehtmldom implement proxy feature without modifying simple_html_dom code 2016-06-25 23:14:27 +02:00
.gitattributes First commit 2013-08-06 23:57:22 +02:00
.gitignore [.gitignore] Ignore all Visual Studio Code settings 2016-08-11 20:18:44 +02:00
.travis.yml Update .travis.yml 2018-01-11 11:41:25 +00:00
CHANGELOG.md [CHANGELOG] Add 2017-08-19 2017-08-19 21:08:44 +02:00
CONTRIBUTING.md Add contribution guidelines. 2017-03-07 11:46:54 +00:00
index.php [index] Add 'curl' extension check 2018-04-06 20:42:19 +02:00
phpcs.xml [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
README.md README - sort lists alphabetically 2018-01-10 11:45:55 +00:00
scalingo.json Typo 2016-08-02 23:37:01 +02:00
UNLICENSE let's unlicense ! 2014-05-21 20:11:01 +02:00

README.md

rss-bridge

LICENSE Build Status

rss-bridge is a PHP project capable of generating ATOM feeds for websites which don't have one.

Supported sites/pages (main)

  • Bandcamp : Returns last release from bandcamp for a tag
  • Cryptome : Returns the most recent documents from Cryptome.org
  • DansTonChat: Most recent quotes from danstonchat.com
  • DuckDuckGo: Most recent results from DuckDuckGo.com
  • Facebook : Returns the latest posts on a page or profile on Facebook
  • FlickrExplore : Latest interesting images from Flickr
  • GooglePlus : Most recent posts of user timeline
  • GoogleSearch : Most recent results from Google Search
  • Identi.ca : Identica user timeline (Should be compatible with other Pump.io instances)
  • Instagram: Most recent photos from an Instagram user
  • OpenClassrooms: Lastest tutorials from fr.openclassrooms.com
  • Pinterest: Most recent photos from user or search
  • ScmbBridge: Newest stories from secouchermoinsbete.fr
  • ThePirateBay : Returns the newest indexed torrents from The Pirate Bay with keywords
  • Twitter : Return keyword/hashtag search or user timeline
  • Wikipedia: highlighted articles from Wikipedia in English, German, French or Esperanto
  • YouTube : YouTube user channel, playlist or search

Plus many other bridges to enable, thanks to the community

Output format

Output format can take several forms:

  • Atom : ATOM Feed, for use in RSS/Feed readers
  • Html : Simple html page.
  • Json : Json, for consumption by other applications.
  • Mrss : MRSS Feed, for use in RSS/Feed readers
  • Plaintext : raw text (php object, as returned by print_r)

Screenshot

Welcome screen:

Screenshot

RSS-Bridge hashtag (#rss-bridge) search on Twitter, in ATOM format (as displayed by Firefox):

Screenshot

Requirements

  • PHP 5.6, e.g. AddHandler application/x-httpd-php56 .php in .htaccess
  • openssl extension enabled in PHP config (php.ini)
  • allow_url_fopen=1 in php.ini

Enabling/Disabling bridges

By default, the script creates whitelist.txt and adds the main bridges (see above). whitelist.txt is ignored by git, you can edit it:

  • to enable extra bridges (one bridge per line)
  • to disable main bridges (remove the line)
  • to enable all bridges (just one wildcard * as file content)

New bridges are disabled by default, so make sure to check regularly what's new and whitelist what you want!

Deploy

Deploy on Scalingo

Authors

We are RSS Bridge Community, a group of developers continuing the project initiated by sebsauvage, webmaster of sebsauvage.net, author of Shaarli and ZeroBin.

Patch/contributors :

Licenses

Code is Public Domain.

Including PHP Simple HTML DOM Parser under the MIT License

Technical notes

  • There is a cache so that source services won't ban you even if you hammer the rss-bridge with requests. Each bridge can have a different duration for the cache. The cache subdirectory will be automatically created and cached objects older than 24 hours get purged.
  • To implement a new Bridge, follow the specifications and take a look at existing Bridges for examples.
  • To enable debug mode (disabling cache and enabling error reporting), create an empty file named DEBUG in the root directory (next to index.php).
  • For more information refer to the Wiki

Rant

Dear so-called "social" websites.

Your catchword is "share", but you don't want us to share. You want to keep us within your walled gardens. That's why you've been removing RSS links from webpages, hiding them deep on your website, or removed feeds entirely, replacing it with crippled or demented proprietary API. FUCK YOU.

You're not social when you hamper sharing by removing feeds. You're happy to have customers creating content for your ecosystem, but you don't want this content out - a content you do not even own. Google Takeout is just a gimmick. We want our data to flow, we want RSS or ATOM feeds.

We want to share with friends, using open protocols: RSS, ATOM, XMPP, whatever. Because no one wants to have your service with your applications using your API force-feeding them. Friends must be free to choose whatever software and service they want.

We are rebuilding bridges you have wilfully destroyed.

Get your shit together: Put RSS/ATOM back in.