Flexget

From Bytesized Wiki

(Difference between revisions)
Jump to: navigation, search
(Scheduling FlexGet)
 
(6 intermediate revisions not shown)
Line 37: Line 37:
*A user-submitted example of advanced configuration:<br>
*A user-submitted example of advanced configuration:<br>
http://pastebin.com/H6gyipex
http://pastebin.com/H6gyipex
 +
*Easy to use software for creating config.yml
 +
http://www.flexgetcfc.co.uk/
====Checking FlexGet====
====Checking FlexGet====
Line 56: Line 58:
*Before you add flexget to cron, it is '''STRONGLY''' advised to run:
*Before you add flexget to cron, it is '''STRONGLY''' advised to run:
  flexget --learn
  flexget --learn
-
*As above command suggests, it learns all torrents that are already on feed. So when flexget is ran for first time, it wont download and queue 50 torrents at once. If you created cool filters, you wont necessarily need this. If you used accept_all anywhere on config.yml, you'll definitely want to do this.
+
*As above command suggests, it learns all torrents that are already on feed and marks them as seen. So when flexget cron is ran for first time, it wont download and queue 50 torrents at once. If you created cool filters, you wont necessarily need this. If you used accept_all anywhere on config.yml, you'll definitely want to do this.
*To get flexget to run automatically, you must add it to crontab, type:
*To get flexget to run automatically, you must add it to crontab, type:
  crontab -e  
  crontab -e  
*This will ask you to choose your prefered editor, select "nano" if you are comfortable with this.
*This will ask you to choose your prefered editor, select "nano" if you are comfortable with this.
-
*If you wish to let flexget run every 10 minutes, '''and you installed it yourself''' add this line:
 
-
*/10 * * * * ~/flexget/bin/flexget --cron
 
-
*To save changes to the crontab file, press Ctrl-O then 'Enter' on your keyboard, then Ctrl-X to close
 
*If you're using '''already installed''' flexget, add this line:
*If you're using '''already installed''' flexget, add this line:
   */10 * * * * /usr/local/bin/flexget --cron
   */10 * * * * /usr/local/bin/flexget --cron
 +
*To save changes to the crontab file, press Ctrl-O then 'Enter' on your keyboard, then Ctrl-X to close
 +
*If you wish to let flexget run every 10 minutes, '''and you installed it yourself''' add this line:
 +
*/10 * * * * ~/flexget/bin/flexget --cron
*To save changes to the crontab file, press Ctrl-O then 'Enter' on your keyboard, then Ctrl-X to close
*To save changes to the crontab file, press Ctrl-O then 'Enter' on your keyboard, then Ctrl-X to close
*There is no way to confirm that your crontab is working by typing a command in the terminal, so simply wait and see if torrents are being added to deluge automatically. If they are not, there's a mistake in the code mentioned above.
*There is no way to confirm that your crontab is working by typing a command in the terminal, so simply wait and see if torrents are being added to deluge automatically. If they are not, there's a mistake in the code mentioned above.
====Installation====
====Installation====
 +
 +
===== Flexget is installed by default =====
 +
''' You should do these steps only if you are sure that flexget is not installed '''
''' You should do these steps only if you are sure that flexget is not installed '''
Open the terminal on your box, either through [http://wiki.bytesized-hosting.com/wiki/index.php/VNC VNC] or through [http://wiki.bytesized-hosting.com/wiki/index.php/SSH_access SSH].
Open the terminal on your box, either through [http://wiki.bytesized-hosting.com/wiki/index.php/VNC VNC] or through [http://wiki.bytesized-hosting.com/wiki/index.php/SSH_access SSH].
Line 74: Line 79:
  virtualenv ~/flexget/
  virtualenv ~/flexget/
*Activate virtualenv by typing in terminal:  
*Activate virtualenv by typing in terminal:  
-
  source ~/flexget/bin/activate
+
source ~/flexget/bin/activate
 +
*Change to ~/flexget directory
 +
cd ~/flexget
*Install latest version of flexget by typing:
*Install latest version of flexget by typing:
-
  easy_install http://download.flexget.com/unstable/FlexGet-1.0r1712-py2.6.egg
+
  easy_install flexget
This will install FlexGet and all the required dependencies.
This will install FlexGet and all the required dependencies.
-
<br>The Flexget version above was released on Dec. 10, 2010.
+
<br>easy_install automatically gets latest version of flexget
-
<br>Newer versions are being released almost daily, go to http://flexget.com/ to see the latest version available. Then simply change the code above.
+
*If you want to upgrade flexget, type:
-
<br>You can easily upgrade your current version to the latest anytime by re-running the code above with the latest version number.
+
easy_install --upgrade flexget
 +
*Just to make sure that upgrade went smoothly, type:
 +
flexget --check
 +
 
 +
 
 +
====Common problems====
 +
If you use Flexget with an SSL based feed and it's giving you errors, "Unable to download the RSS for task shows (RSS URL): [Errno 1] ssl.c:480: error:14090086:SSL routines:SSL3_GET_SERVERCERTIFICATE:certificate verify failed"  try adding: `verify_ssl_certificates: no` to your config.
 +
 
====Help====
====Help====

Current revision as of 20:07, 18 November 2012

FlexGet is a very powerful tool to aggregate and sort RSS feeds automatically and it works well with Deluge.
FlexGet is a multipurpose automation tool for content like torrents, nzbs, podcasts, comics, etc.
FlexGet is able to handle different kinds of sources like RSS-feeds, html pages and csv files.
There are even some plugins for sites that do not provide any kind of useful feeds.
There are numerous plugins that allow utilizing FlexGet in interesting ways and more are being added continuously.
Since the FlexRSS plugin isn’t working in Deluge 1.2.*, I thought I write this workaround for adding torrents through RSS-Feeds.
Feel free to add something or correct me if I made a mistake.

Contents

Installing FlexGet

If you are on a new server FlexGet is already installed, you can go straight to Configuring FlexGet'

New users shouldn't be discouraged by the code below, its very straight forward.
To setup: <10 min.
To configure: <60 min (depending on your complexity of the code).


Configuring FlexGet

  • Type in terminal:
 mkdir -p ~/.flexget

and then

 nano ~/.flexget/config.yml
 
  • To save changes to the config file, press Ctrl-O then 'Enter' on your keyboard, then Ctrl-X to close

Examples of config.yml files

Reading examples below is the easiest way to configure flexget to suit your needs:

  • Examples from flexget website:

http://flexget.com/wiki/Configuration
http://flexget.com/wiki/Cookbook

  • Examples from our blog:

http://blog.bytesized-hosting.com/2010/03/16/the-beauty-of-flexget/

  • A user-submitted example of basic configuration:

http://pastebin.com/GdiqFQ9B

  • A user-submitted example of advanced configuration:

http://pastebin.com/H6gyipex

  • Easy to use software for creating config.yml

http://www.flexgetcfc.co.uk/

Checking FlexGet

  • You can check whether your configuration would work by typing:
flexget --test

Running FlexGet

  • You can run Flexget manually by typing:
flexget

Scheduling FlexGet

  • You can automate FlexGet to run frequently such that it downloads new torrents automatically to your watch folder, without manually running flexget.
  • To see if flexget is installed on your box, type:
which flexget
  • If it returns a path to flexget, it is installed, if not you can ask staff to install it or do it yourself.
  • Before you add flexget to cron, it is STRONGLY advised to run:
flexget --learn
  • As above command suggests, it learns all torrents that are already on feed and marks them as seen. So when flexget cron is ran for first time, it wont download and queue 50 torrents at once. If you created cool filters, you wont necessarily need this. If you used accept_all anywhere on config.yml, you'll definitely want to do this.
  • To get flexget to run automatically, you must add it to crontab, type:
crontab -e 
  • This will ask you to choose your prefered editor, select "nano" if you are comfortable with this.
  • If you're using already installed flexget, add this line:
 */10 * * * * /usr/local/bin/flexget --cron
  • To save changes to the crontab file, press Ctrl-O then 'Enter' on your keyboard, then Ctrl-X to close
  • If you wish to let flexget run every 10 minutes, and you installed it yourself add this line:
*/10 * * * * ~/flexget/bin/flexget --cron
  • To save changes to the crontab file, press Ctrl-O then 'Enter' on your keyboard, then Ctrl-X to close
  • There is no way to confirm that your crontab is working by typing a command in the terminal, so simply wait and see if torrents are being added to deluge automatically. If they are not, there's a mistake in the code mentioned above.

Installation

Flexget is installed by default

You should do these steps only if you are sure that flexget is not installed Open the terminal on your box, either through VNC or through SSH.

  • Create virtualenv by typing in terminal:
virtualenv ~/flexget/
  • Activate virtualenv by typing in terminal:
source ~/flexget/bin/activate
  • Change to ~/flexget directory
cd ~/flexget
  • Install latest version of flexget by typing:
easy_install flexget

This will install FlexGet and all the required dependencies.
easy_install automatically gets latest version of flexget

  • If you want to upgrade flexget, type:
easy_install --upgrade flexget
  • Just to make sure that upgrade went smoothly, type:
flexget --check


Common problems

If you use Flexget with an SSL based feed and it's giving you errors, "Unable to download the RSS for task shows (RSS URL): [Errno 1] ssl.c:480: error:14090086:SSL routines:SSL3_GET_SERVERCERTIFICATE:certificate verify failed" try adding: `verify_ssl_certificates: no` to your config.


Help

  • This guide is based on http://flexget.com/wiki/InstallWizard/Linux/NoRoot/Virtualenv
  • If the installation fails check this page for the latest links.
  • If you get stuck using Flexget, simply create a ticket at http://flexget.com/newticket and the members of flexget will help you out. Response time is usually within 30mins.
  • If you're using Putty, CTRL+C and CTRL+V doesnt work. So copy any code and right-click with your mouse to paste it in Putty. (Useful for long RSS links)
Personal tools