Differences

This shows you the differences between two versions of the page.

--- debian:other-debian:usenet-indexer-debian [2017/11/15 11:06] – michael
+++ debian:other-debian:usenet-indexer-debian [2019/04/16 15:02] (current) – michael
@@ Line 9: / Line 9: @@
   * ''<wrap em>Minimum 12 GB verbaute / allozierte RAM!</wrap>''
   * Putty Client
+https://www.linuxbabe.com/ubuntu/set-up-nzedb-usenet-indexer-ubuntu-16-0417-04
 FIXME
@@ Line 16: / Line 18: @@
 ----
-  * https://forums.nzedb.com/index.php?topic=2464.0
-  * https://www.linuxbabe.com/ubuntu/set-up-nzedb-usenet-indexer-ubuntu-16-0417-04
-  * https://forums.nzedb.com/index.php?topic=2366.0
@@ Line 76: / Line 72: @@
 # sed -i "s/ServerTokens OS/ServerTokens Prod/" /etc/apache2/conf-available/security.conf
 # sed -i "s/ServerSignature On/ServerSignature Off/" /etc/apache2/conf-available/security.conf
+# vim /etc/apache2/apache2.conf     #->> change at "<Directory /var/www/>... AllowOverride None" to -> AllowOverride All
 </code>
@@ Line 108: / Line 106: @@
 <code>
-# sed -i "s/max_execution_time = 30/max_execution_time = 120/" /etc/php/7.0/cli/php.ini
+# sed -i "s/max_execution_time = 30/max_execution_time = 300/" /etc/php/7.0/cli/php.ini
 # sed -i "s/;date.timezone =/date.timezone = Europe\/Zurich/" /etc/php/7.0/cli/php.ini
 </code>
@@ Line 114: / Line 112: @@
 <wrap em>Now we have to do the same for our php7.0-fpm Configuration:</wrap>
 <code>
-# sed -i "s/max_execution_time = 30/max_execution_time = 120/" /etc/php/7.0/fpm/php.ini
+# sed -i "s/max_execution_time = 30/max_execution_time = 300/" /etc/php/7.0/fpm/php.ini
-# sed -i "s/memory_limit = 128M/memory_limit = 1024M/" /etc/php/7.0/fpm/php.ini
+# sed -i "s/post_max_size = 8M/post_max_size = 64M/" /etc/php/7.0/fpm/php.ini
+# sed -i "s/memory_limit = 128M/memory_limit = 2048M/" /etc/php/7.0/fpm/php.ini
 # sed -i "s/;date.timezone =/date.timezone = Europe\/Zurich/" /etc/php/7.0/fpm/php.ini
 </code>
@@ Line 141: / Line 140: @@
 # configurations by nZEDb
 innodb_file_per_table = 1
-max_allowed_packet = 16M
+max_allowed_packet = 128M
 group_concat_max_len = 8192
 </sxh>
@@ Line 180: / Line 179: @@
 MariaDB [(none)]> GRANT ALL PRIVILEGES ON nzedb.* TO 'nzedbuser'@'localhost' IDENTIFIED BY 'YOUR-PASSWORD';
 MariaDB [(none)]> GRANT FILE ON *.* TO 'nzedbuser'@'localhost';
+MariaDB [(none)]> GRANT RELOAD ON *.* TO nzedbuser@'localhost';   #  (used when optimising DB)
 MariaDB [(none)]> FLUSH PRIVILEGES;
 MariaDB [(none)]> quit</code>
@@ Line 249: / Line 249: @@
 <WRAP center box 100%>
 ==== Tmux Version 2 installieren ====
-  * https://forums.nzedb.com/index.php?topic=2464.0
+<code># apt-get install libevent-dev build-essential git autotools-dev automake pkg-config ncurses-dev
+# apt-get remove tmux
+# cd /tmp/
+# git clone https://github.com/tmux/tmux.git --branch 2.0 --single-branch
+# cd tmux
+# ll
+# ./autogen.sh
+# ./configure
+# make -j4
+# make install
+# make clean
+</code>
 </WRAP>
@@ Line 284: / Line 295: @@
+<WRAP center box 100%>
+==== Einrichten von PreDB ====
+PreDB is a database that contains information about releases. Utilizing PreDB will assist nZEDb in renaming releases and picking up valid releases. It will also allow nZEDb to mark bad releases. Using a preDB will use up disk/database space however, so if you plan on utilizing it, be aware.
+<code># cd /var/www/nZEDb/cli
+# php data/predb_import_daily_batch.php 0 local true
+</code>
+</WRAP>
+<WRAP center box 100%>
+==== Einrichten von IRCScraper ====
+Prior to setting up the IRCScraper, you may want to import previous preDB dumps. It’s not necessary, but will help matching/renaming releases. Follow the guide to do this.
+  - We need to add a PPA so we can install a better version of ZNC.<code># add-apt-repository ppa:teward/znc && sudo apt-get update</code>
+  - Install ZNC and the extras: <code># apt-get install znc znc-dbg znc-dev znc-perl znc-python znc-tcl</code>
+  - Run the configuration wizard: <code># znc --makeconf</code> Answer the wizard with the following answers, change to suit your needs. <wrap em>To avoid confusion, it is advisable to set both your username and nick as the same.</wrap> <sxh plain; gutter: false;>Listen on Port: **6664, you can change this if you want**
+Listen using SSL: **no, but up to you (this is SSL for the scraper and ZNC, not to IRC**
+Listen on IPv4 and IPv6: **no, but up to you**
+Username: **Make up a unique one, will be used to connect to ZNC**
+Password: **Make up a unique one, will be used to connect to ZNC**
+Nick: **Make up a unique one, will be used to connect to IRC**
+Alt nick: **Make up a unique one, will be used to connect to IRC**
+Ident: **Leave as default**
+Real Name: **Leave as default**
+Bind host: **Leave as default**
+Setup Network: **yes**
+Name: **synIRC**
+Server host: 192.168.1.14
+Server SSL: **no**
+Server port: **6667**
+Server password: **leave empty**
+Initial channels: **#nZEDbPRE**
+Launch ZNC: **yes**
+</sxh>
+  - Change some settings in ZNC <WRAP center round important 100%>
+''Point your web browser to the IP and port of your ZNC machine, i.e. http://192.168.1.14:6664, and login.''
+  * Under **Global Settings**, change **Max Buffer Size** to 1000 and click Save.
+  * Under **Your Settings** -> **Networks**, click Edit next to syncIRC.
+  * <wrap em>(Nur falls SSL = yes)</wrap> //Paste the following into the textbox for Trusted SSL fingerprints:// <code>0b:35:ba:24:e7:1c:f6:9e:1f:82:1d:9a:4e:0d:9f:70:8e:91:74:26:57:13:9e:f9:c7:8e:9c:5c:a6:8e:30:62
+:2d:7d:fd:79:09:d1:20:ad:6a:88:f1:fc:49:b5:34:cc:00:2a:7f:95:10:07:e7:b7:d7:90:af:7d:eb:7f:07
+:86:50:b5:7e:08:cb:b4:95:d8:54:9e:fb:8d:f3:6b:97:8a:b7:25:95:d6:3e:38:4c:fb:42:b0:4e:2a:d8:de
+:7b:f5:25:0d:c0:2d:06:b8:57:2a:ef:9f:5c:2f:c9:48:e9:17:f0:43:22:2e:67:0a:56:ca:f8:ee:98:79:71
+:26:00:f7:f0:7f:1d:13:a6:20:88:73:ba:42:6c:8b:5e:ef:fd:04:b3:98:90:f7:23:63:bf:08:46:6d:2e:41
+e:17:a3:cd:ea:5c:55:ff:06:14:91:23:3b:d8:26:d5:b0:d5:8f:69:88:5a:b7:60:dd:73:01:54:d0:b2:18:65
+b3:75:8a:5a:a7:ed:5e:ef:22:45:d4:07:bd:06:32:1e:b8:92:07:49:72:cc:7e:7a:63:fb:3f:e1:92:c3:9a:5a
+d9:10:d9:8a:96:0d:f2:89:d1:a0:87:d0:26:42:b8:51:f9:1d:72:fc:fb:ee:d4:32:14:e8:0c:0d:f3:7a:fa:63
+ef:da:d9:13:be:ad:97:aa:64:65:42:ed:77:24:89:65:97:44:81:da:3d:38:97:56:86:27:67:90:99:57:48:7c
+b:35:ba:24:e7:1c:f6:9e:1f:82:1d:9a:4e:0d:9f:70:8e:91:74:26:57:13:9e:f9:c7:8e:9c:5c:a6:8e:30:62
+:2d:7d:fd:79:09:d1:20:ad:6a:88:f1:fc:49:b5:34:cc:00:2a:7f:95:10:07:e7:b7:d7:90:af:7d:eb:7f:07
+:7b:f5:25:0d:c0:2d:06:b8:57:2a:ef:9f:5c:2f:c9:48:e9:17:f0:43:22:2e:67:0a:56:ca:f8:ee:98:79:71
+:26:00:f7:f0:7f:1d:13:a6:20:88:73:ba:42:6c:8b:5e:ef:fd:04:b3:98:90:f7:23:63:bf:08:46:6d:2e:41
+e:17:a3:cd:ea:5c:55:ff:06:14:91:23:3b:d8:26:d5:b0:d5:8f:69:88:5a:b7:60:dd:73:01:54:d0:b2:18:65
+b3:75:8a:5a:a7:ed:5e:ef:22:45:d4:07:bd:06:32:1e:b8:92:07:49:72:cc:7e:7a:63:fb:3f:e1:92:c3:9a:5a
+d9:10:d9:8a:96:0d:f2:89:d1:a0:87:d0:26:42:b8:51:f9:1d:72:fc:fb:ee:d4:32:14:e8:0c:0d:f3:7a:fa:63
+</code>
+  * ''**Under Modules, check the following boxes:** __chansaver__, __keepnick__, __kickrejoin__, __nickserv__, __perform__, __simple_away__ -> Click “Save and Return”''
+</WRAP>
+  * Under Default Settings, change Channel Modes to +stn
+  * Under Default Settings, change Buffer Size to 1000
+  * Click Save and Return
+http://nzedb.readthedocs.io/en/master/ircscraper.html#ircscraper
+</WRAP>
+  - Configure IRCScraper: ''<wrap em>(We’re assuming you install nZEDb to /var/www/nZEDb/)</wrap>'' <code># cd /var/www/nZEDb/configuration/
+# cp ircscraper_settings_example.php ircscraper_settings.php
+# vim ircscraper_settings.php</code> <sxh bash; gutter: false;>
+https://github.com/nZEDb/nZEDb_Misc/blob/master/Guides/Various/IRCScraper/Guide.md
+http://nzedb.readthedocs.io/en/master/ircscraper.html#ircscraper
+==== TO DO ====
+<code># useradd -c nzedb nzedb
+# usermod -a -G nzedb www-data
+***Login with nzedb***
+# /var/www/nZEDb/misc/IRCScraper
+# php scrape.php true false true
+</code>
@@ Line 296: / Line 390: @@
 ----
+  * https://forums.nzedb.com/index.php?topic=2464.0
+  * https://www.linuxbabe.com/ubuntu/set-up-nzedb-usenet-indexer-ubuntu-16-0417-04
+  * https://forums.nzedb.com/index.php?topic=2366.0
+  * http://nzedb.readthedocs.io/en/master/general_guides.html