Jump to content


Photo

XMLTV mirror offline

Started by WanWizard, 25 Mar 2016 13:45

  • Please log in to reply
6 replies to this topic

#1 WanWizard

  • PLi® Core member
  • 68,788 posts

+1,743
Excellent

Posted 25 March 2016 - 13:45

Over the last 24 hours, the OpenPLi server infrastructure, that also hosts an XMLTV mirror, has been onder heavy DDOS from the Kodi community again.

 

This has lead to a collapse of our firewall the last hour, due to a continuous bombardment of over 100Mbps of Kodi download requests (which were already blocked at layer 7 to offload the webservers).

 

As an example of a single user:

77.178.77.57 - - [25/Mar/2016:10:59:38 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:10:59:40 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:04:40 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:04:42 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:04:44 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:09:45 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:09:47 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:09:49 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:14:51 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:14:53 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:14:55 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:19:55 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:19:58 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:20:00 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:25:00 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:25:02 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:25:04 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:52:23 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:52:25 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:52:27 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:57:28 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:57:30 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:11:57:32 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:02:33 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:02:35 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:02:37 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:07:37 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:07:40 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:07:42 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:18:17 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:18:19 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:18:21 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:23:21 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:23:24 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:23:26 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:28:26 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:28:29 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:28:31 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:33:32 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:33:34 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:33:36 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:38:36 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:38:38 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:38:41 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:43:41 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:43:43 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:12:43:45 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"
77.178.77.57 - - [25/Mar/2016:13:12:10 +0100] "GET /rytecxmltvGermany.gz HTTP/1.1" 404 218 "-" "Kodi/15.2 (Linux; Android 5.1; AFTM Build/LMY47O) Android/5.1.0 Sys_CPU/armv7l App_Bitness/32 Version/15.2-Git:2015-10-19-02e7013"

In order to limit the impact of this abuse to the rest of the infstratructure, we have decided to take our rytec mirror offline.


Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Pro (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)

Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.

Many answers to your question can be found in our new and improved wiki.

Re: XMLTV mirror offline #2 doglover

  • Rytec EPG Team
  • 17,051 posts

+642
Excellent

Posted 25 March 2016 - 14:23

And all of this for providing EPG to illegal German streams!!!!!

 

Willy


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*

Re: XMLTV mirror offline #3 doglover

  • Rytec EPG Team
  • 17,051 posts

+642
Excellent

Posted 25 March 2016 - 16:12

IP is from telefonica.de

 

Willy


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*

Re: XMLTV mirror offline #4 WanWizard

  • PLi® Core member
  • 68,788 posts

+1,743
Excellent

Posted 25 March 2016 - 16:23

It was an example, this is the top list of IP's with their occurence count in the logs, starting 04:00 this morning:

    333 77.116.117.199
    328 92.201.8.86
    325 77.20.121.179
    325 37.201.194.80
    324 84.59.248.110
    323 93.196.95.76
    321 82.82.168.209
    321 79.212.90.145
    316 37.201.5.170
    315 93.216.99.41
    315 87.173.140.215
    314 94.217.137.194
    313 95.116.160.53
    313 84.184.182.60
    313 5.146.136.52
    313 5.146.122.215
    313 188.195.26.137
    312 37.24.151.74
    311 83.162.202.150
    310 94.219.5.96
    310 79.231.46.203
    310 178.201.65.33
    302 77.182.64.224
    296 176.199.222.74
    291 95.208.250.247
    288 188.97.76.36
    286 79.239.113.106
    284 188.102.182.239
    282 80.142.75.91
    279 80.110.127.231
    276 84.132.187.6
    276 80.110.121.187
    274 95.90.231.132
    273 84.178.122.21
    271 92.212.7.55
    269 37.24.142.145
    268 80.108.254.35
    262 94.219.191.141
    261 95.91.207.253
    261 84.169.153.90
    261 37.24.145.137
    258 91.6.242.220
    258 80.109.241.139
    258 188.101.90.235
    257 91.115.23.20
    257 79.243.94.250

The counters could have been even higher, but fail2ban eventually blocks these IP's.

 

All to no avail btw, as soon as the cable was plugged into the firewall, the CPU went to 100%, and it became totally unresponsive.


Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Pro (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)

Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.

Many answers to your question can be found in our new and improved wiki.

Re: XMLTV mirror offline #5 doglover

  • Rytec EPG Team
  • 17,051 posts

+642
Excellent

Posted 25 March 2016 - 16:56

Checked approx 10 of these:  All Germany.

 

I do not understand these guys.  There is perfect acceptable plugin for Kodi to obtain the EPG.  No they want to do this this way.  A way which crashes servers.

Bunch of nitwits.

 

 

Willy


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*

Re: XMLTV mirror offline #6 CloudItaly

  • Senior Member
  • 195 posts

+1
Neutral

Posted 26 March 2016 - 18:55

This this code in .htaccess 

# BLOCK USER AGENTS
RewriteEngine on
 RewriteCond %{HTTP_USER_AGENT} Kodi [NC]
RewriteRule !^robots\.txt$ - [F]

Re: XMLTV mirror offline #7 WanWizard

  • PLi® Core member
  • 68,788 posts

+1,743
Excellent

Posted 26 March 2016 - 21:34

We already had that block, didn't help, the L7 firewall got completely swamped with http requests.

 

With this as a result:

Attached File  chart.png   71.06KB   7 downloads


Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Pro (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)

Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.

Many answers to your question can be found in our new and improved wiki.

Back to [EN] Rytec XMLTV and EPG support

0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users

  1. Forums
  2. → PLi® Support
  3. → [EN] Rytec XMLTV and EPG support