Jump to content


Photo

epgimport https links do not work with sources.xml


  • Please log in to reply
14 replies to this topic

#1 jenseneverest

  • Senior Member
  • 50 posts

+2
Neutral

Posted 1 March 2019 - 03:05

I came across this issue on the OE version of the plugin, so i tried the pli version and have the same issue (and others...)
 
while http:// links work with the sources.xml if you try to use https:// links they will not.
A recent upgrade to the server has highlighted the issue
https: is more secure, surely they should work as well ??
 
Further more with the pli version i am  getting 
Error at start: strptime() argument 1 must be string without null bytes not str 

The same sources file attached works on the OE version of the plugin (except for the now https links)  :wacko:

 

TIA

 

Attached File  jenseneverest.sources.xml   2.04KB   11 downloads



Re: epgimport https links do not work with sources.xml #2 doglover

  • Rytec EPG Team
  • 12,570 posts

+380
Excellent

Posted 1 March 2019 - 08:32

Try changing:

 

<source type="gen_xmltv"

 

into:

 

<source type="gen_xmltv"  nocheck="1"

 

This is modification from some time ago.

 

Willy


~~Rytec Team~~
Xtrend ET6000 OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: epgimport https links do not work with sources.xml #3 jenseneverest

  • Senior Member
  • 50 posts

+2
Neutral

Posted 1 March 2019 - 11:38

Yes that is my point, that will now let the http dropbox links work....BUT the nocheck file is already produced daily, i actually think it is a good idea......

and it already works on the OE version of the plugin,  nocheck="1" is not needed there.

 

However the HTTPS: links do not work with both PLI and OE versions of the plugin, with or without the  nocheck="1" options.

[EPGImport] autostart (0) occured at 1551435353.99[EPGImport] autostart (0) occured at 1551435354.02
[EPGImport] WakeUpTime now set to 1551504491 (now=1551435354)
[EPGImport] No settings [Errno 2] No such file or directory: '/etc/enigma2/epgimport.conf'
[EPGImport] Selected source:  ['UK SAT on 28.2 east']
sourcesDone():  False None
[EPGImport] nextImport, source= UK SAT on 28.2 east
[EPGImport] afterDownload https://www.linuxsat-support.com/virgin-epg/epg/vermin.xml.gz
[EPGImport] download failed: [Errno 2] No such file or directory: 'https://www.linuxsat-support.com/virgin-epg/epg/vermin.xml.gz'
[EPGImport] imported 0 events
[EPGImport] Save last import date and count event
[EPGImport] Run check deep standby after import
[EPGImport] #### Finished ####
[EPGImport] WakeUpTime now set to 1551504491 (now=1551435666)

But you can click on the link below and a file will download.

 

https://www.linuxsat...g/vermin.xml.gz



Re: epgimport https links do not work with sources.xml #4 WanWizard

  • Forum Moderator
    PLi® Core member
  • 46,357 posts

+749
Excellent

Posted 1 March 2019 - 12:42

https: is more secure

 

That is a very common misunderstanding, https does not provide any security. It only encrypts packets in transit, which is pointless for public data (since everyone has access to it anyway).

 

I came across this issue on the OE version of the plugin, so i tried the pli version and have the same issue (and others...)

 

No clue what the "OE version" is, as we only make one.

 

And our plugin uses the standard Python twisted framework to download, and tnat supports https just fine.

 

If you have a problem, it is more likely your image is missing components, for example to be able to validate the certificate. Or your box doesn't have the correct time, which also causes the certificate check to fail.

 


Currently in use: VU+Duo 4K (2xFBC S2), Amiko Viper T2C (T2), SAB Alpha Triple HD (S2+T2), Zgemma H3.T2C (T/C), Zgemma H6 (fallback), VU+Zero (fallback)

Many answers to your question can be found in our new and improved wiki.

note: I do not provide support via PM !

 


Re: epgimport https links do not work with sources.xml #5 jenseneverest

  • Senior Member
  • 50 posts

+2
Neutral

Posted 1 March 2019 - 13:07

Thanks for the reply, so as not to confuse matters i will concentrate only on openpli and its version of the plugin from here on.

This is my current image and time is set correctly for my location.

 

Attached File  1_0_1_6218_7E6_2_11A0000_0_0_0_20190301120047.jpg   110.77KB   4 downloads

 

Despite having the dated lastupdate file in the download area it dose not work with epgimporter on the dropbox link in the sources file attached above

 

Further more the HTTPS: links do not work at all. If http: links are used there is not an issue.

 

 



Re: epgimport https links do not work with sources.xml #6 WanWizard

  • Forum Moderator
    PLi® Core member
  • 46,357 posts

+749
Excellent

Posted 1 March 2019 - 13:38

The problem with dropbox is this one:

root@vuduo4k:/tmp# wget http://dl.dropboxusercontent.com/s/k1i1u5w6ydtxzqi/vermin.xml.gz
--2019-03-01 12:17:21--  http://dl.dropboxusercontent.com/s/k1i1u5w6ydtxzqi/vermin.xml.gz
Resolving dl.dropboxusercontent.com... 162.125.64.6, 2620:100:6020:6::a27d:4006
Connecting to dl.dropboxusercontent.com|162.125.64.6|:80... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: https://dl.dropboxusercontent.com/s/k1i1u5w6ydtxzqi/vermin.xml.gz [following]
--2019-03-01 12:17:21--  https://dl.dropboxusercontent.com/s/k1i1u5w6ydtxzqi/vermin.xml.gz
Connecting to dl.dropboxusercontent.com|162.125.64.6|:443... connected.
ERROR: cannot verify dl.dropboxusercontent.com's certificate, issued by ‘CN=DigiCert SHA2 High Assurance Server CA,OU=www.digicert.com,O=DigiCert Inc,C=US’:
  Unable to locally verify the issuer's authority.
To connect to dl.dropboxusercontent.com insecurely, use `--no-check-certificate'.

a check shows:

root@vuduo4k:/tmp# openssl s_client -showcerts -connect dl.dropboxusercontent.com:443
CONNECTED(00000003)
depth=1 C = US, O = DigiCert Inc, OU = www.digicert.com, CN = DigiCert SHA2 High Assurance Server CA
verify error:num=20:unable to get local issuer certificate
---
Certificate chain
 0 s:/C=US/ST=California/L=San Francisco/O=Dropbox, Inc/OU=Dropbox Ops/CN=*.dl.dropboxusercontent.com
   i:/C=US/O=DigiCert Inc/OU=www.digicert.com/CN=DigiCert SHA2 High Assurance Server CA

on a working setup, it shows:

[wanwizard@catwoman] $ openssl s_client -showcerts -connect dl.dropboxusercontent.com:443
CONNECTED(00000003)
depth=2 C = US, O = DigiCert Inc, OU = www.digicert.com, CN = DigiCert High Assurance EV Root CA
verify return:1
depth=1 C = US, O = DigiCert Inc, OU = www.digicert.com, CN = DigiCert SHA2 High Assurance Server CA
verify return:1
depth=0 C = US, ST = California, L = San Francisco, O = "Dropbox, Inc", OU = Dropbox Ops, CN = *.dl.dropboxusercontent.com
verify return:1
---
Certificate chain
 0 s:C = US, ST = California, L = San Francisco, O = "Dropbox, Inc", OU = Dropbox Ops, CN = *.dl.dropboxusercontent.com
   i:C = US, O = DigiCert Inc, OU = www.digicert.com, CN = DigiCert SHA2 High Assurance Server CA

which means the ca-certificates packages is not complete, and it misses the "DigiCert High Assurance EV Root CA" certificate.

 

OpenPLi develop uses 20180409, which is quite recent but doesn't have it, Fedora uses 2018-02-26, but does, which means Redhat has patched their version. I find a similar issue report for Ubuntu too.

 

Fixing this is not for tomorrow...


Currently in use: VU+Duo 4K (2xFBC S2), Amiko Viper T2C (T2), SAB Alpha Triple HD (S2+T2), Zgemma H3.T2C (T/C), Zgemma H6 (fallback), VU+Zero (fallback)

Many answers to your question can be found in our new and improved wiki.

note: I do not provide support via PM !

 


Re: epgimport https links do not work with sources.xml #7 doglover

  • Rytec EPG Team
  • 12,570 posts

+380
Excellent

Posted 1 March 2019 - 13:41

Sorry, misunderstood your problem.

But reading, the above from WanWizard, it is above my paygrade anyway.

(Ask me anything on chemistry)

 

Willy


~~Rytec Team~~
Xtrend ET6000 OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: epgimport https links do not work with sources.xml #8 WanWizard

  • Forum Moderator
    PLi® Core member
  • 46,357 posts

+749
Excellent

Posted 1 March 2019 - 14:16

@jenseneverest,

 

Can you install this on your box, and see if it makes a diference?

 

 

Attached Files


Currently in use: VU+Duo 4K (2xFBC S2), Amiko Viper T2C (T2), SAB Alpha Triple HD (S2+T2), Zgemma H3.T2C (T/C), Zgemma H6 (fallback), VU+Zero (fallback)

Many answers to your question can be found in our new and improved wiki.

note: I do not provide support via PM !

 


Re: epgimport https links do not work with sources.xml #9 jenseneverest

  • Senior Member
  • 50 posts

+2
Neutral

Posted 2 March 2019 - 10:38

Thanks @WanWizard, unfortunately it still will not work unless nocheck is added to the source



Re: epgimport https links do not work with sources.xml #10 WanWizard

  • Forum Moderator
    PLi® Core member
  • 46,357 posts

+749
Excellent

Posted 2 March 2019 - 12:14

That is odd, because it works fine here with this ca-certificates update:

root@vuduo4k:~# wget http://dl.dropboxusercontent.com/s/k1i1u5w6ydtxzqi/vermin.xml.gz
--2019-03-02 11:13:52--  http://dl.dropboxusercontent.com/s/k1i1u5w6ydtxzqi/vermin.xml.gz
Resolving dl.dropboxusercontent.com... 162.125.64.6, 2620:100:6020:6::a27d:4006
Connecting to dl.dropboxusercontent.com|162.125.64.6|:80... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: https://dl.dropboxusercontent.com/s/k1i1u5w6ydtxzqi/vermin.xml.gz [following]
--2019-03-02 11:13:52--  https://dl.dropboxusercontent.com/s/k1i1u5w6ydtxzqi/vermin.xml.gz
Connecting to dl.dropboxusercontent.com|162.125.64.6|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 9539089 (9.1M) [application/octet-stream]
Saving to: ‘vermin.xml.gz’

vermin.xml.gz                                               100%[=========================================================================================================================================>]   9.10M  3.64MB/s    in 2.5s    

2019-03-02 11:13:55 (3.64 MB/s) - ‘vermin.xml.gz’ saved [9539089/9539089]

Currently in use: VU+Duo 4K (2xFBC S2), Amiko Viper T2C (T2), SAB Alpha Triple HD (S2+T2), Zgemma H3.T2C (T/C), Zgemma H6 (fallback), VU+Zero (fallback)

Many answers to your question can be found in our new and improved wiki.

note: I do not provide support via PM !

 


Re: epgimport https links do not work with sources.xml #11 jenseneverest

  • Senior Member
  • 50 posts

+2
Neutral

Posted 2 March 2019 - 12:45

indeed very odd, as wget of both http and https now works as you have above, but not so with epgimport plugin sadly.



Re: epgimport https links do not work with sources.xml #12 WanWizard

  • Forum Moderator
    PLi® Core member
  • 46,357 posts

+749
Excellent

Posted 2 March 2019 - 12:59

Well, I didn't say that. Now that the external problems are out of the way, it's time to look at the rest. ;)


Currently in use: VU+Duo 4K (2xFBC S2), Amiko Viper T2C (T2), SAB Alpha Triple HD (S2+T2), Zgemma H3.T2C (T/C), Zgemma H6 (fallback), VU+Zero (fallback)

Many answers to your question can be found in our new and improved wiki.

note: I do not provide support via PM !

 


Re: epgimport https links do not work with sources.xml #13 WanWizard

  • Forum Moderator
    PLi® Core member
  • 46,357 posts

+749
Excellent

Posted 2 March 2019 - 13:30

It might be related / the same issue as in https://forums.openp...ps-image/page-2

 

Here it is said that twisted' downloadPage() is not SNI compatible, and in fact deprecated. https://twistedmatri...ples/index.html says twisted web agent should be used instead, which means a rewrite of the download section of the plugin.

 

I am not proficient enough in Python to do that.


Currently in use: VU+Duo 4K (2xFBC S2), Amiko Viper T2C (T2), SAB Alpha Triple HD (S2+T2), Zgemma H3.T2C (T/C), Zgemma H6 (fallback), VU+Zero (fallback)

Many answers to your question can be found in our new and improved wiki.

note: I do not provide support via PM !

 


Re: epgimport https links do not work with sources.xml #14 jenseneverest

  • Senior Member
  • 50 posts

+2
Neutral

Posted 3 March 2019 - 20:31

It might be related / the same issue as in https://forums.openp...ps-image/page-2

 

Here it is said that twisted' downloadPage() is not SNI compatible, and in fact deprecated. https://twistedmatri...ples/index.html says twisted web agent should be used instead, which means a rewrite of the download section of the plugin.

 

I am not proficient enough in Python to do that.

 

It has gone way over my head a while ago, i do at least understand why some things were not working now, and appreciate your help thank you

Hopefully the plugin maintainers are aware, is there any point to me reporting the issue on github ?



Re: epgimport https links do not work with sources.xml #15 WanWizard

  • Forum Moderator
    PLi® Core member
  • 46,357 posts

+749
Excellent

Posted 3 March 2019 - 20:56

No, it's been reported here, that should do it.


Currently in use: VU+Duo 4K (2xFBC S2), Amiko Viper T2C (T2), SAB Alpha Triple HD (S2+T2), Zgemma H3.T2C (T/C), Zgemma H6 (fallback), VU+Zero (fallback)

Many answers to your question can be found in our new and improved wiki.

note: I do not provide support via PM !

 





0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users