Jump to content


Photo

New Zealand EPG


  • Please log in to reply
28 replies to this topic

Re: New Zealand EPG #21 doglover

  • Rytec EPG Team
  • 16,974 posts

+635
Excellent

Posted 19 July 2019 - 08:21

At first sight, I could not see anything wrong.

But I copied them to one of my receivers (Although, I cannot import it -but I can see in the log if there are mistakes).  And sure enough 2 errors.

 

Log:

[EPGImport] failed to open /etc/epgimport/nz.sources.xml Error: mismatched tag: line 8, column 2
sourcesDone():  False None
[EPGImport] WakeUpTime now set to 1563520941 (now=1563519960)
[EPGImport] WakeUpTime now set to 1563520941 (now=1563519985)
[EPGImport] Selected source:  ['Matt Huisman NZ EPG ']
sourcesDone():  False None
[EPGImport] nextImport, source= Matt Huisman NZ EPG
[EPGImport] Downloading: http://i.mjh.nz/nz/epg.xml.gz to local path: /tmp/epgimport.gz
[EPGImport] checkValidServer serverurl http://i.mjh.nz/nz/epg.xml.gz
[EPGImport] checkValidServer rejected server download error for: http://i.mjh.nz/nz
[EPGImport] download failed: checkValidServer reject the server
[EPGImport] imported 0 events
[EPGImport] Save last import date and count event
[EPGImport] Run check deep standby after import
[EPGImport] #### Finished ####

The first error is tag mismatch.  The sourcecat closing tag is missing.

 

The second error is an oversight of me.  A nocheck value has to be added.  The EPGimport routine checks if the file on a remote server is not outdated.  It needs a LastUpdate.txt file on the server.

This file is not present on the server you are using, and so EPGimport rejects the server.  This is not needed for local files.  But this is a remote server, which I did not take into account.

The solution is adding a nocheck parameter to the source.

 

The sources file should be this:

<?xml version="1.0" encoding="utf-8"?>
<sources>
<sourcecat sourcecatname="NZ XMLTV">
<source type="gen_xmltv" nocheck="1" channels="nz.channels.xml">
<description>Matt Huisman NZ EPG </description>
<url>http://i.mjh.nz/nz/epg.xml.gz</url>
</source>
</sourcecat>
</sources>

The log now looks this:

[EPGImport] Selected source:  ['Matt Huisman NZ EPG ']
sourcesDone():  False None
[EPGImport] nextImport, source= Matt Huisman NZ EPG
[EPGImport] Downloading: http://i.mjh.nz/nz/epg.xml.gz to local path: /tmp/epgimport.gz
[EPGImport] Not cheching the server since nocheck is set for it: http://i.mjh.nz/nz/epg.xml.gz
[EPGImport] afterDownload /tmp/epgimport.gz
[EPGImport] unlink /tmp/epgimport.gz
[EPGImport] afterChannelDownload None
[EPGImport] Using twisted thread
[EPGImport] Parsing channels from '/etc/epgimport/custom.channels.xml'
[EPGImport] Parsing channels from '/etc/epgimport/nz.channels.xml'
[EPGImport] Parsing channels from '/etc/epgimport/nz.channels.xml'
[XMLTVConverter] Enumerating event information
Unknown channel:  tv.redbull.tv
Unknown channel:  tv.9
Unknown channel:  tv.10
Unknown channel:  tv.11
Unknown channel:  tv.12
Unknown channel:  tv.13
Unknown channel:  tv.38
Unknown channel:  tv.14
Unknown channel:  tv.27
Unknown channel:  tv.30
Unknown channel:  tv.28
Unknown channel:  tv.65
Unknown channel:  tv.37
Unknown channel:  tv.55
Unknown channel:  tv.67
Unknown channel:  tv.20
Unknown channel:  tv.46
Unknown channel:  tv.58
Unknown channel:  tv.45
Unknown channel:  tv.7
Unknown channel:  tv.39
Unknown channel:  tv.56
Unknown channel:  tv.21
Unknown channel:  tv.36
Unknown channel:  tv.18
Unknown channel:  tv.63
Unknown channel:  tv.41
Unknown channel:  tv.60
Unknown channel:  tv.23
Unknown channel:  tv.24
Unknown channel:  tv.26
Unknown channel:  tv.51
[EPGImport] ### thread is ready ### Events: 0
[EPGImport] imported 0 events
[EPGImport] Save last import date and count event
[EPGImport] Run check deep standby after import
[EPGImport] #### Finished ####

It still imports nothing on my receiver, since I do not have these channels on the receiver, and therefore the entries in the log - Unknown channel

But the import is running.

 

Willy

 

PS:  To obtain the log.  Open EPGimport.  Press Menu.  Choose 1 to see the log.

Now you can save the log.  The log is stored in /tmp/


Edited by doglover, 19 July 2019 - 08:27.

~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: New Zealand EPG #22 NZNinja

  • Member
  • 6 posts

0
Neutral

Posted 20 July 2019 - 04:51

Perfect.  Thank you.

 

Still no joy with the logs though, maybe it's a Vu+ / Blackhole issue?



Re: New Zealand EPG #23 doglover

  • Rytec EPG Team
  • 16,974 posts

+635
Excellent

Posted 20 July 2019 - 06:21

A Blackhole issue maybe.  VU+ machine with other software do not have a problem.

 

Willy


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: New Zealand EPG #24 NZNinja

  • Member
  • 6 posts

0
Neutral

Posted 21 July 2019 - 04:54

Funnily enough, when I successfully managed to run an import, it offers you the opportunity to save the logs (which isn't when you really need it)

 

Maybe because I hadn't closed the sourcecat tag the importer crashed and was unable to save the log file.



Re: New Zealand EPG #25 waxhead

  • New Member
  • 2 posts

0
Neutral

Posted 13 October 2020 - 12:14

Okay,

 

So I have been using http://i.mjh.nz/nz/epg.xml.gz as an epg source for years, without issue.

 

Over the last month or so I have been getting the follow error, which I cannot figure out:

 

Attached File  epgimport.log   1.15KB   2 downloads

 

I can download the file from a web browser without any issue.

 

Seems like there might be a redirection issue - wget returns the following:

 

root@vuultimo:/# wget i.mjh.nz/nz/epg.xml.gz
Connecting to i.mjh.nz (172.67.162.157:80)
Connecting to i.mjh.nz (104.28.31.233:443)
wget: error getting response: Connection reset by peer
 
Curl gives this output:
 
root@vuultimo:/# curl -v http://i.mjh.nz/nz/epg.xml.gz
*   Trying 172.67.162.157...
* TCP_NODELAY set
* Connected to i.mjh.nz (172.67.162.157) port 80 (#0)
> GET /nz/epg.xml.gz HTTP/1.1
> Host: i.mjh.nz
> User-Agent: curl/7.53.1
> Accept: */*
>
< HTTP/1.1 301 Moved Permanently
< Date: Tue, 13 Oct 2020 08:06:51 GMT
< Transfer-Encoding: chunked
< Connection: keep-alive
< Cache-Control: max-age=3600
< Expires: Tue, 13 Oct 2020 09:06:51 GMT
< cf-request-id: 05c29881f10000fd2ece248200000001
< Report-To: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report?lkg-colo=26&lkg-time=1602576411"}],"group":"cf-nel","max_age":604800}
< NEL: {"report_to":"cf-nel","max_age":604800}
< Server: cloudflare
< CF-RAY: 5e1790498fabfd2e-SYD
<
* Connection #0 to host i.mjh.nz left intact
 
Any ideas?

 



Re: New Zealand EPG #26 WanWizard

  • PLi® Core member
  • 68,303 posts

+1,718
Excellent

Posted 13 October 2020 - 12:18

I don't see error there, only a redirect because your host seems to be behind cloudflare's CDN.

 

No problem downloading here:

$ wget http://i.mjh.nz/nz/epg.xml.gz
--2020-10-13 12:17:36--  http://i.mjh.nz/nz/epg.xml.gz
Resolving i.mjh.nz (i.mjh.nz)... 172.67.162.157, 104.28.31.233, 104.28.30.233, ...
Connecting to i.mjh.nz (i.mjh.nz)|172.67.162.157|:80... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: https://i.mjh.nz/nz/epg.xml.gz [following]
--2020-10-13 12:17:37--  https://i.mjh.nz/nz/epg.xml.gz
Connecting to i.mjh.nz (i.mjh.nz)|172.67.162.157|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1004757 (981K) [application/octet-stream]
Saving to: ‘epg.xml.gz’

epg.xml.gz          100%[===================>] 981.21K   861KB/s    in 1.1s    

2020-10-13 12:17:39 (861 KB/s) - ‘epg.xml.gz’ saved [1004757/1004757]

 


Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Pro (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)

Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.

Many answers to your question can be found in our new and improved wiki.


Re: New Zealand EPG #27 doglover

  • Rytec EPG Team
  • 16,974 posts

+635
Excellent

Posted 13 October 2020 - 14:41

epgimport cannot handle https: websites.  That is the problem.

(Maybe somebody can have a look at it and fix this).

 

Workaround; download the file first with a cron job f.i.

1 9 * * *  curl https://i.mjh.nz/PlutoTV/epg.xml.gz -o /tmp/PlutoTv.epg.gz
5 9 * * *  curl https://i.mjh.nz/Stirr/epg.xml.gz -o /tmp/STIRRTv.epg.gz

And point in your sources file to the now downloaded local file.

<?xml version="1.0" encoding="utf-8"?>
<sources>
<sourcecat sourcecatname="Pluto TV">
<source type="gen_xmltv" nocheck="1" channels="custom.channels.xml">
<description>Pluto TV USA</description>
<url>/tmp/PlutoTv.epg.gz</url>
</source>
<source type="gen_xmltv" nocheck="1" channels="custom.channels.xml">
<description>STIRR TV USA</description>
<url>/tmp/STIRRTv.epg.gz</url>
</source>
</sourcecat>
</sources>

 

 


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: New Zealand EPG #28 waxhead

  • New Member
  • 2 posts

0
Neutral

Posted 19 October 2020 - 09:47

Thanks for the help - epgimport & https: definitely the problem.

 

I had to install busybox-cron (opkg install busybox-cron) and then work out where & what file to put the cron job in (/etc/cron/crontabs/root).

 

Then just restart cron (/etc/init.d/busybox-cron restart) and the file is downloading. Tweaked the sources file and EPG now work again.

 

Thanks again!



Re: New Zealand EPG #29 catastrofus

  • Senior Member
  • 3,440 posts

+43
Good

Posted 19 October 2020 - 10:33

Use 'crontab -e' to add/remove cronjobs. Then you don't have to restart crond


Edited by catastrofus, 19 October 2020 - 10:33.

2 x ultimo4k (dvb-c fbc + 1 dvb-s2, 8.3r/nb) + een et10k/osmini (geen tuners en dus fallbackclient, nb) met een Synology ds214+ (2 x 6 TB) op DSM 7.1.1 in ziggo oost (voormalig @Home) + A1/A2/A3/HB (TechniSat)
 



1 user(s) are reading this topic

0 members, 1 guests, 0 anonymous users