28 replies to this topic

[doglover]

At first sight, I could not see anything wrong.

But I copied them to one of my receivers (Although, I cannot import it -but I can see in the log if there are mistakes).  And sure enough 2 errors.

 

Log:

[EPGImport] failed to open /etc/epgimport/nz.sources.xml Error: mismatched tag: line 8, column 2
sourcesDone():  False None
[EPGImport] WakeUpTime now set to 1563520941 (now=1563519960)
[EPGImport] WakeUpTime now set to 1563520941 (now=1563519985)
[EPGImport] Selected source:  ['Matt Huisman NZ EPG ']
sourcesDone():  False None
[EPGImport] nextImport, source= Matt Huisman NZ EPG
[EPGImport] Downloading: http://i.mjh.nz/nz/epg.xml.gz to local path: /tmp/epgimport.gz
[EPGImport] checkValidServer serverurl http://i.mjh.nz/nz/epg.xml.gz
[EPGImport] checkValidServer rejected server download error for: http://i.mjh.nz/nz
[EPGImport] download failed: checkValidServer reject the server
[EPGImport] imported 0 events
[EPGImport] Save last import date and count event
[EPGImport] Run check deep standby after import
[EPGImport] #### Finished ####

The first error is tag mismatch.  The sourcecat closing tag is missing.

 

The second error is an oversight of me.  A nocheck value has to be added.  The EPGimport routine checks if the file on a remote server is not outdated.  It needs a LastUpdate.txt file on the server.

This file is not present on the server you are using, and so EPGimport rejects the server.  This is not needed for local files.  But this is a remote server, which I did not take into account.

The solution is adding a nocheck parameter to the source.

 

The sources file should be this:

<?xml version="1.0" encoding="utf-8"?>
<sources>
<sourcecat sourcecatname="NZ XMLTV">
<source type="gen_xmltv" nocheck="1" channels="nz.channels.xml">
<description>Matt Huisman NZ EPG </description>
<url>http://i.mjh.nz/nz/epg.xml.gz</url>
</source>
</sourcecat>
</sources>

The log now looks this:

[EPGImport] Selected source:  ['Matt Huisman NZ EPG ']
sourcesDone():  False None
[EPGImport] nextImport, source= Matt Huisman NZ EPG
[EPGImport] Downloading: http://i.mjh.nz/nz/epg.xml.gz to local path: /tmp/epgimport.gz
[EPGImport] Not cheching the server since nocheck is set for it: http://i.mjh.nz/nz/epg.xml.gz
[EPGImport] afterDownload /tmp/epgimport.gz
[EPGImport] unlink /tmp/epgimport.gz
[EPGImport] afterChannelDownload None
[EPGImport] Using twisted thread
[EPGImport] Parsing channels from '/etc/epgimport/custom.channels.xml'
[EPGImport] Parsing channels from '/etc/epgimport/nz.channels.xml'
[EPGImport] Parsing channels from '/etc/epgimport/nz.channels.xml'
[XMLTVConverter] Enumerating event information
Unknown channel:  tv.redbull.tv
Unknown channel:  tv.9
Unknown channel:  tv.10
Unknown channel:  tv.11
Unknown channel:  tv.12
Unknown channel:  tv.13
Unknown channel:  tv.38
Unknown channel:  tv.14
Unknown channel:  tv.27
Unknown channel:  tv.30
Unknown channel:  tv.28
Unknown channel:  tv.65
Unknown channel:  tv.37
Unknown channel:  tv.55
Unknown channel:  tv.67
Unknown channel:  tv.20
Unknown channel:  tv.46
Unknown channel:  tv.58
Unknown channel:  tv.45
Unknown channel:  tv.7
Unknown channel:  tv.39
Unknown channel:  tv.56
Unknown channel:  tv.21
Unknown channel:  tv.36
Unknown channel:  tv.18
Unknown channel:  tv.63
Unknown channel:  tv.41
Unknown channel:  tv.60
Unknown channel:  tv.23
Unknown channel:  tv.24
Unknown channel:  tv.26
Unknown channel:  tv.51
[EPGImport] ### thread is ready ### Events: 0
[EPGImport] imported 0 events
[EPGImport] Save last import date and count event
[EPGImport] Run check deep standby after import
[EPGImport] #### Finished ####

It still imports nothing on my receiver, since I do not have these channels on the receiver, and therefore the entries in the log - Unknown channel

But the import is running.

 

Willy

 

PS:  To obtain the log.  Open EPGimport.  Press Menu.  Choose 1 to see the log.

Now you can save the log.  The log is stored in /tmp/

Edited by doglover, 19 July 2019 - 08:27.

[NZNinja]

Perfect.  Thank you.

 

Still no joy with the logs though, maybe it's a Vu+ / Blackhole issue?

[doglover]

A Blackhole issue maybe.  VU+ machine with other software do not have a problem.

 

Willy

[NZNinja]

Funnily enough, when I successfully managed to run an import, it offers you the opportunity to save the logs (which isn't when you really need it)

 

Maybe because I hadn't closed the sourcecat tag the importer crashed and was unable to save the log file.

[waxhead]

Okay,

 

So I have been using http://i.mjh.nz/nz/epg.xml.gz as an epg source for years, without issue.

 

Over the last month or so I have been getting the follow error, which I cannot figure out:

 

 epgimport.log   1.15KB   2 downloads

 

I can download the file from a web browser without any issue.

 

Seems like there might be a redirection issue - wget returns the following:

 

root@vuultimo:/# wget i.mjh.nz/nz/epg.xml.gz

Connecting to i.mjh.nz (172.67.162.157:80)

Connecting to i.mjh.nz (104.28.31.233:443)

wget: error getting response: Connection reset by peer

 

Curl gives this output:

 

root@vuultimo:/# curl -v http://i.mjh.nz/nz/epg.xml.gz

*   Trying 172.67.162.157...

* TCP_NODELAY set

* Connected to i.mjh.nz (172.67.162.157) port 80 (#0)

> GET /nz/epg.xml.gz HTTP/1.1

> Host: i.mjh.nz

> User-Agent: curl/7.53.1

> Accept: */*

>

< HTTP/1.1 301 Moved Permanently

< Date: Tue, 13 Oct 2020 08:06:51 GMT

< Transfer-Encoding: chunked

< Connection: keep-alive

< Cache-Control: max-age=3600

< Expires: Tue, 13 Oct 2020 09:06:51 GMT

< Location: https://i.mjh.nz/nz/epg.xml.gz

< cf-request-id: 05c29881f10000fd2ece248200000001

< Report-To: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report?lkg-colo=26&lkg-time=1602576411"}],"group":"cf-nel","max_age":604800}

< NEL: {"report_to":"cf-nel","max_age":604800}

< Server: cloudflare

< CF-RAY: 5e1790498fabfd2e-SYD

<

* Connection #0 to host i.mjh.nz left intact

 

Any ideas?

 

[WanWizard]

I don't see error there, only a redirect because your host seems to be behind cloudflare's CDN.

 

No problem downloading here:

$ wget http://i.mjh.nz/nz/epg.xml.gz
--2020-10-13 12:17:36--  http://i.mjh.nz/nz/epg.xml.gz
Resolving i.mjh.nz (i.mjh.nz)... 172.67.162.157, 104.28.31.233, 104.28.30.233, ...
Connecting to i.mjh.nz (i.mjh.nz)|172.67.162.157|:80... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: https://i.mjh.nz/nz/epg.xml.gz [following]
--2020-10-13 12:17:37--  https://i.mjh.nz/nz/epg.xml.gz
Connecting to i.mjh.nz (i.mjh.nz)|172.67.162.157|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1004757 (981K) [application/octet-stream]
Saving to: ‘epg.xml.gz’

epg.xml.gz          100%[===================>] 981.21K   861KB/s    in 1.1s    

2020-10-13 12:17:39 (861 KB/s) - ‘epg.xml.gz’ saved [1004757/1004757]

 

[doglover]

epgimport cannot handle https: websites.  That is the problem.

(Maybe somebody can have a look at it and fix this).

 

Workaround; download the file first with a cron job f.i.

1 9 * * *  curl https://i.mjh.nz/PlutoTV/epg.xml.gz -o /tmp/PlutoTv.epg.gz
5 9 * * *  curl https://i.mjh.nz/Stirr/epg.xml.gz -o /tmp/STIRRTv.epg.gz

And point in your sources file to the now downloaded local file.

<?xml version="1.0" encoding="utf-8"?>
<sources>
<sourcecat sourcecatname="Pluto TV">
<source type="gen_xmltv" nocheck="1" channels="custom.channels.xml">
<description>Pluto TV USA</description>
<url>/tmp/PlutoTv.epg.gz</url>
</source>
<source type="gen_xmltv" nocheck="1" channels="custom.channels.xml">
<description>STIRR TV USA</description>
<url>/tmp/STIRRTv.epg.gz</url>
</source>
</sourcecat>
</sources>

 

 

[waxhead]

Thanks for the help - epgimport & https: definitely the problem.

 

I had to install busybox-cron (opkg install busybox-cron) and then work out where & what file to put the cron job in (/etc/cron/crontabs/root).

 

Then just restart cron (/etc/init.d/busybox-cron restart) and the file is downloading. Tweaked the sources file and EPG now work again.

 

Thanks again!

[catastrofus]

Use 'crontab -e' to add/remove cronjobs. Then you don't have to restart crond

Edited by catastrofus, 19 October 2020 - 10:33.