68 replies to this topic

[WanWizard]

Looks like you're trying to run a piece of Python on a Windows PC?

 

Looking at the generated output I'm pretty sure you have to run this on your box...

[doglover]

In epgdat.py remark the following lines (put a # before the line)

 

#        if os.path.exists(self.EPGDAT_TMP_FILENAME):
#            os.unlink(self.EPGDAT_TMP_FILENAME)

 

Willy

[proline]

Hm...these lines were already commented out.

what may be even more?

 

ps.

Incidentally I try under windows 7

[doglover]

I run these under XP and a server version of NT.

Could be a problem there. 

 

Do not know what to do further.  I could try on my laptop, but that is Vista.

 

Willy

[proline]

I've done it!!!
But what can it means

 

Unknown channel:  261
[XMLTVConverter] Bad start/stop time: 20131216224500 +0100 (1387230300) - 20131216224501 +
0100 (1387230300) [╨Ф╨╗╤П ╨Ь╨╛╤Б╨║╨▓╤Л ╨╕ ╨╛╨▒╨╗╨░╤Б╤В╨╕ ╨▓╨╡╤Й╨░╨╜╨╕╨╡ ╨┐╨╛ ╤Б╨┐╤Г╤В╨╜╨╕╨
║╨╛╨▓╤Л╨╝ ╨╕ ╨║╨░╨▒╨╡╨╗╤М╨╜╤Л╨╝ ╤Б╨╡╤В╤П╨╝ ╤Б 1.45 ╨┤╨╛ 6.00]
Unknown channel:  292.........
 

[doglover]

Bad start/stop time: 20131216224500 +0100 (1387230300) - 20131216224501 +
0100 (1387230300)
 

There are always some of these errors.  I do not know why they are there.  They do not matter really.  Only a show will be missing somewhere - or not.

 

 

[╨Ф╨╗╤П ╨Ь╨╛╤Б╨║╨▓╤Л ╨╕ ╨╛╨▒╨╗╨░╤Б╤В╨╕ ╨▓╨╡╤Й╨░╨╜╨╕╨╡ ╨┐╨╛ ╤Б╨┐╤Г╤В╨╜╨╕╨
║╨╛╨▓╤Л╨╝ ╨╕ ╨║╨░╨▒╨╡╨╗╤М╨╜╤Л╨╝ ╤Б╨╡╤В╤П╨╝ ╤Б 1.45 ╨┤╨╛ 6.00
 

 

 

This is a codepage mistake.

try running:

 

C:\EPG\python\OfflineImport.py  C:\EPG\python\something.sources.xml >c:\epg\something.log

 

and subsequently opening the the something.log with an editor which can read utf-8 like Notepad++ or PsPad

 

Willy

 

PS: I have attached an old uk.log which shows this error as well.

Attached Files

•  uk.log   2.11KB   8 downloads

[proline]

Thank you for the supporting!
I have no something.sources.xml, but I found the error.

Same as you...

Edited by proline, 16 December 2013 - 18:47.

[doglover]

I really mean something.  This can be everything.

Your sources.file.

 

Willy

[proline]

I've tried just pack epg. And got a mistake.
What could this mean?
Thanks!
 

 

[EPGImport] nextImport, source= Main
[EPGImport] afterDownload c:/EPG/ready/DEU.gz
[EPGImport] afterChannelDownload None
[EPGImport] Parsing channels from 'c:/EPG/ready/DEU.xml.gz'
[XMLTVConverter] Enumerating event information
Unknown channel:  ComedyNick.ch
Unknown channel:  SciFi.de
Unknown channel:  rbbBrandenburg.de
Unknown channel:  MDRS-Anhalt.de
Unknown channel:  [gen_xmltv] Error: 'ascii' codec can't encode character u'\xfc' in position 5: ordinal not in range(128)
[EPGImport] imported 47740 events
[EPGImport] no Oudeis patch, load(.\epg_new.dat) required
reactor stopped
Done, data is in .\epg_new.dat
[EPGImport] #### Finished #### 
 

Edited by proline, 7 January 2014 - 00:32.

[WanWizard]

It's XML, so any non-ASCII should be in a CDATA section. It looks like this isn't the case.

[doglover]

The XMLTV import cannot read:  u'\xfc'

 

It looks like your grabber does not convert these values properly.

If you are using Webgrab to create your XMLTV file (or are you using ours?) you could try a cleanup statement which convert these values.

 

 

description.modify {cleanup}
index_title.modify {cleanup}
title.modify {cleanup}
 

Willy

 

PS: i checked our file and this string is not present.

Edited by doglover, 7 January 2014 - 09:55.

[proline]

I have from

http://xmltvepg.wanw...cxmltvskyde.gz 

or from (no difference)

http://enigma2.world...ecxmltvskyde.gz

 

XMLTV downloaded.
myepg.sources.xml:

 

<?xml version="1.0" encoding="latin-1"?>
<sources>

<source type="gen_xmltv" channels="c:/EPG/ready/DEU.xml.gz">
    <description>Main</description>
    <url>c:/EPG/ready/DEU.gz</url>
</source>

</sources>
 

 

An attempt to to pack the EPG file with command: OfflineImport.py myepg.sources.xml

As a result, I always get the following:
 

c:\EPGpython>OfflineImport.py myepg.sources.xml
[EPGImport] oudeis patch not detected, using epg.dat instead.
[EPGImport] failed to load C implementation, sorry
[EPGImport] nextImport, source= Main
[EPGImport] afterDownload c:/EPG/ready/DEU.gz
[EPGImport] afterChannelDownload None
[EPGImport] Parsing channels from 'c:/EPG/ready/DEU.xml.gz'
[XMLTVConverter] Enumerating event information
Unknown channel:  ComedyNick.ch
Unknown channel:  SciFi.de
Unknown channel:  rbbBrandenburg.de
Unknown channel:  MDRS-Anhalt.de
Unknown channel:  [gen_xmltv] Error: 'ascii' codec can't encode character u'\xfc' in posit
ion 5: ordinal not in range(128)
Traceback (most recent call last):
  File "C:\EPGpython\gen_xmltv.py", line 34, in iterator
    for r in xmltv_parser.enumFile(fd):
  File "C:\EPGpython\xmltvconverter.py", line 71, in enumFile
    print>>log, "Unknown channel: ", channel
  File "C:\EPGpython\log.py", line 22, in write
    logfile.write(data)
UnicodeEncodeError: 'ascii' codec can't encode character u'\xfc' in position 5: ordinal no
t in range(128)
[EPGImport] imported 579 events
[EPGImport] no Oudeis patch, load(.\epg_new.dat) required
reactor stopped
Done, data is in .\epg_new.dat
[EPGImport] #### Finished #### 

 

Edited by proline, 7 January 2014 - 13:01.

[doglover]

Can you send me : DEU.xml.gz

I suspect in this file you have a problem.

 

Willy

[proline]

Of course! No problem.

Please..

[proline]

Sorry...

Attached Files

•  DEU.xml.gz   1.22KB   12 downloads

[doglover]

Try with the file you send me:

 

 

[EPGImport] oudeis patch not detected, using epg.dat instead.
[EPGImport] failed to load C implementation, sorry
[EPGImport] nextImport, source= Rytec Germany
[EPGImport] afterDownload c:/EPG/ready/rytecxmltvskyde.gz
[EPGImport] afterChannelDownload None
[EPGImport] Parsing channels from 'C:\EPG\ready\DEU.xml'
[XMLTVConverter] Enumerating event information
Unknown channel:  ComedyNick.ch
Unknown channel:  SciFi.de
Unknown channel:  rbbBrandenburg.de
Unknown channel:  MDRS-Anhalt.de
Unknown channel:  [gen_xmltv] Error: 'ascii' codec can't encode character u'\xfc' in position 5: ordinal not in range(128)
 

Second try:

 

 

[EPGImport] oudeis patch not detected, using epg.dat instead.
[EPGImport] failed to load C implementation, sorry
[EPGImport] nextImport, source= Rytec Germany
[EPGImport] afterDownload c:/EPG/ready/rytecxmltvskyde.xml
[EPGImport] afterChannelDownload None
[EPGImport] Parsing channels from 'C:\EPG\ready\DEU.xml'
[XMLTVConverter] Enumerating event information
Unknown channel:  ComedyNick.ch
Unknown channel:  SciFi.de
Unknown channel:  rbbBrandenburg.de
Unknown channel:  MDRS-Anhalt.de
Unknown channel:  MDRThuringen.de
Unknown channel:  Sat1Comedy.de
Unknown channel:  KabelEinsClassic.de
Unknown channel:  SF1.ch
Unknown channel:  SF2.ch
Unknown channel:  QVC.de
Unknown channel:  TSR1.ch
Unknown channel:  TSR2.ch
Unknown channel:  VIVA.at
Unknown channel:  TSI1.ch
Unknown channel:  TSI2.ch
Unknown channel:  SFInfo.ch
Unknown channel:  DasVierte.de
Unknown channel:  SSF.ch
Unknown channel:  SRTL.de
Unknown channel:  Pro7.ch
Unknown channel:  Sat1.ch
[EPGImport] importEvents exception: ubyte format requires 0 <= number <= 255
[EPGImport] importEvents exception: ubyte format requires 0 <= number <= 255
Unknown channel:  3plus.ch
Unknown channel:  Classica.de
Unknown channel:  DiscoveryChannel.de
Unknown channel:  Junior.de
Unknown channel:  13thStreet.de
Unknown channel:  MGM.de
Unknown channel:  Heimatkanal.de
Unknown channel:  DMAX.ch
Unknown channel:  MotorVision.de
Unknown channel:  SkyAction.de
Unknown channel:  SkyComedy.de
Unknown channel:  SkyEmotion.de
Unknown channel:  W9.ch
Unknown channel:  SkyCinemaPlus24.de
Unknown channel:  MTV.ch
Unknown channel:  iMusic1.de
Unknown channel:  SkyKrimi.de
Unknown channel:  SkyNostalgie.de
Unknown channel:  beateUhseTV.de
Unknown channel:  DSF.de
Unknown channel:  SkySportNewsHD.de
Unknown channel:  123.tv.de
Unknown channel:  GoldstarTV.de
Unknown channel:  Viva.de
[EPGImport] importEvents exception: ubyte format requires 0 <= number <= 255
[EPGImport] importEvents exception: ubyte format requires 0 <= number <= 255
[EPGImport] importEvents exception: ubyte format requires 0 <= number <= 255
[EPGImport] importEvents exception: ubyte format requires 0 <= number <= 255
Unknown channel:  SkyAtlanticHD.de
Unknown channel:  DuckTV.day
Unknown channel:  NickComedy.de
[EPGImport] importEvents exception: ubyte format requires 0 <= number <= 255
Unknown channel:  KTV.de
Unknown channel:  go.tv
[EPGImport] importEvents exception: ubyte format requires 0 <= number <= 255
Unknown channel:  Wetterfernsehen.de
Unknown channel:  ORF2.de
Unknown channel:  ORFSportPlus.at
Unknown channel:  ATV.de
Unknown channel:  RadioBremen.de
Unknown channel:  AnimalPlanet.de
Unknown channel:  MTVGermany.de
Unknown channel:  MTVHits.de
Unknown channel:  PLANET.de
Unknown channel:  GuteLauneTV.de
Unknown channel:  BBCEntertainment.de
Unknown channel:  ATV2.at
Unknown channel:  EurosportHD.de
Unknown channel:  Nickelodeon.de
Unknown channel:  LustPur.de
Unknown channel:  Hamburg1.de
Unknown channel:  Sky3D.de
Unknown channel:  Universal.de
Unknown channel:  EEntertainment.de
Unknown channel:  ExtremeSports.de
Unknown channel:  Romance.de
Unknown channel:  Animax.de
Unknown channel:  SonnenKlar.de
Unknown channel:  joiz.de
Unknown channel:  BibelTV.de
Unknown channel:  DisneyXD.de
Unknown channel:  NatGeoHD.de
Unknown channel:  HistoryHD.de
Unknown channel:  DiscoveryHD.de
Unknown channel:  DisneyCinemagic.de
Unknown channel:  Sport1HD.de
Unknown channel:  DasNeueTV.de
Unknown channel:  FamilyTV.de
Unknown channel:  rheinmaintv.de
Unknown channel:  ClassicaHD.at
Unknown channel:  Tele5.at
Unknown channel:  ORF3.at
Unknown channel:  RTLCrime.de
Unknown channel:  RTLLiving.de
Unknown channel:  RTLPassion.de
Unknown channel:  PlayhouseDisney.de
Unknown channel:  Puls4.at
Unknown channel:  Nicktoons.de
[EPGImport] importEvents exception: ubyte format requires 0 <= number <= 255
[EPGImport] importEvents exception: ubyte format requires 0 <= number <= 255
Unknown channel:  NatGeo.de
Unknown channel:  MTVBase.de
Unknown channel:  AXN.de
Unknown channel:  Kinowelt.de
Unknown channel:  SkySport1.de
Unknown channel:  SkySport2.de
Unknown channel:  SkySportAustria.de
Unknown channel:  SkySportHD1.de
Unknown channel:  SkySportHD2.de
Unknown channel:  SkyBundesliga.de
Unknown channel:  SpiegelGeschichte.de
Unknown channel:  TNTSerie.de
Unknown channel:  ORF1.de
Unknown channel:  NatGeoWild.de
Unknown channel:  RNF.de
Unknown channel:  MunchenTV.de
Unknown channel:  HSE24.de
Unknown channel:  TRT1.de
Unknown channel:  RTL9.ch
Unknown channel:  EinsFestivalHD.de
Unknown channel:  TideTV.de
Unknown channel:  SkyCinema.de
Unknown channel:  SkyCinemaPlus1.de
Unknown channel:  i24News.en.nws
Unknown channel:  jn1.nws
Unknown channel:  CCTVNews.nws
Unknown channel:  VOA.com
Unknown channel:  DOS.com
Unknown channel:  CNN.nws
Unknown channel:  CNBC.nws
Unknown channel:  Euronews.nws
Unknown channel:  BBCNews.nws
Unknown channel:  BBCWorldNews.nws
Unknown channel:  TV5MondeEurope.fr
Unknown channel:  TV5MondeFBS.fr
Unknown channel:  France24.fr
Unknown channel:  France24fr.fr
Unknown channel:  Bloomberg.nws
Unknown channel:  SkyNews.uk
Unknown channel:  CCTV9.uk
Unknown channel:  FOXNews.uk
Unknown channel:  RussiaToday.uk
Unknown channel:  AlJazeera.nws
Unknown channel:  KBSWorld.kr
Unknown channel:  NHKworld.jp
Unknown channel:  Iconcerts.fr
Unknown channel:  i24News.fr
Unknown channel:  ndr.de
[EPGImport] importEvents exception: ubyte format requires 0 <= number <= 255
Unknown channel:  AutoMotorundSportChannel.de
Unknown channel:  BravaHDTV.nl
Unknown channel:  HopeChannel.de
Unknown channel:  MTVMusic.de
Unknown channel:  MotorTV.de
Unknown channel:  Frankensat.de
Unknown channel:  ERFeins.de
Unknown channel:  History.de
Unknown channel:  DeutscheWelle.de
Unknown channel:  BonGusto.de
Unknown channel:  Eurosport.de
Unknown channel:  SunshineLive.de
 

 

Difference:

 

Changed: MDRThüringen.de in MDRThuringen.de  in de xmltv file (rytecxmltvskyde.xml unzipped from rytecxmltvskyde.gz)

There is a problem with the charachter ü

 

Will change the name in my grabber.

 

Willy

[doglover]

If you load the rytecxmltvskyde.xml file Notepad++ or Pspad and replace MDRThüringen.de with MDRThuringen.de you can now run your epgimport.

 

Tomorrow the file on the website will be corrected.  (If nothing else goes wrong of course)

 

Willy

[proline]

Course correct will a MDRThueringen.de   ä (ae), ö (oe), ü (ue)

but so  you go also
Is now no problem more

Many thanks!!!

[proline]

Aid your WebGrabber can grab any page?

Where can I find it?

[doglover]

Not any page.  Some webpages present problems.

I have to write a grabber definition for each different webpage.  But a website listing epg mostly use the same format for each channel.  So the definition can be reused.

 

Pls. Check out: this.

 

Willy