142 replies to this topic

[deepspace221]

 

It looks the same schedule, but is shifted one hour.  Maybe I made a mistake?

You don't need to concern yourself with this at the moment. 

I'll fix them in a few days.

I'm using google translate to compare the schedules. 

[deepspace221]

Smooth sailing. 

I'm a happy camper. 

 

There is only a small encoding annoyance with the letter "ק" (k) which replaced by the division sign.  

You can even see the bottom to top problem, I discussed earlier, is also present in all extended info epg variants way back from e1.

One important thing you forgot to mention, is that you need to modify this line like so:

$convert -t xmltv -d $epg -f $datadir/$dataname -o $timeOffset -h $hours -m $mapfile -g $genrefile -e -c 8

You need to specify to the sql plugin the file encoding too. 

This is done by the option "-c" and the encoding extension at the end of the line.

This is not present in the binary help, btw, but I was able to figure it through common sense and a bit of trial and error.

Do you know what -e do btw?

 

Those enigma1 boxes are actually great. I quite like them. 

They are very capable for such a "simple" device.

Working from network share from another e2 box it handles itself quite well (there were a few hiccups at the beginning).

 

There are actually things you guys did better in the old days. 

The channel mapping interface is absolutely fantastic.

So easy to use and intuitive. 

You have no idea how many users get NOTHING because of not matching references (the namespace is a big issue), and because they don't have information to indicate otherwise, that there should be information in there, they think everything is set correctly, and that just nothing is present.

I was using for 2 years a sunray box, and didn't get any epg at all for hot... Didn't had a clue it was there in the first place! (I was actually very happily surprised)

If I had the unknown references interface from e1 it would have been a breeze to fix... 

You also used back then only a short part of the full reference, which could have solved issues like namespaces not matching.

You probably had a good reason for changing it, like overlapping references, I suppose.

Anyway, it took me less than 30min to map a lot of channels this way. ROCK SOLID!

 

The osn file is 17mb and after re-encoding you get 14mb. 

It takes quite a long time for SQL to parse through it, but it gets it done with no errors.

Also, don't get thrown by the output "setting encoding to ISO-8859-1", it says that no matter what, apparently.

Iconv, also, only seems to support visual hebrew (not logical).

 

I'm looking now at adding iconv to enigma and then I can automate the entire process. 

Support for e1 boxes doesn't have to be dead necessarily from the users perspective.

 

Muchas gracias, willy.

Edited by deepspace221, 25 January 2016 - 05:26.

[deepspace221]

The genres file also sound promising, I look into that. 

Auto bouquets arrangements, perhaps? Very interesting.

[doglover]

The HOT website iks again unreacheable for me.

 

Willy

[doglover]

e1 import plug-in I gave you is everything I have.  Since I do not have an e1 receiver anymore, I cannot do anything anymore.

I have looked for the iconv version for the powerpc architecture as well in those days. (for the same reason you stated)  Never found it. 

Maybe you can crosscompile one yourself.  After all it is GNU.

 

Willy

[deepspace221]

 

e1 import plug-in I gave you is everything I have.  Since I do not have an e1 receiver anymore, I cannot do anything anymore.

I know. 

Wasn't asking for anything just giving a review as I thought it might interest also other parties besides us.

I noticed some other users in the past asked for this.

I've some crosscompiling experience. I'll give it a go. 

I'll upload the files for e1 when I'll have some headway.

Not a priority at the moment.

[deepspace221]

Someone with a vu receiver (blackhole) sent me these references:

channel 8
1:0:1:819:10:1:FFFF01CA:0:0:0:

mgm hd
1:0:19:BB9:F:1:FFFF01DA:0:0:0:

israeli food channel
1:0:1:1656:E:1:FFFF01D2:0:0:0:

ערוץ 1 hd 
1:0:19:4D8:12:1:FFFF025A:0:0:0:

As you can see the namespace has a different value each time. 

Why is that, and how can I handle it to make it universal for other users as well, which have their own, different, changing every time, namespace?

Can I map the channels to service name instead of sref? 

 

I've uploaded the files to git and update the changes there from now on. Figured it would be simpler to collaborate. 

I'll give you a link in a week or so. I need some time getting use to it first.

 

The HOT website iks again unreacheable for me.

Maybe you should change it back to show delay 3?

I don't have this problem, but  then again I didn't do a grab for some time now.

Edited by deepspace221, 28 January 2016 - 22:49.

[doglover]

Hot site:

 

I am locked out now.  It looks forever.  Already from last saturday.

 

The problem with the Namespace:  At the moment I add them to the channels list as a duplicate.

It is setting in the cables.xml file.  But I do not know to avoid this.  (do not know which setting)  And I cannot test this because, I do not have access to a cable provider.

 

Willy

[deepspace221]

I can do the grab for you if this is a problem.

Did you change your IP?

 

You can do it though a proxy if you want, so you wouldn't be locked out again from your machine ip.

If the porxy has a high ping value (700ms for a proxy in Tokyo I used for example), you don't even need to use the delay line anymore, and it can be removed.

 

Satellite internet would actually be quite perfect for it.

Appropriate.

Edited by deepspace221, 29 January 2016 - 09:38.

[doglover]

I cannot download anymore.  I tried proxies, but no effect.

 

Willy

[deepspace221]

I'm not sure what you mean... Need more info please.

At what stage exactly do you get blocked? 

 

I've done now a 5 days grab completed with no issues.

 

Ran with this values: channel-delay="0" index-delay="4" show-delay="2" time-out="5" (7443 seconds)

 

If you need me to update the file every few days let me know.

It is the xmltv output file here.

Attached Files

•  israel2webgrab.xml   978.54KB   3 downloads

Edited by deepspace221, 29 January 2016 - 17:03.

[deepspace221]

 

Solved both issues. I can merge them now.

The issue I had was caused by accidentally replacing all the underscores in all open documents with colons. 

Why is webif references are separated with underscores if we need to change them all the time?

It is very annoying won't you agree?

 

Yes I agree.  But there is nothing I can do.

I get the service reference from the Webif.  Right click on the stream symbol next to the channel, And chose copy URL.

Now paste this somewhere.  You can get the service ref from that line in the correct format.

 

Willy

 

 

Figured this will save you a lot of headache in the long run...  

 

I'll commit this soon.

.

path: /usr/lib/enigma2/python/Plugins/Extensions/OpenWebif/controllers/models

reboot afterwards.

Attached Files

•  services.py   27.03KB   4 downloads

[doglover]

Copied the webgrab file to the grab PC.  So this will included in the next update tomorrow.

 

The Hot site will not open in a browser.  Tried Firefox, Chrome and IE

Also the grab already fails from the first attempted channel.

i=index  .=same  c=change  g=gab  r=replace  n=new

channel (xmltv_id=MTVRocks.il) site -- HOT.NET.IL -- mode incremental
no robots data found
skipped robots check
error downloading page: Er is een time-out opgetreden voor de bewerking
pausing 1 of 4 times for 5 seconds before re-try.
error downloading page: Er is een time-out opgetreden voor de bewerking
pausing 2 of 4 times for 10 seconds before re-try.

Willy

Edited by doglover, 29 January 2016 - 18:08.

[doglover]

Uploaded the new file.

 

Willy

[deepspace221]

The Hot site will not open in a browser.  Tried Firefox, Chrome and IE

Also the grab already fails from the first attempted channel.

I've checked this. You're right.

It seems they blocked access to Europe or some EU countries.  

Proxy from the US works though.

 

I've done now a 7 days grab. You can update the files. Thanks.

 

7 days xmltv data:

https://raw.githubus...ael2webgrab.xml

https://raw.githubus...raelwebgrab.xml

 

Updated grab files

https://raw.githubus...r/tvxb/TVxb.ini

https://raw.githubus...ael2WebGrab.xml

https://raw.githubus...raelWebGrab.xml

https://raw.githubus...ec.channels.xml

 

If you're missing an ini file:

https://github.com/d.../master/webgrab

 

You can follow the git for the changes, if this is of interest to you.

I didn't yet checked the foreign epg I added. I'm occupied with other stuff at the moment, but will do it soon.

 

Wouldn't it be much easier on you if you will upload everything you have to git and manage it form there? Just a thought. 

Edited by deepspace221, 1 February 2016 - 16:15.

[doglover]

Have copied it to the grab PC.

(Managed to grab hot via an US proxy)

 

Willy

[deepspace221]

Please add this test section. Thank you.

<!-- Israel HOT Cable Provider  ** Region B (Tel Aviv) - TEST - DUPLICATES ** ++CABLE++ -->
<channel id="1+1.ru">1:0:1:F82:20:1:FFFF0000:0:0:0:</channel> <!--  1+1 (HOT) ++CABLE++ -->
<channel id="5GoldPlus.il">1:0:1:1915:10:1:FFFF0000:0:0:0:</channel> <!--  5 GOLD (HOT) ++CABLE++ -->
<channel id="5PlusLive.il">1:0:1:E2E:10:1:FFFF0000:0:0:0:</channel> <!--  5+ Live (HOT) ++CABLE++ -->
<channel id="BarelyLegal.il">1:0:1:10FA:E:1:FFFF0000:0:0:0:</channel> <!--  Barely Legal (HOT) ++CABLE++ -->
<channel id="BFMSD.il">1:0:1:3DE:23:1:FFFF0000:0:0:0:</channel> <!--  BFM SD (HOT) ++CABLE++ -->
<channel id="CANAL24HORAS.sp">1:0:1:2390:22:1:FFFF0000:0:0:0:</channel> <!--  CANAL 24 HORAS (HOT) ++CABLE++ -->
<channel id="CCTVNews.il">1:0:1:1F54:8:1:FFFF0000:0:0:0:</channel> <!--  CCTV NEWS (HOT) ++CABLE++ -->
<channel id="Channel1.il">1:0:19:4D8:12:1:FFFF0000:0:0:0:</channel> <!--  Channel One HD (HOT) ++CABLE++ -->
<channel id="Channel8.il">1:0:1:819:10:1:FFFF0000:0:0:0:</channel> <!--  Channel 8 (HOT) ++CABLE++ -->
<channel id="CTC.ru">1:0:1:6F:10:1:FFFF0000:0:0:0:</channel> <!--  CTC (HOT) ++CABLE++ -->
<channel id="Discovery.il">1:0:19:7DE:F:1:FFFF0000:0:0:0:</channel> <!--  Discovery Channel HD (HOT) ++CABLE++ -->
<channel id="DiscoveryScience.il">1:0:1:77:20:1:FFFF0000:0:0:0:</channel> <!--  Discovery Science (HOT) ++CABLE++ -->
<channel id="DiscoveryScience.il">1:0:1:76:20:1:FFFF0000:0:0:0:</channel> <!--  Discovery Science (HOT) ++CABLE++ -->
<channel id="DogTV.il">1:0:1:37A:22:1:FFFF0000:0:0:0:</channel> <!--  DOG TV (HOT) ++CABLE++ -->
<channel id="DWNews.il">1:0:1:34C:22:1:FFFF0000:0:0:0:</channel> <!--  DW News (HOT) ++CABLE++ -->
<channel id="FoxBusiness.il">1:0:1:335:22:1:FFFF0000:0:0:0:</channel> <!--  Fox Business (HOT) ++CABLE++ -->
<channel id="France2.fr">1:0:19:1A8:F:1:FFFF0000:0:0:0:</channel> <!--  France 2 HD (HOT) ++CABLE++ -->
<channel id="France2.fr">1:0:1:524:8:1:FFFF0000:0:0:0:</channel> <!--  France 2 (HD on 647) (HOT) ++CABLE++ -->
<channel id="FTV.il">1:0:1:80:E:1:FFFF0000:0:0:0:</channel> <!--  FTV (HOT) ++CABLE++ -->
<channel id="FTVHD(HOT).il">1:0:19:395:12:1:FFFF0000:0:0:0:</channel> <!--  FTV HD (HOT) ++CABLE++ -->
<channel id="GoodLife.il">1:0:1:1130:E:1:FFFF0000:0:0:0:</channel> <!--  Good Life (HOT) ++CABLE++ -->
<channel id="Hidabrut.il">1:0:1:318:E:1:FFFF0000:0:0:0:</channel> <!--  HIDABRUT (HOT) ++CABLE++ -->
<channel id="hot3.il">1:0:19:117:F:1:FFFF0000:0:0:0:</channel> <!--  HOT3 HD (HOT) ++CABLE++ -->
<channel id="hot3.il">1:0:19:117:F:1:FFFF0000:0:0:0:</channel> <!--  HOT HD COPY (HOT3 HD) (HOT) ++CABLE++ -->
<channel id="HotAction.il">1:0:19:3F7:11:1:FFFF0000:0:0:0:</channel> <!--  Hot Action HD (HOT) ++CABLE++ -->
<channel id="HotBOLLYWOOD.il">1:0:1:2F7:E:1:FFFF0000:0:0:0:</channel> <!--  HOT Bollywood (HOT) ++CABLE++ -->
<channel id="HOTBombay.il">1:0:1:2F4:10:1:FFFF0000:0:0:0:</channel> <!--  Hot Bombay (Hot) ++CABLE++ -->
<channel id="HotDrama.il">1:0:19:D4A:11:1:FFFF0000:0:0:0:</channel> <!-- Hot Drama HD++CABLE++ -->
<channel id="HotFun.il">1:0:19:125:11:1:FFFF0000:0:0:0:</channel> <!--  Hot Fun HD (HOT) ++CABLE++ -->
<channel id="HotGOLD.il">1:0:19:3FA:11:1:FFFF0000:0:0:0:</channel> <!--  Hot Gold HD (HOT) ++CABLE++ -->
<channel id="HOTPlus.il">1:0:19:417:12:1:FFFF0000:0:0:0:</channel> <!--  HOT Plus HD (HOT) ++CABLE++ -->
<channel id="HOTPlus.il">1:0:1:415:8:1:FFFF0000:0:0:0:</channel> <!--  HOT Plus SD (HOT) ++CABLE++ -->
<channel id="HotZone.il">1:0:19:44D:11:1:FFFF0000:0:0:0:</channel> <!--  HOT Zone HD (HOT) ++CABLE++ -->
<channel id="i24News.en.nws">1:0:1:37F:20:1:FFFF0000:0:0:0:</channel> <!--  I24 news (HOT) ++CABLE++ -->
<channel id="i24News.fr.nws">1:0:1:381:20:1:FFFF0000:0:0:0:</channel> <!--  I24 News French (HOT) ++CABLE++ -->
<channel id="Inter+.ru">1:0:1:17FD:8:1:FFFF0000:0:0:0:</channel> <!--  INTER + (HOT) ++CABLE++ -->
<channel id="JimJam.il">1:0:1:F6D:20:1:FFFF0000:0:0:0:</channel> <!--  JIM JAM (HOT) ++CABLE++ -->
<channel id="JimJam.il">1:0:1:F73:20:1:FFFF0000:0:0:0:</channel> <!--  JIMJAM (HOT) ++CABLE++ -->
<channel id="KralTV.tu">1:0:1:333:22:1:FFFF0000:0:0:0:</channel> <!--  KRALTV (HOT) ++CABLE++ -->
<channel id="Logi.il">1:0:1:48A:10:1:FFFF0000:0:0:0:</channel> <!--  LOGI (HOT) ++CABLE++ -->
<channel id="mbc.il">1:0:1:325:8:1:FFFF0000:0:0:0:</channel> <!--  MBC (HOT) ++CABLE++ -->
<channel id="MeirTV.il">1:0:1:BD1:20:1:FFFF0000:0:0:0:</channel> <!--  MEIR TV (HOT) ++CABLE++ -->
<channel id="MezzoLiveHD.il">1:0:19:223:F:1:FFFF0000:0:0:0:</channel> <!--  Mezzo HD (HOT) ++CABLE++ -->
<channel id="MotorTV.il">1:0:1:410:22:1:FFFF0000:0:0:0:</channel> <!--  Motors TV (HOT) ++CABLE++ -->
<channel id="MTV.il">1:0:1:29E:10:1:FFFF0000:0:0:0:</channel> <!-- MTV Music++CABLE++ -->
<channel id="MTVHD.il">1:0:19:192:12:1:FFFF0000:0:0:0:</channel> <!-- MTV Live HD++CABLE++ -->
<channel id="MTVHD.il">1:0:19:1C4:12:1:FFFF0000:0:0:0:</channel> <!--  MTV LIVE HD (HOT) ++CABLE++ -->
<channel id="MTVSeries.il">11:0:19:3BE:11:1:FFFF0000:0:0:0:</channel> <!--  MTV Series HD (HOT) ++CABLE++ -->
<channel id="MTVSeries.il">1:0:1:3BC:E:1:FFFF0000:0:0:0:</channel> <!--  MTV Series (HOT) ++CABLE++ -->
<channel id="OneHD.il">1:0:19:7DA:12:1:FFFF0000:0:0:0:</channel> <!--  ONE HD (HOT) ++CABLE++ -->
<channel id="Outdoor.ru">1:0:19:3CA:12:1:FFFF0000:0:0:0:</channel> <!--  OUTDOOR HD (HOT) ++CABLE++ -->
<channel id="PentHouse.ero">1:0:19:119:F:1:FFFF0000:0:0:0:</channel> <!--  Penthouse HD (HOT) ++CABLE++ -->
<channel id="PentHouse.ero">1:0:1:3C6:20:1:FFFF0000:0:0:0:</channel> <!--  Penthouse SD (HOT) ++CABLE++ -->
<channel id="RTRPlaneta.ru">1:0:1:12D:8:1:FFFF0000:0:0:0:</channel> <!--  RTR (HOT) ++CABLE++ -->
<channel id="RTVC.il">1:0:1:1FE:E:1:FFFF0000:0:0:0:</channel> <!--  RTVC (HOT) ++CABLE++ -->
<channel id="RussianTravelGuide.ru">1:0:1:F79:20:1:FFFF0000:0:0:0:</channel> <!--  Russian Travel Guide (HOT) ++CABLE++ -->
<channel id="Sat1.de">1:0:1:4E89:8:1:FFFF0000:0:0:0:</channel> <!--  SAT 1 (HOT) ++CABLE++ -->
<channel id="SAT3.il">1:0:1:32A:8:1:FFFF0000:0:0:0:</channel> <!--  SAT3 (HOT) ++CABLE++ -->
<channel id="SkyNews.il">1:0:1:2CD:8:1:FFFF0000:0:0:0:</channel> <!--  Sky News (HOT) ++CABLE++ -->
<channel id="SonLife.uk">1:0:1:327:22:1:FFFF0000:0:0:0:</channel> <!--  Sonlife (HOT) ++CABLE++ -->
<channel id="Sport1HD.il">1:0:1:582:E:1:FFFF0000:0:0:0:</channel> <!--  Sport 1 (HOT) ++CABLE++ -->
<channel id="Sport2.il">1:0:19:3D8:11:1:FFFF0000:0:0:0:</channel> <!-- Sport 2 HD++CABLE++ -->
<channel id="Sport5HD.il">1:0:19:345:22:1:FFFF0000:0:0:0:</channel> <!-- 5 SPORT HD++CABLE++ -->
<channel id="Sport5HD.il">1:0:1:6:10:1:FFFF0000:0:0:0:</channel> <!--  Sport 5I (HOT) ++CABLE++ -->
<channel id="Telecafe.ru">1:0:1:F6A:20:1:FFFF0000:0:0:0:</channel> <!--  TELECAFE (HOT) ++CABLE++ -->
<channel id="TF1.fr">1:0:19:40D:23:1:FFFF0000:0:0:0:</channel> <!--  TF1 HD (HOT) ++CABLE++ -->
<channel id="TNT.ru">1:0:1:F67:20:1:FFFF0000:0:0:0:</channel> <!--  Comedy tv (HOT) ++CABLE++ -->
<channel id="TRT1.tu">1:0:1:326:8:1:FFFF0000:0:0:0:</channel> <!--  TRT1.il (HOT) ++CABLE++ -->
<channel id="TVRi.il">1:0:1:32F:8:1:FFFF0000:0:0:0:</channel> <!--  TVRI (HOT) ++CABLE++ -->
<channel id="VH1.il">1:0:1:164D:8:1:FFFF0000:0:0:0:</channel> <!-- VH1 Europe++CABLE++ -->
<channel id="Vremya.ru">1:0:1:F7C:20:1:FFFF0000:0:0:0:</channel> <!--  VREMYA (HOT) ++CABLE++ -->

Edited by deepspace221, 3 February 2016 - 04:36.

[deepspace221]

Incorrect. Remove line.

 

<channel id="Sport5Plus.il">1:0:19:DE:E:DE:FFFF0000:0:0:0:</channel> <!-- 5 SPORT HD (HOT) ++CABLE++ -->

[doglover]

Removed.

 

Willy

[deepspace221]

Do you have a connection problem to hot site again?

The data disappeared.