22 replies to this topic

[theparasol]

Teletext pid is never scrambled, but nevertheless the teletext pid of a channel is put in the pmt data.

Softcam will use it as a streampid to allow decoding. Waste of resources.

Even worse, I cant recode oscam pmt handler to specifically ignore that teletext pid since its communicated as:

 

Demuxer 0 added new stream H.222 MPEG-2 packeted audio (type: 06 pid: 0020 length: 0)

 

Yep... audio, type 6... and that exact same type is used for AC audio too. Even the length field is zero on e.g. german channels.

 

Can an openpli dev make a small change in the pmt handler of enigma2 so that the teletext pid isnt communicated any longer in the pmt data?

 

Best would be only communicate pids that are "scrambled" and have to be descrambled by softcam.

So on FTA channels just communicate the srvid and nothing else (softcam doesnt care for pids that are not scrambled)

 

Tnx in advance goes to any dev that is willing to invest some time on this!

 

Example german SD sky channel:

 

2015/03/05 23:38:00   5E86D0 c   (dvbapi) Parsing 1 PMT object(s):
2015/03/05 23:38:00   5E86D0 c   (dvbapi)   9F 80 32 53 03 00 32 3D 00 39 01 81 08 00 C0 00
2015/03/05 23:38:00   5E86D0 c   (dvbapi)   00 00 01 00 85 82 02 01 00 84 02 00 67 09 06 17
2015/03/05 23:38:00   5E86D0 c   (dvbapi)   02 F7 9C 00 9C 09 04 18 33 F8 9C 09 04 09 C4 FB
2015/03/05 23:38:00   5E86D0 c   (dvbapi)   9C 09 04 09 AF FF 9C 09 04 09 8C FA 9C 85 04 00
2015/03/05 23:38:00   5E86D0 c   (dvbapi)   00 00 01 06 00 20 00 00 02 09 FF 00 00 03 0A 00
2015/03/05 23:38:00   5E86D0 c   (dvbapi)   00 00 03 0A 01 00 00
2015/03/05 23:38:00   5E86D0 c   (dvbapi) capmt:
2015/03/05 23:38:00   5E86D0 c   (dvbapi)   03 00 32 3D 00 39 01 81 08 00 C0 00 00 00 01 00
2015/03/05 23:38:00   5E86D0 c   (dvbapi)   85 82 02 01 00 84 02 00 67
                                            09 06 17 02 F7 9C 00 9C
                                            09 04 18 33 F8 9C
                                            09 04 09 C4 FB 9C
                                            09 04 09 AF FF 9C
                                            09 04 09 8C FA 9C
                                            85 04 00 00 00 01
                                            06 00 20 00 00
                                            02 09 FF 00 00
                                            03 0A 00 00 00
                                            03 0A 01 00 00
                                            
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Receiver sends PMT command 3 for channel 0032
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Receiver wants to demux srvid 0032 on adapter 0000 camask 0001 index 0000 pmtpid 0067
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 found pmt type: 81 length: 8 (assuming enigma private descriptor: namespace c00000 tsid 01 onid 85)
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 found pmt type: 82 length: 2
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 found pmt type: 84 length: 2
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 found pmt type: 09 length: 6
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 added new ecmpid 0 CAID: 1702 ECM_PID: 179C PROVID: 000000
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 found pmt type: 09 length: 4
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 added new ecmpid 1 CAID: 1833 ECM_PID: 189C PROVID: 000000
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 found pmt type: 09 length: 4
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 added new ecmpid 2 CAID: 09C4 ECM_PID: 1B9C PROVID: 000000
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 found pmt type: 09 length: 4
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 added new ecmpid 3 CAID: 09AF ECM_PID: 1F9C PROVID: 000000
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 found pmt type: 09 length: 4
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 added new ecmpid 4 CAID: 098C ECM_PID: 1A9C PROVID: 000000
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 found pmt type: 85 length: 4
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 added new stream H.222 MPEG-2 packeted audio (type: 06 pid: 0020 length: 0) >>>> teletext!!!
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 added new stream H.262 MPEG-2 higher rate interlaced video (type: 02 pid: 09ff length: 0)
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 added new stream MPEG-1 audio (type: 03 pid: 0a00 length: 0)
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 added new stream MPEG-1 audio (type: 03 pid: 0a01 length: 0)
2015/03/05 23:38:00   5E86D0 c   (dvbapi) Demuxer 0 found 5 ECMpids and 4 STREAMpids in PMT

 

RTL5 HD

 

2015/03/05 23:48:05   5E8280 c   (dvbapi)   03 1B 6F 27 00 22 01 81 08 00 EB 00 00 0C 88 00
2015/03/05 23:48:05   5E8280 c   (dvbapi)   03 82 02 01 00 84 02 09 DB
                                            09 07 18 17 E7 0A 02 00 6A
                                            85 04 00 00 00 01 1B 02 0B 00 14 01
                                            09 11 01 00 E7 0A 00 6A FF FF E0 00 00 00 00 00 00 32 65
                                            06 00 53 00 14 01
                                            09 11 01 00 E7 0A 00 6A FF FF E0 00 00 00 00 00 00 32 65
                                            06 00 21 00 00
2015/03/05 23:48:05   5E8280 c   (dvbapi) Receiver sends PMT command 3 for channel 1B6F
2015/03/05 23:48:05   5E8280 c   (dvbapi) Receiver wants to demux srvid 1B6F on adapter 0000 camask 0001 index 0000 pmtpid 09DB
2015/03/05 23:48:05   5E8280 c   (dvbapi) Demuxer 0 found pmt type: 81 length: 8 (assuming enigma private descriptor: namespace eb0000 tsid c88 onid 03)
2015/03/05 23:48:05   5E8280 c   (dvbapi) Demuxer 0 found pmt type: 82 length: 2
2015/03/05 23:48:05   5E8280 c   (dvbapi) Demuxer 0 found pmt type: 84 length: 2
2015/03/05 23:48:05   5E8280 c   (dvbapi) Demuxer 0 found pmt type: 09 length: 7
2015/03/05 23:48:05   5E8280 c   (dvbapi) Demuxer 0 added new ecmpid 0 CAID: 1817 ECM_PID: 070A PROVID: 00006A
2015/03/05 23:48:05   5E8280 c   (dvbapi) Demuxer 0 found pmt type: 85 length: 4
2015/03/05 23:48:05   5E8280 c   (dvbapi) Demuxer 0 added new stream H.264 MPEG-4 AVC video (type: 1b pid: 020b length: 20)
2015/03/05 23:48:05   5E8280 c   (dvbapi) Demuxer 0 found pmt type: 09 length: 17
2015/03/05 23:48:05   5E8280 c   (dvbapi) Demuxer 0 added new ecmpid 1 CAID: 0100 ECM_PID: 070A PROVID: 00006A
2015/03/05 23:48:05   5E8280 c   (dvbapi) Demuxer 0 added new stream H.222 MPEG-2 packeted audio (type: 06 pid: 0053 length: 20)
2015/03/05 23:48:05   5E8280 c   (dvbapi) Demuxer 0 found pmt type: 09 length: 17
2015/03/05 23:48:05   5E8280 c   (dvbapi) Demuxer 0 added stream to ecmpid 1 CAID: 0100 ECM_PID: 070A PROVID: 00006A
2015/03/05 23:48:05   5E8280 c   (dvbapi) Demuxer 0 added new stream H.222 MPEG-2 packeted audio (type: 06 pid: 0021 length: 0) ---> teletext !!
2015/03/05 23:48:05   5E8280 c   (dvbapi) Demuxer 0 found 2 ECMpids and 3 STREAMpids in PMT

 

 

 

TV Oost (FTA)

 

2015/03/06 18:00:17   5F0E78 c   (dvbapi) PMT6: Trying connect to enigma CA PMT listen socket...
2015/03/06 18:00:17   5F0E78 c   (dvbapi) PMT6 CA PMT Server connected on fd 11!
2015/03/06 18:00:17   5F0E78 c   (dvbapi) Parsing 1 PMT object(s):
2015/03/06 18:00:17   5F0E78 c   (dvbapi)   9F 80 32 2E 03 51 4E 17 00 19 01 81 08 00 EB 00
2015/03/06 18:00:17   5F0E78 c   (dvbapi)   00 0C 8B 00 03 82 02 01 00 84 02 09 0A 85 04 00
2015/03/06 18:00:17   5F0E78 c   (dvbapi)   00 00 01 1B 02 06 00 00 04 00 5C 00 00 06 00 2C
2015/03/06 18:00:17   5F0E78 c   (dvbapi)   00 00
2015/03/06 18:00:17   5F0E78 c   (dvbapi) capmt:
2015/03/06 18:00:17   5F0E78 c   (dvbapi)   03 51 4E 17 00 19 01 81 08 00 EB 00 00 0C 8B 00
2015/03/06 18:00:17   5F0E78 c   (dvbapi)   03 82 02 01 00 84 02 09 0A 85 04 00 00 00 01 1B
2015/03/06 18:00:17   5F0E78 c   (dvbapi)   02 06 00 00 04 00 5C 00 00 06 00 2C 00 00
2015/03/06 18:00:17   5F0E78 c   (dvbapi) Receiver sends PMT command 3 for channel 514E
2015/03/06 18:00:17   5F0E78 c   (dvbapi) Receiver wants to demux srvid 514E on adapter 0000 camask 0001 index 0000 pmtpid 090A
2015/03/06 18:00:17   5F0E78 c   (dvbapi) Demuxer 0 found pmt type: 81 length: 8 (assuming enigma private descriptor: namespace eb0000 tsid c8b onid 03)
2015/03/06 18:00:17   5F0E78 c   (dvbapi) Demuxer 0 added new stream H.264 MPEG-4 AVC video (type: 1b pid: 0206 length: 0)  --> video
2015/03/06 18:00:17   5F0E78 c   (dvbapi) Demuxer 0 added new stream MPEG-2 halved sample rate audio (type: 04 pid: 005c length: 0) ---> audio
2015/03/06 18:00:17   5F0E78 c   (dvbapi) Demuxer 0 added new stream H.222 MPEG-2 packeted audio (type: 06 pid: 002c length: 0) ---> teletext
2015/03/06 18:00:17   5F0E78 c   (dvbapi) Demuxer 0 found 0 ECMpids and 3 STREAMpids in PMT

 

[malakudi]

That is not true, at least teletext pid on greek channels of Nova package are scrambled. The pmt should report correctly if a pid is scrambled or not.

[theparasol]

Ok, didnt check greek channels

But on dutch, german and english channels they are unscrambled.

Anyway, I cant tell from the softcam side they are scrambled. So I must rely on the pmt, it would be nice that only pids are in the pmt that are scrambled.

If teletext pid is scrambled: communicate, if not leave it out. Same goes for other pids.

 

You say in the pmt we can see what is scrambled and what not, can you give me some pointers? I seem unable to derive that scrambled/unscrambled info out of the pmt.

[betacentauri]

Hi,

 

maybe I'm wrong, but we need the pmt with all pids. Without pmt data we can only use lame db data. But pids can change. So you cannot rely only on lame db data.

 

Regarding type 6 this here (http://www.etherguid...tream_type.aspx) says: "MPEG-2 Packetized Elementary Stream packets containing private data". So it's not only audio.

Please use elementary stream info data. With it you can see that this pid is a teletext pid.

See second example here: http://dvbsnoop.sour...xample-pmt.html
First byte in elementary stream info is 0x56. This means teletext descriptor (http://www.etherguid...rs/Default.aspx)

[theparasol]

Tnx for the hints, will read them and hope get some fresh ideas.

 

Your page for type 6 seems old/incorrect too!

 

But while trying to get my old page back.... couldnt find it again but  I even found a better one here: http://en.wikipedia....fic_information

type 0x06 ITU-T Rec. H.222 and ISO/IEC 13818-1 (MPEG-2 packetized data) privately defined (i.e., DVB subtitles/VBI and AC-3)

Edited by theparasol, 6 March 2015 - 19:28.

[betacentauri]

Yes, maybe incorrect, too  . But I guess you can see quickly that you can use dvb descriptor to distinguish between useful (e.g. 0x6A = AC3) and not useful (e.g. 0x56 = teletext) ones.

[theparasol]

Quickly... quickly... have to fetch that dvb descriptor first and parse it... I have to think if this is worth it

But I made some progress since since I started this topic I had some obvious thought faults: teletext never encrypted (seems not true for all)

And I read the "PMT" wrong, the descriptors tell other things. Re-analyzed a german sky SD channel again (tnx to your links!)

 

03 00 32 3D 00 39 01                 03 = LIST_ONLY, SRVID = 0032, 39 = totale lengte pmt
81 08 00 C0 00 00 00 01 00 85       (assuming enigma private descriptor: namespace c00000 tsid 01 onid 85)
82 02 01 00                            ??????????????????????????????
84 02 00 67                         ??????????????????????????????
09 06 17 02 F7 9C 00 9C             09 = Descriptor_Tag = "CA", 06 = lengte 1702 = CAID, ECMPID &1FFF, 00 9C private data
09 04 18 33 F8 9C                   09 = CA, 04 = lengte, 1833 = CAID, ECMPID &1FFF
09 04 09 C4 FB 9C                   09 = CA, 04 = lengte, 09C4 = CAID, ECMPID
09 04 09 AF FF 9C                   09 = CA, 04 = lengte, 09AF = CAID, ECMPID
09 04 09 8C FA 9C                     09 = CA, 04 = lengte, 098C = CAID, ECMPID
85 04 00 00 00 01                     85 = PRIVAT = skip
06 00 20 00 00                      06 = data_stream_alignment_descriptor (MPEG-2), lengte = 0, 20 = alignment type bit 6 gezet
02 09 FF 00 00                        02 = video stream descriptor, 09FF = videopid
03 0A 00 00 00                         03 = audio descriptor, 0A00 = audiopid
03 0A 01 00 00                        03 = audio descriptor, 0A01 = audiopid

 

Those 82 & 84 are still questionmarks, they are private descriptors but I dont know yet what to do with it, for now ignore!

[theparasol]

found some more in source of openpli:

 

81 08 00 EB 00 00 0C 88 00 03    81 enigma private descriptor: namespace eb0000 tsid c88 onid 03
82 02 01 00                                   82 = enigma, 02 = lengte, demuxmask = 1, 00 = read section data from demux number
                                                      83 01 m_adapter (never seen on my box or any log from others)
84 02 09 DB                                  84 = PMT, 02 = lengte, 09DB = PMTPID
85 04 00 00 00 01                         85 04 service type mask 00000001

 

Questions:

82: What is demuxmask, what purpose has it?    Read section data from demux number, what purpose has it?

83: m_adapter? -> perhaps in use with multituner receivers?

85: service type mask? -> what purpose has it?

 

Grateful if someone can explain me the usage in code for these "private" descriptors of enigma2
 

[malakudi]

 

You say in the pmt we can see what is scrambled and what not, can you give me some pointers? I seem unable to derive that scrambled/unscrambled info out of the pmt.

 

If I remember well, CA descriptors can be set per Elementary stream.

But as I see in Sky german channels, CA descriptors are global, so, according to PMT, teletext subtitle stream "could" be scrambled. 

[malakudi]

PMT from Sky Cinema, global CA descriptors

 

new PMT program=10 version=30 pcrpid=511

    - desc 09 ca sysid=0x1702 pid=5954

    - desc 09 ca sysid=0x1833 pid=6210

    - desc 09 ca sysid=0x1836 pid=6211

    - desc 09 ca sysid=0x9c4 pid=6978

    - desc 09 ca sysid=0x9af pid=8002

    - desc 09 ca sysid=0x98c pid=6722

  * ES pid=32 streamtype=0x06 streamtype_txt="13818-1 PES private data"

    - desc 52 stream_identifier component_tag=10

    - desc 56 telx language=deu type=0x1 type_txt="Initial teletext page" mag=1 page=0x0x

  * ES pid=511 streamtype=0x02 streamtype_txt="13818-2 video (MPEG-2)"

    - desc 52 stream_identifier component_tag=2

  * ES pid=512 streamtype=0x03 streamtype_txt="11172-3 audio (MPEG-1)"

    - desc 0a audio_language language=deu audiotype=1 audiotype_txt="clean effects"

    - desc 52 stream_identifier component_tag=3

  * ES pid=513 streamtype=0x03 streamtype_txt="11172-3 audio (MPEG-1)"

    - desc 0a audio_language language=eng audiotype=1 audiotype_txt="clean effects"

    - desc 52 stream_identifier component_tag=6

  * ES pid=515 streamtype=0x06 streamtype_txt="13818-1 PES private data"

    - desc 6a ac3 component_type_flag=1 component_type=66 bsid_flag=1 bsid=8 mainid_flag=1 mainid=0 asvc_flag=1 asvc=0

    - desc 0a audio_language language=deu audiotype=1 audiotype_txt="clean effects"

    - desc 52 stream_identifier component_tag=7

 

PMT from MTV Dance (Astra 19), CA descriptors per elementary stream

 

new PMT program=28655 version=29 pcrpid=8190

  * ES pid=3051 streamtype=0x02 streamtype_txt="13818-2 video (MPEG-2)"

    - desc 09 ca sysid=0x500 pid=8105

    - desc 09 ca sysid=0xd96 pid=6201

    - desc 09 ca sysid=0x100 pid=6413

    - desc 09 ca sysid=0xb00 pid=1970

    - desc 09 ca sysid=0x1817 pid=6413

    - desc 09 ca sysid=0x1818 pid=6423

    - desc 09 ca sysid=0x1819 pid=6438

    - desc 52 stream_identifier component_tag=1

    - desc 09 ca sysid=0x648 pid=7969

    - desc 09 ca sysid=0xd95 pid=7989

    - desc 09 ca sysid=0x624 pid=6211

    - desc 09 ca sysid=0x500 pid=7027

    - desc 09 ca sysid=0xd98 pid=6501

    - desc 09 ca sysid=0x650 pid=6521

  * ES pid=3052 streamtype=0x04 streamtype_txt="13818-3 audio (MPEG-2)"

    - desc 09 ca sysid=0x500 pid=8105

    - desc 09 ca sysid=0xd96 pid=6201

    - desc 09 ca sysid=0x100 pid=6413

    - desc 09 ca sysid=0xb00 pid=1970

    - desc 09 ca sysid=0x1817 pid=6413

    - desc 09 ca sysid=0x1818 pid=6423

    - desc 09 ca sysid=0x1819 pid=6438

    - desc 52 stream_identifier component_tag=2

    - desc 09 ca sysid=0x648 pid=7969

    - desc 09 ca sysid=0xd95 pid=7989

    - desc 09 ca sysid=0x624 pid=6211

    - desc 09 ca sysid=0x500 pid=7027

    - desc 09 ca sysid=0xd98 pid=6501

    - desc 09 ca sysid=0x650 pid=6521

  * ES pid=301 streamtype=0xc0 streamtype_txt="Unknown"

    - desc c2 unknown length=56 value=4353455f50494c314353455f4348414e4353455f50494c324353455f534553004353455f455047004353455f465554314353455f46555432

    - desc c6 unknown length=5 value=01000503ff

  * ES pid=222 streamtype=0xc0 streamtype_txt="Unknown"

    - desc c2 unknown length=8 value=434841494e450000

  * ES pid=196 streamtype=0xc0 streamtype_txt="Unknown"

  * ES pid=300 streamtype=0xc1 streamtype_txt="Unknown"

    - desc c2 unknown length=8 value=50494c4f54450000

end PMT

 

[theparasol]

Tnx for the input guys, I read some tech spec datasheet of a philips CA device and was finally able to change the oscam code in such a way that vu+ devices started to work ok.

Fetching the kind of stream is slowing down the start decoding channel too much but its always nice to know "how to do it"

[pieterg]

Questions:
82: What is demuxmask, what purpose has it?    Read section data from demux number, what purpose has it?

demuxmask: e2 might start filters on any demux in this mask. So all these demuxes should be descrambled.
demux number: use this demux to start your sectionfilters. (should be one of the demuxes in the demuxmask, but you'd better use the indicated one, because the mask might be adjusted, and you don't want to have to move your sectionfilters all the time when the demuxmask changes)

83: m_adapter? -> perhaps in use with multituner receivers?

indeed, same as demux number. Adapter + demux give you your demux device node.

85: service type mask? -> what purpose has it?

different service types (live tv, recording, stream, etc) could be treated differently (e.g. with different priority when resources are low for instance)

[pieterg]

Teletext pid is never scrambled, but nevertheless the teletext pid of a channel is put in the pmt data.
Softcam will use it as a streampid to allow decoding. Waste of resources.

should not cost any resources, actual descrambling is done based on the scrambling bits in the TS header.
If the sections are plain, there is no descrambling. (and even if there is, it's all hardware on an stb)

[theparasol]

After reading the hardware whitepaper I had the same conclusion: wont take any additional resources.

Main problem was that the index on the CA device oscam was using was eventually removed (e.g. change a channel while doing multi channel stream/recording whatever)

and no new one was set -> black picture or no sound. Why it works with other boxes? Perhaps a more "intelligent" ca device? If key A not fits auto try key B  (or C, ord D)?

I dont know. Now oscam handles the CA device more properly so we dont have to rely on the "compensation" factor of the ca device.

[Erik Slagter]

What strikes me is that you say that PMT is for descrambling, but it's not. I hope it's just in the wording. Only one attribute of the PMT has to do with scrambling, the rest is for other purposes, if you remove a pid from the PMT you won't be able to demux/decode (not descramble) it (because the stb doesn't know it belongs to the stream).

[pieterg]

Capmt, not pmt.
(But still the ttx pid should be in it)

[Erik Slagter]

Parasol mentions pmt, that is what I refer to.

[pieterg]

yes, but e2 provides the softcams with capmt, not the full pmt.

So he probably means capmt.

[Erik Slagter]

Exactly, but he (actually the whole oscam team probably) call it pmt, which I think is confusing at least.

[theparasol]

Ok, whatever you want

I will call it CAPMT from now on.

But the issue I wanted to fix is already fixed by now: I was seeking the culprit in the wrong direction.

 

As with most issues: excluding a wrong direction points you eventually in the right direction

 

And for the records: I'm not a oscam team member!

 

They wont allow bad coders I guess...

Edited by theparasol, 12 March 2015 - 20:26.