Missing EPG data since new channel

Have a MythTV related problem? Ask for help from other MythTV users here.

Moderator: Forum Moderators

ProblemChild
Newcomer
Posts: 3
Joined: Sat Dec 24, 2016 12:53 am
Australia

Missing EPG data since new channel

Post by ProblemChild » Sat Dec 24, 2016 1:00 am

Hi,

I added a new channel to my setup a little while ago (Australian ABC HD). I wasn't immediately able to get EPG data for that new channel adding to the system. I just capture the EPG from the broadcast (EIT?)

I had another go last weekend and was able to add get channel data adding for ABC HD. But, that seems to have stopped all data adding from all SBS channels. When I look at the listings from MythWeb, all the SBS channels show "NO DATA".

I've been using MythTV for several years, but I've never explored it in great detail.

Is anyone able to assist me with getting EPG adding again?

Thanks!

nicholas
Newcomer
Posts: 6
Joined: Wed Jan 04, 2017 4:06 am
Australia

Re: Missing EPG data since new channel

Post by nicholas » Wed Jan 04, 2017 4:19 am

I also have the same EPG problems with SBS from the same date.
I contacted SBS and received the following response:

We do not have any other report of issues with EPG data after the signal upgrade a part from Sony PlayTV
which has been discontinued so yours is a first.
In your case I think the first step in troubleshooting the problem would be to ascertain if the source of the issue is the tuner card or mythTV.
If the issue is with the tuner card, as we do not provide technical information to the public, if the card manufacturer requires technical details they can analyse the stream and patch the relevant firmware section or eventually contact us directly on 1800 500 727 or email technical@sbs.com.au

Hope someone has a solution.

ProblemChild
Newcomer
Posts: 3
Joined: Sat Dec 24, 2016 12:53 am
Australia

Re: Missing EPG data since new channel

Post by ProblemChild » Wed Jan 04, 2017 10:55 am

Thanks for the response.

I thought the problem was in my MythTV config, but now I guess it isn't.

Which tuner are you using? I'm using a Silicondust HD Homerun (HDHR3-DT)

User avatar
dekarl
Developer
Posts: 228
Joined: Thu Feb 06, 2014 11:01 pm
Germany

Re: Missing EPG data since new channel

Post by dekarl » Wed Jan 04, 2017 11:18 am

nicholas wrote:We do not have any other report of issues with EPG data after the signal upgrade ...
... they can analyse the stream ...
Sounds like a plan. Can we get a specimen of the stream in question? Basically some SDT (EIT_schedule_flag) / EIT sections would be a good start.
e.g. from dvbsnoop (please include the hexdump) http://dvbsnoop.sourceforge.net/example ... e-eit.html

Can you file a ticket?

nicholas
Newcomer
Posts: 6
Joined: Wed Jan 04, 2017 4:06 am
Australia

Re: Missing EPG data since new channel

Post by nicholas » Fri Jan 06, 2017 2:56 am

Thanks for the interest in my problem.
Could you let me know how to use the tool dvb snoop as I am a bit short on ability at this level.

User avatar
dekarl
Developer
Posts: 228
Joined: Thu Feb 06, 2014 11:01 pm
Germany

Re: Missing EPG data since new channel

Post by dekarl » Fri Jan 06, 2017 4:18 pm

nicholas wrote:Could you let me know how to use the tool dvb snoop as I am a bit short on ability at this level.
What tuner are you using? (e.g. is it network attached or a PCI card?) Here are instructions for PCI(e)/USB tuners.

You need two programs running in parallel (in a command line window), one for tuning the channel and the other for looking at the data stream.

Program A: mythfrontend watching LiveTV on the channel that doesn't get guide data (or dvbtune in monitoring mode with manually passed tuning parameters)

Program B: dvbsnoop -n 1 -nph 0x11 # for SDT - should always be the same
dvbsnoop -n 1 -nph 0x12 # for EIT - lots of different sections - e.g. one per 3 hour window
if you are not watching on the first DVB adapter, then you need to tell dvbsnoop by adding "-adapter x" to the command line, e.g. directly after dvbsnoop

mianos
Newcomer
Posts: 5
Joined: Mon Jan 09, 2017 9:52 pm
Australia

Re: Missing EPG data since new channel

Post by mianos » Mon Jan 09, 2017 9:57 pm

I don't think this is isolated. I also just starting missing the EPG for SBS.
I have been running myth for about 8 years now but the PC it was running on just died so I am setting up another one.
I have a hdhomerun hdhomerun3_dvbt firmware version: 20161117.
Last week I am pretty sure that the EPG came up for SBS.
When I was setting up myth on a new machine the hdhomerun app for Linux upgraded the firmware for the unit (I was running firmware from the beginning of last year).
It could be that.
I just set up the backend on a new server so I can quite easily log in and run diagnostics.
Last edited by mianos on Tue Jan 10, 2017 7:34 am, edited 1 time in total.

mianos
Newcomer
Posts: 5
Joined: Mon Jan 09, 2017 9:52 pm
Australia

Re: Missing EPG data since new channel

Post by mianos » Tue Jan 10, 2017 12:21 am

Is there another way to debug this with a hdhomerun or should I try and install the linux driver for hdhomerun that creates a /proc device and reconfigure the backend to use the local device so I can run dvbsnoop?

nicholas
Newcomer
Posts: 6
Joined: Wed Jan 04, 2017 4:06 am
Australia

Re: Missing EPG data since new channel

Post by nicholas » Wed Jan 11, 2017 7:03 am

dekarl wrote:
nicholas wrote:Could you let me know how to use the tool dvb snoop as I am a bit short on ability at this level.
What tuner are you using? (e.g. is it network attached or a PCI card?) Here are instructions for PCI(e)/USB tuners.

You need two programs running in parallel (in a command line window), one for tuning the channel and the other for looking at the data stream.

Program A: mythfrontend watching LiveTV on the channel that doesn't get guide data (or dvbtune in monitoring mode with manually passed tuning parameters)

Program B: dvbsnoop -n 1 -nph 0x11 # for SDT - should always be the same
dvbsnoop -n 1 -nph 0x12 # for EIT - lots of different sections - e.g. one per 3 hour window
if you are not watching on the first DVB adapter, then you need to tell dvbsnoop by adding "-adapter x" to the command line, e.g. directly after dvbsnoop
Hi, thanks for your advice, I think I have collected the information requested.
The first time I ran it, I only got a small section of information:
root@nick-mythtv:~# dvbsnoop -n 1 -nph 0x12
dvbsnoop V1.4.50 -- http://dvbsnoop.sourceforge.net/

------------------------------------------------------------
SECT-Packet: 00000001 PID: 18 (0x0012), Length: 18 (0x0012)
Time received: Wed 2017-01-11 17:54:04.769
------------------------------------------------------------
PID: 18 (0x0012) [= assigned for: DVB Event Information Table (EIT)]

Guess table from table id...
EIT-decoding....
Table_ID: 80 (0x50) [= Event Information Table (EIT) - actual transport stream, schedule]
section_syntax_indicator: 1 (0x01)
reserved_1: 1 (0x01)
reserved_2: 3 (0x03)
Section_length: 15 (0x000f)
Service_ID: 782 (0x030e) [= --> refers to PMT program_number]
reserved_3: 3 (0x03)
Version_number: 5 (0x05)
current_next_indicator: 1 (0x01) [= valid now]
Section_number: 168 (0xa8)
Last_Section_number: 248 (0xf8)
Transport_stream_ID: 768 (0x0300)
Original_network_ID: 12802 (0x3202) [= >>ERROR: not (yet) defined... Report!<<]
Segment_last_Section_number: 168 (0xa8)
Last_table_id: 81 (0x51) [= Event Information Table (EIT) - actual transport stream, schedule]
CRC: 2753135187 (0xa4198253)
==========================================================

I then ran it again a few minutes later, and got a lot more details, and it mentioned sbs so I hope it is right.
root@nick-mythtv:~# dvbsnoop -n 1 -nph 0x12
dvbsnoop V1.4.50 -- http://dvbsnoop.sourceforge.net/

------------------------------------------------------------
SECT-Packet: 00000001 PID: 18 (0x0012), Length: 689 (0x02b1)
Time received: Wed 2017-01-11 17:56:19.761
------------------------------------------------------------
PID: 18 (0x0012) [= assigned for: DVB Event Information Table (EIT)]

Guess table from table id...
EIT-decoding....
Table_ID: 80 (0x50) [= Event Information Table (EIT) - actual transport stream, schedule]
section_syntax_indicator: 1 (0x01)
reserved_1: 1 (0x01)
reserved_2: 3 (0x03)
Section_length: 686 (0x02ae)
Service_ID: 774 (0x0306) [= --> refers to PMT program_number]
reserved_3: 3 (0x03)
Version_number: 12 (0x0c)
current_next_indicator: 1 (0x01) [= valid now]
Section_number: 40 (0x28)
Last_Section_number: 248 (0xf8)
Transport_stream_ID: 768 (0x0300)
Original_network_ID: 12802 (0x3202) [= >>ERROR: not (yet) defined... Report!<<]
Segment_last_Section_number: 40 (0x28)
Last_table_id: 81 (0x51) [= Event Information Table (EIT) - actual transport stream, schedule]

Event_ID: 27095 (0x69d7)
Start_time: 0xe1a4163500 [= 2017-01-11 16:35:00 (UTC)]
Duration: 0x0005000 [= 00:50:00 (UTC)]
Running_status: 0 (0x00) [= undefined]
Free_CA_mode: 0 (0x00) [= unscrambled]
Descriptors_loop_length: 328 (0x148)

DVB-DescriptorTag: 77 (0x4d) [= short_event_descriptor]
descriptor_length: 242 (0xf2)
ISO639_2_language_code: eng
event_name_length: 41 (0x29)
event_name: "One Born Every Minute: What Happens Next" -- Charset: Latin alphabet no. 5
text_length: 196 (0xc4)
text_char: "(S.2,Ep.3) This series revisits some of One Born Every Minute's most memorable Mums and Dads as they face the highs and the lows of parenthood to build a family and a future. #Onceborneveryminute" -- Charset: Latin alphabet no. 5

DVB-DescriptorTag: 84 (0x54) [= content_descriptor]
descriptor_length: 2 (0x02)
Content_nibble_level_1: 0 (0x00)
Content_nibble_level_2: 0 (0x00)
[= reserved]
User_nibble_1: 0 (0x00)
User_nibble_2: 0 (0x00)


DVB-DescriptorTag: 85 (0x55) [= parental_rating_descriptor]
descriptor_length: 4 (0x04)
Country_code: AUS
Rating: 10 (0x0a) [= minimum age: 13 years]


DVB-DescriptorTag: 118 (0x76) [= content_identifier_descriptor]
descriptor_length: 35 (0x23)
crid_type: 49 (0x31) [= user defined]
crid_location: 0 (0x00) [= Carried explicitly within descriptor]
crid_len: 33 (0x21)
crid_bytes:
0000: 63 72 69 64 3a 2f 2f 73 79 64 6e 65 79 2e 73 62 crid://sydney.sb
0010: 73 68 64 2e 73 62 73 2e 61 75 2f 36 37 38 38 35 shd.sbs.au/67885
0020: 32 2


DVB-DescriptorTag: 118 (0x76) [= content_identifier_descriptor]
descriptor_length: 35 (0x23)
crid_type: 50 (0x32) [= user defined]
crid_location: 0 (0x00) [= Carried explicitly within descriptor]
crid_len: 33 (0x21)
crid_bytes:
0000: 63 72 69 64 3a 2f 2f 73 79 64 6e 65 79 2e 73 62 crid://sydney.sb
0010: 73 68 64 2e 73 62 73 2e 61 75 2f 32 30 37 39 33 shd.sbs.au/20793
0020: 31 1



Event_ID: 27096 (0x69d8)
Start_time: 0xe1a4172500 [= 2017-01-11 17:25:00 (UTC)]
Duration: 0x0003500 [= 00:35:00 (UTC)]
Running_status: 0 (0x00) [= undefined]
Free_CA_mode: 0 (0x00) [= unscrambled]
Descriptors_loop_length: 319 (0x13f)

DVB-DescriptorTag: 77 (0x4d) [= short_event_descriptor]
descriptor_length: 234 (0xea)
ISO639_2_language_code: eng
event_name_length: 31 (0x1f)
event_name: "Food Lovers Guide To Australia" -- Charset: Latin alphabet no. 5
text_length: 198 (0xc6)
text_char: "Maeve O'Meara and Joanna Savill continue to explore the best food and produce around. Today, the fishermen of Ceduna, cake decorating with Amanda Way, and the dancing ginger growers. #FoodNetworkAU" -- Charset: Latin alphabet no. 5

DVB-DescriptorTag: 84 (0x54) [= content_descriptor]
descriptor_length: 2 (0x02)
Content_nibble_level_1: 9 (0x09)
Content_nibble_level_2: 0 (0x00)
[= education/science/factual topics (general)]
User_nibble_1: 0 (0x00)
User_nibble_2: 0 (0x00)


DVB-DescriptorTag: 85 (0x55) [= parental_rating_descriptor]
descriptor_length: 4 (0x04)
Country_code: AUS
Rating: 6 (0x06) [= minimum age: 9 years]


DVB-DescriptorTag: 118 (0x76) [= content_identifier_descriptor]
descriptor_length: 35 (0x23)
crid_type: 49 (0x31) [= user defined]
crid_location: 0 (0x00) [= Carried explicitly within descriptor]
crid_len: 33 (0x21)
crid_bytes:
0000: 63 72 69 64 3a 2f 2f 73 79 64 6e 65 79 2e 73 62 crid://sydney.sb
0010: 73 68 64 2e 73 62 73 2e 61 75 2f 36 34 32 30 30 shd.sbs.au/64200
0020: 30 0


DVB-DescriptorTag: 118 (0x76) [= content_identifier_descriptor]
descriptor_length: 34 (0x22)
crid_type: 50 (0x32) [= user defined]
crid_location: 0 (0x00) [= Carried explicitly within descriptor]
crid_len: 32 (0x20)
crid_bytes:
0000: 63 72 69 64 3a 2f 2f 73 79 64 6e 65 79 2e 73 62 crid://sydney.sb
0010: 73 68 64 2e 73 62 73 2e 61 75 2f 37 32 35 33 39 shd.sbs.au/72539


CRC: 243628733 (0x0e857abd)
==========================================================

Please let me know if you need me to collect any more information or try anything to get this working again.

Greatly appreciate your help

mianos
Newcomer
Posts: 5
Joined: Mon Jan 09, 2017 9:52 pm
Australia

Re: Missing EPG data since new channel

Post by mianos » Thu Jan 19, 2017 5:25 am

useonairguide is not set for the missing channels in my database. How is this normally updated?
Could this be the problem?

Code: Select all

mysql> select chanid, channum, freqid, callsign, name, useonairguide, mplexid, serviceid from channel;
+--------+---------+--------+------------------+------------------+---------------+---------+-----------+
| chanid | channum | freqid | callsign         | name             | useonairguide | mplexid | serviceid |
+--------+---------+--------+------------------+------------------+---------------+---------+-----------+
|   1007 | 7       | 28     | 7 Sydney         | 7 Sydney         |             1 |       1 |      1312 |
|   1071 | 71      | 28     | 7 Sydney         | 7 Sydney         |             1 |       1 |      1313 |
|   1072 | 72      | 28     | 7TWO Sydney      | 7TWO Sydney      |             1 |       1 |      1314 |
|   1073 | 73      | 28     | 7mate Sydney     | 7mate Sydney     |             1 |       1 |      1315 |
|   1070 | 70      | 28     | 7HD Sydney       | 7HD Sydney       |             1 |       1 |      1316 |
|   1076 | 76      | 28     | 7flix Sydney     | 7flix Sydney     |             1 |       1 |      1317 |
|   1078 | 78      | 28     | RACING.COM       | RACING.COM       |             1 |       1 |      1320 |
|   1024 | 24      | 30     | ABC News 24      | ABC News 24      |             1 |       2 |       544 |
|   1002 | 2       | 30     | ABC              | ABC              |             1 |       2 |       545 |
|   1022 | 22      | 30     | ABC2/KIDS        | ABC2/KIDS        |             1 |       2 |       546 |
|   1021 | 21      | 30     | ABC              | ABC              |             1 |       2 |       547 |
|   1023 | 23      | 30     | ABC ME           | ABC ME           |             1 |       2 |       548 |
|   1020 | 20      | 30     | ABC HD           | ABC HD           |             1 |       2 |       549 |
|   1001 | 1       | 31     | ONE              | ONE              |             1 |       3 |      1569 |
|   1013 | 13      | 31     | TEN HD           | TEN HD           |             1 |       3 |      1572 |
|   1010 | 10      | 31     | TEN Digital      | TEN Digital      |             1 |       3 |      1573 |
|   1014 | 14      | 31     | TVSN             | TVSN             |             1 |       3 |      1574 |
|   1012 | 12      | 31     | ONE              | ONE              |             1 |       3 |      1575 |
|   1011 | 11      | 31     | ELEVEN           | ELEVEN           |             1 |       3 |      1576 |
|   1015 | 15      | 31     | SpreeTV          | SpreeTV          |             1 |       3 |      1577 |
|   1003 | 3       | 32     | SBS ONE          | SBS ONE          |             0 |       4 |       769 |
|   1032 | 32      | 32     | SBS VICELAND     | SBS VICELAND     |             0 |       4 |       770 |
|   1033 | 33      | 32     | Food Network     | Food Network     |             0 |       4 |       772 |
|   1034 | 34      | 32     | NITV             | NITV             |             0 |       4 |       773 |
|   1030 | 30      | 32     | SBS HD           | SBS HD           |             0 |       4 |       774 |
|   1009 | 9       | 33     | Channel 9 Sydney | Channel 9 Sydney |             1 |       5 |      1057 |
|   1090 | 90      | 33     | 9HD Sydney       | 9HD Sydney       |             1 |       5 |      1058 |
|   1099 | 99      | 33     | 9Go!             | 9Go!             |             1 |       5 |      1059 |
|   1094 | 94      | 33     | 9Life            | 9Life            |             1 |       5 |      1060 |
|   1095 | 95      | 33     | Extra            | Extra            |             1 |       5 |      1061 |
|   1091 | 91      | 33     | Channel 9 Sydney | Channel 9 Sydney |             1 |       5 |      1062 |
|   1092 | 92      | 33     | 9Gem             | 9Gem             |             1 |       5 |      1063 |
|   1093 | 93      | 33     | 9Go!             | 9Go!             |             1 |       5 |      1064 |
+--------+---------+--------+------------------+------------------+---------------+---------+-----------+

mianos
Newcomer
Posts: 5
Joined: Mon Jan 09, 2017 9:52 pm
Australia

Re: Missing EPG data since new channel

Post by mianos » Thu Jan 19, 2017 5:36 am

I just updated it, update channel set useonairguide = 1; and restarted and all the SBS EPG is back.

nicholas
Newcomer
Posts: 6
Joined: Wed Jan 04, 2017 4:06 am
Australia

Re: Missing EPG data since new channel

Post by nicholas » Thu Jan 19, 2017 6:26 am

Hi
This sounds as though it will fix my problem also.
What are the steps to "update channel set useonairguide = 1".
I'm a bit light on the detail.
Thanks
Regards
Nicholas

mianos
Newcomer
Posts: 5
Joined: Mon Jan 09, 2017 9:52 pm
Australia

Re: Missing EPG data since new channel

Post by mianos » Thu Jan 19, 2017 9:24 am

I logged into the server and used mysql.
When I was looking up the value after I fixed it I think, if you have mythweb installed, this page will also allow you to edit the EIT selection:
http://YOUR-BACKEND-MYTHWEB/mythweb/set ... v/channels

ProblemChild
Newcomer
Posts: 3
Joined: Sat Dec 24, 2016 12:53 am
Australia

Re: Missing EPG data since new channel

Post by ProblemChild » Sun Jan 29, 2017 3:43 am

Thanks - that URL allowed me to change the settings for the channel EPG.

Once I restarted the backend, missing EPG for those channels began to get captured.

Cheers!

nicholas
Newcomer
Posts: 6
Joined: Wed Jan 04, 2017 4:06 am
Australia

Re: Missing EPG data since new channel

Post by nicholas » Tue Jan 31, 2017 6:26 am

Hi Mianos
Thanks for your solution.
I just updated it, update channel set useonairguide = 1; and restarted and all the SBS EPG is back.
Worked like a charm.
Regards
Nicholas

Post Reply