MythFillDatabase Isssue

[mollcons]

I have an issue with MFDB which does not stop the process working but does show up as being an error on the MythWeb status screen.

I am using a script culled from another similar question some two years ago which is as follows:
#!/bin/bash
/usr/bin/ping -c3 saruman.mollcons.local
/usr/bin/ping -c3 bbc.co.uk
/usr/bin/mythfilldatabase --dd-grab-all --loglevel debug -v xmltv,system --logpath /var/log/mythtv

The first half of the log is as follows:
3 packets transmitted, 3 received, 0% packet loss, time 1999ms
rtt min/avg/max/mdev = 0.053/0.056/0.059/0.006 ms
PING bbc.co.uk (212.58.246.79) 56(84) bytes of data.
64 bytes from . (212.58.246.79): icmp_seq=1 ttl=55 time=60.7 ms
64 bytes from . (212.58.246.79): icmp_seq=2 ttl=55 time=62.8 ms
64 bytes from . (212.58.246.79): icmp_seq=3 ttl=55 time=63.1 ms

--- bbc.co.uk ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 60.797/62.251/63.119/1.054 ms
2016-04-26 01:12:05.802011 C mythfilldatabase version: fixes/0.27 [v0.27.6-6-g332aa34]
http://www.mythtv.org
2016-04-26 01:12:05.802021 C Qt version: compile: 4.8.7, runtime: 4.8.7
2016-04-26 01:12:05.802029 N Enabled verbose msgs: general xmltv system
2016-04-26 01:12:05.802184 N Setting Log Level to LOG_DEBUG
2016-04-26 01:12:05.813315 I Setup Interrupt handler
2016-04-26 01:12:05.813326 I Setup Terminated handler
2016-04-26 01:12:05.813335 I Setup Segmentation fault handler
2016-04-26 01:12:05.813342 I Setup Aborted handler
2016-04-26 01:12:05.813350 I Setup Bus error handler
2016-04-26 01:12:05.813357 I Setup Floating point exception handler
2016-04-26 01:12:05.813366 I Setup Illegal instruction handler
2016-04-26 01:12:05.813374 I Setup Real-time signal 0 handler
2016-04-26 01:12:05.813404 N Using runtime prefix = /usr
2016-04-26 01:12:05.813417 N Using configuration directory = /var/lib/mythtv/.mythtv
2016-04-26 01:12:05.813474 I Assumed character encoding: en_GB.UTF-8
2016-04-26 01:12:05.813781 N Empty LocalHostName.
2016-04-26 01:12:05.813786 I Using localhost value of saruman
2016-04-26 01:12:05.822993 I Added logging to the console
2016-04-26 01:12:05.828312 D FindDatabase() - Success!
2016-04-26 01:12:05.830420 N Setting QT default locale to en_GB
2016-04-26 01:12:05.830446 I Current locale en_GB
2016-04-26 01:12:05.830626 N Reading locale defaults from /usr/share/mythtv//locales/en_gb.xml
2016-04-26 01:12:05.837631 I Loading en_gb translation for module mythfrontend
2016-04-26 01:12:05.839055 I Current MythTV Schema Version (DBSchemaVer): 1317
2016-04-26 01:12:05.841430 I MythCoreContext: Connecting to backend server: 127.0.0.1:6543
(try 1 of 1)
2016-04-26 01:12:05.844681 I Using protocol version 77
2016-04-26 01:12:05.845005 I Opening blocking connection to master backend
2016-04-26 01:12:05.846309 I Updating source #2 () with grabber schedulesdirect1
2016-04-26 01:12:05.846625 I No channels are configured to use grabber.
2016-04-26 01:12:05.847827 I Retrieving datadirect data.
2016-04-26 01:12:05.847833 I Grabbing ALL available data.
2016-04-26 01:12:05.847856 I DataDirect: Grabbing listing data
2016-04-26 01:12:05.848119 I Downloading DataDirect feed
2016-04-26 01:12:05.923636 I New Client: (#1)
2016-04-26 01:12:05.923931 I Added logging to /var/log/mythtv/mythfilldatabase.20160426001205.25206.log
2016-04-26 01:12:07.974531 E DataDirect: Failed to get data: Download error
2016-04-26 01:12:07.974552 E Encountered error in grabbing data.
2016-04-26 01:12:08.191651 I Updating source #3 (Mollcons) with grabber tv_grab_uk_rt
2016-04-26 01:12:08.192231 I Found 50 channels for source 3 which use grabber
2016-04-26 01:12:08.192547 D Launching: tv_grab_uk_rt --capabilities
2016-04-26 01:12:08.192668 I Starting process signal handler
2016-04-26 01:12:08.192721 I Starting process manager

Why do I get the two lines 7 and 6 lines up from the bottom of this log?

Is there a way to get more logging which may help to identify the error better?

[dgriffin]

My cynical view of the world is that you will get no useful response to this problem. I've had the identical error message to this ever since October of 2015. That was when I applied what was supposed to be a minor upgrade to V27. I had a thread on this forum and a few e-mails back and forth to people, but nothing was ever resolved. The package doing the grabbing in somehow buried in QT4 code and no person seemed able to dig into it and figure out what was going wrong. I added a bunch of "printf" statements into the MythTV packages but never could determine how the QT4 package stuff was working. I still have the same issue today. Based on the breakage back then, I am loath to upgrade to V28. If I can find someone who is running Debian Linux 8.x (Jessie) and MythTV V28 and having 100% success, then I'll switch. See the Thread entitled "mythfilldatabase doesn't do authentication callback" and/or search for my name as author "dgriffin"

[rayhwhite]

I am running mythfilldatabase version fixes/0.28 [v0.28.2] and mythfilldatabase generates error meesages like the following:

2018-02-13 15:51:29.163130 E DataDirect: Failed to get data: Download error
2018-02-13 15:51:29.163159 E Encountered error in grabbing data.

and MtyhTv gets no schedule info from SchedulesDirect.

The following 2 command workaround works for me:

tv_grab_na_dd --dd-data Sched-Direct.dd

mythfilldatabase --dd-file --sourceid 2 --lineupid schedulesdirect --offset 0 --xmlfile Sched-Direct.dd

where "schedulesdirect" is the name I use for the schedule data source in MythTV and "Sched-Direct.dd"
is the name of the file in my home directory that tv_grab_na_dd writes to.