mythtv-setup version 31 Fedora 34 Schedules Direct

Have a MythTV related problem? Ask for help from other MythTV users here.

Moderator: Forum Moderators

dhighley
Junior
Posts: 18
Joined: Sun Jun 27, 2021 6:55 pm
United States of America

Re: mythtv-setup version 31 Fedora 34 Schedules Direct

Post by dhighley »

There is only one video source and all 3 tuner/capture cards are connected to that video source.

Now for the grabber issue, I'm able to use the same configuration file except for the cache file location. It works when I use it from my account. In the past from my work experience I know that the LANG environment variable can affect XML parsers. For my account its value is en_US.UTF-8. I have no idea what it is for an account without a login. Since I have not set this variable it must be the system default now. Just grasping at straw here.
User avatar
bill6502
Developer
Posts: 2299
Joined: Fri Feb 07, 2014 5:28 pm
United States of America

Re: mythtv-setup version 31 Fedora 34 Schedules Direct

Post by bill6502 »

Reading into the above, it works when run from your user, but fails when
run by the user running mythbackend (typically user mythtv).

I can comment on how the path to the files of interest is developed. The
configuration directory is (for example) ~mythtv/.mythtv. And in there
the SOURCENAMES.xmltv files are located. See the ASCII art linked
to in the earlier response. If your distribution uses systemd, then in
the [Service] section, you could use: Environment="LANG=en_US.UTF-8"
Not my 1st guess at the issue here. See what the 1st lines of the downloaded
data look like when the grabber is run by user mythtv.
dhighley
Junior
Posts: 18
Joined: Sun Jun 27, 2021 6:55 pm
United States of America

Re: mythtv-setup version 31 Fedora 34 Schedules Direct

Post by dhighley »

I did get recordings to work. Issue had nothing to do with the tuners. I missed defining the default storage parameter.

I have now tried the LANG environment variable which did not change the grabber issue. The log file does not say what file is being parsed. No cache file is created. I have checked for Selinux issues but nothing is being reported. Relevant log file output:
2021-07-27 16:36:23.382708 I [290200/290200] CoreContext main.cpp:282 (main) - Opening blocking connection to master backend
2021-07-27 16:36:24.407458 I [290200/290200] CoreContext filldata.cpp:317 (Run) - Updating source #1 (SchedulesDirect) with grabber tv_grab_zz_sdjson
2021-07-27 16:36:24.409229 I [290200/290200] CoreContext filldata.cpp:332 (Run) - Found 613 channels for source 1 which use grabber
2021-07-27 16:36:24.409452 I [290200/290228] SystemManager mythsystemunix.cpp:262 (run) - Starting process manager
2021-07-27 16:36:24.409485 I [290200/290229] SystemSignalManager mythsystemunix.cpp:488 (run) - Starting process signal handler
2021-07-27 16:36:24.409518 I [290200/290230] SystemIOHandlerR mythsystemunix.cpp:82 (run) - Starting IO manager (read)
2021-07-27 16:36:24.410665 I [290200/290231] SystemIOHandlerW mythsystemunix.cpp:82 (run) - Starting IO manager (write)
2021-07-27 16:36:24.810218 I [290200/290200] CoreContext filldata.cpp:393 (Run) - Grabber has capabilities: baseline manualconfig preferredmethod
2021-07-27 16:36:25.160688 I [290200/290200] CoreContext filldata.cpp:418 (Run) - Grabber prefers method: allatonce
2021-07-27 16:36:25.161257 I [290200/290200] CoreContext filldata.cpp:143 (GrabData) - XMLTV config file is: /etc/mythtv/SchedulesDirect.xmltv
2021-07-27 16:36:25.512158 E [290200/290200] CoreContext filldata.cpp:215 (GrabData) - XMLTV grabber returned error code 1
dhighley
Junior
Posts: 18
Joined: Sun Jun 27, 2021 6:55 pm
United States of America

Re: mythtv-setup version 31 Fedora 34 Schedules Direct

Post by dhighley »

Darn, missed a log line:
2021-07-27 16:36:25.862051 E [290200/290200] CoreContext xmltvparser.cpp:743 (parseFile) - Malformed XML file, missing </tv> element, at line 1, Premature end of document.
User avatar
bill6502
Developer
Posts: 2299
Joined: Fri Feb 07, 2014 5:28 pm
United States of America

Re: mythtv-setup version 31 Fedora 34 Schedules Direct

Post by bill6502 »

I can't tell what logging was in play from the snippet above.

If starting as your user, then do mythfilldatabase -v system,xmltv

If it's the backend running, use the same -v ..., or alter the log components on-the-fly
by typing: mythbackend --setverbose system,xmltv

That will log the actual grabber command, which can then be run (as the same user,
yourself or mythtv) from the command line.
dhighley
Junior
Posts: 18
Joined: Sun Jun 27, 2021 6:55 pm
United States of America

Re: mythtv-setup version 31 Fedora 34 Schedules Direct

Post by dhighley »

Once I figured out the correct command line options; --verbose system comma xmltv. Reminder even though it indicates the grabber needs to be run with the --configure option that has been done. The only difference between the one in my home directory that works and the one in /etc/mythtv is the cache file location. I noticed there is a carriage return after the password in the configuration file is that needed? Just curious. The tmp noted in the log file is gone so nothing can be checked there. Here is the complete log file:

2021-07-28 16:36:39.256264 C [348944/348944] thread_unknown mythcommandlineparser.cpp:2608 (ConfigureLogging) - mythfilldatabase version: fixes/31 [v31.0-v31.0-158-g0680b37c68] www.mythtv.org
2021-07-28 16:36:39.256276 C [348944/348944] thread_unknown mythcommandlineparser.cpp:2612 (ConfigureLogging) - Qt version: compile: 5.15.2, runtime: 5.15.2
2021-07-28 16:36:39.256331 I [348944/348944] thread_unknown mythcommandlineparser.cpp:2614 (ConfigureLogging) - Fedora 34 (Workstation Edition) (x86_64)
2021-07-28 16:36:39.256334 N [348944/348944] thread_unknown mythcommandlineparser.cpp:2616 (ConfigureLogging) - Enabled verbose msgs: general system xmltv
2021-07-28 16:36:39.256409 N [348944/348944] thread_unknown logging.cpp:724 (logStart) - Setting Log Level to LOG_INFO
2021-07-28 16:36:39.266654 I [348944/348946] Logger logging.cpp:280 (run) - Added logging to the console
2021-07-28 16:36:39.266808 I [348944/348944] thread_unknown signalhandling.cpp:191 (SetHandlerPrivate) - Setup Interrupt handler
2021-07-28 16:36:39.266811 I [348944/348944] thread_unknown signalhandling.cpp:191 (SetHandlerPrivate) - Setup Terminated handler
2021-07-28 16:36:39.266815 I [348944/348944] thread_unknown signalhandling.cpp:191 (SetHandlerPrivate) - Setup Segmentation fault handler
2021-07-28 16:36:39.266817 I [348944/348944] thread_unknown signalhandling.cpp:191 (SetHandlerPrivate) - Setup Aborted handler
2021-07-28 16:36:39.266822 I [348944/348944] thread_unknown signalhandling.cpp:191 (SetHandlerPrivate) - Setup Bus error handler
2021-07-28 16:36:39.266824 I [348944/348944] thread_unknown signalhandling.cpp:191 (SetHandlerPrivate) - Setup Floating point exception handler
2021-07-28 16:36:39.266827 I [348944/348944] thread_unknown signalhandling.cpp:191 (SetHandlerPrivate) - Setup Illegal instruction handler
2021-07-28 16:36:39.266830 I [348944/348944] thread_unknown signalhandling.cpp:191 (SetHandlerPrivate) - Setup Real-time signal 0 handler
2021-07-28 16:36:39.266834 I [348944/348944] thread_unknown signalhandling.cpp:191 (SetHandlerPrivate) - Setup Hangup handler
2021-07-28 16:36:39.266856 N [348944/348944] thread_unknown mythdirs.cpp:37 (InitializeMythDirs) - Read conf dir = /etc/mythtv
2021-07-28 16:36:39.266941 I [348944/348945] LogForward loggingserver.cpp:128 (FileLogger) - Added logging to /var/log/mythtv/mythfilldatabase.20210728233639.348944.log
2021-07-28 16:36:39.267022 N [348944/348944] thread_unknown mythdirs.cpp:203 (InitializeMythDirs) - Using runtime prefix = /usr
2021-07-28 16:36:39.267023 N [348944/348944] thread_unknown mythdirs.cpp:204 (InitializeMythDirs) - Using configuration directory = /etc/mythtv
2021-07-28 16:36:39.267046 I [348944/348944] CoreContext mythcorecontext.cpp:284 (Init) - Assumed character encoding: en_US.UTF-8
2021-07-28 16:36:39.267219 I [348944/348944] CoreContext mythcontext.cpp:629 (LoadDatabaseSettings) - Empty LocalHostName. This is typical.
2021-07-28 16:36:39.267223 I [348944/348944] CoreContext mythcontext.cpp:636 (LoadDatabaseSettings) - Using a profile name of: 'douglas' (Usually the same as this host's name.)
2021-07-28 16:36:39.267251 I [348944/348944] CoreContext mythcontext.cpp:885 (TestDBconnection) - Start up testing connections. DB localhost, BE , attempt 0, status dbAwake, Delay: 2000
2021-07-28 16:36:40.292888 N [348944/348944] CoreContext mythcorecontext.cpp:1809 (InitLocale) - Setting QT default locale to en_US
2021-07-28 16:36:40.292900 I [348944/348944] CoreContext mythcorecontext.cpp:1842 (SaveLocaleDefaults) - Current locale en_US
2021-07-28 16:36:40.293056 N [348944/348944] CoreContext mythlocale.cpp:121 (LoadDefaultsFromXML) - Reading locale defaults from /usr/share/mythtv//locales/en_us.xml
2021-07-28 16:36:40.354973 I [348944/348944] CoreContext platforms/mythpowerdbus.cpp:530 (AcquireLock) - PowerDBus: Failed to delay sleep,shutdown: Permission denied
2021-07-28 16:36:40.357494 I [348944/348944] CoreContext platforms/mythpowerdbus.cpp:360 (DeviceAdded) - PowerDBus: Added UPower.Device '/org/freedesktop/UPower/devices/keyboard_hidpp_battery_8'
2021-07-28 16:36:40.357719 I [348944/348944] CoreContext mythpower.cpp:348 (PowerLevelChanged) - Power: On AC power
2021-07-28 16:36:40.402168 I [348944/348944] CoreContext mythpower.cpp:131 (Init) - Power: Supported actions: None
2021-07-28 16:36:40.402936 I [348944/348944] CoreContext mythtranslation.cpp:62 (load) - Loading en_us translation for module mythfrontend
2021-07-28 16:36:40.403589 I [348944/348944] CoreContext schemawizard.cpp:117 (Compare) - Current MythTV Schema Version (DBSchemaVer): 1361
2021-07-28 16:36:40.404806 I [348944/348944] CoreContext mythcorecontext.cpp:469 (ConnectCommandSocket) - MythCoreContext::ConnectCommandSocket(): Connecting to backend server: 127.0.0.1:6543 (try 1 of 1)
2021-07-28 16:36:40.406306 I [348944/348944] CoreContext mythcorecontext.cpp:1691 (CheckProtoVersion) - MythCoreContext::CheckProtoVersion(): Using protocol version 91 BuzzOff
2021-07-28 16:36:40.406615 I [348944/348944] CoreContext main.cpp:282 (main) - Opening blocking connection to master backend
2021-07-28 16:36:41.431173 I [348944/348944] CoreContext filldata.cpp:317 (Run) - Updating source #1 (SchedulesDirect) with grabber tv_grab_zz_sdjson
2021-07-28 16:36:41.432950 I [348944/348944] CoreContext filldata.cpp:332 (Run) - Found 613 channels for source 1 which use grabber
2021-07-28 16:36:41.433155 I [348944/348967] SystemManager mythsystemunix.cpp:262 (run) - Starting process manager
2021-07-28 16:36:41.433182 I [348944/348968] SystemSignalManager mythsystemunix.cpp:488 (run) - Starting process signal handler
2021-07-28 16:36:41.433205 I [348944/348969] SystemIOHandlerR mythsystemunix.cpp:82 (run) - Starting IO manager (read)
2021-07-28 16:36:41.434388 I [348944/348944] CoreContext mythsystemunix.cpp:934 (Fork) - Managed child (PID: 348971) has started! * command=tv_grab_zz_sdjson --capabilities, timeout=25
2021-07-28 16:36:41.434451 I [348944/348970] SystemIOHandlerW mythsystemunix.cpp:82 (run) - Starting IO manager (write)
2021-07-28 16:36:41.795849 I [348944/348967] SystemManager mythsystemunix.cpp:335 (run) - Managed child (PID: 348971) has exited! command=tv_grab_zz_sdjson --capabilities, status=0, result=0
2021-07-28 16:36:41.833923 I [348944/348944] CoreContext filldata.cpp:393 (Run) - Grabber has capabilities: baseline manualconfig preferredmethod
2021-07-28 16:36:41.834892 I [348944/348944] CoreContext mythsystemunix.cpp:934 (Fork) - Managed child (PID: 348974) has started! * command=tv_grab_zz_sdjson --preferredmethod, timeout=15
2021-07-28 16:36:42.136064 I [348944/348967] SystemManager mythsystemunix.cpp:335 (run) - Managed child (PID: 348974) has exited! command=tv_grab_zz_sdjson --preferredmethod, status=0, result=0
2021-07-28 16:36:42.184478 I [348944/348944] CoreContext filldata.cpp:418 (Run) - Grabber prefers method: allatonce
2021-07-28 16:36:42.185083 I [348944/348944] CoreContext filldata.cpp:143 (GrabData) - XMLTV config file is: /etc/mythtv/SchedulesDirect.xmltv
2021-07-28 16:36:42.188515 I [348944/348944] CoreContext filldata.cpp:176 (GrabData) - Grabber Command: nice tv_grab_zz_sdjson --config-file '/etc/mythtv/SchedulesDirect.xmltv' --output /tmp/mythrNDuON
2021-07-28 16:36:42.188516 I [348944/348944] CoreContext filldata.cpp:178 (GrabData) - ----------------- Start of XMLTV output -----------------
2021-07-28 16:36:42.189429 I [348944/348944] CoreContext mythsystemunix.cpp:934
(Fork) - Managed child (PID: 348977) has started! * command=nice tv_grab_zz_sdjson --config-file '/etc/mythtv/SchedulesDirect.xmltv' --output /tmp/mythrNDuON, timeout=0
2021-07-28 16:36:42.510778 I [348944/348967] SystemManager mythsystemunix.cpp:335 (run) - Managed child (PID: 348977) has exited! command=nice tv_grab_zz_sdjson --config-file '/etc/mythtv/SchedulesDirect.xmltv' --output /tmp/mythrNDuON, status=256, result=1
2021-07-28 16:36:42.535046 I [348944/348944] CoreContext filldata.cpp:192 (GrabData) - You need to configure the grabber by running it with --configure
2021-07-28 16:36:42.535049 I [348944/348944] CoreContext filldata.cpp:195 (GrabData) - ------------------ End of XMLTV output ------------------
2021-07-28 16:36:42.536916 E [348944/348944] CoreContext filldata.cpp:215 (GrabData) - XMLTV grabber returned error code 1
2021-07-28 16:36:42.543069 I [348944/348944] CoreContext mythsystemunix.cpp:934 (Fork) - Managed child (PID: 348980) has started! * command=/usr/share/mythtv/metadata/Movie/tmdb3.py -v, timeout=0
2021-07-28 16:36:42.683774 I [348944/348967] SystemManager mythsystemunix.cpp:335 (run) - Managed child (PID: 348980) has exited! command=/usr/share/mythtv/metadata/Movie/tmdb3.py -v, status=0, result=0
2021-07-28 16:36:42.687162 I [348944/348944] CoreContext mythsystemunix.cpp:934 (Fork) - Managed child (PID: 348981) has started! * command=/usr/share/mythtv/metadata/Television/ttvdb.py -v, timeout=0
2021-07-28 16:36:42.867856 I [348944/348967] SystemManager mythsystemunix.cpp:33
5 (run) - Managed child (PID: 348981) has exited! command=/usr/share/mythtv/metadata/Television/ttvdb.py -v, status=0, result=0
2021-07-28 16:36:42.885765 E [348944/348944] CoreContext xmltvparser.cpp:743 (parseFile) - Malformed XML file, missing </tv> element, at line 1, Premature end of document.
2021-07-28 16:36:43.797924 E [348944/348944] CoreContext main.cpp:407 (main) - Failed to fetch some program info
2021-07-28 16:36:43.797943 I [348944/348944] CoreContext main.cpp:417 (main) - Adjusting program database end times.
2021-07-28 16:36:43.798257 I [348944/348944] CoreContext main.cpp:422 (main) - 0 replacements made
2021-07-28 16:36:43.798259 I [348944/348944] CoreContext main.cpp:425 (main) - Marking generic episodes.
2021-07-28 16:36:44.794292 I [348944/348944] CoreContext main.cpp:436 (main) - Found 0
2021-07-28 16:36:44.794296 I [348944/348944] CoreContext main.cpp:439 (main) - Extending non-unique programids with multiple parts.
2021-07-28 16:36:44.991237 I [348944/348944] CoreContext main.cpp:490 (main) - Found 0
2021-07-28 16:36:44.991240 I [348944/348944] CoreContext main.cpp:492 (main) - Fixing missing original airdates.
2021-07-28 16:36:45.699938 I [348944/348944] CoreContext main.cpp:506 (main) - Found 0 with programids
2021-07-28 16:36:45.700361 I [348944/348944] CoreContext main.cpp:528 (main) - Found 0 without programids
2021-07-28 16:36:45.700363 I [348944/348944] CoreContext main.cpp:535 (main) - Marking repeats.
2021-07-28 16:36:46.643737 I [348944/348944] CoreContext main.cpp:548 (main) - Found 0
2021-07-28 16:36:46.643741 I [348944/348944] CoreContext main.cpp:551 (main) - Unmarking new episode rebroadcast repeats.
2021-07-28 16:36:47.625181 I [348944/348944] CoreContext main.cpp:560 (main) - Found 0
2021-07-28 16:36:50.592917 I [348944/348944] CoreContext main.cpp:570 (main) - Marking episode first showings.
2021-07-28 16:36:57.413458 I [348944/348944] CoreContext main.cpp:606 (main) - Found 120375
2021-07-28 16:36:57.413462 I [348944/348944] CoreContext main.cpp:608 (main) - Marking episode last showings.
2021-07-28 16:37:03.818790 I [348944/348944] CoreContext main.cpp:644 (main) - Found 120855
2021-07-28 16:37:03.851031 I [348944/348944] CoreContext main.cpp:660 (main) -
===============================================================
| Attempting to contact the master backend for rescheduling. |
| If the master is not running, rescheduling will happen when |
| the master backend is restarted. |
Found 0 without programids
2021-07-28 16:36:45.700363 I [348944/348944] CoreContext main.cpp:535 (main) - Marking repeats.
2021-07-28 16:36:46.643737 I [348944/348944] CoreContext main.cpp:548 (main) - Found 0
2021-07-28 16:36:46.643741 I [348944/348944] CoreContext main.cpp:551 (main) - Unmarking new episode rebroadcast repeats.
2021-07-28 16:36:47.625181 I [348944/348944] CoreContext main.cpp:560 (main) - Found 0
2021-07-28 16:36:50.592917 I [348944/348944] CoreContext main.cpp:570 (main) - Marking episode first showings.
2021-07-28 16:36:57.413458 I [348944/348944] CoreContext main.cpp:606 (main) - Found 120375
2021-07-28 16:36:57.413462 I [348944/348944] CoreContext main.cpp:608 (main) - Marking episode last showings.
2021-07-28 16:37:03.818790 I [348944/348944] CoreContext main.cpp:644 (main) - Found 120855
2021-07-28 16:37:03.851031 I [348944/348944] CoreContext main.cpp:660 (main) -
===============================================================
| Attempting to contact the master backend for rescheduling. |
| If the master is not running, rescheduling will happen when |
| the master backend is restarted. |
===============================================================
2021-07-28 16:37:03.851670 N [348944/348944] CoreContext main.cpp:674 (main) - mythfilldatabase run complete.
2021-07-28 16:37:03.851721 I [348944/348944] CoreContext platforms/mythpowerdbus.cpp:72 (~MythPowerDBus) - PowerDBus: Closing interfaces
2021-07-28 16:37:03.852012 I [348944/348944] CoreContext mythcontext.cpp:1659 (~MythContext) - Waiting for threads to exit.
2021-07-28 16:37:03.852248 I [348944/348944] CoreContext mythcontext.cpp:1665 (~MythContext) - Exiting
User avatar
bill6502
Developer
Posts: 2299
Joined: Fri Feb 07, 2014 5:28 pm
United States of America

Re: mythtv-setup version 31 Fedora 34 Schedules Direct

Post by bill6502 »

I fixed the comma that was a period in case anyone else follows this, I got the 1st example right.

The grabber command from the above is: tv_grab_zz_sdjson --config-file '/etc/mythtv/SchedulesDirect.xmltv' --output /tmp/mythrNDuON
and that should be run from the command line to find a clue to the failure.

When mythfilldatabase runs, the --output file is removed.

From the above, MYTHCONFDIR is set (and that's fine). It appears to be run
by user douglas, also OK. If the backend runs as user mythtv (or something
else), then be sure XMLTV files in /etc/mythtv are readable/writable by both.
dhighley
Junior
Posts: 18
Joined: Sun Jun 27, 2021 6:55 pm
United States of America

Re: mythtv-setup version 31 Fedora 34 Schedules Direct

Post by dhighley »

I have opened up permissions in the /etc/mythv area. I also created a watch task and tried hard linking to the /tmp file that was supposed to get created but I believe it does not happen. So I have made zero progress with this issue. I have run out of ideas on this issue. For now I can create a cron task to run myfilldatabase as my user which works.
Post Reply