[SOLVED] Problems obtaining data from schedulesdirect.org

Have a MythTV related problem? Ask for help from other MythTV users here.

Moderator: Forum Moderators

Post Reply
tobim
Newcomer
Posts: 4
Joined: Sun Nov 09, 2014 8:15 pm
United States of America

[SOLVED] Problems obtaining data from schedulesdirect.org

Post by tobim »

Hello!

I recently set up Mythtv (now 0.27.4) on a general-purpose (i.e. not dedicated) Fedora 20 Linux box, with an HDHomerun HDHR4-2US. I am using it to record digital over-the-air TV in the US.

I cannot get program guide downloads from schedulesdirect.org to work. In mythtvsetup, under "Video Sources", I put in my schedulesdirect account info, where I have set up a channel lineup; however, when I try to retrive this lineup, a progress bar briefly appears at 50%, then disappears, but no lineups show up. By the way, if I purposely put in a wrong user name or password, the result is the same.

At one point in the past it did work, and so when I first pull up the screen for the appropriate Video Source, it defaults to that lineup (which should still exist). Or maybe it manages to connect and downloads it fresh; hard to tell. At any rate, when I try to retrive channels manually, the above happens.

Running mythfilldatabase yields a bunch of "DataDirect: Failed to get data: Download error", one for each day. I attach a log.

Having searched these forums, I have tried changing my username/password to alphanumeric only, as well as to remove all but one channel from the lineup. So far, to no avail.

Any ideas?

P.S.: By the way, the attached log file was generated while mythbackend was not running. However, doing mythfilldatabase while mythbackend is running makes no difference in this regard.

Thanks!
mythfilldatabase.20141109185926.4926.log
mythfilldatabase log
(26.45 KiB) Downloaded 126 times
Last edited by tobim on Tue Nov 11, 2014 5:04 am, edited 1 time in total.
User avatar
bill6502
Developer
Posts: 2437
Joined: Fri Feb 07, 2014 5:28 pm
United States of America

Re: Problems obtaining data from schedulesdirect.org

Post by bill6502 »

tobim wrote: Any ideas?
Maybe. Schedules Direct has set up a feature that prevents too many connections and bans users if they exceed it
(fail2ban.) The last limit I read about was 40 HTTP queries in 1 hour. If you've been testing frequently, you may be
locked out for 24 hours.

I'd recommend running mfdb like this (assuming you don't have an underpowered backend):

Code: Select all

mythfilldatabase -v file,network --loglevel debug --logpath /tmp --dd-grab-all
If you are being banned, then you'll see some authentication errors in the log file.

You mentioned that this did work, but the text:
No channels are configured to use grabber.
isn't what I'd expect, rather a line containing:
Found X channels for source Y which use grabber
tobim
Newcomer
Posts: 4
Joined: Sun Nov 09, 2014 8:15 pm
United States of America

Re: Problems obtaining data from schedulesdirect.org

Post by tobim »

Hi, Bill6502!

First of all, thanks for your quick and thoughtful reply. While I have been testing this frequently, I'm not sure if it was frequent enough to get me banned... :o

I did run mythfilldatabase with the parameters you suggest and am attaching the new log file.

The line that would immediately jump out at me is:

Code: Select all

2014-11-09 17:50:08.071230 D [4444/4454] DownloadManager mythdownloadmanager.cpp:1003 (downloadError) - DownloadManager: downloadError 1 Connection refused
But not sure what else to make of what's going on. It is quite possible that I have something else screwed up in the configuration, as this is my first time setting up mythtv on anything.

If it's any help, watching TV, scheduling manual recordings, and even scheduling recordings based on EIT retrieval works fine at this point.

What made me think that something worked at some point, is that when I load the Video Sources configuration screen, there is the name of a channel lineup there, called 'PC:<my-zip-code-which-I-entered-into-schedulesdirect>'. On the other hand, though, again this is my first try with mythtv, so I'm not sure how else I could tell if things were working at some point. I don't think I ever saw anything that positive in mythfilldatabase.

Thanks again for the help!
Attachments
mythfilldatabase.20141109235858.4692.log
(12.27 KiB) Downloaded 149 times
User avatar
bill6502
Developer
Posts: 2437
Joined: Fri Feb 07, 2014 5:28 pm
United States of America

Re: Problems obtaining data from schedulesdirect.org

Post by bill6502 »

If it's any help, watching TV, scheduling manual recordings, and even scheduling recordings based on EIT retrieval works fine at this point.
The previous post suggests that you were, in fact, banned. Good news is that the SD developer is planning on putting some kind of message on their page,
so you wouldn't have to guess. I haven't proven it, but if something other than --dd-grab-all is used, then there might be more than 3 HTTP requests per
mfdb run. E.g. with --max-days=14.

If 24 hours has passed, you should be able run mythfilldatabase OK. But, you should never have it and EIT active at the same time.
One will stomp on the other, just in case you didn't already know.
tobim
Newcomer
Posts: 4
Joined: Sun Nov 09, 2014 8:15 pm
United States of America

Re: Problems obtaining data from schedulesdirect.org

Post by tobim »

YAY! I got it working.

Maybe waiting got me un-banned. One other thing I did, though, was go to "input Sources" and select "Fetch Channels From Listings Source". Not sure if that was related, but after that it worked.

Thanks so much for your tips, Bill6502.

I will mark this solved if I can figure out how to edit the subject line.
tobim
Newcomer
Posts: 4
Joined: Sun Nov 09, 2014 8:15 pm
United States of America

Re: [SOLVED] Problems obtaining data from schedulesdirect.or

Post by tobim »

Oh, and thanks also for the tip about EIT stomping the scheduledirect info. I had read this somewhere, but it's good to hear it.

At any rate, leaving mythbackend running and letting it automatically scan EIT info whenever it felt like, made it somehow lose connection to the tuner box. But that is a story for a different day.

Thanks again!
Post Reply