Spiegel RSS feed no longer working

Support requests, bug reports, etc. go here. Dedicated servers / VDS hosting only
bratscher
Bear Rating Trainee
Bear Rating Trainee
Posts: 1
Joined: 10 Nov 2013, 15:36

Spiegel RSS feed no longer working

Postby bratscher » 10 Nov 2013, 15:51

Hi all,

I'm interested if someone else experienced this problem. Since several days the RSS feed by Spiegel online no longer works with ttrss:

http://www.spiegel.de/schlagzeilen/index.rss

I'm running ttrss 1.10 on a self hosted machine running Ubuntu 12.04 LTS, 64-bit with apache 2.2.22. PHP is version 5.3.10.
Postgres in 9.1.10. No ttrss plugins are enabled.

The interesting thing is that I haven't performed any updates inbetween.

The android clients shows the same behaviour.

Is there more I can do to pinpoint that problem?

Regards,

bratscher

saedelaere
Bear Rating Trainee
Bear Rating Trainee
Posts: 2
Joined: 10 Nov 2013, 13:17

[1.10] One Feed is not updating

Postby saedelaere » 10 Nov 2013, 16:18

Hi,


I have installed Tiny Tiny RSS on my Debain Wheezy and I am very happy with it. So far mostly everything works perfect. I am using the update daemon (update_daemon2.php) to get the latest feeds.
I have problems with one german news portal www.spiegel.de

It offers different RSS feeds
http://www.spiegel.de/schlagzeilen/tops/index.rss
http://www.spiegel.de/schlagzeilen/index.rss

But none of them work. I don't get any updates. I can see one or two articles sometimes but thats it.
Funnily I found out they also provide an RSS Feed via their mobile website and this one is working:

http://ml.spiegel.de/rss.do

Anyone an idea what the problem could be?

Thanks for this great application!
Last edited by saedelaere on 10 Nov 2013, 23:58, edited 1 time in total.

Latimer
Bear Rating Master
Bear Rating Master
Posts: 131
Joined: 17 Mar 2013, 19:35

Re: Spiegel RSS feed no longer working

Postby Latimer » 10 Nov 2013, 21:56

Feed validator results: This feed does not validate

saedelaere
Bear Rating Trainee
Bear Rating Trainee
Posts: 2
Joined: 10 Nov 2013, 13:17

Re: Spiegel RSS feed no longer working

Postby saedelaere » 11 Nov 2013, 00:01

Just found something on twitter
https://twitter.com/search?q=SPIEGEL%20ONLINE%20RSS&src=typd

So they say that they have changed their RSS feeds and know about the problem. Unfortunately I started using Tiny Tiny RSS on the same day and thought something would be wrong with my settings :D

Latimer
Bear Rating Master
Bear Rating Master
Posts: 131
Joined: 17 Mar 2013, 19:35

Re: Spiegel RSS feed no longer working

Postby Latimer » 11 Nov 2013, 01:34

There was a plugin that was fixing broken ids in one of the xkcd feeds. You can try to repurpose it for Spiegel's feeds if nothing else helps.

e: af_whatif

Marty
Bear Rating Trainee
Bear Rating Trainee
Posts: 9
Joined: 30 Apr 2013, 01:15

Re: Spiegel RSS feed no longer working

Postby Marty » 11 Nov 2013, 23:56

On Twitter people are reporting that SPIEGEL ONLINE works again in Feedly. But still no updates in tt-rss! :x
SPON doesn't seem to have changed their feeds - all the articles have still the same <guid>!
After reading their response to my mail, I'm not sure if SPON is really working on the problem... :(

Does anyone know how to make the feeds work again - maybe using the ff_FeedCleaner or the af_whatif plugin? :?:

feader
Bear Rating Master
Bear Rating Master
Posts: 160
Joined: 26 Dec 2012, 20:03

Re: Spiegel RSS feed no longer working

Postby feader » 12 Nov 2013, 01:18

Marty wrote:Does anyone know how to make the feeds work again - maybe using the ff_FeedCleaner or the af_whatif plugin? :?:


I think a similar case was discussed on the forum some time ago. You can try to use ff_FeedCleaner with

Code: Select all

[
   {
      "URL": "spiegel.de",
      "type": "xpath_regex",
      "xpath": "//item/guid",
      "pattern": "/.+/",
      "replacement": ""
   }
]

in its config. ttRSS should then use the <link> tag to create the (internal) article guids.

e: Old config didn't work.
e2: Should work with versions ≥ dded7ae.
Last edited by feader on 12 Nov 2013, 23:59, edited 2 times in total.

sesom
Bear Rating Trainee
Bear Rating Trainee
Posts: 2
Joined: 10 Nov 2013, 10:56

Re: Spiegel RSS feed no longer working

Postby sesom » 12 Nov 2013, 17:46

Marty wrote:... maybe using the ff_FeedCleaner or the af_whatif plugin? :?:


Neither one fixes that problem for me. :(

Latimer
Bear Rating Master
Bear Rating Master
Posts: 131
Joined: 17 Mar 2013, 19:35

Re: Spiegel RSS feed no longer working

Postby Latimer » 12 Nov 2013, 20:30

Another thing to consider would be to roll your own feed with yahoo pipes.

User avatar
fox
^ me reading your posts ^
Posts: 6318
Joined: 27 Aug 2005, 22:53
Location: Saint-Petersburg, Russia
Contact:

Re: Spiegel RSS feed no longer working

Postby fox » 12 Nov 2013, 20:42

One could also consider choosing one of the news outlets that don't actively shit on their userbase.

feader
Bear Rating Master
Bear Rating Master
Posts: 160
Joined: 26 Dec 2012, 20:03

Re: Spiegel RSS feed no longer working

Postby feader » 12 Nov 2013, 21:35

sesom wrote:
Marty wrote:... maybe using the https://github.com/wltb/ff_feedcleaner or the af_whatif plugin? :?:


Neither one fixes that problem for me. :(

The config for ff_FeedCleaner I posted yesterday did indeed fail to remove the guids, I edited the post. This one should work.

reibuehl
Bear Rating Trainee
Bear Rating Trainee
Posts: 25
Joined: 17 May 2013, 19:37

Re: Spiegel RSS feed no longer working

Postby reibuehl » 12 Nov 2013, 21:47

feader wrote:The config for ff_FeedCleaner I posted yesterday did indeed fail to remove the guids, I edited the post. This one should work.


Yes, the new code works. Thanks very much for sharing it!

BTW: Do you also have a solution for the new link format of this feed that redirects you to the homepage first instead of linking to the article?

feader
Bear Rating Master
Bear Rating Master
Posts: 160
Joined: 26 Dec 2012, 20:03

Re: Spiegel RSS feed no longer working

Postby feader » 12 Nov 2013, 23:55

reibuehl wrote:BTW: Do you also have a solution for the new link format of this feed that redirects you to the homepage first instead of linking to the article?

No. I believe I have seen Spiegel articles referenced by a number only, and I conjecture that in the URL http://www.spiegel.de/#ai=933259&aitype=rss&ref=rss
it is the one after the ai=. You can toy around with

Code: Select all

[
   {
      "URL": "spiegel.de",
      "type": "xpath_regex",
      "xpath": "//item/link",
      "pattern": "[(http://www.spiegel.de)#ai=([0-9]+)&.*]",
      "replacement": "$1?$2?"
   }
]

in ff_FeedCleaner, where you have to figure out what to put in the replacement part.

IMO Spiegel content is not worth the hassle, so don't expect me to do any more in this matter. FWIW, the original guid fixer should work with versions ≥ dded7ae.

niehztog
Bear Rating Trainee
Bear Rating Trainee
Posts: 2
Joined: 17 Oct 2013, 09:13

Re: Spiegel RSS feed no longer working

Postby niehztog » 13 Nov 2013, 00:25

I experimented a bit with Yahoo Pipes, and this is my result:
http://pipes.yahoo.com/pipes/pipe.run?_ ... render=rss

fixes broken guid and links
Last edited by niehztog on 13 Nov 2013, 02:09, edited 1 time in total.

xaberus
Bear Rating Trainee
Bear Rating Trainee
Posts: 14
Joined: 20 Mar 2013, 15:02

Re: Spiegel RSS feed no longer working

Postby xaberus » 13 Nov 2013, 01:27

seems to work with:

Code: Select all

[
   {
      "URL": "spiegel.de",
      "type": "xpath_regex",
      "xpath": "//item/link",
      "pattern": "[(http://www.spiegel.de)#ai=([0-9]+)&.*]",
      "replacement": "$1/artikel/a-$2.html"
   }
]


feader wrote:IMO Spiegel content is not worth the hassle.

what alternatives do you suggest :-)


Return to “Support”

Who is online

Users browsing this forum: No registered users and 3 guests