Tiny Tiny RSS seems to be omitting entries

Support requests, bug reports, etc. go here. Dedicated servers / VDS hosting only
Telofy
Bear Rating Trainee
Bear Rating Trainee
Posts: 9
Joined: 30 Mar 2013, 18:12

Tiny Tiny RSS seems to be omitting entries

Postby Telofy » 24 Jun 2013, 19:37

Hi Fox, hi forum,

I’m using the Tiny Tiny RSS master branch (commit 1ed69dc5f587), which seems to be in the habit of omitting entries, and I can’t see what may be causing it. I already ticked “Allow duplicate articles,” but that didn’t.

A static snapshot of my feed can be found here. Since it includes entries from third-party sources, it sometimes gets “infected” with their errors (invalid IDs, bogus markup, etc.). I purged the pertaining entries from the feed.

As baseline, here the titles according to the Python Feedparser library (45 entries).

Code: Select all

Canterlot Radio - Episode #15 - Jun 26,2013
Discovery Press Pagediff Alert: 0.991333333333
Zap2it Episode Guide Pagediff Alert: 0.97691624741
Zap2it Episode Guide Pagediff Alert: 0.554095488392
Editorial: Hype. Equestria Girls, EQD, Episode Followups, and Twilight Sparkle
Zap2it Episode Guide Pagediff Alert: 0.974786401386
Zap2it Episode Guide Pagediff Alert: 0.946633571207
Nightly Roundup #694
Great opportunities for BG Layout & Colour Artists to join our team on a new series this Summer! dhxmedia.com/careers/399-de…
Everfree Events - BronyCon Announces: Brenda Crichlow attending!
Everfree Events - Sweet Apple Con Announces: Change of Venue
Bluescreen Bronies Episode 33 is Live!
Music of the Day #130
Random Media: Dash's Mom / SFM: Footprints on the Moon / Summer in Ponyville Episode Three - Say "What" One More Time!
Discovery Channel Captures Nik Wallenda’s Historic Tightrope Crossing Over the Grand Canyon
Movie Followup: "Equestria Girls"
Bluescreen Bronies Episode 33 - Grand Galloping E3
Happy National Pink Day! #MyLittlePony #PinkiePie
Recent Hasbro Press Release on MLP
Wallpaper Compilation #92
sci – PLAYFUL PONI MUSIC!!! ^___^
Large Pinkie Pie Figure
Film Matters Publishes Essay On Bronies
Upcoming MLP Merchandise in Japan (Tokyo Toy Show 2013)
Plushie Compilation #118
Questria: Princess Destiny Fundraiser
Scootareader Looks Into: Charity
Horse Painted Like Rainbow Dash in Russia
Spotlight Music: Up in Cloudsdale / Hard to Exist / Shadow & Light
RIVALRIES - Baseball - Chicago Cubs & St. Louis Cardinals
What's Wrong With This Picture?
Fantasy Anime My Little Pony:  Episode 1
Drawfriend Stuff #843
Review: My Little Pony: Equestria Girls
Sunday Morning Comics 64
Zap2it Episode Guide Pagediff Alert: 0.960732289732
Kallisti III Interview: Anneli Head
Story Updates - June 23rd
Kallisti III Interview: Andrea Libman
Kallisti III Interview: M.A. Larson
Kallisti III Interview: Amy Keating Rogers
Artsy-Wartsy Stuff #291 + Comics
[Random] Title is TL;DR
#ALF doing his best #DonDraper impression: ow.ly/i/2qdtS
Comic: Rarity, Get Your Sword / Raritvy Vs. a Giant Crab / Karts


Below the result of the immediately following database query. (feed_id = 13 being the same static snapshot of my actual feed.)

Code: Select all

select left(title, 80), updated, date_updated, date_entered from ttrss_user_entries join ttrss_entries on id = ref_id where feed_id = 13 order by updated desc;


Code: Select all

                                       left                                       |       updated       |        date_updated        |    date_entered     
----------------------------------------------------------------------------------+---------------------+----------------------------+---------------------
 Canterlot Radio - Episode #15 - Jun 26,2013                                      | 2013-06-24 12:27:00 | 2013-06-24 15:16:28.52744  | 2013-06-24 07:46:00
 Great opportunities for BG Layout & Colour Artists to join our team on a new | 2013-06-24 04:40:23 | 2013-06-24 15:16:28.846712 | 2013-06-24 07:46:00
 Everfree Events - Sweet Apple Con Announces: Change of Venue                     | 2013-06-24 04:15:25 | 2013-06-24 15:16:28.864244 | 2013-06-17 21:49:00
 Discovery Channel Captures Nik Wallenda’s Historic Tightrope Crossing Over the G | 2013-06-24 02:36:58 | 2013-06-24 15:16:29.04108  | 2013-06-24 13:06:00
 Bluescreen Bronies Episode 33 - Grand Galloping E3                               | 2013-06-24 01:43:55 | 2013-06-24 15:16:29.462051 | 2013-06-17 09:14:00
 Happy National Pink Day! #MyLittlePony #PinkiePie                                | 2013-06-24 01:16:15 | 2013-06-24 15:16:29.470716 | 2013-06-17 09:14:00
 Upcoming MLP Merchandise in Japan (Tokyo Toy Show 2013)                          | 2013-06-24 00:05:00 | 2013-06-24 15:16:29.804993 | 2013-06-18 21:25:00
 Scootareader Looks Into: Charity                                                 | 2013-06-23 22:39:16 | 2013-06-24 15:16:30.014773 | 2013-06-17 09:14:00
 RIVALRIES - Baseball - Chicago Cubs & St. Louis Cardinals                        | 2013-06-23 20:46:24 | 2013-06-24 15:16:30.507209 | 2013-06-20 20:24:00
 Fantasy Anime My Little Pony:  Episode 1                                         | 2013-06-23 20:05:59 | 2013-06-24 15:16:30.528048 | 2013-06-17 09:14:00
 Review: My Little Pony: Equestria Girls                                          | 2013-06-23 19:56:20 | 2013-06-24 15:16:30.687046 | 2013-06-18 03:10:00
 Sunday Morning Comics 64                                                         | 2013-06-23 19:41:27 | 2013-06-24 15:16:30.699791 | 2013-06-17 09:14:00
 Zap2it Episode Guide Pagediff Alert: 0.960732289732                              | 2013-06-23 19:20:44 | 2013-06-24 15:16:30.714397 | 2013-06-17 09:14:00
 Story Updates - June 23rd                                                        | 2013-06-23 19:04:35 | 2013-06-24 15:16:31.138596 | 2013-06-17 09:14:00
 Kallisti III Interview: Amy Keating Rogers                                       | 2013-06-23 19:03:52 | 2013-06-24 15:16:32.231937 | 2013-06-21 13:05:00
 [Random] Title is TL;DR                                                          | 2013-06-23 17:35:19 | 2013-06-24 15:16:32.264502 | 2013-06-17 09:14:00
(16 rows)


When I added the feed, Tiny Tiny RSS showed me a JSON parsing error and the attached feed updater log.

Code: Select all

SyntaxError, JSON.parse: expected ',' or ']' after array element
Function: subscribeToFeed()
Location: prefs.php:150


Any ideas what may be going on here?

Many thanks!
Telofy
Attachments
pony.atom.log
Updater log displayed when adding the feed with DAEMON_EXTENDED_DEBUG set to true.
(52.92 KiB) Downloaded 69 times

Telofy
Bear Rating Trainee
Bear Rating Trainee
Posts: 9
Joined: 30 Mar 2013, 18:12

Re: Tiny Tiny RSS seems to be omitting entries

Postby Telofy » 25 Jun 2013, 13:21

Alrighty, did some digging.

I’m not too well versed in PHP but it would seem to me that

Code: Select all

$id = $this->elem->getElementsByTagName("id")->item(0);
in classes/feeditem/atom.php selects the id element from atom:source (which every entry on my feed has) rather than the id of the entry itself. As a result, I only get one element from each source feed.

Has SimplePie been removed entirely, or can I still switch back to it until this is fixed?

Thanks in advance!

User avatar
sleeper_service
Bear Rating Overlord
Bear Rating Overlord
Posts: 884
Joined: 30 Mar 2013, 23:50
Location: Dallas, Texas

Re: Tiny Tiny RSS seems to be omitting entries

Postby sleeper_service » 25 Jun 2013, 13:36

Telofy wrote:Has SimplePie been removed entirely, or can I still switch back to it until this is fixed?


I find your lack of faith disturbing.

User avatar
fox
^ me reading your posts ^
Posts: 6318
Joined: 27 Aug 2005, 22:53
Location: Saint-Petersburg, Russia
Contact:

Re: Tiny Tiny RSS seems to be omitting entries

Postby fox » 25 Jun 2013, 14:30

Atom is a p fucked up format.

Edit: lol mlp shit, oh god. Maybe not being compatible with that should be a feature or something.

User avatar
blainemono
Gaping Anus of Eternity
Gaping Anus of Eternity
Posts: 246
Joined: 05 Jun 2009, 18:13

Re: Tiny Tiny RSS seems to be omitting entries

Postby blainemono » 25 Jun 2013, 14:37

Image

User avatar
fox
^ me reading your posts ^
Posts: 6318
Joined: 27 Aug 2005, 22:53
Location: Saint-Petersburg, Russia
Contact:

Re: Tiny Tiny RSS seems to be omitting entries

Postby fox » 25 Jun 2013, 14:44

Try this patch: https://github.com/gothfox/Tiny-Tiny-RS ... 2e427a913a

and maybe don't mlp ew

Telofy
Bear Rating Trainee
Bear Rating Trainee
Posts: 9
Joined: 30 Mar 2013, 18:12

Re: Tiny Tiny RSS seems to be omitting entries

Postby Telofy » 25 Jun 2013, 15:02

Way too late for that. Just Google my name; I’m hopelessly lost in Equestria, have been since 2011.

Also, Atom is awesome, at least compared to RSS. I’d much prefer a JSON-based format.

Thanks for the patch; my first impression is that it works!
Last edited by Telofy on 25 Jun 2013, 15:11, edited 1 time in total.

User avatar
blainemono
Gaping Anus of Eternity
Gaping Anus of Eternity
Posts: 246
Joined: 05 Jun 2009, 18:13

Re: Tiny Tiny RSS seems to be omitting entries

Postby blainemono » 25 Jun 2013, 15:05

> Just Google my name;

protip: DON'T

User avatar
fox
^ me reading your posts ^
Posts: 6318
Joined: 27 Aug 2005, 22:53
Location: Saint-Petersburg, Russia
Contact:

Re: Tiny Tiny RSS seems to be omitting entries

Postby fox » 25 Jun 2013, 15:08

do you have a fedora wait don't answer

Telofy
Bear Rating Trainee
Bear Rating Trainee
Posts: 9
Joined: 30 Mar 2013, 18:12

Re: Tiny Tiny RSS seems to be omitting entries

Postby Telofy » 25 Jun 2013, 15:13

fox wrote:do you have a fedora wait don't answer


I don’t actually; I’m a contrarian like that, or maybe I have meta hipster aspirations. (But they are pretty cool.)

cqrt
Bear Rating Disaster
Bear Rating Disaster
Posts: 70
Joined: 05 Apr 2013, 00:37

Re: Tiny Tiny RSS seems to be omitting entries

Postby cqrt » 25 Jun 2013, 18:51

Biggest motivator to google/search/research to fix your own shit, is not having to reveal your feed sources.

Telofy
Bear Rating Trainee
Bear Rating Trainee
Posts: 9
Joined: 30 Mar 2013, 18:12

Re: Tiny Tiny RSS seems to be omitting entries

Postby Telofy » 25 Jun 2013, 19:39

Naw, I help run several of those blogs, so I’m always proud when I can include them in bug reports.

But admittedly there are feed sources I would’ve surreptitiously removed if I had been following them in the first place. Oh, I’m a bad fandom advocate, but it’s in keeping with the (paraphrased) discordian saying that whoever isn’t with us is with us still.


Return to “Support”

Who is online

Users browsing this forum: No registered users and 5 guests