[feed.py] Updating: not all feeds publish etags or modified headers #2

Open
opened 2022-01-01 07:34:09 +00:00 by aadil · 0 comments
Owner

copied over from lumbung-feed-aggregator repo

Currently the main way to check for updates is to check for date modified or etag headers returned from the feed source. Some systems such as tumblr and SPIP do not use this at all and therefore the feed is downloaded over and over again.

16cbeaedb0/rss_aggregator.py (L150)

Perhaps it is possible to derive another signature from the feed or have another way of checking whether an update is in order.

copied over from [`lumbung-feed-aggregator` repo](https://git.vvvvvvaria.org/rra/lumbung-feed-aggregator/issues/6) > Currently the main way to check for updates is to check for date modified or etag headers returned from the feed source. Some systems such as tumblr and SPIP do not use this at all and therefore the feed is downloaded over and over again. > > [16cbeaedb0/rss_aggregator.py (L150)](https://git.vvvvvvaria.org/rra/lumbung-feed-aggregator/src/commit/16cbeaedb017e80fe162b4206325b296fd3ab4d8/rss_aggregator.py#L150) > > Perhaps it is possible to derive another signature from the feed or have another way of checking whether an update is in order.
r changed title from Updating: not all feeds publish etags or modified headers to [feed.py] Updating: not all feeds publish etags or modified headers 2022-01-07 09:55:31 +00:00
Sign in to join this conversation.
No Label
No Milestone
No project
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: ruangrupa/konfluks#2
No description provided.