[feed.py] Updating: not all feeds publish etags or modified headers #2

New Issue

aadil · 2022-01-01T07:34:09Z

aadil commented

2022-01-01 07:34:09 +00:00

copied over from lumbung-feed-aggregator repo

Currently the main way to check for updates is to check for date modified or etag headers returned from the feed source. Some systems such as tumblr and SPIP do not use this at all and therefore the feed is downloaded over and over again.

16cbeaedb0/rss_aggregator.py (L150)

Perhaps it is possible to derive another signature from the feed or have another way of checking whether an update is in order.

copied over from [`lumbung-feed-aggregator` repo](https://git.vvvvvvaria.org/rra/lumbung-feed-aggregator/issues/6) > Currently the main way to check for updates is to check for date modified or etag headers returned from the feed source. Some systems such as tumblr and SPIP do not use this at all and therefore the feed is downloaded over and over again. > > [16cbeaedb0/rss_aggregator.py (L150)](https://git.vvvvvvaria.org/rra/lumbung-feed-aggregator/src/commit/16cbeaedb017e80fe162b4206325b296fd3ab4d8/rss_aggregator.py#L150) > > Perhaps it is possible to derive another signature from the feed or have another way of checking whether an update is in order.

r changed title from ~~Updating: not all feeds publish etags or modified headers~~ to [feed.py] Updating: not all feeds publish etags or modified headers

2022-01-07 09:55:31 +00:00

Sign in to join this conversation.

No Label

No Milestone

No project

No Assignees

1 Participants

Notifications

Due Date

The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: ruangrupa/konfluks#2