Extension of the maximum "What's new"-tab backlog from 500 to 1000 possible tiles

[Plugdemholes-Imeanpatchdembugs]

Checklist

• I made sure that there are no existing issues - open or closed - which I could contribute my information to.
• I have read the FAQ and my problem isn't listed.
• I'm aware that this is a request for NewPipe itself and that requests for adding a new service need to be made at NewPipeExtractor.
• I have taken the time to fill in all the required details. I understand that the feature request will be dismissed otherwise.
• This issue contains only one feature request.
• I have read and understood the contribution guidelines.

Feature description

Hi :)
I've noticed, the first time ever after a months of absence from my tablet that the feed backlog is limited to 500 tiles, so I currently can't see the other two weeks. It's very rare occasion I guess but could the feed be extended to a maximum of 1000 tiles if possible? :)

Why do you want this feature?

I can't see the rest of the videos that were uploaded in one month of absence, the maximum tiles of 500 "recent" uploads were exceeded. :)

Additional information

no further remarks

[TobiGr]

This is the limit you are talking about, I guess:

NewPipe/app/src/main/java/org/schabi/newpipe/database/feed/dao/FeedDAO.kt

Lines 85 to 94 in 1408150

	ORDER BY s.upload_date IS NULL DESC, s.upload_date DESC, s.uploader ASC
	LIMIT 500
	"""
	)
	abstract fun getStreams(
	groupId: Long,
	includePlayed: Boolean,
	includePartiallyPlayed: Boolean,
	uploadDateBefore: OffsetDateTime?
	): Maybe<List<StreamWithState>>

It is there to keep the query fast and memory usage low. I think we could even reduce the limit to ~200 because it is unusual to look further back. Especially because the feed only contains streams that were published in the last 13 weeks. Instead we could implement lazy loading more items when reaching the end of the displayed list.

[Plugdemholes-Imeanpatchdembugs]

This would be awesome! :)
I myself didn't think I'd ever have to load in so many videos at once. But here I am with my ~170 subscriptions and look and see it's a backlog of more than 500 in just one month. ^^"

[chirag-urb]

Yes, I would also like this feature to be implemented.

[brwnz]

This is the limit you are talking about, I guess:

NewPipe/app/src/main/java/org/schabi/newpipe/database/feed/dao/FeedDAO.kt

Lines 85 to 94 in 1408150

	ORDER BY s.upload_date IS NULL DESC, s.upload_date DESC, s.uploader ASC
	LIMIT 500
	"""
	)
	abstract fun getStreams(
	groupId: Long,
	includePlayed: Boolean,
	includePartiallyPlayed: Boolean,
	uploadDateBefore: OffsetDateTime?
	): Maybe<List<StreamWithState>>

It is there to keep the query fast and memory usage low. I think we could even reduce the limit to ~200 because it is unusual to look further back. Especially because the feed only contains streams that were published in the last 13 weeks. Instead we could implement lazy loading more items when reaching the end of the displayed list.

Yes, the 'lazy loading' of new more items would the best/optimal solution. You can than limit the number of initial items, and allow users to fetch more items when needed.
This would personally help me, as I need to be able to go back and rewatch/find previous videos, but cannot remember which subscription they were in. This is also how it works in FreeTube on GNU/Linux