Twitter media best practice / tips ? #8358
Unanswered
illudonite
asked this question in
Q&A
Replies: 1 comment
-
|
Related |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I found #4618 (reply in thread) from looking through the search, but as it was two years old already, I figured that Twitter restrictions have only gone downhill from then . . .
Are there any recent tips / best practice when scraping for media from twitter ?
What I'm planning to scrape:
My main questions:
I think gallery-dl already has some default rate limit & random delay built in, but is it still possible to get banned / flagged from twitter while doing this ? Since I have to use my main to scrape private accounts, I would prefer if there's a way to do it without raising flags . . .
for public accounts I plan to create a new account to scrape them, is there a minimum account age / follow(er) / other criteria for it to function properly (not heavily rate limited) ?
since the search function is heavily crippled, is there any recommended filter that might help finding more posts ?
(e.g. from personal experience with twitter web / app, I find more posts when using min. faves & date-from/to than normal search)
(As a last resort), will having premium help with the rate limit / search functionality ? As much as I hate the idea, I think it's not too bad as a one-off for a huge list of things I want to scrape . . .
Any other tips is greatly appreciated !
Beta Was this translation helpful? Give feedback.
All reactions