Twitter API - Twitter is run by massive faggots.

[James Smith]

In order to use the Twitter API developers have to apply for a developer account and describe what their application will do. If that description rustles the Twitter reviewer's jimmies the application is permanently denied with no appeals or reapplications available. The only way to try again is to make another Twitter account (which Twitter intentionally makes difficult to do more than once or twice) and try again with a different description.

I'd like to be able to effectively archive tweets like I do for DSP but the way I do it now doesn't keep track of replies as they arrive which I think would be cool. Does anyone know of any third party sites or tools that make accessing Twitter data easier than outright scraping HTML?

 

[MediocreMilt]

The Virgin Automator versus the CHAD WHO CONSTANTLY REFRESHES THE BROWSER

 

[⠠⠠⠅⠑⠋⠋⠁⠇⠎ ⠠⠠⠊⠎ ⠠⠠⠁ ⠠⠠⠋⠁⠛]

In order to use the Twitter API developers have to apply for a developer account and describe what their application will do. If that description rustles the Twitter reviewer's jimmies the application is permanently denied with no appeals or reapplications available. The only way to try again is to make another Twitter account (which Twitter intentionally makes difficult to do more than once or twice) and try again with a different description.

I'd like to be able to effectively archive tweets like I do for DSP but the way I do it now doesn't keep track of replies as they arrive which I think would be cool. Does anyone know of any third party sites or tools that make accessing Twitter data easier than outright scraping HTML?

Twint is an excellent tool for scraping Twitter data. It's been a while since I used it to capture replies/retweets, but I believe it still has that capability.

I believe you would need to run multiple passes regardless of whether there are new replies to get what you want, though Twint does support Twitter search queries (i.e. the 'from:' and 'until:' parameters) so maybe things could be pruned down that way. You could just run a full capture of everything from the past week every day/hour and do whatever postprocessing you want after that.

twintproject/twint

An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most ...

github.com

 

[James Smith]

Twint is an excellent tool for scraping Twitter data. It's been a while since I used it to capture replies/retweets, but I believe it still has that capability.

Thanks that sounds awesome.

 

[Stoneheart]

In order to use the Twitter API developers have to apply for a developer account and describe what their application will do.

Let me guess, you need to use a phonenumber for that because the email verifivation is broken?