twitter

Nina
04/24/2017 02:35 am
Hello,
I recently wanted to download somebody's twitter feed only. So I set the download level filter to zero and scrolling to 999 to hopefully get the whole feed. The page showed up fine but it did not scroll down even once and instead browsed off into the help section etc. on twitter. What is gong on there?
Thanks
Oleg Chernavin
04/24/2017 02:36 am
Can you please give me the address of the Twitter page? I will see what could be done.

Thank you!

Best regards,
Oleg Chernavin
MP Staff
Nina
04/24/2017 04:28 am
Hi so this is the persons media feed, thats what I wanted to get https://twitter.com/overloved/with_replies
Thanks
Oleg Chernavin
04/25/2017 07:08 am
I tried to view this feed in a web browser online, but Twitter reports an error after displaying 20 or so posts.

Can you please try to see if it happens the same way? I used Chrome and FireFox browsers.

Thank you!

Oleg.
Nina
04/25/2017 07:45 am
Hi,
I just scrolled down more than ten times in firefox and it was fine. Thats my standard browser so it shud be ok I guess.
Thanks
Oleg Chernavin
04/25/2017 08:00 pm
I was able to improve the scroll code. Here is the new version:

http://www.metaproducts.com/download/betas/opsetup.exe

I also noticed that Twitter doesn't allow to scroll at all without logging into it. So, I would suggest you to open the Twitter page online in the Internal Browser first to make sure you logon there. And the start the download. Level=0 is enough for Twitter page.

Oleg.
Nina
04/26/2017 06:33 am
Hello,
This time it worked much better and scrolled a few times but then it stopped and went of to youtube. Also how can I get the embedded videos? would I need to set level 1 for that and only enable videos?
Thanks
Nina
05/02/2017 09:01 am
Hello,
I now noticed that twitter poses a limit on the number of tweets you can load. So thats why it stopped. Now Im just trying to get the youtube videos and vine on twitter too. I know all crawling software always has problems with youtube so a list of the youtube links that the offline explorer has found could be an alternative.
Thanks
Oleg Chernavin
05/02/2017 09:32 am
Yes, I am working on YouTube videos now. I noticed that it downloads them sometimes and sometimes - fails.

I hope to have a fix for it today or tomorrow.

Thank you!

Oleg.