Comments on: Scrape Twitter Followers https://webrobots.io/scrape-twitter-followers/ We do web scraping service better! Mon, 04 Mar 2019 14:22:14 +0000 hourly 1 https://wordpress.org/?v=6.5.8 By: andreas https://webrobots.io/scrape-twitter-followers/#comment-308 Thu, 01 Mar 2018 15:03:26 +0000 http://webrobots.io/?p=5257#comment-308 Great tool :-)
Is there a way to extend this scraper in order to automatically get “followers of followers”?
I would like to generate ego-networks starting from one account (=start URL) and including this accounts followers and their followers and so on (up to a predefined number of steps).
The output should then also include a collumn for the user currently in focus (in order to reconstruct the social network).

]]> By: nicerobot https://webrobots.io/scrape-twitter-followers/#comment-98 Tue, 29 Dec 2015 15:03:07 +0000 http://webrobots.io/?p=5257#comment-98 In reply to robin.

It may be flaky depending on how responsive Twitter’s infinite scroll data loading is.

You may want to play with variables on these two lines:
if (bottomCount < 5) { <-- increase from 5 to let's say 10 setTimeout(done, 1000); <-- change 1000 to 3000

]]> By: robin https://webrobots.io/scrape-twitter-followers/#comment-96 Tue, 22 Dec 2015 00:38:57 +0000 http://webrobots.io/?p=5257#comment-96 This works, but only outputs 6 followers out of 10k. What is wrong

]]> By: nicerobot https://webrobots.io/scrape-twitter-followers/#comment-90 Thu, 03 Dec 2015 13:55:57 +0000 http://webrobots.io/?p=5257#comment-90 In reply to michael.

Someone was playing around with the robot code. Remember, it is public – anyone can use it.
Robot works now – I just ran it on your link. Result with about 2.5k followers is here: http://portal.webrobots.io/runs/twitter_followers_2015-12-03T13_50_01_993Z

Web Robots Team

]]> By: michael https://webrobots.io/scrape-twitter-followers/#comment-77 Mon, 02 Nov 2015 20:56:39 +0000 http://webrobots.io/?p=5257#comment-77 Hi there,

it does not work for me, it opens a new window.

Log:

2015-11-02T20:55:53.833Z UI: INFO: next: execute: steps.start();
2015-11-02T20:55:53.834Z UI: INFO: next: openUrl: https://twitter.com/showpad/followers
2015-11-02T20:55:53.837Z UI: INFO: Run started: twitter_followers_2015-11-02T20_55_53_833Z
2015-11-02T20:55:54.081Z UI: DEBUG: Run save ok: undefined
2015-11-02T20:55:54.084Z UI: DEBUG: Run status sent ok: [object Object]
2015-11-02T20:56:03.948Z UI: DEBUG: Run status sent ok: undefined

Thanks!

]]>