Update: 1/8/2019 Twitter has updated their layout to render data primarily through Javascript. You will need to scrape https://mobile.twitter.com rather than https://twitter.com. As mobile twitter still renders html in the source. We will be updating the scraper soon to be able to crawl js rendered content. I have been meaning to write this blog post … Continue reading How to Scrape Data From Twitter Profile Pages