Crawling Followers with Intelligent Stopping

Like almost every other academic, I have started a Covid-19 project.  I think my team has a unique angle because of the kind of data I collect.  One dynamic we are interested in is patterns of following, and being able to analyze that across enough accounts required me to work with Twitter endpoints I have […]

My Ongoing Twitter Collections

I recently spent a lot of time reviewing my Twitter data collection infrastructure in order to start some more collections.  In that process, I discovered some tokens and streams I forgot about.  The purpose of this post is to document what data I am collecting as of 04.29.2020 so that I have an easy reference […]

Cell Phone or Geolocation Datasets

I want cell phone data.  Location tracking or call detail records, both have their users and can answer research questions.  Basically nothing is publicly available, but lots of companies exist and some say they will work with academics.  This post is for me to keep track of those companies. SafeGraph – Focused on places, not […]