Collecting and digitizing raw sources
I build datasets from sources that arrive scattered, unstructured, or only on paper.
- Web data at scale. I scraped more than 1.6 million posts from the campaign, personal, and official Twitter/X accounts of sitting U.S. senators, from 2008 to the present.
- Administrative records. I assembled more than 64,000 franking advisory-opinion submissions from the House Clerk’s records, 2018 through January 2025, the first systematic dataset of its kind.
- Paper archives. Records filed before 2018 exist only on paper. With a team of undergraduates, I copied more than 10,000 documents in one week at the Legislative Resource Center and am converting them into digital data.