Resources by Stefan

The greatest hip-hop songs off all time

The greatest hip-hop songs off all time

Stefan
Open Dataset
Creators: BBC
Publication Date: 2019
Creators: BBC

BBC Music polled over 1001 critics in 15 countries to find the best hip-hop song ever. This repo contains poll data, originally published by BBC Music, as well as code for transforming the data, adding cover artwork, and publishing charts via Datawrapper. The poll data was extracted from this article on bbc.com: The greatest hip-hop songs of all time – who voted. It covered over 300 hip-hop songs, each representing an individual observation. The songs listed span from the late 1970s to 2019, covering the evolution of hip-hop over approximately four decades. In total, the dataset has a size of 60,8 kB. Structurally, it is built upon the following key variables:​

  • Rank: The position of the song in the overall ranking.​

  • Title: The name of the song.​

  • Artist: The performing artist(s) of the song.​

  • Year: The release year of the song.​

  • Total Points: The cumulative points the song received based on the poll’s scoring system.​

  • Number of Votes: The count of critics who included the song in their top five lists.

National Zoning and Land Use Database

National Zoning and Land Use Database

Stefan
Open Dataset
Creators: Desmond, Matthew; Mleczko: Matthew
Publication Date: 2023
Creators: Desmond, Matthew; Mleczko: Matthew

We constructed a National Zoning and Land Use Database using natural language processing techniques on publicly available administrative data. We created the National Zoning and Land Use Database (NZLUD) to provide national zoning and land use data for the 2019-2022 time period. We supply our source code to enable timely access to publicly available zoning information. Users can rerun our code at regular intervals to create panel zoning data moving forward. Users can also expand to additional municipalities or additional zoning and land use measures not currently captured by our process. The intent is for this code to further automate the process of building national zoning and land use information in an open source way. Overall, the dataset has a size of 82,2 kB and is structured into:

  • Municipal-Level Data: The file contains zoning and land use information for individual municipalities. This includes various measures extracted using NLP techniques from municipal codes, focusing on aspects such as zoning regulations and land use policies. ​

  • MSA-Level Data: This file aggregates the municipal-level data to the MSA level, providing a broader view of zoning and land use patterns across metropolitan areas. ​

Project Foundations of Legal Data Science I

Project Foundations of Legal Data Science I

Stefan
Open Dataset
Creators: Fobbe, Seán
Publication Date: 2019
Creators: Fobbe, Seán

the first two of a new series of open and high-quality international legal data sets: comprehensive, fully reproducible, human- and machine-readable open access collections covering one hundred years of case law of the primary judicial organs of the United Nations and the League of Nations: the Corpus of Decisions: International Court of Justice (CD-ICJ) and the Corpus of Decisions: Permanent Court of International Justice(CD-PCIJ).

New York Prison Employee Discipline Data

New York Prison Employee Discipline Data

Stefan
Open Dataset
Creators: The Mashall Project
Publication Date: 2023
Creators: The Mashall Project

The Marshall Project examined 12 years of employee discipline data and hundreds of prisoner lawsuits. The Marshall Project requested this data via New York’s Freedom of Information Law in the summer of 2020. We asked for: “An electronic copy of the database maintained by the Bureau of Labor Relations to document disciplinary cases and their resolutions involving alleged misconduct by DOCCS employees from January 1, 2010 to present.” We later asked for a second batch of data covering the time period up until the spring of 2022. By doing so, we prove an in-depth look into the internal disciplinary processes of the New York prison system, offering insights into the nature and frequency of infractions committed by prison staff, the outcomes of disciplinary proceedings, and patterns that may exist within the system. Such detailed information is typically challenging to access, making this dataset particularly valuable for research and analysis in criminal justice and institutional accountability. The dataset has a size of 1,2 MB.

Netflix Prize Data Set

Netflix Prize Data Set

Stefan
Open Dataset
Creators: Netflix
Publication Date: 2009
Creators: Netflix

This dataset was constructed to support participants in the Netflix Prize. See [Web Link] for details about the prize.

There are over 480,000 customers in the dataset, each identified by a unique integer id.

The title and release year for each movie is also provided. There are over 17,000 movies in the dataset, each identified by a unique integer id.

The dataset contains over 100 million ratings and has a size of 7,7 kB. The ratings were collected between October 1998 and December 2005 and reflect the distribution of all ratings received during this period. Each rating has a customer id, a movie id, the date of the rating, and the value of the rating.

As part of the original Netflix Prize a set of ratings was identified whose rating values were not provided in the original dataset. The object of the Prize was to accurately predict the ratings from this ‘qualifying’ set. These missing ratings are now available in the grand_prize.tar.gz dataset file.

Soccer Power Index (SPI) Ratings

Soccer Power Index (SPI) Ratings

Stefan
Open Dataset
Creators: FiveThirtyEight
Publication Date: 2022
Creators: FiveThirtyEight

This file contains links to the data behind our Club Soccer Predictions and Global Club Soccer Rankings. These data analyse soccer team performances worldwide,  providing valuable insights into team strengths and match outcomes.

The SPI database covers data up to the year 2022 with a total size of 52,6 kB and includes the following metrics:​

  • SPI Rating: An overall measure of a team’s strength, combining offensive and defensive capabilities.​

  • Offensive and Defensive Ratings: Separate evaluations of a team’s attacking and defensive proficiencies.​

  • Match Probabilities: Predicted probabilities for home win, away win, and draw outcomes, offering insights into expected match results.​

  • Projected Scores: Anticipated goal counts for both home and away teams, aiding in match analysis and forecasting.

 

2020 U.S. Election Emails

2020 U.S. Election Emails

Stefan
Open Dataset
Creators: Mathur, Arunesh; Wang, Angelina; Schemmer, Carsten; Hami, Maia; Stewart, Brandom M; Narayanan; Arvind
Publication Date: 2023
Creators: Mathur, Arunesh; Wang, Angelina; Schemmer, Carsten; Hami, Maia; Stewart, Brandom M; Narayanan; Arvind

This is a preliminary release of the code and data associated with the research paper “Manipulative tactics are the norm in political emails: Evidence from 300K emails from the 2020 U.S. election cycle”.

The corpus contains emails from over 3,000 political campaigns and organizations in the 2020 election cycle in the U.S. The corpus aims to be comprehensive and includes coverage of emails from the candidates in prominent federal and state races as well as political organizations such as Political Action Committees (PACs) and political parties active in the 2020 cycle. We automated the process of signing up to receive emails from the websites of the political campaigns and organizations. For each entity’s website, if the bot discovered an email sign-up form, it filled it in with the information of a fictional recipient The entire dataset contains 317,366 emails.

Comparative Constitution Project Data

Comparative Constitution Project Data

Stefan
Open Dataset
Creators: Comparative Constitutional Project
Publication Date: 2022
Creators: Comparative Constitutional Project

The dataset includes information on 799 constitutional systems and 2,999 amendments across various countries since 1789. The primary objective of the CCP is to record the characteristics of national constitutions written since 1789. The CCP aims to fill this informational gap by providing systematic data to comparative legal scholars for analysis long before they provide advice to constitution drafters. It is our hope that the analysis of, and insights from, these data will promote peace, justice, and human development through the constitution making process. The dataset has s a size of approximately 435 kB and is organized into several key components:​

  • Chronology of Constitutional Events: This component documents each constitutional event (e.g., adoption, amendment, suspension) for recognized independent states since 1789. ​

  • Constitutional Texts: The CCP has collected the texts of nearly every constitutional system as well as most amendments, providing a repository for textual analysis. ​

  • Characteristics of National Constitutions: This dataset includes approximately 650 variables coded for each constitution, detailing various aspects such as governmental structure, rights, and amendment processes.

Sign In

New to BERD@NFDI? Register

Forgot password?

Register

Reset Password

Please enter your username or email address, you will receive a link to create a new password via email.