Dataset: Identifying Influential Bloggers: Techcrunch

About this Dataset

Identifying Influential Bloggers: Techcrunch

Context

This dataset is a crawl of the blog posts of the Techcrunch technology blog which was conducted on April of 2010. It was used as an experimental dataset for the requirements of the research paper:

L. Akritidis, D. Katsaros, P. Bozanis, "Identifying the Productive and Influential Bloggers in a Community", IEEE Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews, vol. 41, no 5, pp. 759-764, 2011.

The primary goal of this dataset was to provide an active community for the identification of members who are both productive and influential. However, since the full text of the posts is present, it can also be used for a wide variety of text mining tasks, such as sentiment analysis, opinion retrieval, and NLP. There is also a (My)SQL version that is available from here.

The researchers who used, or will use this dataset, are kindly asked to cite the aforementioned article in their work/s.

If you found this dataset useful, you may also check my TUAW dataset for identifying influential bloggers.

Content

The repository consisfts of four files:

A list of the bloggers of Techcrunch, along with their (unique) IDs and some statistics
A database of the retrieved blog posts,
The incoming links to the blog posts of Techcrunch, automatically retrieved by using the Googl Blog Search service.
The submitted comments to the posts.

Precise descriptions and record counts for each file are provided below.

Tables

Authors

@kaggle.lakritidis_identifying_influential_bloggers_techcrunch.authors

8.98 KB
106 rows
6 columns


CREATE TABLE authors (
  "n_1" BIGINT,
  "jason_kincaid" VARCHAR,
  "n_43" BIGINT,
  "n_43_1" BIGINT,
  "n_4_257910" DOUBLE,
  "n_5_858018" DOUBLE
);

Comments

@kaggle.lakritidis_identifying_influential_bloggers_techcrunch.comments

128.93 MB
746560 rows
6 columns


CREATE TABLE comments (
  "n_1" BIGINT,
  "n_1_1" BIGINT,
  "seemed_to_work_fine" VARCHAR,
  "bj_cook" VARCHAR,
  "n_2010_04_01" TIMESTAMP,
  "n_1_2" BIGINT
);

Inlinks

@kaggle.lakritidis_identifying_influential_bloggers_techcrunch.inlinks

13.98 MB
193807 rows
6 columns


CREATE TABLE inlinks (
  "n_319895" BIGINT,
  "n_19464" BIGINT,
  "popular_blogs_and_their_first_post" VARCHAR,
  "alex" VARCHAR,
  "n_2009_06_17" TIMESTAMP,
  "http_feeds_notaniche_com_r_afrison_3_hxarxfintem" VARCHAR
);

Posts

@kaggle.lakritidis_identifying_influential_bloggers_techcrunch.posts

27.24 MB
19463 rows
16 columns


CREATE TABLE posts (
  "n_1" BIGINT,
  "we_just_tested_twitter_8217_s_anywhere_platform_screenshots" VARCHAR,
  "jason_kincaid" VARCHAR,
  "n_1_1" BIGINT,
  "n_14" BIGINT,
  "during_his_keynote_at_sxsw_last_month_twitter_ceo_evan_dc85c240" VARCHAR,
  "http_techcrunch_com_2010_04_01_we_just_tested_twitters_711e7eeb" VARCHAR,
  "n_2010_04_01" TIMESTAMP,
  "n_0" BIGINT,
  "n_14_1" BIGINT,
  "n_314" BIGINT,
  "n_223" BIGINT,
  "n_4_130293" DOUBLE,
  "n_5_686099" DOUBLE,
  "n_0_00000" DOUBLE,
  "n_0_00000_1" DOUBLE
);