GH Archive for TiDB

github_events

Shared columns

name	column_type	ext_info	ref	default	comment
id	bigint	[null]
type	varchar	[null]
created_at	datetime	[null]
repo_id	bigint	[null]
repo_name	varchar	[null]
actor_login	varchar	[null]
actor_id	bigint	[null]
org_login	varchar	[null]
org_id	bigint	[null]
event_day	date	[null]
event_month	date	[null]
event_year	int	[null]
action	varchar	[null]

PullRequestEvent

name	column_type	ext_info	ref	default	comment
language	varchar	[null]
additions	bigint	[null]
deletions	bigint	[null]
number	int	[null]
state	varchar	[null]
closed_at	datetime	[null]
comments	int	[null]
pr_merged_at	datetime	[null]
pr_merged	tinyint	[null]
pr_changed_files	int	[null]
pr_review_comments	int	[null]
pr_or_issue_id	bigint	[null]

IssuesEvent

name	column_type	ext_info	ref	default	comment
number	int	[null]
state	varchar	[null]
closed_at	datetime	[null]
comments	int	[null]

PushEvent

name	column_type	ext_info	ref	default	comment
push_size	int	[null]
push_distinct_size	int	[null]

IssueCommentEvent

name	column_type	ext_info	ref	default	comment

PullRequestReviewCommentEvent

name	column_type	ext_info	ref	default	comment
commit_id	bigint	[null]
comment_id	bigint	[null]

PullRequestReviewEvent

name	column_type	ext_info	ref	default	comment

CommitCommentEvent

name	column_type	ext_info	ref	default	comment
commit_id	bigint	[null]
comment_id	bigint	[null]

cn_orgs

name	column_type	ext_info	ref	default	comment
id	varchar	[pk, not null]
name	varchar	[null]
company	varchar	[null]

cn_repos

name	column_type	ext_info	ref	default	comment
id	varchar	[pk, not null]
name	varchar	[null]
company	varchar	[null]

db_repos

name	column_type	ext_info	ref	default	comment
id	varchar	[pk, not null]
name	varchar	[null]

users

name	column_type	ext_info	ref	default	comment
id	int	[pk, not null]
login	varchar	[not null]
company	varchar	[null]
created_at	timestamp	[not null]
type	varchar	[not null]
fake	tinyint	[not null]
deleted	tinyint	[not null]
long	decimal	[null]
lat	decimal	[null]
country_code	char	[null]
state	varchar	[null]
city	varchar	[null]
location	varchar	[null]

Usage

• set DATABASE_URL env in .env.local
• bundle exec rails db:create
• bundle exec rails db:migrate
• bundle exec rake gh:import
• bundle exec rake gh:load_meta
• bundle exec rake gh:load_collection

Realtime Fetch Github Event

• bundle exec rails runner 'Realtime.new(ENV["GITHUB_TOKEN"].split(","), 500).run'
• bundle exec rails runner 'Realtime.clean!' # every 5 minutes

Automatic Tweet for trending repo

• bundle exec rails runner 'TrendingRepoGenerator.new(1).generate' # every 1 hour

Automatic Tweet for collection

• bundle exec rails runner 'CollectionTweetGenerator.new(1).generate' # every day

Realtime Fetch Hackernews Item

• bundle exec rails runner 'HnRealtime.new.run'