GitHub - jtmart/text-processing: Text structuring for import/manipulation/analysis in R | TXM

jtmart / text-processing Public

Notifications You must be signed in to change notification settings
Fork 2
Star 3

Text structuring for import/manipulation/analysis in R | TXM | IRaMuTeQ

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 39 Commits
corpus		corpus
workflow		workflow
workshop		workshop
.gitattributes		.gitattributes
CharanSingh_Speeches.txt		CharanSingh_Speeches.txt
Convert_tcpd.py		Convert_tcpd.py
DivideSpeeches.py		DivideSpeeches.py
FileNaming.py		FileNaming.py
Footer.txt		Footer.txt
GHTML.ipynb		GHTML.ipynb
IndiraGandhi2Parser.py		IndiraGandhi2Parser.py
MatchID.py		MatchID.py
MatchID_fast.py		MatchID_fast.py
MatchID_tuned.py		MatchID_tuned.py
Parser_CharanSingh.py		Parser_CharanSingh.py
Parser_IndiraGandhi.py		Parser_IndiraGandhi.py
README.txt		README.txt
Renaming_file.csv		Renaming_file.csv
ReplaceChar.py		ReplaceChar.py
Titles.txt		Titles.txt
check_files.py		check_files.py
checkmismachfilecsv.py		checkmismachfilecsv.py
csvOP.py		csvOP.py
dataframeXpureSample.csv		dataframeXpureSample.csv
divide.py		divide.py
edit_final1_tuned.py		edit_final1_tuned.py
extractby.py		extractby.py
fileRename.py		fileRename.py
final_processing_tuned.py		final_processing_tuned.py
fl.py		fl.py
flu.py		flu.py
generate_star_file.py		generate_star_file.py
getWords.py		getWords.py
groupby.py		groupby.py
listlongwords.txt		listlongwords.txt
machine-learning-label.ipynb		machine-learning-label.ipynb
make_LIWC_dictionary.py		make_LIWC_dictionary.py
makecsvindira.py		makecsvindira.py
makecsvnehru.py		makecsvnehru.py
metadata.csv		metadata.csv
p.py		p.py
rename.py		rename.py
replace.py		replace.py
replace_listlongwords.py		replace_listlongwords.py
replacesnumberingsfiveyearplans.py		replacesnumberingsfiveyearplans.py
sampledataframemodinotweet2.csv		sampledataframemodinotweet2.csv
scrapfirstlineandputascsvdetail.py		scrapfirstlineandputascsvdetail.py
script.py		script.py
script2.py		script2.py
script_1.py		script_1.py
script_2.py		script_2.py
script_append.py		script_append.py
seaglass-pre-alpha.md		seaglass-pre-alpha.md
shivaniutf8.py		shivaniutf8.py
speeches.txt		speeches.txt
spellingCheck.py		spellingCheck.py
star.py		star.py
star_tuned.py		star_tuned.py
starpylinuxonly.txt		starpylinuxonly.txt
variables.csv		variables.csv
words.txt		words.txt
workflow.zip		workflow.zip

Repository files navigation

This repository contains a series of scripts to batch process textual data for analysis in R, Python, TXM and IRaMuTeQ. It mainly consists of tools to extract text – and its metadata – from digital sources (PDFs, HTML, SRT), clean it (layout and OCR corrections) and format it in a CSV+TXT format for analysis.