Skip to content

Tweetclean #17

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
pariyashu wants to merge 51 commits into
base: main
Choose a base branch
from
Open

Tweetclean #17

pariyashu wants to merge 51 commits into from

Conversation

@pariyashu
Copy link

@pariyashu pariyashu commented Oct 23, 2021

No description provided.

TobiObeck and others added 30 commits October 6, 2021 12:18
@TobiObeck
- adds main function to most scripts
b530c66 
For all .py files that are entry points (can be invoked as separate scripts via CLI commands) the whole code is wrapped in a main function. This has the advantages that later on code can be separated out into their own functions and these functions can be placed below the previous code. So the overall reading flow of the code is from top to bottom like prose. Without this pattern functions would need to be defined above the invocation.
- also deletes unnecessary author comments at the top of the file
@TobiObeck
adds multiple evaluation metrics for classifier
7b953d6 
also changes invocation via command line arguments
@TobiObeck
Merge branch 'main' into add-evaluation-metrics
de3084f
@TobiObeck
separates loading of data sets into setup.sh script
86a9eb1
@TobiObeck
Merge branch 'main' of https://github.com/lbechberger/MLinPractice
929db48
@pariyashu
Update util.py
ae3c345
@TobiObeck
Merge branch 'main' of https://github.com/TobiObeck/MLinPractice
0daf32a
@TobiObeck
Merge commit 'a7c7fdb9a3ff5a5af9677b5808279c5f8b018662'
a7a61aa
@TobiObeck
adds parsing of tokenized tweets example
ee9f4c0
@TobiObeck
adds func to document tests
fde0818
@TobiObeck
moves tests into respective code folder
a9ce4de
@TobiObeck
adds documentation how to run tests
f37740f
@pariyashu
test connection
303ba92
@pariyashu
remove unnecessary comment
7c873ac
@TobiObeck
adds counting of mentions & removal of orig. column
d0cb537
@TobiObeck
minor cleanup
39b1bdc
@TobiObeck
Merge branch 'main' of https://github.com/TobiObeck/MLinPractice
6483c10
@TobiObeck
adds MentionsCounter Preprocessor
8988ef6
@TobiObeck @pariyashu
minor cleanup
8e92246
@pariyashu
test connection
cf0c340
@pariyashu
remove unnecessary comment
ca148df
@pariyashu
Merge pull request #1 from TobiObeck/mentions-count-col
5e03e47 
languase filter, trans_dest\r drop language
@pariyashu
Merge branch 'main' of https://github.com/TobiObeck/MLinPractice into…
c45a142 
… main
@pariyashu
filter language
8777d37
@pariyashu
drop columns inc eng
240dc9a
@TobiObeck
implements column remover as proper preprocessor
9ea4c4e
@TobiObeck
Merge branch 'main' of https://github.com/lbechberger/MLinPractice in…
bebf224 
…to temp-pull-grid-from-bech
@TobiObeck
gets rid of warning by specifying dtypes while reading csv
62b0de2
@TobiObeck
gets rid of warning by specifying dtypes while reading csv
6e19a6d
@TobiObeck
Merge branch 'main' of https://github.com/TobiObeck/MLinPractice
fba4d6b
TobiObeck and others added 21 commits October 19, 2021 19:14
@TobiObeck
renames folder code -> src
6fdf847
@TobiObeck
adds test for counting feature
eaf0117
@TobiObeck
cleanup
33c42bc
@TobiObeck
minor changes
d584460
@TobiObeck
renames folder code -> src
a821f94
@TobiObeck
stores mlflow and pickle data
00c91be
@TobiObeck
Merge branch 'temp-pull-grid-from-bech'
39b3875
@TobiObeck
separates examples into corresponding files
a07f531
@TobiObeck
adds randomforest classifier
6c860e8
@TobiObeck
disables dimensionality reduction
2227e83 
we currently have only three features. Therefore, all features are used
@TobiObeck
adds a classification run for all classifiers
46d98b4
@pariyashu
tweet clean remove @user,#hashtag,https and emojis
411ba86
@pariyashu
append tweetClean class
71108c0
@TobiObeck
adds test for tweet cleaner
5d90eec
@TobiObeck
makes tweet_cleaner runnable, but still WIP
df0f208
@pariyashu
text removel after link solved
774784a 
text after link is now not removed
@pariyashu
Update tweet_clean.py
b214a25
@pariyashu
white spece problem solve 1 remaining
9728f8c
@TobiObeck
fixes tweet clean test
4d37f95
@TobiObeck
strips white spaces text start & end
8883475
@TobiObeck
renames leftover filepaths from code to src
90c6f70
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@pariyashu @TobiObeck