Skip to content

Support for custom column names in harness for csv #650

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ArshaanNazir merged 27 commits into from
Aug 18, 2023
Merged

Support for custom column names in harness for csv #650

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
5b76e46
custom-column-names for text-classification and summarization
Prikshit7766 Jul 20, 2023
2f1db05
updated langtest.py for custom-column-names for csv
Prikshit7766 Jul 20, 2023
ad7da52
Format: datasource.py and langtest.py
Prikshit7766 Jul 20, 2023
d62598e
added default_question_answering_prompt
Prikshit7766 Jul 21, 2023
902795b
added support for question answering for csv dataset
Prikshit7766 Jul 21, 2023
3382635
Test(test/test_harness.py): added test
Prikshit7766 Jul 21, 2023
b459bbc
updated test
Prikshit7766 Jul 21, 2023
ea9e607
minor change
Prikshit7766 Jul 21, 2023
373bd56
Merge branch 'release/1.2.0' of https://github.com/JohnSnowLabs/langt…
Prikshit7766 Jul 21, 2023
9c8a6b3
chore(datasource): add load raw method for CustomCSVDataset
Prikshit7766 Jul 21, 2023
f45509f
updated test for HuggingFaceDataset
Prikshit7766 Jul 28, 2023
108f6b0
updated CSVDataset for custom column names
Prikshit7766 Jul 28, 2023
234177f
tests\test_datasource.py reformatted
Prikshit7766 Jul 28, 2023
30add66
datasource.py updated
Prikshit7766 Jul 28, 2023
c4692be
re-arranged code and directly load csv for summarization, question-an…
Prikshit7766 Jul 29, 2023
49a3ced
re-arranged classes
Prikshit7766 Jul 29, 2023
f82ac20
added some checks and support for custom columns ner
Prikshit7766 Jul 30, 2023
c1b0d8f
Test(test/test_harness.py): added some test
Prikshit7766 Jul 30, 2023
55ce03e
file path updated
Prikshit7766 Jul 30, 2023
dc332eb
resolve conflicts
Prikshit7766 Jul 31, 2023
f15585c
conflict resolved
Prikshit7766 Aug 17, 2023
aeefe00
updated test_harness.py and datasource.py
Prikshit7766 Aug 17, 2023
b457911
fix lint
Prikshit7766 Aug 17, 2023
299eafb
added Loading_Data_with_Custom_Columns notebook
Prikshit7766 Aug 18, 2023
f1a4c78
updated docstring and added tests
Prikshit7766 Aug 18, 2023
9279cde
updated test_datasource.py
Prikshit7766 Aug 18, 2023
0f904dd
updated load_raw_data for csv
Prikshit7766 Aug 18, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7,435 changes: 7,435 additions & 0 deletions demo/tutorials/misc/Loading_Data_with_Custom_Columns.ipynb
View file
Open in desktop

Large diffs are not rendered by default.

Loading