Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
c815e14
task(dataset/Bigbench): Added AbstractUnderstanding and DisambiguationQA
RakshitKhajuria Aug 24, 2023
b97e9cb
task(dataset): Added LogiQA
RakshitKhajuria Aug 24, 2023
d6d9d5a
dataset: added casual-judgement-test and disfl-qa-test
Prikshit7766 Aug 24, 2023
fd39a49
dataset: added asdiv-test
Prikshit7766 Aug 24, 2023
76c6645
datasource.py: added dataset path
Prikshit7766 Aug 24, 2023
1f5faa5
helpers.py : prompt added (asdiv, causaljudgment, disflqa)
Prikshit7766 Aug 24, 2023
ac3647c
task(datasource.py): Dataset added to path
RakshitKhajuria Aug 24, 2023
adae708
task(helpers.py): Prompts added
RakshitKhajuria Aug 24, 2023
470362d
fix: path
RakshitKhajuria Aug 24, 2023
9680ee7
Task(dataset): Added ASDiv tiny version
RakshitKhajuria Aug 28, 2023
1b07925
Task(dataset): Added casual-judgement and disfl-qa tiny version
Prikshit7766 Aug 28, 2023
e6965e7
Task(dataset): Added DisambiguationQA tiny version
RakshitKhajuria Aug 28, 2023
9fafe1a
fix: path asdiv
RakshitKhajuria Aug 28, 2023
c83f917
Rename ASDiv-test-tiny.jsonl to asdiv-test-tiny.jsonl
Prikshit7766 Aug 28, 2023
354e9ff
Chore(notebook): Added asdiv dataset nb
RakshitKhajuria Aug 28, 2023
f62332a
Chore(notebook): Added LogiQA dataset nb
RakshitKhajuria Aug 28, 2023
9e8d35f
Merge branch 'dataset-lm-evaluation-library' of https://github.com/Jo…
RakshitKhajuria Aug 28, 2023
f734772
rename: abstract narrative understanding
RakshitKhajuria Aug 28, 2023
9e8013b
rename: abstract narrative understanding
RakshitKhajuria Aug 28, 2023
0e9dcb8
added Bigbench_dataset notebooks
Prikshit7766 Aug 28, 2023
f85676e
updated colab links
Prikshit7766 Aug 28, 2023
594a92f
Rename DisflQA and Causal-judgment
Prikshit7766 Aug 28, 2023
75fb13b
rename: abstract narrative understanding
RakshitKhajuria Aug 28, 2023
a48c5a5
setup.py: added dataset path
Prikshit7766 Aug 28, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view

Large diffs are not rendered by default.

10,989 changes: 10,989 additions & 0 deletions demo/tutorials/llm_notebooks/dataset-notebooks/Bigbench_dataset.ipynb

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

190 changes: 190 additions & 0 deletions langtest/data/Bigbench/CausalJudgment/causal-judgment-test.jsonl

Large diffs are not rendered by default.

Large diffs are not rendered by default.

207 changes: 207 additions & 0 deletions langtest/data/Bigbench/DisambiguationQA/DisambiguationQA-test.jsonl

Large diffs are not rendered by default.

50 changes: 50 additions & 0 deletions langtest/data/Bigbench/DisflQA/disfl-qa-test-tiny.jsonl

Large diffs are not rendered by default.

1,000 changes: 1,000 additions & 0 deletions langtest/data/Bigbench/DisflQA/disfl-qa-test.jsonl

Large diffs are not rendered by default.

50 changes: 50 additions & 0 deletions langtest/data/LogiQA/LogiQA-test-tiny.jsonl

Large diffs are not rendered by default.

1,000 changes: 1,000 additions & 0 deletions langtest/data/LogiQA/LogiQA-test.jsonl

Large diffs are not rendered by default.

50 changes: 50 additions & 0 deletions langtest/data/asdiv/asdiv-test-tiny.jsonl
Original file line number Diff line number Diff line change
@@ -0,0 +1,50 @@
{"passage": "Seven red apples and two green apples are in the basket.", "question": "How many apples are in the basket?", "answer": "9 (apples)"}
{"passage": "Ellen has six more balls than Marin. Marin has nine balls.", "question": "How many balls does Ellen have?", "answer": "15 (balls)"}
{"passage": "Janet has nine oranges and Sharon has seven oranges.", "question": "How many oranges do Janet and Sharon have together? ", "answer": "16 (oranges)"}
{"passage": "Allan brought two balloons and Jake brought four balloons to the park.", "question": "How many balloons did Allan and Jake have in the park?", "answer": "6 (balloons)"}
{"passage": "Adam has five more apples than Jackie. Jackie has nine apples.", "question": "How many apples does Adam have?", "answer": "14 (apples)"}
{"passage": "Brian has four more plums than Paul. Paul has seven plums.", "question": "How many plums does Brian have?", "answer": "11 (plums)"}
{"passage": "Sandra took six cups of coffee and Marcie took two cups of coffee.", "question": "How many cups of coffee did Sandra and Marcie take in total?", "answer": "8 (cups)"}
{"passage": "17 plums were in the basket. More plums were added to the basket. Now there are 21 plums.", "question": "How many plums were added to the basket?", "answer": "4 (plums)"}
{"passage": "14 red plums and four green plums are in the basket.", "question": "How many plums are in the basket? ", "answer": "18 (plums)"}
{"passage": "Marin has nine apples and Donald has two apples.", "question": "How many apples do Marin and Donald have together?", "answer": "11 (apples)"}
{"passage": "46 apples were in the basket. 22 are red and the rest are green.", "question": "How many apples are green?", "answer": "24 (apples)"}
{"passage": "Five red peaches and 14 green peaches are in the basket.", "question": "How many peaches are in the basket? ", "answer": "19 (peaches)"}
{"passage": "20 peaches are in the basket. 25 more peaches are put in the basket.", "question": "How many peaches are in the basket now?", "answer": "45 (peaches)"}
{"passage": "Two marbles are in the basket. Two marbles are taken out of the basket.", "question": "How many marbles are in the basket now?", "answer": "0 (marbles)"}
{"passage": "Eight balls were in the basket. Some of the balls were removed from the basket. Now there are six balls.", "question": "How many balls were removed from the basket? ", "answer": "2 (balls)"}
{"passage": "Some oranges were in the basket. Five oranges were taken from the basket. Now there are three oranges.", "question": "How many oranges were in the basket before some of the oranges were taken?", "answer": "8 (oranges)"}
{"passage": "Jake has six fewer peaches than Steven. Steven has 13 peaches.", "question": "How many peaches does Jake have? ", "answer": "7 (peaches)"}
{"passage": "David has zero fewer apples than Marin. Marin has three apples.", "question": "How many apples does David have?", "answer": "3 (apples)"}
{"passage": "Jake has 34 fewer balls than Audrey. Audrey has 41 balls.", "question": "How many balls does Jake have?", "answer": "7 (balls)"}
{"passage": "Brian has zero fewer oranges than Marcie. Marcie has 12 oranges.", "question": "How many oranges does Brian have? ", "answer": "12 (oranges)"}
{"passage": "2 birds were sitting on the fence. 4 more birds came to join them.", "question": "How many birds are sitting on the fence?", "answer": "6 (birds)"}
{"passage": "You have 7 cookies and you ate 2 of them.", "question": "How many cookies do you have left?", "answer": "5 (cookies)"}
{"passage": "You have collected 7 crickets.", "question": "How many more crickets do you need to collect to have 11 crickets?", "answer": "4 (crickets)"}
{"passage": "4 birds are sitting on a branch. 1 flies away.", "question": "How many birds are left on the branch?", "answer": "3 (birds)"}
{"passage": "3 raccoons are playing in the woods. 2 go home to eat dinner.", "question": "How many raccoons are left in the woods?", "answer": "1 (raccoons)"}
{"passage": "1 lonely pigeons was eating breadcrumbs. Another pigeon came to eat breadcrumbs, too.", "question": "How many pigeons are eating breadcrumbs now?", "answer": "2 (pigeons)"}
{"passage": "3 owls were sitting on the fence. 2 more owls joined them.", "question": "How many owls are on the fence now?", "answer": "5 (owls)"}
{"passage": "2 beavers were working on their home. 1 went for a swim.", "question": "How many beavers are still working on their home?", "answer": "1 (beavers)"}
{"passage": "2 toucans are sitting on a tree limb. 1 more toucan joins them.", "question": "How many toucans in all?", "answer": "3 (toucans)"}
{"passage": "Mrs. Hilt has two pennies, two dimes, and two nickels. Jacob has four pennies, one nickel, and one dime.", "question": "Who has more money?", "answer": "Mrs. Hilt"}
{"passage": "Mrs. Hilt has two pennies, two dimes, and two nickels. Jacob has four pennies, one nickel, and one dime.", "question": "How much more?", "answer": "13 (pennies)"}
{"passage": "Mrs. Hilt found a quarter, 1 dime, and 2 nickels.", "question": "How much money did she find?", "answer": "45 (cents)"}
{"passage": "Mrs. Hilt's favorite first grade classes are baking muffins. Mrs. Brier's class bakes 18 muffins, Mrs. MacAdams's class bakes 20 muffins, and Mrs. Flannery's class bakes 17 muffins.", "question": "How many muffins does first grade bake in all?", "answer": "55 (muffins)"}
{"passage": "Mrs. Hilt bought a yoyo for 24 cents and a whistle for 14 cents.", "question": "How much did she spend in all for the two toys?", "answer": "38 (cents)"}
{"passage": "Mrs. Hilt made 5 Rice Krispie Treats. She used 8 large marshmallows and 10 mini marshmallows.", "question": "How many marshmallows did she use altogether?", "answer": "18 (marshmallows)"}
{"passage": "At Mrs. Hilt's house, there was 29 inches of snow, and Brecknock Elementary School received 17 inches of snow.", "question": "How much more snow did Mrs. Hilt's house have?", "answer": "12 (inches of snow)"}
{"passage": "Mrs. Hilt has $10. She spends $3 on a toy truck and $2 on a pencil case.", "question": "How much money does she have left?", "answer": "5 (dollars)"}
{"passage": "Mrs. Hilt reads 5 books a day.", "question": "How many books does she read in 3 days?", "answer": "15 (books)"}
{"passage": "Mrs. Hilt saw 2 dogs and 2 chickens.", "question": "How many animal legs did she see?", "answer": "12 (legs)"}
{"passage": "Mrs. Hilt saw 3 bugs eat two flowers each.", "question": "How many flowers total did the bugs eat?", "answer": "6 (flowers)"}
{"passage": "Mrs. Hilt has 15 friends. She can only take 8 of her friends to the movies.", "question": "How many friends can't go to the movies?", "answer": "7 (friends)"}
{"passage": "Mrs. Hilt ran 3 miles on Monday, 2 miles on Wednesday, and 7 miles on Friday.", "question": "How many total miles did she run that week?", "answer": "12 (miles)"}
{"passage": "Mrs. Hilt picked up a book that has 17 pages in it. She read 11 of the pages.", "question": "How many pages did she have left to read?", "answer": "6 (pages)"}
{"passage": "Mrs. Hilt had 15 cents. She bought a pencil for 11 cents.", "question": "How much money did she have left?", "answer": "4 (cents)"}
{"passage": "Mrs. Hilt met 15 friends. Nine of the friends were carrying pears. The rest were carrying oranges.", "question": "How many friends were carrying oranges?", "answer": "6 (friends)"}
{"passage": "Mrs. Hilt spent 25 cents on one caramel apple and 15 cents on one ice cream cone.", "question": "How much more did the apple cost?", "answer": "10 (cents)"}
{"passage": "Mrs. Hilt bought 2 pizzas. Each pizza had 8 slices.", "question": "How many total slices of pizza did she have?", "answer": "16 (slices)"}
{"passage": "Mrs. Hilt read 2 books per day.", "question": "How many books did she read in one week?", "answer": "14 (books)"}
{"passage": "Mrs. Hilt ate 5 apples every hour.", "question": "How many apples had she eaten at the end of 3 hours?", "answer": "15 (apples)"}
{"passage": "Mrs. Hilt gave 2 pieces of candy to each student in the group. The group had a total of 9 students in it.", "question": "How many pieces of candy did Mrs. Hilt give away?", "answer": "18 (pieces)"}
Loading