Hello, I tried to use my dataset to train the model.
I've preprocessed my data and made my pretrain embedding.
So far, I only use my pretrain embedding and POS as my input feature.
However, at the end of the training of the first epoch, I am faced with this problem.
Did I make any mistakes?
Do you have any idea that can help me solve this problem? Thank you!
Start training...
- number of epochs: 13, starting from Epoch 1
- batch size: 64
Loading train dataset from data/temp/dp/dp.train.1.pt, number of examples: 56957
Epoch 1, 50/ 890; acc: 0.00; ppl: 13.31; xent: 2.59; 9483 src tok/s; 11083 tgt tok/s; 2 s elapsed
Epoch 1, 100/ 890; acc: 0.00; ppl: 6.80; xent: 1.92; 9531 src tok/s; 11131 tgt tok/s; 5 s elapsed
Epoch 1, 150/ 890; acc: 0.00; ppl: 4.72; xent: 1.55; 8883 src tok/s; 10483 tgt tok/s; 7 s elapsed
Epoch 1, 200/ 890; acc: 0.00; ppl: 4.09; xent: 1.41; 9957 src tok/s; 11557 tgt tok/s; 9 s elapsed
Epoch 1, 250/ 890; acc: 0.00; ppl: 3.56; xent: 1.27; 9382 src tok/s; 10982 tgt tok/s; 11 s elapsed
Epoch 1, 300/ 890; acc: 0.00; ppl: 3.84; xent: 1.35; 9654 src tok/s; 11254 tgt tok/s; 14 s elapsed
Epoch 1, 350/ 890; acc: 0.00; ppl: 3.16; xent: 1.15; 9321 src tok/s; 10921 tgt tok/s; 16 s elapsed
Epoch 1, 400/ 890; acc: 0.00; ppl: 3.60; xent: 1.28; 9917 src tok/s; 11517 tgt tok/s; 18 s elapsed
Epoch 1, 450/ 890; acc: 0.00; ppl: 3.24; xent: 1.17; 9728 src tok/s; 11328 tgt tok/s; 20 s elapsed
Epoch 1, 500/ 890; acc: 0.00; ppl: 2.87; xent: 1.06; 9012 src tok/s; 10612 tgt tok/s; 22 s elapsed
Epoch 1, 550/ 890; acc: 0.00; ppl: 3.04; xent: 1.11; 9461 src tok/s; 11061 tgt tok/s; 25 s elapsed
Epoch 1, 600/ 890; acc: 0.00; ppl: 2.79; xent: 1.03; 9510 src tok/s; 11110 tgt tok/s; 27 s elapsed
Epoch 1, 650/ 890; acc: 0.00; ppl: 2.68; xent: 0.99; 10310 src tok/s; 11910 tgt tok/s; 29 s elapsed
Epoch 1, 700/ 890; acc: 0.00; ppl: 2.33; xent: 0.85; 8729 src tok/s; 10329 tgt tok/s; 31 s elapsed
Epoch 1, 750/ 890; acc: 0.00; ppl: 2.36; xent: 0.86; 9449 src tok/s; 11049 tgt tok/s; 34 s elapsed
Epoch 1, 800/ 890; acc: 0.00; ppl: 2.32; xent: 0.84; 9400 src tok/s; 11000 tgt tok/s; 36 s elapsed
Epoch 1, 850/ 890; acc: 0.00; ppl: 1.97; xent: 0.68; 8381 src tok/s; 9981 tgt tok/s; 38 s elapsed
Traceback (most recent call last):
File "/usr/lib/python3.7/site-packages/torchtext/data/iterator.py", line 182, in iter
raise StopIteration
StopIteration
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "train.py", line 506, in
main()
File "train.py", line 498, in main
train_model(model, fields, optim, data_type, model_opt)
File "train.py", line 260, in train_model
train_stats = trainer.train(train_iter, epoch, report_func)
File "/home/tyson/seq2seq_parser/onmt/Trainer.py", line 171, in train
for i, batch in enumerate(train_iter):
File "train.py", line 144, in iter
for batch in self.cur_iter:
RuntimeError: generator raised StopIteration
Hello, I tried to use my dataset to train the model.
I've preprocessed my data and made my pretrain embedding.
So far, I only use my pretrain embedding and POS as my input feature.
However, at the end of the training of the first epoch, I am faced with this problem.
Did I make any mistakes?
Do you have any idea that can help me solve this problem? Thank you!
Start training...
Loading train dataset from data/temp/dp/dp.train.1.pt, number of examples: 56957
Epoch 1, 50/ 890; acc: 0.00; ppl: 13.31; xent: 2.59; 9483 src tok/s; 11083 tgt tok/s; 2 s elapsed
Epoch 1, 100/ 890; acc: 0.00; ppl: 6.80; xent: 1.92; 9531 src tok/s; 11131 tgt tok/s; 5 s elapsed
Epoch 1, 150/ 890; acc: 0.00; ppl: 4.72; xent: 1.55; 8883 src tok/s; 10483 tgt tok/s; 7 s elapsed
Epoch 1, 200/ 890; acc: 0.00; ppl: 4.09; xent: 1.41; 9957 src tok/s; 11557 tgt tok/s; 9 s elapsed
Epoch 1, 250/ 890; acc: 0.00; ppl: 3.56; xent: 1.27; 9382 src tok/s; 10982 tgt tok/s; 11 s elapsed
Epoch 1, 300/ 890; acc: 0.00; ppl: 3.84; xent: 1.35; 9654 src tok/s; 11254 tgt tok/s; 14 s elapsed
Epoch 1, 350/ 890; acc: 0.00; ppl: 3.16; xent: 1.15; 9321 src tok/s; 10921 tgt tok/s; 16 s elapsed
Epoch 1, 400/ 890; acc: 0.00; ppl: 3.60; xent: 1.28; 9917 src tok/s; 11517 tgt tok/s; 18 s elapsed
Epoch 1, 450/ 890; acc: 0.00; ppl: 3.24; xent: 1.17; 9728 src tok/s; 11328 tgt tok/s; 20 s elapsed
Epoch 1, 500/ 890; acc: 0.00; ppl: 2.87; xent: 1.06; 9012 src tok/s; 10612 tgt tok/s; 22 s elapsed
Epoch 1, 550/ 890; acc: 0.00; ppl: 3.04; xent: 1.11; 9461 src tok/s; 11061 tgt tok/s; 25 s elapsed
Epoch 1, 600/ 890; acc: 0.00; ppl: 2.79; xent: 1.03; 9510 src tok/s; 11110 tgt tok/s; 27 s elapsed
Epoch 1, 650/ 890; acc: 0.00; ppl: 2.68; xent: 0.99; 10310 src tok/s; 11910 tgt tok/s; 29 s elapsed
Epoch 1, 700/ 890; acc: 0.00; ppl: 2.33; xent: 0.85; 8729 src tok/s; 10329 tgt tok/s; 31 s elapsed
Epoch 1, 750/ 890; acc: 0.00; ppl: 2.36; xent: 0.86; 9449 src tok/s; 11049 tgt tok/s; 34 s elapsed
Epoch 1, 800/ 890; acc: 0.00; ppl: 2.32; xent: 0.84; 9400 src tok/s; 11000 tgt tok/s; 36 s elapsed
Epoch 1, 850/ 890; acc: 0.00; ppl: 1.97; xent: 0.68; 8381 src tok/s; 9981 tgt tok/s; 38 s elapsed
Traceback (most recent call last):
File "/usr/lib/python3.7/site-packages/torchtext/data/iterator.py", line 182, in iter
raise StopIteration
StopIteration
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "train.py", line 506, in
main()
File "train.py", line 498, in main
train_model(model, fields, optim, data_type, model_opt)
File "train.py", line 260, in train_model
train_stats = trainer.train(train_iter, epoch, report_func)
File "/home/tyson/seq2seq_parser/onmt/Trainer.py", line 171, in train
for i, batch in enumerate(train_iter):
File "train.py", line 144, in iter
for batch in self.cur_iter:
RuntimeError: generator raised StopIteration