模型:

nickmuchi/fb-bart-large-finetuned-trade-the-event-finance-summarizer

中文

fb-bart-large-finetuned-trade-the-event-finance-summarizer

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.5103
  • Rouge1: 57.6289
  • Rouge2: 53.0421
  • Rougel: 56.54
  • Rougelsum: 56.5636

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5.6e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 8

Training results

Training Loss Epoch Step Validation Loss Rouge1 Rouge2 Rougel Rougelsum
1.8188 1.0 1688 1.7495 37.9629 22.0496 32.2942 32.4631
1.2551 2.0 3376 1.7559 38.5548 22.7487 32.9304 33.0737
0.8629 3.0 5064 1.9539 39.3912 22.8503 33.2043 33.4378
0.5661 4.0 6752 2.1153 39.1514 22.8104 33.1306 33.2955
0.3484 5.0 8440 2.3289 39.0093 22.4364 32.5868 32.7545
0.2009 6.0 10128 2.5754 39.0874 22.4444 32.6894 32.8413
0.1105 7.0 11816 2.8093 39.0905 22.4051 32.597 32.8183
0.0609 8.0 13504 0.5103 57.6289 53.0421 56.54 56.5636

Framework versions

  • Transformers 4.16.2
  • Pytorch 1.10.0+cu111
  • Datasets 1.18.3
  • Tokenizers 0.11.0