BigScience - testing model

This model aims to test the conversion between Megatron-LM and transformers. It is a small GPT-2 -like model that has been used to debug the script. Use it only for integration tests