tsdae-bert-base-dv-news-title / tokenizer_config.json

completed training for 3 epochs

0f94d0a almost 5 years ago

418 Bytes

{"unk_token": "[UNK]", "pad_token": "[PAD]", "cls_token": "[CLS]", "sep_token": "[SEP]", "mask_token": "[MASK]", "special_tokens_map_file": "/home/studio-lab-user/.cache/huggingface/transformers/4c862d274b17afb624c8466b2a632a75acee4d4c6fb3bba2a400c6d0acc34047.dd8bd9bfd3664b530ea4e645105f557769387b3da9f79bdb55ed556bdd80611d", "name_or_path": "./tsdae-bert-base-dv-news/", "tokenizer_class": "PreTrainedTokenizerFast"}