Adapt tokenization_interns1.py to transformers>=5.0.0

#13

by Zhangyc02 - opened 4 days ago

←

This PR is in draft mode

No description provided.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Publish this branch

This branch is in draft mode, publish it to be able to merge.

· Sign up or log in to comment