datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
cantonese-span-detection
Cantonese Span Detection dataset
This dataset contains writings in (possibly) a mixture of Standard Chinese and Cantonese, derived from the NLPTEA 2017 Chinese Spelling Check Shared Task (Fung et al., NLP-TEA 2017).
This dataset is intended for text classification or token classification (span detection) tasks.
Columns:
id: Identifier, in the format of ASTRI0XXX, EVAXXX or ADDXXX.
sentence: A Chinese sentence that may contain spelling mistakes and/or Cantonese colloqialisms.… See the full description on the dataset page: https://huggingface.co/datasets/Swithord/cantonese-span-detection.span-marker-base-model-detection
SpanMarker Base Model Detection
It is relative simply to determine base model of a fine-tuned SpanMarker model:
import os
from huggingface_hub import login, HfApi
hf_token = os.environ.get("HF_TOKEN")
login(token=hf_token, add_to_git_credential=True)
api = HfApi()
Please make sure that HF_TOKEN is set as environment variable.
After that, list of all SpanMarker models can be retrieved and configuration file is parsed.
Please make sure that span-marker library is installed:
from… See the full description on the dataset page: https://huggingface.co/datasets/stefan-it/span-marker-base-model-detection.