Japanese General Language Understanding Evaluation - text classification, sentence pairs, QA.
pip install lm-eval && lm_eval --model hf --tasks jglue --batch_size auto