Webb1 mars 2024 · Experimental results show that PhoBERT consistently outperforms the recent best pre-trained multilingual model XLM-R and improves the state-of-the-art in multiple Vietnamese-specific NLP tasks including Part- of-speech tagging, Dependency parsing, Named-entity recognition and Natural language inference. We present PhoBERT … WebbTwo PhoBERT versions of "base" and "large" are the first public large-scale monolingual language models pre-trained for Vietnamese. PhoBERT pre-training approach is based on RoBERTa which optimizes the BERT pre-training procedure for more robust performance.

Support for Transformers

Webb23 maj 2024 · Two PhoBERT versions of "base" and "large" are the first public large-scale monolingual language models pre-trained for Vietnamese. PhoBERT pre-training … WebbThe model was designed to be used on WISDM biometrics and activity recognition dataset (18 activities, 51 subjects), with only phone accelerometer x, y, and z values as input data. The model achieved 93.4% accuracy on activity recognition test set (compared to 87.8% in the original paper) on a 10s data sampling window. dailypictwitter

PhoBERT: Pre-trained language models for Vietnamese

Webbphobert-large-finetuned-vietnamese_students_feedback. This model is a fine-tuned version of vinai/phobert-large on the vietnamese_students_feedback dataset. It achieves the … Webb12 apr. 2024 · For this purpose, we exploited the capabilities of BERT by training it from scratch on the largest Roman Urdu dataset consisting of 173,714 text messages ... model to a text classification task, which was Vietnamese Hate Speech Detection (HSD). Initially, they tuned the PhoBERT on the HSD dataset by re-training the ... Webbunify-parameter-efficient-tuning - Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2024) bioman ecodetectives