Text is no more Enough! A Benchmark for Profile-based Spoken Language Understanding
This repository contains the official
PyTorch implementation of the paper:
If you use any source codes or the datasets included in this toolkit in your work, please cite the following paper. The bibtex are listed below:
In the following, we will guide you how to use this repository step by step.
Our code is based on the following packages:
We highly suggest you using Anaconda to manage your python environment.
We download the chinese pretrained model checkpoints from the following links:
- BERT & RoBERTa
How to Run it
The script train.py acts as a main function to the project, you can run the experiments by the following commands.
# LSTM w/o Profile on TITAN Xp
python train.py -g -fs -es -uf -bs 8 -lr 0.0006
# LSTM w/ Profile on TITAN Xp
python train.py -g -fs -es -uf -ui -bs 8 -lr 0.0004
# BERT w/o Profile on Tesla V100s PCIE 32GB
python train.py -g -fs -es -uf -up -mt XLNet -bs 8 -lr 0.001 -blr 4e-05
# BERT w/ Profile on Tesla V100 PCIE 32GB
python train.py -g -fs -es -uf -up -ui -mt ELECTRA -bs 8 -lr 0.0008 -blr 4e-05
- We are highly grateful for the public code of Stack-Propagation!
- We are highly grateful for the open-source knowledge graph!