18 Star 74 Fork 49

DeepSpark / DeepSparkHub

加入 Gitee
与超过 1200万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
克隆/下载
README.md 624 Bytes
一键复制 编辑 原始数据 按行查看 历史
张文风 提交于 2022-11-08 14:41 . Add the models based on PaddlePaddle

Transformer

Step 1: Installing

git clone https://github.com/PaddlePaddle/PaddleNLP.git
cd PaddleNLP
pip3 install -r requirements.txt

Step 2: Training

The training is use AMP model.

cd PaddleNLP/examples/machine_translation/transformer
export FLAGS_cudnn_exhaustive_search=True
export FLAGS_cudnn_batchnorm_spatial_persistent=True
export CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7
python3 -u -m paddle.distributed.launch --gpus=0,1,2,3,4,5,6,7 train.py --config ./configs/transformer.big.yaml \
--use_amp True --amp_level O1

Reference

Python
1
https://gitee.com/deep-spark/deepsparkhub.git
git@gitee.com:deep-spark/deepsparkhub.git
deep-spark
deepsparkhub
DeepSparkHub
master

搜索帮助