Eosc/pretraining/nvidia
Background
This page provides a recipe to large-scale pre-training of a BERT neural language model, using the high-efficiency NVIDIA BERT implementation (which is based on TensorFlow, in contrast to the NVIDIA Megatron code).
- Content is available under Creative Commons Attribution unless otherwise noted.
