FasterTransformer

NVIDIA highly optimized transformer inference library for GPT, BERT and encoder-decoders.