CTranslate2 accelerates Transformer inference for translation, transcription and text generation with quantisation and CPU/GPU execution.The post CTranslate2 – efficient Transformer inference engine appeared first on LinuxLinks.