The goal of releasing this new API is to make training and deployment of Transformer models more cost effective and affordable, the team explained. PyTorch 2.0 also introduces torch.compile as ...