Jianfeng WangUnderstanding pytorch’s autograd with grad_fn and next_functionsAs we know, the gradient is automatically calculated in pytorch. The key is the property of grad_fn of the final loss function and the…3 min read·Sep 13, 2021--2--2
Jianfeng Wang[Deep learning pipeline] Dataset managementAs there is lots of engineering when we work on deep learning projects, I will present some tips I learned in practice for data/job/model…5 min read·Mar 26, 2021--1--1
Jianfeng WangGradient backpropagation with torch.distributed.all_gatherThis blog presents some tips on how to use torch.distributed.all_gather and make sure the gradient is correctly calculated for deep…4 min read·Feb 7, 2021--2--2
Jianfeng WangA simple introduction on Sinkhorn distancesThe Sinkhorn distance [1] was proposed in 2013, and the work was accepted in NIPS conference. The goal is to improve the optimization…8 min read·Dec 19, 2020----