Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge

This work reformulates FL as a group knowledge transfer training algorithm, called FedGKT, which designs a variant of the alternating minimization approach to train small CNNs on edge nodes and periodically transfer their knowledge by knowledge distillation to a large server-side CNN.