As the depth of a neural network increases, the non-linearity and more parameters allow it to learn more complex functions. While network deepening has been proven e_ective, there is still an opportunity for e_cient feature ...