Sharp Approximation Rates for Neural Networks with Affine Latent Parameterizations

Many parameter-efficient methods generate the parameters of a large neural network from a low-dimensional latent representation.

Many parameter-efficient methods generate the parameters of a large neural network from a low-dimensional latent representation. Given an architecture $Φ$ with $P_Φ$ parameter slots, we write $\boldsymbolθ_f=\mathcal{G}(\boldsymbolξ_f)$, where…