Icnn universality and depth
3 experts are actively discussing the implications.
“Approximating convex functions is hard; input-convex neural networks (ReLu networks with positive weights) are convex, but for finite depth, they are not universal approximators. www.gpeyre.com/blog/2026/10...”