Infinite-dimensional optimization problems can be more challenging than finite-dimensional ones. Typically one needs to employ methods from partial differential equations to solve such problems.
Several disciplines which study infinite-dimensional optimization problems are calculus of variations, optimal control and shape optimization.