Maxout is a learnable activation function that takes the elementwise maximum of several linear transformations. Instead of using a fixed shape such as ReLU or sigmoid, Maxout lets the network learn a piecewise-linear activation directly from data, giving it more flexibility in how it represents nonlinear relationships.

The core idea is simple. For each input, the network computes several affine candidates and picks the largest one. That creates a convex, piecewise-linear function whose segments are shaped by training. In practice, this can make Maxout useful in hidden layers where richer nonlinearity is helpful, especially in networks that need to model complex decision boundaries.

Why it matters: Maxout can improve expressiveness and sometimes help models fit difficult functions, but it also costs more memory and compute because each activation unit needs multiple weight sets. It is often discussed as a research-era activation choice that showed the value of learnable nonlinearity, even though ReLU-style activations became more practical in modern systems.

<svg viewBox="0 0 760 470" xmlns="http://www.w3.org/2000/svg" font-family="-apple-system,Segoe UI,Roboto,sans-serif">
  <rect width="760" height="470" fill="#0d1422"/>
  <rect x="24" y="24" width="712" height="422" rx="18" fill="#142133" stroke="#5a7587" stroke-width="1.2"/>
  <text x="380" y="62" fill="#f5f7fb" font-size="20" font-weight="700" text-anchor="middle">Maxout Activation</text>
  <text x="380" y="86" fill="#8fa8b8" font-size="12" text-anchor="middle">the model picks the strongest linear path among several candidates</text>
  <path d="M120 320C190 250 250 220 320 220C400 220 460 260 520 180" stroke="#5ec7ff" stroke-width="4" fill="none"/>
  <path d="M120 320C220 300 280 280 320 240C370 190 440 180 520 240" stroke="#f59e0b" stroke-width="4" fill="none"/>
  <path d="M120 320C200 340 280 330 360 300C440 270 480 250 520 280" stroke="#8b5cf6" stroke-width="4" fill="none"/>
  <rect x="140" y="340" width="480" height="44" rx="10" fill="#0f1b28" stroke="#5d7887"/>
  <text x="380" y="366" fill="#91aab8" font-size="11" text-anchor="middle">Maxout builds a piecewise-linear activation by selecting the strongest candidate at each point</text>
</svg>

In short, Maxout is a powerful but heavier activation design that demonstrates how neural networks can learn their own nonlinearities rather than rely on a fixed activation shape.