What does decentralization mean?

Hello. Could someone explain to me, for a layman, what exactly is decentralization? Many exchanges are decentralized. Many cryptocurrencies are also called decentralized, but what exactly does that mean?