Entropy is usually understood as the quantitative measure of “chaos” or “disorder”. However, the notions of “chaos” and “disorder” are definitely obscure. This leads to numerous misinterpretations of entropy. We propose to see the disorder as an absence of symmetry and to identify “ordering” with symmetrizing of a physical system; in other words, introducing the elements of symmetry into initially disordered physical system. We demonstrate with the binary system of elementary magnets that introducing elements of symmetry necessarily diminishes its entropy. This is true for 1D and 2D systems of elementary magnets. Imposing symmetry does not influence the Landauer Principle valid for the addressed systems. Imposing the symmetry restrictions onto the system built of particles contained within the chamber divided by the permeable partition also diminishes its entropy.