What does that cloth in front of a speaker do?

Well, I noticed that many speakers always have some kind of mesh covering the output device and I want to know what it does and if it will degrade my speaker performance if I took it off.