It's a little difficult to explain but, apparently, that stone is some sort of switch.

Zanak said something about it being able to control the chaos power through unauthorized interference or something... In short, we can't harm the stone itself.

But then, if we can't destroy it...

What do we do?

Throwing it away should be enough.

Without being at the right place and the right time, the stone cannot be activated.