If we start calling gzip a language model, the practical problem is people will expect it to actually understand and answer things, and it just won't. The other side might have a clever comparison, but to me it still feels like a stretch. I can't really argue it better than that.