But that is still wrong. Protons are not held together by their mass, but by the strong nuclear force. Either way to twist or turn this the answer is just wrong. No, it doesn't know what it is talking about as even the creators of ChatGPT make it clear that it has very limited understanding and cannot distinguish easily fact from fiction.

This thing of stating the complete opposite of what is true is actually quite common for ChatGPT to do. I have seen it numerous times in various tests. It is simply something which is statistically likely because things which are opposite of each other are often discussed together. That means there is a statistical correlation which ChatGPT picks up since it is mostly based on statistical relations and not real understanding.