Suppose you are with a friend and looking at a kitten.
You say, "How cute!".
This sounds fine, but do you say "What a cute?"
I don't think so, but do you?
"What a cute kitten !" would be correct, I mean grammatically, but is "What a cute!" a colloquial expression?