As you know, "only few" and "only little" are not correct, and we normally say "only a few" and "only a little".
But what's the grammatical reason? I think the reason solely has to do with the semantic, rather than syntax. Correct me if I am wrong.
Source: General question