A handful of people or things is a small number of them.

A handful of something is the amount of it that you can hold in your hand.

If you say that someone, especially a child, is a handful, you mean that they are difficult to control.