holes in thumb gussets

It seems like every time I knit a pair of mittens or gloves, I end up with a gaping hole in the thumb gusset. Picking up more stitches in surrounding stitches helps, but doesn't solve the problem (maybe I'm not picking up enough?) and sewing it shut looks ugly. Help?