Yes, if I were you I'd give him guidance, but it's important not to make him feel awkward that he's not gotten the whole thing down already. Maybe instead of brushing him away you can guide his fingers so they have a better sense of what turns you on. Leaving things as they are will only frustrate you in the long run...

If I were your boyfriend I would appreciate if you stop me when I am doing things right. And verbally approve of my moves. Either moaning, or yes! or something that lets me know I hit the spot. I always like to learn from the person who owns the clit how she prefers I touch it...