I don't think having a lot of includes will really affect performance, well at least to the point where it is noticable.
Just from a programming standpoint, I think it is better group your include files into logical groups instead of having one big one or many small ones. Includes are suppose to make it easier to share common logic throughout your site.