chances are that what you will have to do is go into the bios (u know when u first turn ur computer on and it says press f2/del or something else to enter setup)
once inside that menu there should be a setting for frequency/voltage control and inside that there are usually settings for multiplier, fsb, vcore and possibly others.
those setting may not be usable unless you select cpu operating speed as user define. Now if all of that so far has fit accordingly the first thing you should do is increase the fsb by 1-2mhz increments saving, exiting the bios and booting into windows each time. also you will want a few programs to stress-test ur system prime95 is very common.
Now once you reach the max possible fsb for that vcore (when the computer crashes fairly quickly under prime95. Then up the vcore a little and check to see if it is stable
and also check that the temps are ok (below 50C idle) this usually can be done through the bios under pc health. Once you reach the point where your fsb is at its highest under the little raise of vcore and with an idle temp of below 50C run prime 95 for a few hours and if it doesnt crash ur comp is most likely stable. This is just a basic explanation
Im sorry for the long winded explanation but thats the most basic explanation i could give u. Also none of that will most likely be attainable if the computer is storebought ie. dell, compaq, HP, Gateway........... as they put restrictions on the bios that prohibit overclocking.
Hope that helps