Sure, but like anything it depends on the motherboard, not just the chipset only. Many have BIOS's which offer many FSB adjustments, while some do not. What mobo do you have?
It also depends on the CPU. Some have a lot of OC potential, others not much. In general, the lower speed Coppermine Penitium III's OC pretty nicely getting a 33% increase or more. Celerons OC pretty well too. The Pentium III's above 700 mhz based on the 100 mhz FSB, begin to drop off in terms of speed increase. If you are buying a new CPU and you can find one, the Pentium III 700 will get you 933 mhz in most cases.