Just to clarify, one outlet is not on it's own circuit. Depending on the age of the house you could have anywhere between 1-15 outlets on one circuit. I'm guessing that the outlet you have your things plugged into is sharing a circuit with a device that requires high amps to start (A/C, fridge, sump-pump, basically anything with a big electric motor). First check your breaker box and see if they labeled your circuits. There usually is a label on the door that gives circuit number and a place to write in where it goes. Simply adding a higher amperage breaker is NOT a good idea. Usually the electrician installs the highest amperage breaker for the wire size installed. Also removing your breaker panel cover and changing a breaker is not something your average person can do. If it is labeled try to find out if there are any high current devices using the same circuit. Try moving these devices to another circuit. Good luck, electrical problems can be fun.