thanks to all who answered.

I actually figured out that I have more than one outlet I can use now but I have a several more questions (sorry if they are stupid) as follows:
1. i have some kind of jack in my wall that can plug into my router or my computer's GbLAN port. what is it called? what is it used for? is it an alternative way of hooking up my router? if it is, then is it as fast as a coax connection?
2. i believe i have a splitter for the whole home rather than runs to each outlet. the splitter is 3.5 db for each coax connector (there are two) or something like that and 1.675Ghz maximum if i remember correctly. i got ~3.2MBps downloads on steam at the place i used to live at which had runs to each outlet and i have the same service.
is there any way I can get 3.2MBps at the new place (other than having it rewired)? if yes, then how?
thanks in advance.