I thought I was huge very early the first 2 times, but when I look at photos from 12 weeks there is hardly any bump noticable even in my tight tops. I think you always feel bigger than you look to other people. I was big early this last time (noone said anything at the time but a number of people said they had known for ages after I announced it at 12 weeks), but then by half way I was normal size for 20ish weeks. You may find you don't get much bigger than you are for quite a while.
Early on it is just bloating... gotta love hormones!! Your uterus will start to move up early in the second trimester and you will get a proper preggo belly. In the meantime try not to worry about how your belly compares to anyone else's. Your body will do what it is supposed to do when you are pregnant and there isn't much that you can do about it.