If you're worried I'd get him checked out too. More so because of how he's behaving than the temp. It may well be just a viral thing but at least someone can look at him and make sure he's not getting dehydrated and also checking he doesn't have something that does need antibiotics. An emerg department may have a long wait but you'll have some peace of mind. There are also some GP services that come and see you at home and then send you in to hospital if they are worried. At hospital if there is not something obvious when examining him they will probably check a urine and may do a blood test. Don't worry, paeds doctors will always take a fever in a baby seriously and no-one will think you are silly for getting him checked out, even if it turns out to be nothing serious. And you will feel better having him checked out.