To be honest, they would be right. According to the teachings of Muhammad anyways. Peaceful Muslims are the radicals of Islam.
Muslims were fairly peaceful under Mohammad once he consolidated his power basis. It was the Caliph after him that changed the peaceful doctrine to the convert or kill everyone on Earth.