 They recognize that he speaks with great authority and understanding. The problem isn't with the what, it's with the who. Anyone else probably could have come to town with the same message and been welcomed as a prophet sent by God. But this guy is one of their own. They know him. They know who he is. Like most small towns, they know who his relatives are. This is a carpenter.