They might be horrified. The Dursleys are very set in their Muggle ways, and magic is completely foreign to them. So, seeing the Potters, who are clearly magical, could terrify them.
It's also possible that the Dursleys are intrigued despite themselves. The allure of the unknown, which magic represents to them, might make them want to learn more, even if they are initially reluctant.