if you're wearing casual clothing, i think you can pull of some types of athletic shoes.
for example some casual new balance shoes can be pulled off with a button down and casual chinos.
if you're talking about cross trainers (running shoes), then no, its a bad look.