If it's at a Chinese seafood restaurant, you don't need to wear a suit, smart casual is fine. That said, I would drop the sweater. Make sure your shirt and pants are pressed, and wear some nice shoes and you'll be fine. Not everyone goes through life having to wear a suit and tie