The main thing gooten from seafood is the Omega Fatty Acids and various minerals.
If you you include various wild foods (weeds, inner bark of trees) and sprouts then its not so much of a problem. Also, if you tend to eat the seeds of the fruits you consume you'll be better off.