Take a look at badbugs.org (or search badbugs on google) and read about them. Then you can at least remove that from your possible causes list. These two bugs can cause tons of trouble and the symptoms you listed (among others).
You don't have to have IBS as well, though anyone with 'IBS' so be check for these bugs via, a 3-DAY Stool Test WITH Fixative by a proper lab. This is very important.
Anyway, look into it, if you feel it is possible.