Yes,it does affect your fast. Everytime you put something in your mouth it activates your digestion system. You do not want a sleeping system to be awaken. There are many people on this forum will tell you otherwise. Get a good tounge scraper and clean your tounge everytime when you feel you have stuff accumulating on it.
Many people brush with there finger and water only to feel clean.