Of course, it's up to you what to do. However, you do realize that by doing nothing it could be fatal.
That's why I had my gallbladder taken out. I had an attack very similar to yours. I waited for the stone to pass since during a previous attack it had passed. When that didn't happen, I had to have my gallbladder removed. Apparently, I had 3 large stones that were stuck in the bile duct. That happens sometimes---you pass a stone that is too big to fit through the bile duct.
I can't stress enough the seriousness of your situation. Get in touch with your doctor RIGHT NOW!