The fuel filter is located inside the fuel pressure regulator which means you have to drop the gas tank to change it. However, the fuel filter has a positively huge surface area and doesn't normally clog up... the factory considers it to be a lifetime filter. The good news is I seriously doubt that problem is caused by the fuel filter. More likely is a dirty IAC (idle air controller) which is mounted on the throttle body. When the IAC is dirty, it causes idle problems since the IAC is what provides all of the engine's air when you're not stepping on the accelerator pedal.
Cleaning the IAC is an easy thing to do that normally restores it back to 100% operation. I have described how to clean it many times here in WF including once today. Do a quick Search here in the forum on 'cleaning the IAC' and you'll find countless posts on how to clean it.