You are in a good place to launch from, in the middle of it all.
As for a local group, there is the High Desert Four Wheelers. They meet once a month at the mall and try to get out on a group run once a month or so. As the weather begins to cool runs will be being posted.
If you need any work or something fab'ed check out The Weld Shop in Rosamond. Guy does great work and is very meticulous.