Anza Borrego Desert State Park is always nice in November. It's about a 2-hour drive from San Diego, depending on what part of town you're in. Lots of trails to choose from, and lots of varied scenery. Fish Creek/Sandstone Canyon is very nice. Fish Creek is about 12.5 miles of easy driving in a very scenic wash, with interesting geology to check out. Turn into Sandstone Canyon and go as far as you can (not sure just where that is right now, it's changed a little over the last year or two), then turn around go back to pavement the same way you came in.
The area around Borrego Mountain Wash is also very nice, and pretty much stock friendly. A nice route for a day trip in Anza Borrego is to start at the north end of Inspiration Wash off of S-22 and take that south past the open space preserve and then past the dump, then keep going south until you connect up with San Felipe Wash near the Borrego Sink. From there head east, take a side trip up Borrego Mountain Wash (and back out the way you came), then continue east in San Felipe and turn south in Blow Sand Canyon. Take that up to the Goat Trail, and go west-ish until you meet up with Buttes Pass Road. At that point you're back close to Hwy 78, with a few options for additional exploring.
The whole area around 17 Palms, Arroyo Salado and the Pumpkin Patch is very nice too.
Another idea, if you prefer low mountains (of sorts) is to drive up to the top of Los Pinos Mountain via the one-lane paved shelf road from Corral Canyon OHV, and then come back down via the Espinosa Trail. Best to check the conditions of that trail with the Cleveland NF ranger station in Alpine first though. You'll also need an Adventure Pass or a Federal lands pass (like an annual all-access pass that you can get a the various National Parks).
What days are you going to be out here? Maybe we can set something up.
