If you're not on a VStrom or similiar dual-sport bike, I'd advise to stay away from Imogene Pass Road; too hairy for regular pavement road-riders and slicker than snot when it rains up thar!!!, which is about every afternoon in the summer. I think that you are talking about Colorado Hwy 62 that heads south over Lizard Head Pass towards Telluride. Paved, fun, and beautiful!! One of my favorite autumn rides; golden aspen with copper scrub oak and green spruce. Too much, man!
Spend the night in Ouray and take a soak in the town's hot springs pool or cruise further down the road to Orvis Hot Springs. It's a privately owned resort and small, but it will blow your mind when you hit the water and are under a sky like you've never experienced. You can check out accommodations there, but they may be booked solid during tourist season. It's clothing optional after dark and if your and a honey are together; it's a slice of heaven.
Next day, you can head up over Lizard Head to Telluride, if that's your gig to hit the "other Aspen".
God, it used to be such a nice, quiet place, but got yuppified around 1985 and hasn't looked back since. Every freakin' chamber of commerce in western colorado has become a pimp factory for fabricated "high country adventures" and similar garbage. It's still about the land, my friend.
My suggestion would be to head over to Lake City where the air is purer and not so crowded in the high, high country.
Gunnison and Crested Butte are a better choice as well if you are seeking quieter pastures.
When are you visiting as Telluride has a couple of major music festivals in the summer? The town gets overrun and if you are looking for mellow...it's tough to find it with 25,000 people in a box canyon.
Good ride to you.

Kirk out.