Ben Affleck appeared downcast as he evacuated to ex-wife Jennifer Garner’s home, fleeing the raging wildfires…