I’m looking for a word that refers either to hating a specific place, or someone who hates a specific place.
If there is a word for hating the place you’re in, that would also work.
I think what you are looking for is topophobia from Greek “topos” (place) and “phobos” (fear).
a fear of a certain place or location
His topophobia of his hometown creeped up on him. She has been quite topophobic of Bulawayo lately.
See it a Dictionary.com.
Or if you specifically want to refer to a home or houses, oikophobia from Greek “oikos” (home), or domatophobia from Greek “domos” (house). See it a Dictionary.com.
But since you are saying that the place you are in may also work, then I suggest the simplest solution of claustrophobia from Latin “claudere” (to close), which is though being a Greek-Latin hybrid is very known and widely used.
2 : a feeling of discomfort or discontent caused by being in a limiting or restrictive situation or environment
the claustrophobia of small-town life
Also this list can help.