Architecture sits at an intersection between drawing and sculpture, with a markedly more utilitarian execution than either on their own. There is also a requisite level of, at the very least, artistic inclination or sensibility to do interior design for a home well. I get the point you're getting at, though similar things to what you describe have been attempted- largely as "postmodern statement pieces" more than anything else, but to say "houses/buildings aren't art because le corbusier was a faggot" is like saying paintings can't be art because picasso sucked dick for cock.