He’s got an apartment that legally has to be “cheap”, so he should move to an apartment priced at a normal extortionate rate so that the poor family can move in (except they probably won’t, even)

There is a limited number of public housing units and he is taking up one. If he takes up one, then the city has no option but to just have one less apartment for poor people. It’s a permanently fixed quantity that can’t be changed.