A disabled man from Bristol says he felt he was in "jail" during the nearly nine years he spent in a council-run care centre.