I really liked the Annex Katsutaro Ryokan in Tokyo. It isn't in Ikebukuro but is near the Yamanote line so you can get to Ikebukuro quickly. It does fit your budget too.
Review of the hotel, inn, and ryokan we stayed at in Tokyo, Hakone, and Kyoto Japan