Short answer: Yes it'll increase your electric bill.
Long answer: No it won't increase it as much as you're expecting- your computer won't draw the full 250w, it'll pull only what it needs based on your usage. So it probably won't cost you a full $23 a month. I'd expect more like $5-15 a month difference.