>>5935817For a solid single color background, I would suggest using pvc board/foam board, they are made in an array of colors. Or you can use poster board or construction paper to change the color. That shouldn't cost more than $5 in total.
I second the idea to shoot outside, I've seen some really good photos taken in nature. That's also where I take all of my photos, since I don't have a diorama or anything to use inside.