Bro, do you even bushcraft?
You don't need fancy gear recommended by some "ex marine" with "25 years of EXTREME survival experience". You need a couple of basic tools (if you'll be out for more than a day or two). More importantly, you need some common sense and a little bit of ingenuity.
-Tell someone where you're going/when you'll be back
-Keep your cellphone on but conserve battery
As for gear, you will need:
Comfortable clothes, with at least one waterproof layer and an extra set of socks. You can cut holes in a garbage bag to make a poncho if you really don't have a raincoat. Check your local goodwill for gore-tex, rubberized or waxed cotton etc. Should be very easy to find SOMETHING.
-Water bottles with AT LEAST 1 liter of water per day for drinking. Bring iodine solution (costs a couple bucks). See if you can bring a metal water bottle (some universities give these out free) since you can also boil water if you have to purify it. Leads me to...
-Fire. Bring some matches in a waterproof container, bic lighter for backup. Practice making a fire in the cold and wet.
-Shelter. Like others said, just buy a tarp and wool blanket. You can skip one or both of these and make a primitive debris hut, but you'll want to practice this first.
Other shit:
If you'll be /out/ for a long time, you'll want a knife. Hit up gun shows, flea markets, craigslist, etc. Hardware store hatchet or bow saw can also be useful.
You might also want a pack. Look up surplus Alice packs, Swiss Mountain rucksacks, or just hit up thrift stores for a cheapo backpack. Seriously, this is like a $20-30 purchase. Yes, I like to hike with a $250 waxed canvas affair from frost-river. But I'm a dirty hipster, so fuck it. You don't need that if your whole thing is getting /out/ for cheap.
Lastly OP, just get the fuck /out/ your damn door and do it. Watch as many youtube videos as you want (see link below), but just go.
http://www.youtube.com/user/wildernessoutfitters/search?query=common+man