A dirt road called Kelly Stand running from Route 100 near Stratton Mountain over to East Arlington has not only some wonderful scenery, but a whole lot of peace and quiet that is just right for camping.
This road runs through the National Forest, and as I understand it, camping is not only allowed, but is free. No permits, no nothing. Along this road (nearer to the East Arlington side) are these pull-out areas that have rock fire rings, and if the space isn't taken, it will be after you settle there. Of course, take nothing but pictures and leave nothing but footprints. A stream runs along the road, a perfect background for a great nights rest. The closest supplies would be located in the town of East Arlington, and you are also about 20 minutes away from Manchester VT, which is what I like to refer to as outlet town. Plenty of outlet stores there for your shopping pleasure. You can collect wood for your fire from the immediate area, or there is a private campground called Camping on the Battenkill that seems pretty friendly about selling a bundle or two of wood if you wish. (Go north on 7A - about 3 minutes from the Stewart's store.)