Stripped down Ubuntu

I am trying to do a very stripped down version of Ubuntu. What I would like is to have the ability to open OpenOffice, a dictionary program, the ability to read files off my USB flash drive, maybe a music player, and that's about it. I would like to not have internet capability or other distractions. Basically, I want to create an alternate OS in my preexisting machine that recreates having a stripped down old computer that I use for writing. Space is a consideration in my office, or I might just buy that old computer (though most older computers don't handle large-capacity flash drives very well...).

I have a gaming laptop, but for this I don't need full graphics capability or even to be able to use all 4 GB of RA, and I want to minimize distractions, hence the lack of internet connection. It would be nice but not essential if I could boot very quickly into this. I've installed pre-built Ubuntu as a dual-boot and in Wubi before, but I'm not sure how to approach this current idea. Is this an impossible dream? If not, I'd be grateful for some guidance.