Not sure what your headphones plugged into before, but perhaps you need adapters (electronics or computer store) to make them fit the smaller diameter input jacks?
Buy.com, Amazon, or an electronics retailer such as Fry's, or Radio Shack. Some are for mono so make sure you get the right part. Tell the shop worker you need a stereo adapter.