Your motor sounds like the famous Hippo-build. (From another forum I visit).
I’ll throw my two cent in, its just my opinion.
Yes, I think you will lose at least 5 Horsepower. Throw them true duds on and have it re- dyno’ed (if you an afford it), I’ll bet you a few cold ones that it will be around 90HP.
It will probably run better with the stock pipes on it than the TD’s.
I like to think I have a finely calibrated A$$, the little voices in my head try to tell me that even after I wash and/or change the oil that my cycle runs faster. My Dyno is the big black one, my seat of the pants has many twists of the wrists for the proper calibration of my cycle and I like to imagine that I can feel the slightest adjustments, so yes, I think one can easily will feel the difference of 5 or 10 HP.
What it really boils down to is, if you like the sound of the true duals, then by all means put them back on.
A man’s (or women’s) Harley is about personal preference, making your Harley your own. Who cares what the Jones's or Smith’s think about your bike. Getting the sound right (personal preference) is one of the first things people do to their Harley, so, do what makes you happy; that even goes for those dreaded drag-pipes.
