I removed the baffle from my Yosh. It is loud as hell. It will sound cool for about a month then get aggrevating after that.
I have the carbon fiber type... I had to drill out the rivets and pull off the exit cap. After that you just hafta reach in and pull out the fiberglass packing.
Just a suggestion:
If you plan to take out the packing and leave it out, consider welding a sleeve onto the internal pipe to cover the holes in it. This will cut down on noise and back pressure. You may have to have the bike re-mapped... I haven't but I havent had it checked to see what the change in power has been either