Design Dilemma

I've cast on twice for my Lima Fisherman's Rib Pullover. The raglan sleeve increases are really mucking things up.

First I tried knit front and back and although I can keep in pattern as far a the ribbing, the increases are regular knits and purls. This makes them stand out a bit and makes the yoke puff up around each raglan increase. No Bueno.
I cast on again and tried make one increases. This didn't work because the ladder you work the make one into is the same on either side of the marker and stretches out the increases making the sweater gap around each raglan increase. Strike Two.

Next I searched Fisherman's Rib sweaters on Ravelry: "top down raglan fishermans rib" and got no matches! Inconceivable! So I tried again and searched: "fishermans rib sweaters" to see how other designers have treated this dilemma. I learned that they don't, at least the ones that came up on my search. The sweaters were either had crew necks, saddle shoulders, or set in sleeves.

The design elements that are important to me are that the sweater is a v-neck and of course, I'm committed to a Fisherman's rib.

I'm going to cast on again, this time allowing for a set-in sleeve instead of raglan. I found a very helpful article on Knitting Daily. May the Force be with me.