yes absolutely, i imagine that too! conversely, i think mihawk would have a little bit of trouble adjusting his balance and reach with a body missing one arm, as well. it's interesting to think about how they both would be forced to change their fighting style, and whether or not they would exchange swords.
mihawk's been seen using yoru with just one hand so he could probably pull it off with shanks's body. also interesting to think about shanks tripping up on having two arms until he naturally slips into his old fighting style again--or would he? because there's also the question of muscle memory, right? would mihawk's body automatically do things that shanks isn't predisposed to doing, and vice versa?
the other thing i find intriguing about body swapping in one piece is the question of whether or not your haki powers would switch as well. they say haki is spiritual presence, so presumably your haki switches if your spirits switch, but if it's the kind of spirit that's tethered to the presence of the body? then consider mihawk having the strongest conqueror's haki out on the blues, or shanks being able to use observation haki at mihawk's level, practically being able to predict the future--or mihawk, able to counter with shanks's haki-kill technique. food for thought!