Dave,
The 5 line XX is the most complicated reel setup I've encountered.
The best thing I think is for you to go through each of the 5 lines and determine what exactly pays and what does not pay. It will be tedious to check each kind of pay, on each of the 5 lines, but may give a baseline.
I believe you have 5 or even 6 different segments on your cuts of the back of your reel wiper assemblys, and as I recall, not all of the pays are the same cuts on the discs. You have what are called above the line and below the line cuts, which are different for each type of symbol. E.G., an orange with a cherry above it is different than an orange with a bar above it.
Because of the great complexity of these XX machines (XX means criss-cross, or 5 lines), most casinos were unable to do any modifications to the reels.
It might be of benefit to us here for you to log what the reel strips are, and what each corresponding cut is, just for our records and discussion. (That is a lot of work, so I won't hold you to it).
The guy who gave me my start on EMs was a master at reel modifications, and I have seen many, but do not remember many or even any mods that he made to criss cross machines. However, if it were a bars only criss cross, that might be in my realm of experience, as they are not quite so hairy.
Good luck and keep us posted on what you learn.
You might start out on the 3rd reel board, and take note of the grey wires, see how many there are, and record what the trace colors are. That will give you a start on how the payouts are powered through the reels.
Use the force, man.
Send some pics of the payboard, too, as it is probably not your usual run of the mill payboard.
Also, you can get a quick check to see if the reel wipers are correctly adjusted, by manually pushing them all the way back, and seeing if they land cleanly on the last set of buttons. Check my troubleshoot tips #1 post for how to do that.