I was thinking the same thing as Jay regarding pushing vs pulling the wood. There's no way you'll be able to switch from pushing to pulling without some change in the pressure holding the wood to the fence. Make yourself a very thin, expendable push stick to work the wood in those last few inches. The other thing I find very useful are the magnetic featherboards that sit on the saw table. The really help maintain the feed alignment going in. Since you are using a plywood top, a magnetic system won't work. You might me able to devise something that would work with a wood table. Since you have to adjust it every pass, you'll need something that is not fixed in place.

Good luck.