I fed the output to the VCO (RF generator device) with this configuration, and it does lock, using positive polarity (M2=1, M1=0) - I'm comparing the Ref signal and the Mux Out. Changing the phase or frequency (within a small range of frequency about 10 Hz) the RF will respond and adjust/lock.
I had to use 70 nF instead of 82, 228 nF instead of 390, and 140 Ohm instead of 100 Ohm.