EXS 24 Logic Sampler Users Group

hello friends, 
      I am experiencing midi latency. Heres the deal. In the 
environment I cabled from a physical input to a toggle macro so I 
can turn loops on and off. The macro is outputted to the exs24. 
Its actually cool cause I also routed from the macro input directly 
into another exs for single shot samples. It actually works thank 
God cause I have been trying to figure this out forever. The 
problem is there is midi latency.... enough to make it impossible 
to play to a click. Any suggestions my brilliant collegues? 
Thanks... Justin