If your agency was only interested in long term work and they are who you have gotten the intervie through then its no problem. if your employers mention that they knew you were there short term u can explain about what your agency asked of you. or u can bite the bullet and explain BEFORE they check your references. personally as you have not done anything wrong i would just leave it until your employers have finished checking your references.
try not to worry though! x