Yes!  It does matter if either

     a) stars drift across the field during a single night

  or

     b) stars appear on different pixels in images taken on 
            different nights