Best practice would probably be to avoid validation formulas altogether and handle validation using lotusscript events, but try this:
@If (@IsDocBeingEdited & UpdateDate = ""; @Failure("Please enter an Update Date/Time.");@Success)
I assume you're trying to avoid this error from popping up when the document is simply having its fields refreshed. I can't think of any other situation that this issue would apply.