Inference-Time Defense