Yes — the delivery fee is based on the distance between you and the store, not the number of items in your order.
So even if a few items are cancelled by the store, the delivery fee will still apply.