There is no point in displaying out of stock products in the upsell block because ift he product cannot be purchased there is no point in offering it as an upsell. Please do not show out of stock products there.