The new homes will be built behind the refurbished library