Bloomsbury, the world’s largest auctioneer of rare books, is forming a photo department at its recently expanded New York branch.