A longtime partner remembers the influential architect’s many loves, from New York City to well-stocked libraries to vodka martinis (dry, shaken, with a twist)