Julius Castle, a restaurant with a castle-like exterior located on San Francisco's Telegraph Hill, was used as the exterior of the house in the film. The filmmakers built a mansion-like exterior around parts of the restaurant to hide certain elements (such as the "Julius Castle" sign on the outside wall). Built in 1922, Julius Castle served as a high-class restaurant until it closed in 2008. (It is currently for sale.)
The grocery store where Tony worked was an actual store called Speedy's. It was open 94 years from 1914 to 2008 at 301 Union Street San Francisco, CA 94133. Google Maps Streetview shows that the corner store building still looks similar to the movie.
The role of the real Karin Dernakova in the concentration camp was played by Natasha Lytess. Just a few years later, she was employed by Marilyn Monroe as her first on- and off-set drama coach. Eventually she was replaced by Actors Studio guru Lee Strasberg and his wife Paula Strasberg, who served as on-set coaches during Monroe's last six films.