The temperature-dependence of the hydrodynamic diameter and colloidal stability of gold-polymer core-shell particles with temperature-sensitive (poly(N-isopropylacrylamide)) and temperature-insensitive shells (polyallylaminine hydrochloride/polystyrensulfonate, poly(isobutylene-alt-maleic anhydride)-graft-dodecyl) are investigated in various aqueous media. The data demonstrate that for all nanoparticle agglomeration, the presence of salts or proteins in the dispersion media has to be taken into account. Poly(N-isopropylacrylamide) coated nanoparticles show a reversible temperature-dependent increase in size above the volume phase transition of the polymer shell when they are dispersed in phosphate buffered saline or in media containing protein. In contrast, the nanoparticles coated with temperature-insensitive polymers show a time-dependent increase in size in phosphate buffered saline or in medium containing protein. This is due to time-dependent agglomeration, which is particularly strong in phosphate buffered saline, and induces a time-dependent, irreversible increase in the hydrodynamic diameter of the nanoparticles. This demonstrates that one has to distinguish between temperature- and time-induced agglomerations. Since the size of nanoparticles regulates their uptake by cells, temperature-dependent uptake of thermosensitive and non-thermosensitive nanoparticles by cells lines is compared.