Well, not really. If an object has low thermal conductivity, but is being held at a temperature of 500 degrees C, you're not going to feel "cold" if you touch it. You're going to feel the thermal conduction from the object from your hand, even if it's small. However, if an object is near room temperature, it's going to feel "cold" as your hand transfers heat energy to the object, cooling your hand, as your hand is above room temperature. In conduction, heat always flows against the temperature gradient. The higher the heat conductivity, the "hotter" a higher temperature object will feel, and the colder a lower temperature object will feel, as heat will flow faster against the temperature gradient.