No it wouldn't, the n and the p silicon would be shorted together. You'd have a nice linear curve on your scope. To have a pn junction an electric field is set up between the regions depleted of carriers which prevents additional holes or electrons from the n+ and p+ regions from filling in. This bias cannot be maintained across a conductor. This is why in the manufacturing process it is critical to keep metallic contaminants away from the silicon where they can lead to increased junction leakage and possibly complete shorts.