On May 6th, 1949 EDSAC (or Electronic DelayStorage Automatic Calculator) ran its first programs, calculating a table of squares and generating a list of prime numbers.
Before the introduction of magnetic tape, digital storage for early computers used punched cards, paper tape as well as more exotic technologies such as mercury delay lines and the phosphors on cathode ray tubes.