Yes, you would need to have another column for each blank space in the data. Be sure to look at the options after the chart is made, so that empty cells are not plotted (uncheck the check box to that effect).
John Walkenbach has some instructions in his book,Excel Charts, chapters 7-8, that...