While the cost to customers was relatively small, analysts said the damage to the industry and the exchange could be much greater. The BATS announcement, one in a monthslong succession of glitches, snafus and misfires at exchanges and brokerages, threatens to further undermine investor confidence in financial markets.