The cosmic gamma-ray spectrum from secondary particle production in the metagalaxy