In certain comic arcs, Captain America's fate included death. But comic universes are complex and often subject to reboots and alternate timelines.
Captain America has died in the comics at various points. It depends on the specific comic series and the creative decisions of the writers. Sometimes it's a temporary plot device, and other times it has more lasting implications.