Captain America does kill in the comics, but it's not a routine thing. Usually, it happens when there's no other choice to save lives or uphold justice in extreme circumstances.
Yes, Captain America has killed in the comics. However, such instances are rare and usually come with significant consequences and internal conflicts for the character.