Frost arrows are elemental arrows crafted with materials collected in the mountains. They deal bonus damage to swamp monsters that are vulnerable to frost.
As with all elemental arrows, you should avoid using frost arrows in their native biome (mountains) because most enemies there are resistant to frost.