Several kanji with the “thread” component (糸) represent colors. Originally, these characters meant “green thread,” “purple thread,” and so on.
In the case of 紅, the エ usually means “work” but acts phonetically in this case to express “pink.” So 紅 once meant “pink thread” but then came to mean “pink” and changed again to mean “crimson.”