How did 'despite' semantically shift to signify 'without being affected by something'?

The quotes below substantiate that 'spite' in 'despite' or in 'in spite of' connotes 'scorn, contempt'. How did these meanings shift to the 'despite' meaning?

I quote Etymonline on despite (n., prep.)

c. 1300, despit (n.) "contemptuous challenge, defiance; act designed to insult or humiliate someone;" mid-14c., [1.] "scorn, contempt,"
from Old French despit (12c., Modern French dépit),
from Latin despectus "a looking down on, scorn, contempt," from past participle of despicere "look down on, scorn,"
from de "down" (see de-)
+ spicere/specere "to look at" (from PIE root *spek- "to observe").

The prepositional sense "notwithstanding" (early 15c.) is short for in despite of "in defiance or contempt of" (c. 1300), a loan-translation of Anglo-French en despit de "in contempt of."

Lexico Dictionaries defines the prep. 'despite':

[2.] Without being affected by

Merriam-Webster defines 'in spite of':

[3.] in defiance or contempt of : without being prevented by

4. What semantic notions underlie meaning 1, 2, 3 above?

5. Isn't 'scorn, contempt' a polar opposite of 'without being affected by [something]'? E.g. vegans scorn human meat consumption that many of them protest. So vegans are undoubtedly affected by human meat consumption, or else they wouldn't protest!

Solution 1:

The path of despite and in spite of from their French origins to their modern usage leads through a process of semantic bleaching, where the lexical meaning fades in favor of function, to reach a state of grammaticalization, where despite can only be defined by what it does — a concessive preposition or conjunction — rather than what it means.

In this particular case, it is a matter of the affect or attitude inherent in the word — contempt, defiance, strong objection — reducing to a mere contrast.

and that riall chyrche of Sancta Sophia robbed and despoilled and the reliques and ymages and the rode [rood, i. e., cross] drawe aboute the stretes whiche was done in despite of cristen feith … William Caxton, Chronicles of England, 1480.EEBO

A modern reading of in (de)spite of here is impossible, as those who paraded about the icons and reliquaries of Hagia Sophia were not themselves Christian. The meaning here is still lexical: in contempt of.

Other early texts are more ambiguous:

… they helde in perpetual pryson, the most noble emperour Valerian in despite of all the romaynes and many other princes, whiche wrote for his delyueraunce … Roger Ascham, Toxophilus the School of Shootinge, 1545. EEBO

But if in all this, i had said nothing, but that stil in spite of all that hath beene said, these and the like masterpieces of the world, would of force bestow some happinesse on man, … Francis Rous, The Arte of Hapines, 1619. EEBO

Others in a great river haue beene carried away by the strength of the streame in spite of their skill in swimming, … — Stephen Bradwell, Helps for Suddain Accidents, 1633. EEBO

… when I haue harried him thus two, or three yeare, though he sue in forma pauperis, in spite of all his thrift, and care he'le grow behind-hand. — Philip Massinger, A New Way to Pay Old Debts (comedy), 1633. EEBO

Discerning the level of defiance in these passages is, of course, subjective, but while one might keep someone prisoner in defiance of those demanding his release, it’s difficult to see a swift current “defying” someone’s swimming skills or a man his own thriftiness. These sentences, however, are cherry-picked from tens of others where some degree of affect, and thus lexical meaning, is still possible, even probable.

Around the 1680s and 90s, passages more patient of a modern, grammatialized usage become more frequent:

… for air is so subtle a matter, that it will be apt to insinuate it self by degrees into the tube, in spite of all the quick-silver within it, … — John Smith, A Complete Discourse [on the Barometer], 1688. EEBO

… but in spite of all that art can do, men will abound in their own sense, and there will for ever be as many diversities of opinions, as there are of palats. — Benedict de Spinoza, (unknown trans.), A Treatise Partly Theological, and Partly Political, 1689. EEBO

Demosthenes did by great resolution and almost infinite pains, and after a long habit, alter the natural imperfection of his speech, and even in despite of nature became the most eloquent man perhaps that ever lived. — John Tillotson, Six Sermons, 1694. EEBO.

And in the 18th c., grammaticalization seems complete:

Under your auspices, this lord, in spight of all his unpopular actions, carries away the hearts of the people, not by the fineness of his address, or any particular deset, but by your favour. — Thomas Brown, “A Declamation in Praise of Wealth_, Works, 1744.

Solution 2:

You have come within inches of answering your own question.

The knight takes of his gauge (glove) and throws it contemptuously at you feet. But in despite of (scorn at) this, you pick up the gauge, slap the challenger's cheek and accept to fight. In other words,

even though the knight has challenged you to a fight to the death (unless you apologise, or withdraw your charge of treason), you are going, in despite of this, to stick to your guns (or sword, or lance).

'Despite', modifying a noun phrase, is doing the same job as a concessive clause.

1. Even though the Green Knight challenging him was terrifyingly huge, Sir Gawain accepted the challenge.

   1a. Despite the terrifying size of the Green Knight who had challenged him, Sir Gawain accepted the challenge.

In the same way, the following two sentences are more or less equivalent.

2. Even though the rain was pouring down, Colonel Brandon strode out to rescue Marianne.

   2a Colonel Brandon strode to rescue Marianne, despite the pouring rain.