“International themed” or “internationally themed”?
It depends on what you are calling "international."
If the party is international, then the adjective "international" modifies the noun party, and it is "an international, themed party" but we don't know what the specific theme is.
If the theme is international, then it is "an internationally themed party" so that the adverb "internationally" modifies the adjective "themed."