"And I you" with "you" as an indirect object
Solution 1:
According to The Cambridge Grammar of the English Language (CGEL), the version without with is not grammatical.
Per chapter 15 "Coordination and supplementation", § 4.2 "Gapped coordination (Kim is an engineer and Pat a barrister)", p. 1338:
One limitation is that the antecedent cannot end with a preposition or infinitival to, so that the underlined items cannot be omitted in [9] even though they appear in the first clause too:
[9] i I went by car and Bill __ by bus. -- ii Kim was hoping to go to university and Pat __ to join the family business. --
(where the "antecedent" is the part that the gap refers back to; "went" in the first example, "was hoping" in the second).