"Starting with" vs. "starting from"
Please give me all the names starting with A.
Starting with A includes only words that start with the letter A.
- Adam
- Alfred
Please give me all the names starting from A.
Starting from A gives you all the words that start with A and all the words that start with the letters after A.
- Adam
- Chris
- John
Your wording makes the difference less clear. For example I think the following is clearer.
Please give me all the names starting with the letter C.
Please give me all the names starting from the letter C.
When there is no known ordering, they mean the same thing so with/from can be used interchangeably in the following example.
Let's start cutting back on our expenses, starting with/from the money we spend on food.
So I'm of the opinion they can be used interchangeably if there is no order to what is being started with/from, though with is more correct in my opinion. When order matters, starting from includes all items starting with and coming after.
OP's first sentence (#1) can mean either...
A: List all names that start with with the letter A (but don't list any other names)
B: List all names (but begin with those that start with with the letter A
...but OP's second sentence (#2) can only mean B above.
In the above, it's implicit that a notional "list" already exists, arranged in some natural sequence (probably, alphabetical), so it makes sense to start "reading out" that list from a specified point. Note that this is a "metaphoric" usage based on the spatial/directional connotations of from the beginning to the end.
But in OP's final sentence, it's unlikely any list exists at all (and even if it did, there's no obvious sequence). Idiomatically, unless there's some reason we wish to emphasise the starting point (and subsequent sequence), we start with the first item.