iTunes: Move files off a network drive

I have somehow screwed up my iTunes database such that iTunes/iTunes Music Library.xml contains network paths:

<key>Location</key><string>file://localhost/Volumes/media/Music/iTunes/iTunes%20Media/Music/Unknown%20Artist/Unknown%20Album...</string>

Most of the files are where they belong, in file://localhost/Users/Shared/..., but not all. Furthermore, all of the files are located on the local disk, e.g. /Volumes/media/Music/iTunes/iTunes Media/Music/Artis/Album/Track.mp3 has been copied into the local directory /Users/Shared/Music/iTunes/iTunes Media/Music/Artis/Album/Track.mp3.

I used File > Library > Organize Library..., and enabled the Consolidate files checkbox (along with Reorganize files in the folder "iTunes Media"), but this did not move all of the network-located files onto the local disk.

iTunes/iTunes Music Library.xml itself appears to be a write-only file, based off the contents of the binary file iTunes/iTunes Library.itl, so closing iTunes, editing iTunes/iTunes Music Library.xml to correct the paths, and restarting iTunes doesn't fix the issue.

Is there a way to update the iTunes database so that it uses local file paths instead of network paths for some of the files? (This impacts 9888 entries out of 11449 entries within iTunes.)

I have a similar/identical issue with iPhoto, in which some files are network located, and some aren't, and I don't know how to consolidate them to all be on the local machine...

Solution 1:

Reset the iTunes Library

Open the iTunes music folder in Finder ( it’s in your home folder / Music / iTunes) and drag iTunes Music Library.xml and iTunes Library.itl out on the desktop. This will reset iTunes next time you start it, but don’t start it yet. We’ll be working on the xml file, while the itl file is just there for backup.

Change the location of where iTunes keeps the music

In the iTunes preferences > Advanced, click on “change” next to the “iTunes music folder location”, and select your hard disk.

Look inside iTunes Library to see what the problem is

If your iTunes library is huge, it’s a good idea to use Terminal to look at the first few lines, which you can do easily with

head -n100 /Users/ME/Desktop/iTunes\ Music\ Library.xml

(you can just type “head -n100 ” and drag the file onto Terminal to let OS X type out the name for you) The output will be something along the lines of

  <?xml version="1.0" encoding="UTF-8"?>
    <!DOCTYPE plist PUBLIC "-//Apple Computer//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
    <plist version="1.0">
    <dict>
      <key>Major Version</key><integer>1</integer>
      <key>Minor Version</key><integer>1</integer>
      <key>Date</key><date>2012-08-13T21:09:21Z</date>
      <key>Application Version</key><string>10.6.3</string>
      <key>Features</key><integer>5</integer>
      <key>Music Folder</key><string>file://localhost/Volumes/HD1T/Music/</string>
      <key>Library Persistent ID</key><string>C326B89DCF4457DF</string>
      <key>Tracks</key>
      <dict>
          <key>41557</key>
          <dict>
              <key>Track ID</key><integer>41557</integer>
              <key>Name</key><string>Fifths (Jazzanova 6 Sickth Mix)</string>
              <key>Artist</key><string>Ski</string>
              <key>Album</key><string>Jazzanova: The Remixes, 1997-2000</string>
              <key>Grouping</key><string>where:de</string>
              <key>Genre</key><string>ambient-synth-90s</string>
              <key>Kind</key><string>MPEG audio file</string>
              <key>Size</key><integer>19718194</integer>
              <key>Total Time</key><integer>482925</integer>
              <key>Disc Number</key><integer>2</integer>
              <key>Disc Count</key><integer>2</integer>
              <key>Track Number</key><integer>1</integer>
              <key>Track Count</key><integer>10</integer>
              <key>Year</key><integer>2000</integer>
              <key>Date Modified</key><date>2008-12-05T14:26:06Z</date>
              <key>Date Added</key><date>2012-07-14T07:42:37Z</date>
              <key>Bit Rate</key><integer>320</integer>
              <key>Sample Rate</key><integer>44100</integer>
              <key>Play Count</key><integer>12</integer>
              <key>Play Date</key><integer>3321087305</integer>
              <key>Play Date UTC</key><date>2009-03-28T10:15:05Z</date>
              <key>Rating</key><integer>80</integer>
              <key>Album Rating</key><integer>80</integer>
              <key>Album Rating Computed</key><true/>
              <key>Artwork Count</key><integer>1</integer>
              <key>Persistent ID</key><string>E5B52C3DE807B7DC</string>
              <key>Track Type</key><string>File</string>
              <key>File Type</key><integer>1297106739</integer>
              <key>Location</key><string>file://localhost/Users/ME/Music/iTunes/iTunes%20Media/Music/Ski/Jazzanova_%20The%20Remixes,%201997-2000/Fifths%20(Jazzanova%206%20Sickth%20Mix).mp3</string>

You need to look out for the file:// bit of the xml. Here it is telling me that it is looking into /Users/ME/Music/, i.e. my home folder instead of my external hard disk.

Use sed to fix the path and create a new xml file

sed is a nifty unix utility which you can use from Terminal. It can open a file, go through it line by line, change things on each line, and then put the result in another file.

sed 's/file:\/\/localhost\/Users\/ME\/Music\/iTunes\/iTunes%20Media\//file:\/\/localhost\/Volumes\/HD1T\//'  < /Users/ME/Desktop/iTunes\ Music\ Library.xml  > /Users/ME/Music/iTunes/iTunes\ Music\ Library.xml

Here’s a breakdown of what the command does.

sed calls the sed command - it stands for Stream Editor

’s/…/…./’ sed will itself need instructions, which are strings hence the ’ (apostrophe). s/a/b/ means “if you find an a, substitue it with b”

file:\/\/localhost\/Users\/ME… this is the string we are looking for. Note that given that forward slashes are used by sed for s/…/…/, if you need them in the string you have to escape them with backward slashes

file:\/\/localhost\/Volumes\/HD1T\/ the string we are replacing with

< /Users/ME/Desktop/iTunes\ Music\ Library.xml The less than sign means “use this file as input” - in this case, the xml file I had dragged to the Desktop

> /Users/ME/Music/iTunes/iTunes\ Music\ Library.xml and this means “create this file as output”. We are asking sed to recreate the xml library file from the one on the desktop, but changing some bits around as it does so

Create a broken iTunes library

Now this is important - if you just start iTunes now, with the new .xml file there and no .itl file there, nothing will happen. iTunes will ignore the xml file, and just reset to an empty library. But if iTunes finds a broken .itl file, it will use the .xml file we just fiddled with to recreate the .itl file. The easiest way to create a broken .itl file is from terminal:

touch ~/Music/iTunes/iTunes\ Library.itl

which will create an empty file - broken enough for iTunes.

Restart iTunes

Now iTunes will finally pay attention to the xml file - it will show a dialog saying ‘Importing ‘iTunes Music Library.xml’…” This may take a while, even though it isn’t actually copying mp3 files around.

Source: http://gotofritz.net/blog/howto/fixing-itunes-cannot-find-music/

Solution 2:

I haven't tried the much better sounding answer by @Tesujin. I'm certain his is much faster than what I did do.

This "solution" worked for me. It also consumes lots of disk space. However, as an added "benefit," it found several files which were overlooked...

1. Click iTunes > Preferences...
2. Click the Advanced tab.
3. Change the iTunes Media Folder location, e.g. to another disk. Something with a path name that won't be too similar to the current path, to make grep(1) easier later.
4. Click OK, and dismiss the Preferences window.

5. Click File > Library > Organize Library..., enabled the Consolidate files checkbox, and click OK.

   This will result in copying over your library into the new location, "fixing up" the paths as it goes. This in turn means you need enough free disk space to store two complete copies of your music library.

6. Quit iTunes.

7. Verify the contents of iTunes/iTunes Music Library.xml, by grepping that it doesn't contain the previous path(s):

   $ grep Users/Shared 'iTunes Music Library.xml'
   $ grep Volumes/media 'iTunes Music Library.xml'
   

   What you want is no matches. What I actually got was several matches; the network mount was still being used for ~10 files, while the previous location had ~5 matches.

At this point, more investigation was warranted. As It Turns Out™, my network share had a case-sensitive filesystem, so the files which weren't copied were because of case changes, e.g. the song was actually in 'ArTist/Album/Song.mp3' while there was also an 'Artist/Album/Another Song.mp3' file; iTunes apparently doesn't like artists/albums which differ only in case, and there were ~10 of these.

Fixing these remaining issues was simple, if weird:

1. Find the source file in Finder. (This may require copying the file via root shell on the NAS... ;-)
2. Find the "bad" entry within iTunes.
3. File > Get Info the entry.
4. iTunes may complain that it can't find the file. Refer iTunes to the file in (1).
5. Go to the File tab, and double-check the location entry. For example, the location was on my NAS.
6. Click OK
7. Drag the file in (1) onto iTunes. iTunes will now copy the file, thus removing the need for my NAS for this particular file.
8. Verify that the location is fixed via (4) and (5).

What's funny is that if I skipped the initial steps (2)-(5), iTunes would copy the file but there would be two of the songs within iTunes, one on the NAS/wrong location, and one just added. I needed to Get Info the file first in order to "update" the file location.