Copy files in subdirs to azure storage with ADF

Solution 1:

You can use the below options in the CopyActivity Source Setting:

1. File path type

Allowed wildcards are: * (matches zero or more characters) and ? (matches zero or single character); use ^ to escape if your actual folder name has wildcard or this escape char inside.
See official MS docs for more examples in Folder and file filter examples.

• wildcardFolderPath - The folder path with wildcard characters under your file system configured in dataset to filter source folders.
• wildcardFileName - The file name with wildcard characters under your file system + folderPath/wildcardFolderPath to filter source files.

2. recursive - When set to true the data is read recursively from the subfolders.

Example:

If there are only .csv files in your source directories you can simply specify wildcardFileName as just *