递归过滤目录中的所有文件，然后将它们移动到一组新文件夹中，每个文件夹中每个目录的文件数受限制

Question

Sorry for the long title, just trying to be specific.

Here's my scenario today (as the title alludes):

Root Dir has x amount of folders, say 20. Each folder has files and possible sub-folders. I know that I only care about the files in any folder with "Hold" in the folder name.

I need to target all files, no matter the type, in the folders and subs. I then need to move the target files to new folders in the root dir. Each folder must only house 50,000 files and then roll over to the next folder for the next 50k. That process will repeat until all the targets have been moved to their new dir.

Here's the PS code I have so far:

#SETUP
$FileDir = GCI -Path C:\TEST -Filter 'Hold*' -Directory -Recurse
$FilesinHOLD = GCI -File -Path $FileDir.FullName -Recurse
$NewDir = 'C:\TEST\Limited'
$Limit = '50000'

#Execution
$FilesinHOLD | Select-Object -First $Limit | Move-Item -Destination $NewDir

Where I'm left is looking for the mechanism to auto-create a new "Limited" folder and put 50k in there and then repeat the process. I was wondering if it would be possible to just render the same name simply followed by (2) and then (3) and so on automatically as the default behavior in Windows Explorer..? It would look like this:

C:\\TEST\\Limited

C:\\TEST\\Limited(2)

C:\\TEST\\Limited(3)

I would finish up by running back through and deleting the now empty "HOLD" directories from which I pulled the files from after verifying they are empty via GCI or Measure-Object.

Thanks in advance for your input.

-CE

Answer 1

Rather than grabbing all the files then removing them from the array, I would move them as I recurse the directories, then loop on that:

$rootDir = 'C:\TEST\Limited' 
$NewDir = $rootDir
$Limit = '50000'
$filesMoved = $Limit
$folderCnt = 1
while($filesMoved -ge $limit)
{    
    $filesMoved = GCI -Path C:\TEST -Filter 'Hold*' -Directory -Recurse | GCI -File -Recurse | Select-Object -First $Limit | Move-Item -Destination $NewDir -passthru | measure | select -expand count
    $folderCnt += 1
    $newDir = $rootDir +"($folderCnt)"
}