如何使用 Laravel 读取目录中的所有文件内容

Question

I have so many files in a directory and I want to read all of them and save them in Database. I know how to do it but the way i know is that all file contents will load to the memory at the same time and web application will be dead. I tend to put some limits like it reads 300 files at the same time and after that it goes through the next 300 files. as you can see I have 736 files here.

this is my sample file contents:

I'm using this code to split them.

    foreach ($contents as $content) {
        $slice = preg_split("/\\r\\n|\\r|\\n/", $content);
    }

and results:

Answer 1

You can use laravel's filesytem and the Storage facade to achieve this:

$files = Storage::disk('public')->files('path/to/files');

foreach ($files as $file) {
    $contents = Storage::disk('public')->get($file);
    // Save contents to DB;
}

You could also do them in batches by building up an array of contents

$files = Storage::disk('public')->files('path/to/files');
$contents = [];
$toMove = [];

foreach ($files as $file) {
    $content = Storage::disk('public')->get($file);
    $slice = preg_split("/\\r\\n|\\r|\\n/", $content);
    
    $contents[] = [
         'metadata' => $slice[0],
         'data1' => $slice[1],
         'data2' => $slice[2],
         'data3' => $slice[3],
    ];
    
    $toMove[] = $file;

    if (count($contents) === 10) {
        DB::table('informations')->insert($contents);

        foreach($toMove as $file) {
            Storage::disk('public')
                ->move($file , 'done/'.Str::of($file)->after('/')); 
        }

        $contents = [];
        $toMove = [];
    }
}

if (count($contents)) {
    DB::table('informations')->insert($contents);

    foreach($toMove as $file) {
        Storage::disk('public')
            ->move($file , 'done/'.Str::of($file)->after('/')); 
    }
}