将Windows文件格式转换为Linux格式

Question

I am using Linux machine for development and then deploying my script files to Azure function app which is a Windows machine.

Then I am copying shell script files to wasb from Azure function app.

I am getting following error when running shell script in Edge node on Azure HDI cluster

$'\r': command not found

My script files are not executed properly.

What is the best way to convert dos2unix option in C# Azure function?

Answer 1

You don't have to do anything special to read a file that contains Unix-style newlines ( \\n ) instead of \\r\\n . .NET IO methods treat both as newlines.

You could write

var lines-File.ReadAllLines("myUnixText.txt");

or

using(var reader=File.OpenText("myUnixText.txt"))
{
    string line;
    while( (line=reader.ReadLine()) !=null)
    {
        // Do something
    }
}

to read lines whether the line ending is \\r or \\n

To prove it :

var numbers = new[]{1,2,3,4,5,6};
var lines=String.Join("\n",numbers);
File.WriteAllText("myUnixText.txt",lines);

var newLines=File.ReadAllLines("myUnixText.txt");

Debug.Assert(newLines.Length==6);

Even though only a single string was written, File.ReadAllLines read 6 lines from the file

Answer 2

You could upload your file to Linux and change file format.

dos2unix <filename>

Another easy solution is that if you install Notepad++, it supports automatic conversion format to Unix(LF).

Answer 3

I am calling Dos2Unix(filePath) method before copying file from Azure function to WASB.

Call method:-

Dos2Unix(D:\home\site\repository\sample.sh);

Following method actually works for me in C# Azure function.

private void Dos2Unix(string fileName)
{
    const byte CR = 0x0D;
    const byte LF = 0x0A;
    byte[] data = File.ReadAllBytes(fileName);
    using (FileStream fileStream = File.OpenWrite(fileName))
    {
        BinaryWriter bw = new BinaryWriter(fileStream);
        int position = 0;
        int index = 0;
        do
        {
            index = Array.IndexOf<byte>(data, CR, position);
            if ((index >= 0) && (data[index + 1] == LF))
            {
                // Write before the CR
                bw.Write(data, position, index - position);
                // from LF
                position = index + 1;
            }
        }
        while (index >= 0);
        bw.Write(data, position, data.Length - position);
        fileStream.SetLength(fileStream.Position);
    }
}

Update 1:-

Here is my code to upload files(*.sh, *.jar, *.img, etc) to blob storage.

public bool UploadBlobFile(string containerName, string blobName, string filePath)
{

    try{
        CloudBlobContainer container = blobClient.GetContainerReference(containerName);
        CloudBlockBlob blob = container.GetBlockBlobReference(blobName);
        // convert dos2unix format
        Dos2Unix(filePath);
        using (var fileStream = System.IO.File.OpenRead(filePath))
        {
            blob.UploadFromStream(fileStream);
        }
        return true;
    } catch (Exception e) {
        log.Info("Exception: " + e);
        return false;
    }
}

Answer 4

It seems that you have Windows style line endings (\\r\\n) - you need to change them to unix style (\\n).

Refer: '\\r': command not found and Convert DOS line endings to Linux line endings in vim

Answer 5

There is a tool in sourceforge that can do it. Is has been actualized recently a runs very well.