Python - 如何使用NUL分隔行讀取文件？

Question

我通常使用以下Python代碼從文件中讀取行：

f = open('./my.csv', 'r')
for line in f:
    print line

但是如果文件是由“\\ 0”（而不是“\\ n”）以行分隔的呢？ 是否有可以處理此問題的Python模塊？

謝謝你的建議。

Answer 1

如果您的文件足夠小，您可以將其全部讀入內存，則可以使用split：

for line in f.read().split('\0'):
    print line

否則，您可能希望從有關此功能請求的討論中嘗試此配方：

def fileLineIter(inputFile,
                 inputNewline="\n",
                 outputNewline=None,
                 readSize=8192):
   """Like the normal file iter but you can set what string indicates newline.

   The newline string can be arbitrarily long; it need not be restricted to a
   single character. You can also set the read size and control whether or not
   the newline string is left on the end of the iterated lines.  Setting
   newline to '\0' is particularly good for use with an input file created with
   something like "os.popen('find -print0')".
   """
   if outputNewline is None: outputNewline = inputNewline
   partialLine = ''
   while True:
       charsJustRead = inputFile.read(readSize)
       if not charsJustRead: break
       partialLine += charsJustRead
       lines = partialLine.split(inputNewline)
       partialLine = lines.pop()
       for line in lines: yield line + outputNewline
   if partialLine: yield partialLine

---

我還注意到你的文件有一個“csv”擴展名。 Python內置了一個CSV模塊（import csv）。 有一個名為Dialect.lineterminator的屬性，但它目前沒有在閱讀器中實現：

Dialect.lineterminator

用於終止writer生成的行的字符串。 它默認為'\\ r \\ n'。

注意閱讀器是硬編碼的，可識別'\\ r'或'\\ n'作為行尾，並忽略行終止符。 此行為將來可能會發生變化。

Answer 2

我修改了Mark Byers的建議，以便我們可以使用Python中的NUL分隔行READLINE文件。 這種方法逐行讀取一個可能很大的文件，應該更有效。 這是Python代碼（帶注釋）：

import sys

# Variables for "fileReadLine()"
inputFile = sys.stdin   # The input file. Use "stdin" as an example for receiving data from pipe.
lines = []   # Extracted complete lines (delimited with "inputNewline").
partialLine = ''   # Extracted last non-complete partial line.
inputNewline="\0"   # Newline character(s) in input file.
outputNewline="\n"   # Newline character(s) in output lines.
readSize=8192   # Size of read buffer.
# End - Variables for "fileReadLine()"

# This function reads NUL delimited lines sequentially and is memory efficient.
def fileReadLine():
   """Like the normal file readline but you can set what string indicates newline.

   The newline string can be arbitrarily long; it need not be restricted to a
   single character. You can also set the read size and control whether or not
   the newline string is left on the end of the read lines.  Setting
   newline to '\0' is particularly good for use with an input file created with
   something like "os.popen('find -print0')".
   """
   # Declare that we want to use these related global variables.
   global inputFile, partialLine, lines, inputNewline, outputNewline, readSize
   if lines: 
       # If there is already extracted complete lines, pop 1st llne from lines and return that line + outputNewline.
       line = lines.pop(0)
       return line + outputNewline
   # If there is NO already extracted complete lines, try to read more from input file.
   while True:   # Here "lines" must be an empty list.
       charsJustRead = inputFile.read(readSize)   # The read buffer size, "readSize", could be changed as you like.
       if not charsJustRead:   
          # Have reached EOF. 
          if partialLine:
             # If partialLine is not empty here, treat it as a complete line and copy and return it.
             popedPartialLine = partialLine
             partialLine = ""   # partialLine is now copied for return, reset it to an empty string to indicate that there is no more partialLine to return in later "fileReadLine" attempt.
             return popedPartialLine   # This should be the last line of input file.
          else:
             # If reached EOF and partialLine is empty, then all the lines in input file must have been read. Return None to indicate this.
             return None
       partialLine += charsJustRead   # If read buffer is not empty, add it to partialLine.
       lines = partialLine.split(inputNewline)   # Split partialLine to get some complete lines.
       partialLine = lines.pop()   # The last item of lines may not be a complete line, move it to partialLine.
       if not lines:
          # Empty "lines" means that we must NOT have finished read any complete line. So continue.
          continue
       else:
          # We must have finished read at least 1 complete llne. So pop 1st llne from lines and return that line + outputNewline (exit while loop).
          line = lines.pop(0)
          return line + outputNewline


# As an example, read NUL delimited lines from "stdin" and print them out (using "\n" to delimit output lines).
while True:
    line = fileReadLine()
    if line is None: break
    sys.stdout.write(line)   # "write" does not include "\n".
    sys.stdout.flush() 

希望能幫助到你。