[英]How to multiply one column by another in a csv file and re-write
我有一些csv格式的数据,我需要将第三列与第六列相乘,并将结果附加到末尾。 我的数据如下:
TITLE,TITLE,T,T,T,T
data,data,5,data,data,98.7,data
data,data,2,data,data,97,data
data,data,5,data,data,98,data
data,data,4,data,data,8.7,data
data,data,5,data,data,9.7,data
data,data,12.5,data,data,198.7,data
我对编码真的很陌生,但是我的尝试如下:导入csv导入datetime导入来自集合的副本import defaultdict
class_col = 2
data_col = 5
with open('minitest.csv', 'r') as f:
data = [line.strip().split(',') for line in f]
for row in data:
class_col*data_col
with open('minitest_edit.csv', 'w') as nf:
nf.write('\n'.join(','.join(row) for row in data))
print "done"
我没有出现任何错误,有什么建议吗? 谢谢操作系统”
使用csv.reader
和csv.writer
:
import csv
with open('minitest.csv', 'rb') as f:
reader = csv.reader(f)
data = [next(reader)] # title row
for row in reader:
data.append(row + [float(row[2]) * float(row[5])])
with open('minitest.csv', 'wb') as nf:
writer = csv.writer(nf)
writer.writerows(data)
产生:
TITLE,TITLE,T,T,T,T
data,data,5,data,data,98.7,data,493.5
data,data,2,data,data,97,data,194.0
data,data,5,data,data,98,data,490.0
data,data,4,data,data,8.7,data,34.8
data,data,5,data,data,9.7,data,48.5
data,data,12.5,data,data,198.7,data,2483.75
您希望以下内容将列相乘并将它们附加到原始列中:
new_data = []
for row in data:
new_data.append(row + [float(row[class_col]) * float(row[data_col])])
这是一种更有效地执行此操作的方法,即通过不读取内存中的数据,这将与较大的数据集有关:
import csv
import tempfile
import shutil
input_file = 'minitest.csv'
with open(input_file, 'rb') as f, \
tempfile.NamedTemporaryFile(delete=False) as out_f:
# in order to be able to not have to read everything in memory, we have to
# write every processed row to disk immediatley; for that, we need a temporary
# file because we can't read and write a single file at the same time:
reader = csv.reader(f)
writer = csv.writer(out_f)
# header row
writer.writerow(next(reader))
# note that this uses a generator not a list, so that writerows will lazily
# evaluate each row as it writes them to disk
writer.writerows(row + [float(row[2]) * float(row[5])] for row in reader)
# one everything's done, overwrite the original file with the new contents.
shutil.move(out_f.name, input_file)
PS:如果您不写回同一文件,实际上实际上会更简单-在处理代码完成之后,您始终可以手动进行移动,以使处理代码更简单。
如果您幸运并在LUNIX上编程,可以使用awk:
awk -F "\"*,\"*" '{print $0 "," $3*$6 }' test.csv > result.csv
您可以使用Python http://docs.python.org/2/library/subprocess.html进行调用。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.